“Algorithmic Progress in Six Domains”, 2013-12-09 ():
We examine evidence of progress in 6 areas of algorithms research [SAT, chess+Go, factoring, physics simulations, linear programming+scheduling, machine learning], with an eye to understanding likely algorithmic trajectories after the advent of artificial general intelligence. Many of these areas appear to experience fast improvement, though the data are often noisy. For tasks in these areas, gains from algorithmic progress have been roughly 50 to 100% as large as those from hardware progress. Improvements tend to be incremental, forming a relatively smooth curve on the scale of years.
[cf. “The International SAT Solver Competitions”, et al 2012; “A Time Leap Challenge for SAT Solving”, et al 2020]
View PDF: