Two AI models · Estimated training computation · 2012 versus 2024
Training computation · AlexNet = 1
Two selected models with different tasks. More computing work does not mean the same increase in intelligence.
Training Llama 3.1 405B in 2024 used roughly 81 million times the computing work estimated for AlexNet in 2012. AlexNet helped machines recognise images; Llama is a language model.
The comparison makes the change in training scale tangible. It does not measure an equivalent change in intelligence: these are two different kinds of model, and both computation figures are estimates.
More Detail, Sources and Data
Selected historical models · estimates. Each vertical step is 100×.
What It Shows
The full chart places GPT-3 and PaLM between the two endpoints. It compares the work needed to train four selected models, not how much each model can do.
What It Does Not Show
Four selected historical models are not a complete trend or a ranking of today’s frontier. Epoch classifies all four records as “Confident”; its guidance still allows roughly a factor of three of uncertainty. This label covers the least certain populated quantity, not a separately measured error bar for each compute value.
Sources, Method & Data
FLOP counts arithmetic operations, the small calculations used in training. Points use the dataset’s publication dates and estimates. The vertical scale uses equal spacing for equal multipliers: each labeled step up is 100 times as much work. No fitted trend line is shown. Selection and visualization by Vastkind.
Data: Epoch AI, Data on AI Models, accessed 5 October 2026. CC BY 4.0. Dataset Documentation · Original CSV.
| Model | Publication Date | Training calculations (FLOP) |
|---|---|---|
| AlexNet | 2012-09-30 | 4.7e+17 |
| GPT-3 175B | 2020-05-28 | 3.14e+23 |
| PaLM 540B | 2022-04-04 | 2.5272e+24 |
| Llama 3.1-405B | 2024-07-23 | 3.8e+25 |