Skip to content
← All Charts
ChartPublished

Training Llama 3.1 Used 81 Million Times as Much Computing as AlexNet

Training Llama 3.1 used 81 million times as much computing as AlexNet.

Two AI models · Estimated training computation · 2012 versus 2024

Two selected models with different tasks. More computing work does not mean the same increase in intelligence.

Source: Epoch AI · Chart: VastkindModels: 2012 and 2024 · Estimates

Training Llama 3.1 405B in 2024 used roughly 81 million times the computing work estimated for AlexNet in 2012. AlexNet helped machines recognise images; Llama is a language model.

The comparison makes the change in training scale tangible. It does not measure an equivalent change in intelligence: these are two different kinds of model, and both computation figures are estimates.

More Detail, Sources and Data
Computing Work Used to Train Four AI ModelsCALCULATION COUNT · EACH STEP UP IS 100×
10¹⁸10²⁰10²²10²⁴10²⁶2012201620202024AlexNet: 4.7e+17 FLOPAlexNetGPT-3 175B: 3.14e+23 FLOPGPT-3 175BPaLM 540B: 2.5272e+24 FLOPPaLM 540BLlama 3.1-405B: 3.8e+25 FLOPLlama 3.1-405BYear the Model Was Published10¹⁸10²⁰10²²10²⁴10²⁶2012201620202024AlexNet: 4.7e+17 FLOPAlexNetGPT-3 175B: 3.14e+23 FLOPGPT-3 175BPaLM 540B: 2.5272e+24 FLOPPaLM 540BLlama 3.1-405B: 3.8e+25 FLOPLlama 3.1-405BYear the Model Was Published

Selected historical models · estimates. Each vertical step is 100×.

Data: Epoch AI · Chart: VastkindModels: 2012–2024 · Dataset Accessed: 5 Oct 2026

What It Shows

The full chart places GPT-3 and PaLM between the two endpoints. It compares the work needed to train four selected models, not how much each model can do.

What It Does Not Show

Four selected historical models are not a complete trend or a ranking of today’s frontier. Epoch classifies all four records as “Confident”; its guidance still allows roughly a factor of three of uncertainty. This label covers the least certain populated quantity, not a separately measured error bar for each compute value.

Sources, Method & Data

FLOP counts arithmetic operations, the small calculations used in training. Points use the dataset’s publication dates and estimates. The vertical scale uses equal spacing for equal multipliers: each labeled step up is 100 times as much work. No fitted trend line is shown. Selection and visualization by Vastkind.

Data: Epoch AI, Data on AI Models, accessed 5 October 2026. CC BY 4.0. Dataset Documentation · Original CSV.

Values Used in This Chart
ModelPublication DateTraining calculations (FLOP)
AlexNet2012-09-304.7e+17
GPT-3 175B2020-05-283.14e+23
PaLM 540B2022-04-042.5272e+24
Llama 3.1-405B2024-07-233.8e+25

Explore Vastkind

Explore topics
For another moment

Your reading list

Saved on this device. No account needed.

Something catch your eye? Use the bookmark beside an article to keep it here.