← Timeline · Model Release

PaLM scales to 540B parameters with reasoning gains

· significance ●●○○○

Google's PaLM shows breakthrough performance on multi-step reasoning with chain-of-thought prompting.

What happened and why it matters

PaLM, trained on 6,144 TPU v4 chips, combined scale with chain-of-thought prompting to produce marked jumps on arithmetic and commonsense reasoning, and could explain jokes — capabilities absent in smaller models.

Sources

Hover the chart to read values · click a marker to open its articles