Llama 3.1 8B Instruct
by Meta · meta-llama/llama-3.1-8b-instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
- Input / 1M tokens
- $0.05
- Output / 1M tokens
- $0.08
- Context
- 131K
Specs
| Input price | $0.05 / 1M tokens |
|---|---|
| Output price | $0.08 / 1M tokens |
| Cached input | $0.025 / 1M tokens |
| Context window | 131K tokens |
| Max output | 118K tokens |
| Reads | text |
| Writes | text |
| Tool calling | Yes |
| Reasoning | No |
| Listed | Jul 23, 2024 |
List prices in USD, updated Oct 30, 2026. Providers may charge differently.
Providers
5 providers serve this model, as of Oct 30, 2026, 18:12 UTC.
| Provider | Quantization | Context | Max output | Input / 1M | Output / 1M | Cache read / 1M | Uptime (30 min) | Latency (median) | Throughput (median) | Supports | Status |
|---|---|---|---|---|---|---|---|---|---|---|---|
| DeepInfra | fp8 | 131K | 16.4K | $0.02 | $0.04 | — | 100% | 501 ms | 35 tok/s | Normal | |
| Novita | fp8 | 16.4K | 14.7K | $0.02 | $0.05 | — | 100% | 474 ms | 96 tok/s | Code -2 | |
| Groq | — | 131K | 118K | $0.05 | $0.08 | $0.025 | 100% | 65 ms | 362 tok/s | Normal | |
| Cloudflare | fp8 | 32K | 28.8K | $0.152 | $0.287 | — | 100% | 420 ms | 19 tok/s | Normal | |
| CoreWeave | bf16 | 131K | 118K | $0.22 | $0.22 | $0.22 | 100% | 316 ms | 132 tok/s | Normal |
"Cheapest" is the lowest input plus output price; "Fastest" the highest median throughput. Columns empty for every provider are not shown.
Related models
- Meta
Llama Guard 4 12B
- Input
- $0.18
- Output
- $0.18
- Context
- 164K
- Meta
Llama 4 Maverick
- Input
- $0.188
- Output
- $0.652
- Context
- 524K
- Meta
Llama 4 Scout
- Input
- $0.10
- Output
- $0.30
- Context
- 1.31M
- Meta
Llama 3.3 70B Instruct
- Input
- $0.10
- Output
- $0.32
- Context
- 131K
- Meta
Llama 3.2 1B Instruct
- Input
- $0.027
- Output
- $0.201
- Context
- 60K
- Meta
Llama 3.2 3B Instruct
- Input
- $0.05
- Output
- $0.33
- Context
- 131K