Llama 3.1 8b Instruct
nano-gpt/meta-llama/llama-3.1-8b-instruct · family llama · in: text → out: text · price provider-declared (via models.dev). Capabilities: tools text.
$0.03
Blended $/1M (3:1)
$0.02
Input $/1M
$0.04
Output $/1M
$0.06
1M in + 1M out
$0.0272
Cache read $/1M
#585 of 8,539
Cheapest rank
- Provider
- NanoGPT (
nano-gpt) - Kind
- text (outputs text)
- Context
- 131,072 tokens
- Max output
- 16,384 tokens
- Capabilities
- tools text
Same model, other providers
“Llama 3.1 8b Instruct” is offered by 6 providers — cheapest-effective first. This one (NanoGPT) is the cheapest.
| Provider | Input | Output | Blended | Context |
|---|---|---|---|---|
| NanoGPT (this) | $0.02 | $0.04 | $0.03 | 131k |
| Inference | $0.025 | $0.025 | $0.03 | 16k |
| Abacus | $0.02 | $0.05 | $0.03 | 128k |
| Vercel AI Gateway | $0.22 | $0.22 | $0.22 | 128k |
| Amazon Bedrock | $0.22 | $0.22 | $0.22 | 128k |
| Neon | $0.15 | $0.45 | $0.22 | 131k |
Call it
jishie indexes & prices models; it does not proxy inference.
Most providers are OpenAI-compatible — point base_url at NanoGPT and pass this model id:
curl $BASE_URL/v1/chat/completions \
-H "Authorization: Bearer $API_KEY" -H "Content-Type: application/json" \
-d '{"model":"meta-llama/llama-3.1-8b-instruct","messages":[{"role":"user","content":"hello"}]}'
Route programmatically with MCP find_model / get_model, or fetch this record free (no wallet):