Llama 3.1 8BQ4_K_M
requires 10 GB+ memory · 131K context · Laptop
4.9 GBWeights
← All models4K 6.1 GB 8K 6.5 GB 16K 6.9 GB 33K 7.3 GB 66K 7.7 GB 131K 8.1 GB
Llama 3.1
The 8B Llama 3.1 instruct checkpoint: still a reliable generalist for chat and writing when you want the Meta stack fully local.
- Maker
- Meta
- Architecture
- Dense instruct
- Fits from
- Laptop · 10 GB+ RAM
- Context
- up to 131K
- Runs
- Local Intelligence
MultilingualGeneral chatWritingClassic Llama
Sizes
Memory at context length
Approximate working set for Llama 3.1 8B as context grows.
