Skip to content
CodeWiki
Practice
Paths
Tracks
Cheatsheets
Playground
Glossary
AI era
Search
⌘K
English
English
Chinese
Practice
Paths
Tracks
Cheatsheets
Playground
Glossary
AI era
English
English
Chinese
Practice
/
Quiz
/
AI and LLM engineering
/
Local large language models
Which statement is safe to use when planning memory for a quantized local model?
from Local large language models
Ollama 0.33.3 · llama.cpp 0.3.0 · Python 3.14
intermediate
1 min
Which statement is safe to use when planning memory for a quantized local model?
Raw quantized weight size is a lower bound; measure buffers and the KV cache at the target context and concurrency.
A 4-bit model always needs exactly one quarter of the memory of its 16-bit version.
If the model file is smaller than VRAM, every supported context length is safe.
Check
Ask AI about this kata
Report an error
previous kata
What does this program print?
Predict the output
next kata
Review generated private summarizer
Review AI code
A new version is available
Reload