#Quantization

A guide to key AI LLM concepts: KV cache, weights and quantization

Learn essential AI terminology: what model weights, quantization, parameters, and context windows mean, and how LLM inference actually works.