AI Tutorials
Running a dense 33B agent model on one 24 GB GPU
A technical guide on deploying the Nanbeige4.3-33B dense agent model on a single 24 GB GPU, exploring GGUF quantization, the offloading trap, KV cache optimization, and fixing the empty reply issue.
Read more →