Sglang
2 mentions across 2 people
Visit ↗All mentions
“frameworks like vLLM, SGLang play a super important role here.”
Inference Optimization at Scale: MoE Architectures, Sovereign AI, and the Open S ↗
“This short course teaches you to eliminate that waste using SGLang, an open-source inference framework...”
SGLang Caches Shared Prompts and Context to Slash LLM Inference Costs and Boost ↗