Topic hub

Model Serving Systems

Covers algorithms and systems for routing, scheduling, and optimization of inference workloads and multi-agent request flows for large models.

71 briefs

Model Serving Systems · Page 3

  1. AgentsView: Set a custom model price for Claude Fable 5The Brieftide
  2. Anthropic and Stanford: why larger LLMs learn rare skillsThe Brieftide
  3. Thousand Token Wood: five labs' small-model finance dramaThe Brieftide
  4. Mellum2 by JetBrains: 12B MoE model with 2.5B active paramsThe Brieftide
  5. MagenticLite, MagenticBrain & Fara1.5: Microsoft Research releaseThe Brieftide
  6. OlmoEarth v1.1 release: Up to 3× cheaper satellite AIThe Brieftide
  7. GridSFM release: Microsoft's model solves AC‑OPF in millisecondsThe Brieftide
  8. AWS building blocks for foundation model training and inferenceThe Brieftide
  9. GRASP: Gradient Planning for World Models at Long HorizonsThe Brieftide
  10. MIT pruning method trims models during training, reduces computeThe Brieftide
  11. Algorithms: Dimitris Bertsimas Killian Lecture on life andThe Brieftide
  12. Hugging Face and NVIDIA: build domain embeddings in a dayThe Brieftide
  13. Holotron-12B release: 12B agent for high-throughput computeThe Brieftide
  14. Async RL libraries: 16 open-source projects from Hugging FaceThe Brieftide
  15. Modular Diffusers: Hugging Face releases composable v1The Brieftide
  16. Mixture of Experts (MoE) in Transformers: Hugging Face guideThe Brieftide

Explore related topics