阿斯塔纳时间
AI QAZAQSTANKZ · AI测试版

哈萨克斯坦人工智能与高科技领域的智能门户

内容来自原始来源:

arXiv — cs.AI

在 arXiv — cs.AI 阅读全文

标题为英语GAUSS: A Workload-Aware Analytical and Monte-Carlo Simulator for LLM Inference Serving

arXiv:2610.37989v1 Announce Type: new Abstract: Large language model (LLM) inference has become an operational workload that fleets must provision, monitor, and bill against latency service-level objectives (SLOs). A single throughput number cannot answer the questions operators…

arXiv — cs.AI作者: Srikant Bharadwaj, Ankur Mallick, Spyridon Mastorakis, Anjaly Parayil, Dhruv Deshmukh, Victor Ruehle2026年10月30日 (14小时前)
提供 1 种语言版本

AI 摘要:要点

  • arXiv:2610.37989v1 Announce Type: new Abstract: Large language model (LLM) inference has become an operational workload that fleets must provision, monitor, and bill against latency service-level objectives (SLOs)
  • A single throughput number cannot answer the questions operators…
Research
KZ·AI 66F7
Инсайт дня

GAUSS: A Workload-Aware Analytical and Monte-Carlo Simulator for LLM Inference Serving

标签:#arXiv
Поделиться:

相关文章

返回列表