All pull requests

Pull requests

• [ROCm][Perf][Kimi-K3] Accumulate the latent-MoE up-projection in aiter a16w16 atomic

  k3kimirocm
  #58944·nsusanto opened Sep 27, 2026·

  ·
  1

• [Bugfix] Terminate streaming sessions on ABORT/ERROR and prevent zombie sessions

  bugschedulerstreaming-input
  #58942·sawsa307 opened Sep 27, 2026Contributor·

  ·
  2

• [Bugfix][Frontend] Preserve streaming chunk boundaries in RequestOutputCollector

  bugstreaming-input
  #58941·sawsa307 opened Sep 27, 2026Contributor·

  ·

• Check nested JSON schemas in structural_tag for xgrammar support

  frontendstructured-output
  #58940·Kylinny opened Sep 27, 2026Contributor·

  ·
  1

  11

• [Bugfix][XPU] Forward softcap and alibi_slopes in xpu_ops.flash_attn_varlen_func

  bugintel-gpu
  #58936·zhangchengzhucufe-dev opened Sep 27, 2026Contributor·3 of 4 tasks·

  ·
  1

  4

• [Bugfix][XPU] Enforce attention backend capability gates via validate_configuration

  bugintel-gpu
  #58935·zhangchengzhucufe-dev opened Sep 27, 2026Contributor·3 of 4 tasks·

  ·
  1

  1

• [Bugfix][MooncakeStore] Keep connector state for requests preempted and re-admitted in the same scheduler step

  bugkv-connectormooncake
  #58933·yaojiejia opened Sep 27, 2026·3 of 4 tasks·

  ·
  1

  1

• [Bugfix][Spec Decode] Trim optimistic spec-decode tokens on every PP rank

  bug
  #58926·Peuqui opened Sep 27, 2026·3 of 4 tasks·

  ·
  1

  1

• [Bugfix][CPU] Reuse selected memory node for KV cache sizing

  bugcpu
  #58924·i-m-aditya opened Sep 27, 2026Contributor·

  ·
  2

• [Bugfix][Compile] Replace Transformers AOT caching with graph caching

  bugneeds-rebasetorch.compile
  #58918·Taimys opened Sep 27, 2026Contributor·

  ·
  5

• [Bugfix] shm_broadcast: never drop a write notification

  bug
  #58917·tobymao opened Sep 27, 2026Contributor·

  ·
  1

• [Bugfix][Metrics] Retain components for resolved quantization configs

  bugquantization
  #58915·thunderstornX opened Sep 27, 2026·

  ·
  1

  1

• [Rust Frontend] Support OpenAI n choices

  rust
  #58914·errmakov opened Sep 27, 2026Contributor·3 of 4 tasks·

  ·

• [Bugfix][Rust Frontend] Guard every route by default in the API-key middleware

  bugrust
  #58908·ashishpatel26 opened Sep 27, 2026Contributor·

  ·
  2

• [Perf][MRV2] Reduce cross-lane reductions in min-p filtering

  mrv2performance
  #58907·cyanseek opened Sep 27, 2026·

  ·
  1

• [Bugfix][Core] Reject malformed logits processor FQCNs

  bug
  #58905·13-4dev opened Sep 27, 2026·3 of 4 tasks·

  ·
  1

• [Docs] Document NIXL KV connector metrics aggregation semantics

  documentationkv-connector
  #58903·NA-V10 opened Sep 27, 2026·4 tasks done·

  ·
  1

  2

• [Bugfix][Core] Count the external claim's state block in MambaManager admission

  bugkv-cache-manager
  #58901·adam-lb opened Sep 27, 2026·

  ·
  1

• [CI] Add tooling to report how job groups divide up the test tree

  ci/build
  #58898·awesome-pro opened Sep 27, 2026Contributor·

  ·
  1

• [Perf][MoE] Cheaper triton_kernels 3.8 routing build in the OAI Triton MoE

  gpt-oss
  #58897·ZhengGong-amd opened Sep 27, 2026Contributor·

  ·
  3

• [Bugfix] Keep FlashAttention sparse ahead of FlashInfer SM90 for NoPE-512 MLA

  bugnvidia
  #58892·CarrotSwordsman opened Sep 27, 2026·

  ·
  1

  6

• [Perf][Core] Restore compact prefix-cache entries after duplicate eviction

  kv-cache-manager
  #58891·cyanseek opened Sep 27, 2026·

  ·
  1

• [Bugfix][Model Loader] Restore kernel state post model loading via TensorizerLoader.

  bugquantization
  #58889·codetalker7 opened Sep 27, 2026·4 tasks·

  ·
  1

  

• [Security] Reject short Voxtral Realtime audio before the encoder

  mistralmulti-modalityneeds-rebase
  #58888·jperezdealgaba opened Sep 27, 2026Contributor·

  ·
  1

• [Bugfix][Rust Frontend] Use prefiller cache hits for P/D usage

  bugkv-connectorrust
  #58885·thuongvu opened Sep 27, 2026·4 tasks·

  ·
  4