Files
sglang/python
leavelet cf46defddd Harden the affinity wiring per opus review (F-1, F-2)
- A chunked-led batch now seeds affinity_batch_warm_led from the CHUNK's
  class instead of the first loop candidate: a 65536 first chunk is
  cold-led (later colds are free density, caps bound them); latching
  from a warm follower inverted cold-led-admits-everything and could
  spuriously STOP the scan, under-filling the forward.
- The policy additionally requires no LoRA and no L3 hicache-storage:
  their pre-classification continues make "first classified candidate"
  drift from the true FCFS head, mis-routing the defer accounting.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-12 08:07:36 +00:00
..
2026-06-10 05:54:43 +08:00