All pull requests

Pull requests

• feat(server): place --target-device auto by GPU availability and multi-GPU technique

  #821·Graffioh opened Oct 7, 2026Collaborator·

  ·
  1

• fix(server): Responses tool calls follow the stream item lifecycle and replay as one assistant turn

  #818·Graffioh opened Oct 7, 2026Collaborator·7 of 8 tasks·

  ·

• fix(server): replay tool history with model-native templates

  #817·Graffioh opened Oct 6, 2026Collaborator·7 tasks done·

  ·

• fix(server): stop the thinking budget once the model closes thinking

  #816·Graffioh opened Oct 6, 2026Collaborator·

  ·
  1

• feat(qwen4exp): exact 4-slot concurrent serving (stacked on #809)

  #810·dusterbloom opened Oct 5, 2026Collaborator·

  ·

• feat(qwen4exp): reuse cached prompt prefixes across requests (stacked on #808)

  #809·dusterbloom opened Oct 5, 2026Collaborator·

  ·

• feat(qwen4exp): MTP speculative decoding (stacked on #774)

  #808·dusterbloom opened Oct 5, 2026Collaborator·

  ·
  1

• feat(vulkan): add native LFM2.5 MoE alongside Qwen

  #807·Amidwestnoob opened Oct 3, 2026Contributor·

  ·
  18

• Add JEV compatible interface

  #790·howard0su opened Sep 30, 2026Contributor·

  ·
  9

• feat(profiling): emit lucegraph concurrency capture in-tree

  #783·Graffioh opened Sep 29, 2026Collaborator·

  ·

• perf(pflash): build the Qwen3.5 drafter's causal mask in the graph

  #773·Graffioh opened Sep 25, 2026Collaborator·

  ·
  1

• ci(e2e): run Qwen and DS4 end to end on lucebox3

  #756·Graffioh opened Sep 23, 2026Collaborator·4 tasks·

  ·
  24

• feat(pflash): auto skip-park residency with VRAM estimate and OOM fallback

  #747·Graffioh opened Sep 20, 2026Collaborator·2 tasks done·

  ·

• feat(pflash): Qwen3.5-0.8B drafter scorer, segment probe and strict budget selection

  #746·Graffioh opened Sep 19, 2026Collaborator·

  ·
  1

• DO NOT MERGE

  #745·jagtesh opened Sep 19, 2026·

  ·
  41

• fix(dflash): let the drafter see its trained context window (deep-context accept)

  #740·dusterbloom opened Sep 17, 2026Collaborator·

  ·
  14

• feat(server): opt-in logprobs on chat completions (AR path, qwen35 + ds4)

  #737·Graffioh opened Sep 16, 2026Collaborator·5 of 6 tasks·

  ·

• feat(server): carry drafter feature ring in concurrent prefix checkpoints

  #730·Graffioh opened Sep 14, 2026Collaborator·

  ·
  12

• refactor(test): organize component suites and replace simulated coverage

  #709·Graffioh opened Sep 5, 2026Collaborator·

  ·
  34

• perf(dspark): keep the Markov chain graph instead of rebuilding it per call

  #705·maikzz32 opened Sep 4, 2026Contributor·

  ·
  4

• feat(pflash): improve AMD defaults and enable rocWMMA

  #669·Graffioh opened Aug 27, 2026Collaborator·

  ·

• experimental: integrate luce_odistill bridge

  #663·Graffioh opened Aug 26, 2026Collaborator·

  ·

• feat(test): add manual Qwen 3.6 production qualification

  #636·Graffioh opened Aug 20, 2026Collaborator·

  ·
  135

• fix(qwen35): size mixed concurrent target-step graphs

  #622·Graffioh opened Aug 18, 2026Collaborator·

  ·

• feat(harness): add interactive modes and GPU selection

  #611·Graffioh opened Aug 15, 2026Collaborator·2 tasks·

  ·
  5