speculative decoding
Scroll to zoom · drag vertically to pan · double-click to reset
Actual kernel timings
| k | Profiled B | Emitted / round | Target total | Draft | Sample + verify | Attention | Indexer | MoE | Dense linear | Routing | Communication | Other target | Attributed |
|---|