Original release notes
opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations (speculative decoding/MTP) (#26477)
- opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations
- opencl: guard q4_K/q6_K tiled_ns convert-kernel registration for non-Adreno build
- opencl: gate q4_K MUL_MAT+GLU fusion dispatch to Adreno
- opencl: require the noshuffle weight layout in the q4_K GLU fusion gate
- opencl: do not take the vectorized f16 mrow GEMV path on an unaligned row stride
- opencl: pass the new get_scale_min_k4 stride argument at the row-major call sites
- opencl: enable the q4_K split-K decode GEMV only where it is measured to win
- opencl: record the X1-85 split-K datapoint (neutral, exclusion confirmed)
- opencl: restrict the tiled lm_head/embed GEMV default to X2E/A8X
- opencl: fix q4_K variant kernels to read the transposed scales layout
- opencl: keep the flat-GEMV large-m escape opt-in
- opencl: guard the o4 GEMV store against the rounded-up dispatch tail
- opencl: restore the tiled q4_K/q6_K layout on tensor read-back
- opencl: split-K for the q8_0 decode GEMV at small M
- opencl: keep the q6_K noshuffle correctness escape ahead of the opt-in gate
Website: -
Attestations: -
UI:
