Skip to content

Fix and use AIE RoPE in llama + RoPE optimizations #66

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
andrej wants to merge 5 commits into
base: devel
Choose a base branch
from
Open

Fix and use AIE RoPE in llama + RoPE optimizations #66

andrej wants to merge 5 commits into from
+228 −290

Conversation

@andrej
Copy link
Collaborator

@andrej andrej commented Jan 12, 2026 •
edited
Loading

Despite other indications, RoPE was actually not getting dispatched to the NPU. There were also some issues in how the batching was dispatched.

This PR makes the llama model use RoPE on the NPU, so we should hopefully have a baseline now where everything is offloaded.

Switching on RoPE with the existing implementation initially slowed down the model a good bit, with some small optimizations we're back close to previous performance, but now finally with all operators offloaded, as far as I can tell.

Note that there are still some transpose operations in the Python code (which are not offloaded).

Added

  • Support interspersed input tensor of shape (seq_len, n_heads, head_dim) for RoPE natively in the AIE code to avoid costly transposes.

Changed

  • Simplify code. Remove unused and untested arguments and functionality. Give arguments clearer names and add documentation.

Removed

PR Merge Checklist

  1. The PR is rebased on the latest devel commit and pointing to devel.
  2. Your PR has been reviewed and approved.
  3. All checks are passing.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 12, 2026

📊 Test Results for Small Benchmark/Test Suite

c3a30ff (2026_01_12_21_00_22)

IRONCLAD

Tested on 2026_01_12_21_00_22 at commit c3a30ff.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0_0 ✅ 5/5 129.68 0.10 n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0_0 ✅ 5/5 136.86 0.09 n/a
axpy_4_cols_2_channels_2048_tile_512_3.0_0 ✅ 5/5 148.06 0.09 n/a
axpy_8_cols_2_channels_2048_tile_256_3.0_0 ✅ 5/5 148.08 0.08 n/a
dequant_1_cols_1_channels_2048_tile_2048_0 ✅ 5/5 129.06 0.04 n/a
dequant_1_cols_2_channels_2048_tile_1024_0 ✅ 5/5 138.16 0.04 n/a
dequant_2_cols_1_channels_2048_tile_1024_0 ✅ 5/5 133.54 0.04 n/a
dequant_2_cols_2_channels_2048_tile_512_0 ✅ 5/5 129.36 0.04 n/a
dequant_4_cols_1_channels_2048_tile_512_0 ✅ 5/5 132.98 0.04 n/a
dequant_4_cols_2_channels_2048_tile_256_0 ✅ 5/5 130.00 0.04 n/a
dequant_8_cols_1_channels_2048_tile_256_0 ✅ 5/5 161.94 0.03 n/a
dequant_8_cols_2_channels_2048_tile_128_0 ✅ 5/5 155.48 0.03 n/a
eltwise_add_1_cols_2_channels_2048_tile_2048 ✅ 5/5 133.74 0.09 n/a
eltwise_add_2_cols_2_channels_2048_tile_1024 ✅ 5/5 140.80 0.09 n/a
eltwise_add_4_cols_2_channels_2048_tile_512 ✅ 5/5 136.64 0.09 n/a
eltwise_add_8_cols_2_channels_2048_tile_256 ✅ 5/5 147.68 0.09 n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048 ✅ 5/5 140.56 0.09 n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024 ✅ 5/5 128.06 0.10 n/a
eltwise_mul_4_cols_2_channels_2048_tile_512 ✅ 5/5 162.80 0.08 n/a
eltwise_mul_8_cols_2_channels_2048_tile_256 ✅ 5/5 136.96 0.09 n/a
gelu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 136.30 0.06 n/a
gelu_1_cols_2_channels_2048_tile_1024 ✅ 5/5 153.78 0.05 n/a
gelu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 144.72 0.07 n/a
gelu_2_cols_2_channels_2048_tile_512 ✅ 5/5 146.78 0.06 n/a
gelu_4_cols_1_channels_2048_tile_512 ✅ 5/5 148.74 0.06 n/a
gelu_4_cols_2_channels_2048_tile_256 ✅ 5/5 160.56 0.05 n/a
gelu_8_cols_1_channels_2048_tile_256 ✅ 5/5 177.34 0.05 n/a
gelu_8_cols_2_channels_2048_tile_128 ✅ 5/5 189.52 0.05 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0_0 ✅ 5/5 6444.98 3.91 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_1_ccolmaj_0_0 ✅ 5/5 6843.34 3.68 n/a
gemm_2048x2048x2048_64x64x64_8_cols_1_bcolmaj_0_ccolmaj_0_0 ✅ 5/5 7333.68 3.43 n/a
layer_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 147.96 0.06 n/a
layer_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 146.84 0.06 n/a
layer_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 142.16 0.06 n/a
layer_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 137.08 0.06 n/a
layer_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 145.38 0.06 n/a
layer_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 147.52 0.06 n/a
layer_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 152.88 0.05 n/a
layer_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 183.68 0.05 n/a
matrix_vector_mul_128x128_32_1col0 ✅ 5/5 n/a 0.25 n/a
matrix_vector_mul_2048x8192_1_1col0 ✅ 5/5 n/a 12.87 n/a
matrix_vector_mul_2048x8192_1_2col0 ✅ 5/5 n/a 23.65 n/a
matrix_vector_mul_2048x8192_1_4col0 ✅ 5/5 n/a 38.49 n/a
matrix_vector_mul_2048x8192_1_8col0 ✅ 5/5 n/a 45.18 n/a
matrix_vector_mul_8192x2048_4_1col0 ✅ 5/5 n/a 13.05 n/a
matrix_vector_mul_8192x2048_4_2col0 ✅ 5/5 n/a 22.00 n/a
matrix_vector_mul_8192x2048_4_4col0 ✅ 5/5 n/a 40.72 n/a
matrix_vector_mul_8192x2048_4_8col0 ✅ 5/5 n/a 45.60 n/a
mem_copy_16_cores_2_chans_2048_tile_128_False0 ✅ 5/5 170.40 0.05 n/a
mem_copy_1_cores_1_chans_2048_tile_2048_False0 ✅ 5/5 181.42 0.05 n/a
mem_copy_2_cores_1_chans_2048_tile_1024_False0 ✅ 5/5 154.86 0.05 n/a
mem_copy_2_cores_2_chans_2048_tile_1024_False0 ✅ 5/5 157.82 0.05 n/a
mem_copy_4_cores_1_chans_2048_tile_512_False0 ✅ 5/5 148.36 0.06 n/a
mem_copy_4_cores_2_chans_2048_tile_512_False0 ✅ 5/5 140.18 0.06 n/a
mem_copy_8_cores_1_chans_2048_tile_256_False0 ✅ 5/5 185.88 0.05 n/a
mem_copy_8_cores_2_chans_2048_tile_256_False0 ✅ 5/5 162.42 0.05 n/a
mha0 ✅ 5/5 47440.68 0.18 n/a
relu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 120.58 0.07 n/a
relu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 117.10 0.07 n/a
relu_4_cols_1_channels_2048_tile_512 ✅ 5/5 138.06 0.06 n/a
relu_8_cols_1_channels_2048_tile_256 ✅ 5/5 127.96 0.07 n/a
rms_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 168.56 0.05 n/a
rms_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 143.20 0.06 n/a
rms_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 158.70 0.05 n/a
rms_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 145.66 0.06 n/a
rms_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 148.98 0.06 n/a
rms_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 157.36 0.05 n/a
rms_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 162.96 0.05 n/a
rms_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 168.36 0.05 n/a
rope_1_cols_2_channels_4096_tile_4096_0 ✅ 5/5 142.94 0.18 n/a
rope_2_cols_2_channels_4096_tile_2048_0 ✅ 5/5 139.36 0.18 n/a
rope_4_cols_2_channels_4096_tile_1024_0 ✅ 5/5 134.10 0.19 n/a
rope_8_cols_2_channels_4096_tile_512_0 ✅ 5/5 167.22 0.16 n/a
sigmoid_1_cols_1_channels_2048_tile_2048 ✅ 5/5 127.70 0.06 n/a
sigmoid_2_cols_1_channels_2048_tile_1024 ✅ 5/5 117.28 0.07 n/a
sigmoid_4_cols_1_channels_2048_tile_512 ✅ 5/5 132.28 0.06 n/a
sigmoid_8_cols_1_channels_2048_tile_256 ✅ 5/5 148.50 0.06 n/a
silu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 152.20 0.06 n/a
silu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 149.76 0.06 n/a
silu_4_cols_1_channels_2048_tile_512 ✅ 5/5 175.48 0.05 n/a
silu_8_cols_1_channels_2048_tile_256 ✅ 5/5 181.10 0.05 n/a
softmax_1_cols_2_channels_4096_tile_2048 ✅ 5/5 148.62 0.11 n/a
softmax_2_cols_2_channels_4096_tile_1024 ✅ 5/5 132.82 0.13 n/a
softmax_2_cols_2_channels_4096_tile_512 ✅ 5/5 184.04 0.09 n/a
swiglu_decode_1x2048x2048_0 ✅ 5/5 4579.52 0.00 n/a
tanh_1_cols_1_channels_2048_tile_2048 ✅ 5/5 137.80 0.06 n/a
tanh_2_cols_1_channels_2048_tile_1024 ✅ 5/5 150.26 0.05 n/a
tanh_4_cols_1_channels_2048_tile_512 ✅ 5/5 127.20 0.07 n/a
tanh_8_cols_1_channels_2048_tile_256 ✅ 5/5 154.96 0.05 n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0 ✅ 5/5 183.44 2.95 n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0 ✅ 5/5 145.18 3.62 n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048 ✅ 5/5 143.54 0.06 n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024 ✅ 5/5 154.68 0.05 n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512 ✅ 5/5 153.22 0.05 n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256 ✅ 5/5 182.20 0.05 n/a
📈 Trends (vs main branch) for Small Benchmark/Test Suite

c3a30ff (2026_01_12_21_00_22)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.13 (-1.96%)0.11 (+2.52%)0.10 (+1.86%)0.08 (-1.91%)0.02 (-1.72%)162.40 (+1.95%)120.96 (-2.36%)117.00 (-1.85%)94.40 (+2.05%)23.11 (+4.09%)
0a6c11c — 2025-12-04 00:39:100.13 (n/a)0.10 (n/a)0.10 (n/a)0.08 (n/a)0.02 (n/a)159.30 (n/a)123.88 (n/a)119.20 (n/a)92.50 (n/a)22.21 (n/a)

axpy_1_cols_2_channels_2048_tile_2048_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.11 (-2.34%)0.10 (+2.19%)0.10 (-0.84%)0.08 (+5.94%)0.01 (-25.47%)158.10 (-5.61%)129.68 (-3.53%)124.90 (+0.89%)107.30 (+2.39%)18.90 (-28.88%)
331dcca — 2026-01-08 18:34:100.12 (n/a)0.09 (n/a)0.10 (n/a)0.07 (n/a)0.02 (n/a)167.50 (n/a)134.42 (n/a)123.80 (n/a)104.80 (n/a)26.57 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.11 (-26.77%)0.09 (-9.09%)0.09 (-10.81%)0.08 (+8.25%)0.01 (-55.42%)152.00 (-7.60%)135.46 (+6.28%)142.80 (+12.18%)115.00 (+36.58%)15.03 (-41.36%)
0a6c11c — 2025-12-04 00:39:100.15 (n/a)0.10 (n/a)0.10 (n/a)0.07 (n/a)0.02 (n/a)164.50 (n/a)127.46 (n/a)127.30 (n/a)84.20 (n/a)25.64 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.13 (+22.66%)0.09 (+3.34%)0.08 (-1.56%)0.08 (-5.41%)0.02 (+124.66%)153.60 (+5.71%)136.86 (-0.71%)145.40 (+1.61%)93.70 (-18.45%)24.42 (+89.48%)
331dcca — 2026-01-08 18:34:100.11 (n/a)0.09 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)145.30 (n/a)137.84 (n/a)143.10 (n/a)114.90 (n/a)12.89 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.12 (-10.21%)0.10 (-8.41%)0.10 (-6.20%)0.07 (+3.52%)0.02 (-23.48%)166.70 (-3.36%)128.78 (+7.33%)121.80 (+6.65%)103.90 (+11.36%)22.95 (-18.82%)
0a6c11c — 2025-12-04 00:39:100.13 (n/a)0.11 (n/a)0.11 (n/a)0.07 (n/a)0.02 (n/a)172.50 (n/a)119.98 (n/a)114.20 (n/a)93.30 (n/a)28.27 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.12 (+1.01%)0.09 (-3.49%)0.09 (-0.04%)0.06 (-14.95%)0.02 (+14.79%)214.90 (+17.56%)148.06 (+5.65%)139.10 (+0.00%)106.70 (-1.02%)41.37 (+38.14%)
331dcca — 2026-01-08 18:34:100.11 (n/a)0.09 (n/a)0.09 (n/a)0.07 (n/a)0.02 (n/a)182.80 (n/a)140.14 (n/a)139.10 (n/a)107.80 (n/a)29.95 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.10 (-16.19%)0.08 (-10.40%)0.09 (-2.09%)0.07 (-17.38%)0.01 (-10.61%)184.40 (+21.00%)153.18 (+11.99%)144.10 (+2.20%)127.10 (+19.34%)21.26 (+34.76%)
0a6c11c — 2025-12-04 00:39:100.12 (n/a)0.09 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)152.40 (n/a)136.78 (n/a)141.00 (n/a)106.50 (n/a)15.78 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.11 (+14.60%)0.08 (+4.64%)0.08 (+3.44%)0.07 (+1.25%)0.01 (+62.92%)164.80 (-1.26%)148.08 (-3.58%)150.30 (-3.34%)115.30 (-12.78%)19.81 (+38.01%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)166.90 (n/a)153.58 (n/a)155.50 (n/a)132.20 (n/a)14.36 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (-18.83%)0.04 (-5.21%)0.04 (-2.69%)0.03 (+37.10%)0.00 (-53.98%)160.40 (-27.06%)141.12 (-0.91%)136.40 (+2.79%)114.30 (+23.17%)17.37 (-59.06%)
0a6c11c — 2025-12-04 00:39:100.06 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)219.90 (n/a)142.42 (n/a)132.70 (n/a)92.80 (n/a)42.43 (n/a)

dequant_1_cols_1_channels_2048_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.05 (+8.96%)0.04 (+11.15%)0.04 (+21.53%)0.03 (+0.62%)0.01 (+65.94%)155.50 (-0.58%)129.06 (-8.70%)117.10 (-17.77%)109.00 (-8.25%)22.94 (+53.63%)
331dcca — 2026-01-08 18:34:100.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)156.40 (n/a)141.36 (n/a)142.40 (n/a)118.80 (n/a)14.93 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.06 (-13.28%)0.05 (-8.93%)0.06 (-13.59%)0.04 (+4.63%)0.01 (-39.10%)133.60 (-4.43%)106.08 (+5.85%)95.10 (+15.69%)87.90 (+15.35%)17.90 (-31.97%)
0a6c11c — 2025-12-04 00:39:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)139.80 (n/a)100.22 (n/a)82.20 (n/a)76.20 (n/a)26.31 (n/a)

dequant_1_cols_2_channels_2048_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.04 (+2.93%)0.04 (+4.15%)0.04 (+7.03%)0.03 (+3.28%)0.00 (-2.06%)153.00 (-3.23%)138.16 (-4.08%)140.80 (-6.57%)116.90 (-2.83%)14.15 (-8.20%)
331dcca — 2026-01-08 18:34:100.04 (n/a)0.04 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)158.10 (n/a)144.04 (n/a)150.70 (n/a)120.30 (n/a)15.41 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.07 (+5.66%)0.05 (+1.21%)0.05 (+0.61%)0.04 (-15.02%)0.01 (+58.42%)143.40 (+17.64%)101.02 (+1.49%)97.60 (-0.61%)78.90 (-5.40%)22.56 (+78.52%)
0a6c11c — 2025-12-04 00:39:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)121.90 (n/a)99.54 (n/a)98.20 (n/a)83.40 (n/a)12.64 (n/a)

dequant_2_cols_1_channels_2048_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.05 (+8.76%)0.04 (-4.75%)0.04 (-16.55%)0.03 (-8.97%)0.01 (+79.87%)164.40 (+9.82%)133.54 (+7.71%)145.70 (+19.82%)98.00 (-8.07%)27.80 (+75.85%)
331dcca — 2026-01-08 18:34:100.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)149.70 (n/a)123.98 (n/a)121.60 (n/a)106.60 (n/a)15.81 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (+17.06%)0.04 (+8.98%)0.05 (+21.37%)0.03 (-11.65%)0.01 (+301.89%)159.70 (+13.18%)126.32 (-5.68%)109.00 (-17.67%)106.80 (-14.56%)22.48 (+280.15%)
0a6c11c — 2025-12-04 00:39:100.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)141.10 (n/a)133.92 (n/a)132.40 (n/a)125.00 (n/a)5.91 (n/a)

dequant_2_cols_2_channels_2048_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.05 (+6.89%)0.04 (+11.01%)0.04 (+17.12%)0.03 (+46.16%)0.01 (-28.48%)158.40 (-31.58%)129.36 (-13.83%)117.40 (-14.62%)105.80 (-6.45%)22.63 (-53.38%)
331dcca — 2026-01-08 18:34:100.05 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)231.50 (n/a)150.12 (n/a)137.50 (n/a)113.10 (n/a)48.55 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.06 (+20.24%)0.05 (-3.19%)0.05 (-6.73%)0.03 (-20.69%)0.01 (+194.26%)156.10 (+26.09%)120.86 (+7.15%)114.90 (+7.18%)88.30 (-16.85%)24.40 (+214.82%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)123.80 (n/a)112.80 (n/a)107.20 (n/a)106.20 (n/a)7.75 (n/a)

dequant_4_cols_1_channels_2048_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.05 (+8.75%)0.04 (-3.31%)0.04 (-6.15%)0.04 (-5.87%)0.01 (+59.65%)147.50 (+6.27%)132.98 (+5.06%)142.50 (+6.58%)96.20 (-8.03%)21.50 (+55.63%)
331dcca — 2026-01-08 18:34:100.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)138.80 (n/a)126.58 (n/a)133.70 (n/a)104.60 (n/a)13.82 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (-6.09%)0.04 (-8.04%)0.04 (-12.46%)0.03 (-0.41%)0.01 (-20.19%)168.10 (+0.42%)135.74 (+7.44%)132.20 (+14.26%)107.40 (+6.44%)22.91 (-12.67%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.04 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)167.40 (n/a)126.34 (n/a)115.70 (n/a)100.90 (n/a)26.23 (n/a)

dequant_4_cols_2_channels_2048_tile_256_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.05 (+9.74%)0.04 (+7.16%)0.04 (+8.78%)0.04 (+0.85%)0.00 (+32.02%)148.50 (-0.87%)130.00 (-6.41%)132.40 (-8.06%)112.90 (-8.88%)13.63 (+18.53%)
331dcca — 2026-01-08 18:34:100.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)149.80 (n/a)138.90 (n/a)144.00 (n/a)123.90 (n/a)11.50 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.04 (-13.65%)0.04 (-13.67%)0.04 (-18.56%)0.03 (-13.52%)0.00 (-23.88%)170.40 (+15.68%)140.12 (+15.33%)135.80 (+22.78%)119.60 (+15.78%)17.94 (+1.87%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.04 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)147.30 (n/a)121.50 (n/a)110.60 (n/a)103.30 (n/a)17.61 (n/a)

dequant_8_cols_1_channels_2048_tile_256_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.04 (-2.62%)0.03 (-1.37%)0.03 (-4.03%)0.03 (-1.13%)0.00 (+4.52%)189.80 (+1.12%)161.94 (+1.50%)165.40 (+4.22%)141.30 (+2.69%)19.26 (+6.39%)
331dcca — 2026-01-08 18:34:100.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)187.70 (n/a)159.54 (n/a)158.70 (n/a)137.60 (n/a)18.10 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (+17.21%)0.03 (-1.70%)0.03 (-3.04%)0.03 (-16.20%)0.01 (+95.59%)198.20 (+19.33%)160.00 (+4.92%)166.20 (+3.17%)106.50 (-14.66%)29.86 (+87.19%)
0a6c11c — 2025-12-04 00:39:100.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)166.10 (n/a)152.50 (n/a)161.10 (n/a)124.80 (n/a)15.95 (n/a)

dequant_8_cols_2_channels_2048_tile_128_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.04 (-14.42%)0.03 (+1.60%)0.03 (+8.88%)0.03 (+8.33%)0.00 (-60.19%)167.40 (-7.67%)155.48 (-3.27%)152.20 (-8.15%)142.20 (+16.84%)10.60 (-56.32%)
331dcca — 2026-01-08 18:34:100.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)181.30 (n/a)160.74 (n/a)165.70 (n/a)121.70 (n/a)24.27 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.13 (+20.71%)0.09 (+6.79%)0.09 (-4.30%)0.08 (+10.02%)0.02 (+40.49%)155.90 (-9.10%)133.74 (-5.44%)141.00 (+4.52%)97.80 (-17.19%)24.24 (+6.13%)
331dcca — 2026-01-08 18:34:100.10 (n/a)0.09 (n/a)0.09 (n/a)0.07 (n/a)0.01 (n/a)171.50 (n/a)141.44 (n/a)134.90 (n/a)118.10 (n/a)22.84 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.11 (+19.78%)0.09 (+10.31%)0.08 (-10.73%)0.08 (+28.68%)0.02 (-1.49%)162.20 (-22.28%)140.80 (-10.54%)151.40 (+12.07%)108.20 (-16.51%)23.88 (-33.88%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.08 (n/a)0.09 (n/a)0.06 (n/a)0.02 (n/a)208.70 (n/a)157.38 (n/a)135.10 (n/a)129.60 (n/a)36.12 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.12 (+22.94%)0.09 (+14.67%)0.08 (-0.13%)0.07 (+17.28%)0.02 (+45.33%)169.30 (-14.75%)136.64 (-11.47%)145.10 (+0.14%)98.50 (-18.66%)32.33 (+0.24%)
331dcca — 2026-01-08 18:34:100.10 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.02 (n/a)198.60 (n/a)154.34 (n/a)144.90 (n/a)121.10 (n/a)32.26 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.10 (+13.62%)0.09 (+5.20%)0.08 (-0.25%)0.07 (-7.65%)0.01 (+103.09%)185.70 (+8.28%)147.68 (-3.41%)150.00 (+0.20%)120.40 (-12.05%)25.04 (+93.34%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)171.50 (n/a)152.90 (n/a)149.70 (n/a)136.90 (n/a)12.95 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.10 (-15.41%)0.09 (+1.38%)0.09 (+10.96%)0.08 (+4.89%)0.01 (-46.78%)156.80 (-4.68%)140.56 (-2.70%)132.70 (-9.91%)128.70 (+18.18%)13.16 (-37.76%)
331dcca — 2026-01-08 18:34:100.11 (n/a)0.09 (n/a)0.08 (n/a)0.07 (n/a)0.02 (n/a)164.50 (n/a)144.46 (n/a)147.30 (n/a)108.90 (n/a)21.14 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.11 (-0.33%)0.10 (+2.69%)0.10 (+1.60%)0.08 (+4.09%)0.01 (-14.77%)149.10 (-3.93%)128.06 (-3.03%)119.50 (-1.57%)116.60 (+0.34%)14.21 (-18.66%)
331dcca — 2026-01-08 18:34:100.11 (n/a)0.09 (n/a)0.10 (n/a)0.08 (n/a)0.01 (n/a)155.20 (n/a)132.06 (n/a)121.40 (n/a)116.20 (n/a)17.47 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.10 (+0.76%)0.08 (-7.61%)0.08 (-3.60%)0.05 (-18.12%)0.02 (+25.74%)225.20 (+22.13%)162.80 (+10.42%)156.00 (+3.72%)118.70 (-0.75%)38.78 (+56.10%)
331dcca — 2026-01-08 18:34:100.10 (n/a)0.09 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)184.40 (n/a)147.44 (n/a)150.40 (n/a)119.60 (n/a)24.85 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.12 (+39.07%)0.09 (+29.23%)0.10 (+32.55%)0.07 (+17.98%)0.02 (+79.46%)180.00 (-15.25%)136.96 (-21.47%)128.90 (-24.58%)104.90 (-28.10%)27.64 (+10.13%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)212.40 (n/a)174.40 (n/a)170.90 (n/a)145.90 (n/a)25.10 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.08 (-5.14%)0.06 (+4.19%)0.06 (+1.34%)0.05 (+12.43%)0.01 (-19.87%)162.90 (-11.08%)136.30 (-5.40%)145.00 (-1.36%)106.30 (+5.35%)22.78 (-23.40%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)183.20 (n/a)144.08 (n/a)147.00 (n/a)100.90 (n/a)29.74 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (-3.73%)0.05 (-8.29%)0.05 (-11.40%)0.05 (-6.79%)0.01 (+15.08%)169.90 (+7.26%)153.78 (+9.44%)159.10 (+12.84%)130.50 (+3.82%)17.69 (+30.45%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)158.40 (n/a)140.52 (n/a)141.00 (n/a)125.70 (n/a)13.56 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.08 (+7.61%)0.07 (+4.34%)0.07 (+15.75%)0.03 (-46.33%)0.02 (+137.46%)281.00 (+86.34%)144.72 (+8.88%)113.50 (-13.56%)100.60 (-7.11%)76.45 (+334.67%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)150.80 (n/a)132.92 (n/a)131.30 (n/a)108.30 (n/a)17.59 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-10.62%)0.06 (-9.65%)0.05 (-17.25%)0.05 (+17.78%)0.01 (-34.04%)166.30 (-15.11%)146.78 (+7.48%)153.20 (+20.82%)111.40 (+11.85%)21.03 (-41.48%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)195.90 (n/a)136.56 (n/a)126.80 (n/a)99.60 (n/a)35.93 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-22.54%)0.06 (-20.16%)0.06 (-23.51%)0.04 (-24.90%)0.01 (-17.31%)196.60 (+33.20%)148.74 (+25.75%)142.40 (+30.76%)124.20 (+29.11%)29.30 (+40.77%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.07 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)147.60 (n/a)118.28 (n/a)108.90 (n/a)96.20 (n/a)20.81 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (-12.83%)0.05 (-10.70%)0.05 (-13.96%)0.05 (+17.74%)0.01 (-54.78%)178.50 (-15.04%)160.56 (+8.50%)156.60 (+16.17%)140.20 (+14.73%)16.08 (-55.79%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)210.10 (n/a)147.98 (n/a)134.80 (n/a)122.20 (n/a)36.38 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-19.28%)0.05 (-19.75%)0.05 (-20.86%)0.03 (-9.22%)0.01 (-37.15%)237.20 (+10.17%)177.34 (+19.94%)172.00 (+26.38%)123.10 (+23.84%)41.64 (-14.39%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.02 (n/a)215.30 (n/a)147.86 (n/a)136.10 (n/a)99.40 (n/a)48.64 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (+9.22%)0.05 (-13.22%)0.04 (-22.17%)0.03 (-22.95%)0.01 (+124.78%)239.60 (+29.79%)189.52 (+19.98%)190.30 (+28.49%)133.40 (-8.44%)45.12 (+171.84%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)184.60 (n/a)157.96 (n/a)148.10 (n/a)145.70 (n/a)16.60 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
3a053d3 — 2025-11-26 01:12:163.72 (-0.11%)3.55 (-2.75%)3.56 (-2.75%)3.36 (-5.33%)0.12 (+76.10%)2725.23 (-0.11%)2602.52 (-2.75%)2612.11 (-2.75%)2459.89 (-5.33%)86.27 (+76.10%)6984.00 (+5.63%)6608.60 (+2.91%)6577.00 (+2.83%)6304.00 (+0.11%)221.87 (+87.15%)
9e98049 — 2025-11-25 20:50:553.72 (n/a)3.65 (n/a)3.66 (n/a)3.54 (n/a)0.07 (n/a)2728.26 (n/a)2676.06 (n/a)2686.03 (n/a)2598.29 (n/a)48.99 (n/a)6612.00 (n/a)6422.00 (n/a)6396.00 (n/a)6297.00 (n/a)118.55 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
3a053d3 — 2025-11-26 01:12:163.40 (-3.14%)3.38 (-0.82%)3.38 (-0.82%)3.35 (+4.93%)0.02 (-84.51%)2493.81 (-3.14%)2475.27 (-0.82%)2479.06 (-0.82%)2453.92 (+4.93%)13.33 (-84.51%)7001.00 (-4.70%)6940.80 (+0.71%)6930.00 (+0.83%)6889.00 (+3.24%)37.43 (-84.76%)
9e98049 — 2025-11-25 20:50:553.51 (n/a)3.40 (n/a)3.41 (n/a)3.19 (n/a)0.12 (n/a)2574.53 (n/a)2495.72 (n/a)2499.62 (n/a)2338.67 (n/a)86.02 (n/a)7346.00 (n/a)6892.20 (n/a)6873.00 (n/a)6673.00 (n/a)245.57 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
3a053d3 — 2025-11-26 01:12:163.02 (+0.52%)2.87 (-2.05%)2.86 (-2.24%)2.70 (-6.16%)0.11 (+131.66%)2216.19 (+0.52%)2104.44 (-2.05%)2094.08 (-2.24%)1980.84 (-6.16%)80.25 (+131.67%)8673.00 (+6.56%)8175.60 (+2.21%)8204.00 (+2.29%)7752.00 (-0.51%)314.03 (+145.36%)
9e98049 — 2025-11-25 20:50:553.01 (n/a)2.93 (n/a)2.92 (n/a)2.88 (n/a)0.05 (n/a)2204.81 (n/a)2148.41 (n/a)2142.13 (n/a)2110.81 (n/a)34.64 (n/a)8139.00 (n/a)7998.60 (n/a)8020.00 (n/a)7792.00 (n/a)127.99 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:491.04 (+0.94%)1.03 (+0.23%)1.03 (+0.09%)1.02 (+0.07%)0.00 (+197.51%)24576.00 (-0.07%)24485.82 (-0.23%)24530.40 (-0.09%)24266.40 (-0.94%)111.26 (+194.35%)
0a6c11c — 2025-12-04 00:39:101.03 (n/a)1.03 (n/a)1.03 (n/a)1.02 (n/a)0.00 (n/a)24594.30 (n/a)24542.14 (n/a)24551.90 (n/a)24495.50 (n/a)37.80 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
a4b6ffe — 2026-01-05 19:24:051.04 (+0.28%)1.03 (-0.15%)1.03 (+0.05%)1.02 (-0.52%)0.01 (+42.72%)24719.80 (+0.52%)24512.42 (+0.16%)24529.20 (-0.05%)24092.60 (-0.28%)252.92 (+43.15%)713.08 (+0.28%)700.92 (-0.15%)700.38 (+0.05%)694.98 (-0.52%)7.30 (+42.71%)
50ad37c — 2025-12-29 20:35:531.04 (n/a)1.03 (n/a)1.03 (n/a)1.02 (n/a)0.01 (n/a)24592.30 (n/a)24473.70 (n/a)24540.90 (n/a)24160.80 (n/a)176.68 (n/a)711.06 (n/a)702.00 (n/a)700.05 (n/a)698.59 (n/a)5.12 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.99 (+1.69%)0.97 (+0.29%)0.97 (-0.04%)0.97 (-0.15%)0.01 (+434.92%)26025.30 (+0.15%)25839.34 (-0.29%)25916.70 (+0.04%)25446.00 (-1.67%)202.05 (+425.44%)
0a6c11c — 2025-12-04 00:39:100.97 (n/a)0.97 (n/a)0.97 (n/a)0.97 (n/a)0.00 (n/a)25986.90 (n/a)25913.52 (n/a)25905.70 (n/a)25877.00 (n/a)38.45 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
a4b6ffe — 2026-01-05 19:24:050.97 (-0.01%)0.97 (+0.03%)0.97 (+0.04%)0.97 (+0.00%)0.00 (-6.43%)25927.90 (-0.00%)25903.20 (-0.03%)25898.60 (-0.04%)25892.80 (+0.01%)14.05 (-6.56%)663.50 (-0.01%)663.23 (+0.03%)663.35 (+0.04%)662.60 (+0.00%)0.36 (-6.43%)
50ad37c — 2025-12-29 20:35:530.97 (n/a)0.97 (n/a)0.97 (n/a)0.97 (n/a)0.00 (n/a)25928.10 (n/a)25910.14 (n/a)25908.10 (n/a)25891.20 (n/a)15.04 (n/a)663.54 (n/a)663.06 (n/a)663.11 (n/a)662.60 (n/a)0.38 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.92 (-1.02%)0.92 (-0.66%)0.92 (-0.10%)0.91 (-0.78%)0.01 (-4.54%)27751.40 (+0.79%)27480.74 (+0.66%)27354.80 (+0.10%)27320.50 (+1.03%)182.69 (-2.84%)
0a6c11c — 2025-12-04 00:39:100.93 (n/a)0.92 (n/a)0.92 (n/a)0.91 (n/a)0.01 (n/a)27534.80 (n/a)27299.32 (n/a)27326.70 (n/a)27042.30 (n/a)188.04 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
a4b6ffe — 2026-01-05 19:24:050.92 (+0.11%)0.91 (-0.12%)0.91 (-0.21%)0.91 (-0.24%)0.00 (+30.34%)27723.50 (+0.24%)27548.94 (+0.12%)27522.90 (+0.21%)27403.60 (-0.11%)124.26 (+30.58%)626.92 (+0.11%)623.62 (-0.12%)624.20 (-0.21%)619.69 (-0.24%)2.81 (+30.34%)
50ad37c — 2025-12-29 20:35:530.92 (n/a)0.91 (n/a)0.92 (n/a)0.91 (n/a)0.00 (n/a)27657.10 (n/a)27515.58 (n/a)27464.70 (n/a)27434.60 (n/a)95.16 (n/a)626.21 (n/a)624.37 (n/a)625.52 (n/a)621.17 (n/a)2.16 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
31ab24e — 2025-11-22 02:01:563.65 (-1.06%)3.59 (+0.83%)3.63 (-0.26%)3.45 (+2.66%)0.07 (-44.71%)2678.08 (-1.06%)2632.13 (+0.83%)2658.60 (-0.26%)2528.31 (+2.66%)53.86 (-44.71%)6795.00 (-2.59%)6529.80 (-0.92%)6462.00 (+0.26%)6415.00 (+1.07%)137.14 (-45.27%)
d9a64c5 — 2025-11-21 20:49:353.69 (n/a)3.56 (n/a)3.64 (n/a)3.36 (n/a)0.13 (n/a)2706.77 (n/a)2610.50 (n/a)2665.61 (n/a)2462.71 (n/a)97.41 (n/a)6976.00 (n/a)6590.40 (n/a)6445.00 (n/a)6347.00 (n/a)250.58 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:003.98 (+0.22%)3.91 (-1.28%)3.95 (-0.30%)3.78 (-3.51%)0.09 (+284.82%)6657.30 (+3.63%)6444.98 (+1.33%)6363.50 (+0.30%)6320.20 (-0.22%)145.01 (+297.45%)2718.25 (+0.22%)2666.69 (-1.28%)2699.76 (-0.30%)2580.62 (-3.51%)59.25 (+284.82%)
331dcca — 2026-01-08 18:34:103.97 (n/a)3.96 (n/a)3.97 (n/a)3.92 (n/a)0.02 (n/a)6423.80 (n/a)6360.32 (n/a)6344.30 (n/a)6333.90 (n/a)36.48 (n/a)2712.39 (n/a)2701.17 (n/a)2707.91 (n/a)2674.40 (n/a)15.40 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:003.74 (+0.06%)3.68 (+0.60%)3.72 (+0.28%)3.50 (+0.60%)0.10 (-8.43%)7188.00 (-0.60%)6843.34 (-0.61%)6756.50 (-0.28%)6731.00 (-0.06%)193.87 (-8.64%)2552.35 (+0.06%)2512.01 (+0.60%)2542.70 (+0.28%)2390.07 (+0.60%)68.64 (-8.43%)
331dcca — 2026-01-08 18:34:103.74 (n/a)3.66 (n/a)3.71 (n/a)3.48 (n/a)0.11 (n/a)7231.20 (n/a)6885.18 (n/a)6775.70 (n/a)6734.90 (n/a)212.21 (n/a)2550.87 (n/a)2497.04 (n/a)2535.50 (n/a)2375.78 (n/a)74.96 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:003.46 (-5.20%)3.43 (-3.05%)3.43 (-4.97%)3.42 (+1.44%)0.02 (-86.20%)7360.50 (-1.42%)7333.68 (+3.05%)7344.50 (+5.23%)7273.40 (+5.49%)35.79 (-85.63%)2362.00 (-5.20%)2342.65 (-3.05%)2339.16 (-4.97%)2334.08 (+1.44%)11.48 (-86.20%)
331dcca — 2026-01-08 18:34:103.65 (n/a)3.54 (n/a)3.61 (n/a)3.37 (n/a)0.12 (n/a)7466.20 (n/a)7116.40 (n/a)6979.60 (n/a)6895.10 (n/a)249.09 (n/a)2491.61 (n/a)2416.45 (n/a)2461.45 (n/a)2301.00 (n/a)83.20 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-1.55%)0.06 (-14.00%)0.05 (-20.14%)0.05 (-25.82%)0.01 (+209.30%)181.40 (+34.77%)147.96 (+19.13%)154.50 (+25.20%)120.50 (+1.60%)26.54 (+307.19%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.00 (n/a)134.60 (n/a)124.20 (n/a)123.40 (n/a)118.60 (n/a)6.52 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (-5.80%)0.06 (+0.56%)0.06 (+4.04%)0.05 (-1.11%)0.01 (-18.65%)170.50 (+1.13%)146.84 (-1.00%)137.00 (-3.93%)132.90 (+6.15%)16.37 (-15.36%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)168.60 (n/a)148.32 (n/a)142.60 (n/a)125.20 (n/a)19.34 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (-22.97%)0.06 (-7.27%)0.06 (-8.96%)0.05 (+10.75%)0.00 (-79.10%)150.70 (-9.71%)142.16 (+5.05%)138.90 (+9.80%)136.60 (+29.85%)6.05 (-75.89%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)166.90 (n/a)135.32 (n/a)126.50 (n/a)105.20 (n/a)25.11 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-4.63%)0.06 (-9.92%)0.06 (-9.04%)0.05 (-18.44%)0.01 (+64.33%)162.40 (+22.66%)137.08 (+12.25%)132.80 (+9.93%)118.60 (+4.86%)19.27 (+109.45%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)132.40 (n/a)122.12 (n/a)120.80 (n/a)113.10 (n/a)9.20 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-2.00%)0.06 (-10.46%)0.06 (-16.51%)0.05 (-14.95%)0.01 (+15.29%)177.20 (+17.58%)145.38 (+12.33%)144.20 (+19.77%)121.50 (+2.10%)20.28 (+42.21%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)150.70 (n/a)129.42 (n/a)120.40 (n/a)119.00 (n/a)14.26 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-4.10%)0.06 (+1.93%)0.06 (+17.82%)0.04 (-25.39%)0.01 (+27.40%)222.20 (+34.02%)147.52 (+1.24%)131.10 (-15.15%)112.70 (+4.26%)43.19 (+93.94%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)165.80 (n/a)145.72 (n/a)154.50 (n/a)108.10 (n/a)22.27 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (+6.85%)0.05 (+7.05%)0.05 (-1.16%)0.05 (+40.56%)0.01 (-25.66%)173.80 (-28.86%)152.88 (-9.00%)152.40 (+1.13%)131.80 (-6.39%)20.70 (-52.02%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)244.30 (n/a)168.00 (n/a)150.70 (n/a)140.80 (n/a)43.15 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (+19.92%)0.05 (+1.48%)0.05 (+7.94%)0.03 (-5.13%)0.01 (+81.52%)235.00 (+5.43%)183.68 (+1.80%)164.30 (-7.33%)129.80 (-16.58%)44.88 (+66.23%)
331dcca — 2026-01-08 18:34:100.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)222.90 (n/a)180.44 (n/a)177.30 (n/a)155.60 (n/a)27.00 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:490.37 (+17.13%)0.30 (+24.87%)0.30 (+38.03%)0.23 (+12.47%)0.06 (+35.23%)
0a6c11c — 2025-12-04 00:39:100.32 (n/a)0.24 (n/a)0.22 (n/a)0.20 (n/a)0.04 (n/a)

matrix_vector_mul_128x128_32_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:000.28 (+6.76%)0.25 (+2.68%)0.24 (-0.46%)0.22 (+5.94%)0.03 (+32.55%)0.27 (+6.76%)0.24 (+2.68%)0.24 (-0.46%)0.22 (+5.94%)0.03 (+32.55%)
331dcca — 2026-01-08 18:34:100.26 (n/a)0.24 (n/a)0.24 (n/a)0.21 (n/a)0.02 (n/a)0.26 (n/a)0.24 (n/a)0.24 (n/a)0.20 (n/a)0.02 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4913.57 (+3.47%)13.15 (+1.09%)13.10 (+0.16%)12.52 (-1.58%)0.37 (+153.19%)
0a6c11c — 2025-12-04 00:39:1013.11 (n/a)13.01 (n/a)13.07 (n/a)12.72 (n/a)0.15 (n/a)

matrix_vector_mul_2048x8192_1_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:0013.61 (+1.29%)12.87 (-3.24%)13.36 (+0.70%)11.31 (-14.10%)0.94 (+708.15%)13.60 (+1.29%)12.86 (-3.24%)13.36 (+0.70%)11.30 (-14.10%)0.94 (+708.15%)
331dcca — 2026-01-08 18:34:1013.43 (n/a)13.30 (n/a)13.27 (n/a)13.16 (n/a)0.12 (n/a)13.42 (n/a)13.29 (n/a)13.26 (n/a)13.16 (n/a)0.12 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4925.06 (+2.47%)23.71 (+1.81%)24.13 (+0.50%)20.90 (+5.41%)1.48 (-15.60%)
0a6c11c — 2025-12-04 00:39:1024.46 (n/a)23.29 (n/a)24.01 (n/a)19.83 (n/a)1.75 (n/a)

matrix_vector_mul_2048x8192_1_2col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:0025.63 (+4.81%)23.65 (+12.22%)25.00 (+26.60%)17.45 (-3.49%)3.48 (+14.74%)25.62 (+4.81%)23.64 (+12.22%)24.99 (+26.60%)17.44 (-3.49%)3.48 (+14.74%)
331dcca — 2026-01-08 18:34:1024.46 (n/a)21.07 (n/a)19.75 (n/a)18.08 (n/a)3.03 (n/a)24.44 (n/a)21.06 (n/a)19.74 (n/a)18.07 (n/a)3.03 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4942.05 (+1.54%)40.50 (+12.60%)40.49 (+2.36%)38.98 (+97.53%)0.97 (-88.09%)
0a6c11c — 2025-12-04 00:39:1041.41 (n/a)35.97 (n/a)39.55 (n/a)19.73 (n/a)8.15 (n/a)

matrix_vector_mul_2048x8192_1_4col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:0041.03 (-3.65%)38.49 (-6.95%)39.79 (-3.54%)32.19 (-20.17%)3.59 (+288.55%)41.00 (-3.65%)38.47 (-6.95%)39.77 (-3.54%)32.17 (-20.17%)3.59 (+288.55%)
331dcca — 2026-01-08 18:34:1042.58 (n/a)41.37 (n/a)41.25 (n/a)40.33 (n/a)0.92 (n/a)42.56 (n/a)41.34 (n/a)41.23 (n/a)40.30 (n/a)0.92 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4946.62 (+3.11%)44.82 (+0.17%)44.78 (+0.17%)42.60 (-3.80%)1.60 (+367.72%)
0a6c11c — 2025-12-04 00:39:1045.21 (n/a)44.75 (n/a)44.70 (n/a)44.29 (n/a)0.34 (n/a)

matrix_vector_mul_2048x8192_1_8col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:0046.19 (+0.34%)45.18 (+0.27%)45.80 (+2.81%)43.40 (-2.02%)1.23 (+41.93%)46.16 (+0.34%)45.15 (+0.27%)45.77 (+2.81%)43.38 (-2.02%)1.23 (+41.93%)
331dcca — 2026-01-08 18:34:1046.04 (n/a)45.06 (n/a)44.55 (n/a)44.30 (n/a)0.87 (n/a)46.01 (n/a)45.03 (n/a)44.52 (n/a)44.27 (n/a)0.87 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4913.29 (+1.63%)13.19 (+6.08%)13.19 (+1.17%)13.09 (+26.86%)0.08 (-92.94%)
0a6c11c — 2025-12-04 00:39:1013.08 (n/a)12.44 (n/a)13.03 (n/a)10.32 (n/a)1.07 (n/a)

matrix_vector_mul_8192x2048_4_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:0013.71 (+0.19%)13.05 (-1.87%)13.43 (+0.34%)11.88 (-6.65%)0.79 (+125.72%)13.70 (+0.19%)13.04 (-1.87%)13.42 (+0.34%)11.87 (-6.65%)0.79 (+125.72%)
331dcca — 2026-01-08 18:34:1013.68 (n/a)13.30 (n/a)13.38 (n/a)12.72 (n/a)0.35 (n/a)13.67 (n/a)13.29 (n/a)13.38 (n/a)12.71 (n/a)0.35 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4925.58 (+4.24%)24.23 (+6.59%)24.03 (+0.29%)23.58 (+37.29%)0.70 (-74.97%)
0a6c11c — 2025-12-04 00:39:1024.54 (n/a)22.73 (n/a)23.96 (n/a)17.18 (n/a)2.79 (n/a)

matrix_vector_mul_8192x2048_4_2col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:0024.88 (-0.81%)22.00 (-10.86%)24.41 (-0.80%)17.95 (-26.65%)3.70 (+1435.10%)24.87 (-0.81%)21.99 (-10.86%)24.40 (-0.80%)17.94 (-26.65%)3.69 (+1435.09%)
331dcca — 2026-01-08 18:34:1025.08 (n/a)24.68 (n/a)24.61 (n/a)24.47 (n/a)0.24 (n/a)25.07 (n/a)24.67 (n/a)24.59 (n/a)24.46 (n/a)0.24 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4940.94 (-2.19%)39.74 (-1.10%)39.76 (-0.60%)38.17 (-2.14%)1.04 (+4.39%)
0a6c11c — 2025-12-04 00:39:1041.86 (n/a)40.18 (n/a)40.00 (n/a)39.00 (n/a)1.00 (n/a)

matrix_vector_mul_8192x2048_4_4col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:0042.76 (+4.94%)40.72 (+9.59%)40.50 (+0.61%)39.63 (+61.67%)1.22 (-82.72%)42.73 (+4.94%)40.69 (+9.59%)40.47 (+0.61%)39.61 (+61.67%)1.22 (-82.72%)
331dcca — 2026-01-08 18:34:1040.74 (n/a)37.16 (n/a)40.25 (n/a)24.51 (n/a)7.07 (n/a)40.72 (n/a)37.13 (n/a)40.23 (n/a)24.50 (n/a)7.07 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4946.71 (-1.04%)44.91 (-2.34%)44.71 (-2.98%)43.80 (-1.44%)0.96 (+6.93%)
0a6c11c — 2025-12-04 00:39:1047.20 (n/a)45.98 (n/a)46.08 (n/a)44.44 (n/a)0.90 (n/a)

matrix_vector_mul_8192x2048_4_8col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
c3a30ff — 2026-01-12 20:55:0047.65 (+2.96%)45.60 (+1.59%)45.23 (+1.10%)44.68 (+1.08%)1.18 (+40.85%)47.63 (+2.96%)45.57 (+1.59%)45.20 (+1.10%)44.65 (+1.08%)1.18 (+40.85%)
331dcca — 2026-01-08 18:34:1046.28 (n/a)44.89 (n/a)44.74 (n/a)44.20 (n/a)0.84 (n/a)46.25 (n/a)44.86 (n/a)44.71 (n/a)44.17 (n/a)0.84 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.07 (+22.03%)0.06 (+27.86%)0.06 (+35.49%)0.05 (+15.00%)0.01 (+49.69%)173.30 (-13.00%)137.94 (-21.32%)133.60 (-26.19%)123.40 (-18.06%)18.40 (+8.53%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)199.20 (n/a)175.32 (n/a)181.00 (n/a)150.60 (n/a)16.96 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (+17.68%)0.05 (+10.92%)0.05 (+12.55%)0.04 (-3.50%)0.01 (+47.13%)215.20 (+3.61%)170.40 (-8.29%)173.10 (-11.14%)118.40 (-15.00%)34.63 (+28.19%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)207.70 (n/a)185.80 (n/a)194.80 (n/a)139.30 (n/a)27.01 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-16.99%)0.05 (-12.47%)0.05 (-7.32%)0.04 (-11.17%)0.00 (-29.61%)197.00 (+12.57%)171.00 (+13.70%)164.00 (+7.89%)153.00 (+20.47%)17.49 (-4.32%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)175.00 (n/a)150.40 (n/a)152.00 (n/a)127.00 (n/a)18.28 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+5.56%)0.05 (-1.59%)0.05 (-1.39%)0.03 (-14.07%)0.01 (+25.03%)263.00 (+16.37%)166.00 (+4.53%)144.00 (+1.41%)126.00 (-5.26%)49.38 (+43.17%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)226.00 (n/a)158.80 (n/a)142.00 (n/a)133.00 (n/a)34.49 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.08 (+10.93%)0.07 (+7.79%)0.07 (+3.55%)0.05 (-1.73%)0.01 (+36.73%)150.20 (+1.76%)121.68 (-6.36%)125.60 (-3.38%)97.90 (-9.85%)18.56 (+21.98%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.01 (n/a)147.60 (n/a)129.94 (n/a)130.00 (n/a)108.60 (n/a)15.21 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (+14.66%)0.05 (-10.89%)0.05 (-5.76%)0.02 (-57.41%)0.02 (+296.67%)346.20 (+134.71%)181.42 (+30.91%)154.50 (+6.11%)109.90 (-12.78%)95.35 (+755.63%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.00 (n/a)147.50 (n/a)138.58 (n/a)145.60 (n/a)126.00 (n/a)11.14 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-15.32%)0.05 (-17.09%)0.05 (-23.81%)0.04 (-15.54%)0.01 (-18.18%)193.00 (+18.40%)160.80 (+20.36%)168.00 (+31.25%)124.00 (+18.10%)22.92 (+11.39%)
0999a9a — 2025-11-13 19:24:080.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)163.00 (n/a)133.60 (n/a)128.00 (n/a)105.00 (n/a)20.58 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-23.02%)0.05 (-6.98%)0.05 (-2.13%)0.04 (-15.31%)0.01 (-33.29%)196.00 (+18.07%)147.00 (+6.52%)141.00 (+2.17%)126.00 (+29.90%)25.27 (+8.13%)
0999a9a — 2025-11-13 19:24:080.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)166.00 (n/a)138.00 (n/a)138.00 (n/a)97.00 (n/a)23.37 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.10 (+31.37%)0.08 (+29.12%)0.08 (+29.06%)0.07 (+41.80%)0.01 (+0.23%)109.90 (-29.46%)98.30 (-23.38%)100.80 (-22.52%)79.40 (-23.87%)10.54 (-46.17%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.07 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)155.80 (n/a)128.30 (n/a)130.10 (n/a)104.30 (n/a)19.58 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (-12.34%)0.05 (-5.00%)0.06 (+2.67%)0.04 (-11.80%)0.01 (-10.30%)191.10 (+13.35%)154.86 (+5.38%)143.60 (-2.58%)131.40 (+14.06%)24.33 (+18.10%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)168.60 (n/a)146.96 (n/a)147.40 (n/a)115.20 (n/a)20.60 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.10 (+25.02%)0.07 (+10.01%)0.07 (+7.53%)0.05 (-1.99%)0.01 (+77.08%)150.10 (+2.04%)114.60 (-7.22%)111.70 (-6.99%)83.90 (-20.02%)21.23 (+43.54%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)147.10 (n/a)123.52 (n/a)120.10 (n/a)104.90 (n/a)14.79 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (+5.76%)0.05 (-9.96%)0.05 (-15.89%)0.04 (-20.99%)0.01 (+49.86%)206.60 (+26.59%)157.82 (+13.20%)152.80 (+18.91%)119.60 (-5.45%)31.34 (+83.88%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)163.20 (n/a)139.42 (n/a)128.50 (n/a)126.50 (n/a)17.04 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.07 (+11.97%)0.05 (+3.09%)0.05 (+2.10%)0.03 (-11.35%)0.01 (+41.65%)229.00 (+12.81%)156.00 (-0.51%)143.00 (-2.05%)117.00 (-10.69%)38.21 (+48.71%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)203.00 (n/a)156.80 (n/a)146.00 (n/a)131.00 (n/a)25.69 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+9.02%)0.05 (+5.59%)0.05 (+0.00%)0.04 (+3.63%)0.01 (+25.48%)193.00 (-3.50%)147.40 (-4.66%)147.00 (+0.00%)122.00 (-8.27%)25.24 (+7.48%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)154.60 (n/a)147.00 (n/a)133.00 (n/a)23.48 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.09 (-3.98%)0.07 (+4.00%)0.07 (+7.04%)0.06 (+3.67%)0.01 (-15.76%)129.70 (-3.57%)113.30 (-4.50%)116.90 (-6.55%)90.40 (+4.15%)15.04 (-13.80%)
0a6c11c — 2025-12-04 00:39:100.09 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)134.50 (n/a)118.64 (n/a)125.10 (n/a)86.80 (n/a)17.45 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-15.07%)0.06 (-2.25%)0.05 (+4.96%)0.05 (+8.11%)0.01 (-38.83%)179.50 (-7.52%)148.36 (-0.40%)151.70 (-4.77%)121.70 (+17.81%)23.10 (-33.05%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)194.10 (n/a)148.96 (n/a)159.30 (n/a)103.30 (n/a)34.50 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.08 (+9.57%)0.07 (+16.85%)0.07 (+19.58%)0.06 (+24.52%)0.01 (+1.05%)134.50 (-19.70%)116.64 (-14.92%)116.80 (-16.39%)98.00 (-8.75%)15.71 (-25.13%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)167.50 (n/a)137.10 (n/a)139.70 (n/a)107.40 (n/a)20.99 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-3.89%)0.06 (-5.54%)0.05 (-6.91%)0.05 (-10.37%)0.01 (+22.57%)159.10 (+11.57%)140.18 (+6.54%)150.10 (+7.44%)119.10 (+4.02%)18.83 (+38.51%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.01 (n/a)142.60 (n/a)131.58 (n/a)139.70 (n/a)114.50 (n/a)13.59 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-13.48%)0.05 (-17.79%)0.05 (-15.33%)0.03 (-25.09%)0.01 (+6.67%)267.00 (+33.50%)176.80 (+24.51%)150.00 (+18.11%)141.00 (+15.57%)47.41 (+61.41%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)142.00 (n/a)127.00 (n/a)122.00 (n/a)29.37 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (+13.38%)0.05 (+23.85%)0.05 (+37.91%)0.05 (+30.72%)0.00 (-56.85%)166.00 (-23.50%)153.40 (-20.60%)153.00 (-27.49%)142.00 (-11.80%)7.63 (-70.60%)
0999a9a — 2025-11-13 19:24:080.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)217.00 (n/a)193.20 (n/a)211.00 (n/a)161.00 (n/a)25.96 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.09 (+16.31%)0.08 (+15.34%)0.08 (+14.60%)0.07 (+19.30%)0.01 (-5.41%)117.30 (-16.15%)107.80 (-13.61%)108.50 (-12.78%)94.10 (-13.99%)8.29 (-32.01%)
0a6c11c — 2025-12-04 00:39:100.07 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)139.90 (n/a)124.78 (n/a)124.40 (n/a)109.40 (n/a)12.20 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (+2.46%)0.05 (-12.07%)0.04 (-22.54%)0.04 (-1.97%)0.01 (+11.45%)230.40 (+1.99%)185.88 (+14.44%)188.00 (+29.12%)133.10 (-2.42%)39.65 (+8.36%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)225.90 (n/a)162.42 (n/a)145.60 (n/a)136.40 (n/a)36.59 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.09 (+12.61%)0.07 (-2.24%)0.07 (-8.85%)0.06 (+5.13%)0.01 (+35.50%)136.50 (-4.88%)120.86 (+2.96%)125.10 (+9.64%)91.60 (-11.15%)15.72 (+10.46%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)143.50 (n/a)117.38 (n/a)114.10 (n/a)103.10 (n/a)14.23 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-6.00%)0.05 (-10.70%)0.05 (-14.64%)0.04 (-18.63%)0.01 (+8.98%)220.40 (+22.92%)162.42 (+13.61%)151.80 (+17.13%)123.30 (+6.38%)38.67 (+41.92%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)179.30 (n/a)142.96 (n/a)129.60 (n/a)115.90 (n/a)27.25 (n/a)

mha

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.18 (+0.16%)0.18 (+0.19%)0.18 (+0.12%)0.18 (+0.32%)0.00 (-52.24%)47253.90 (-0.32%)47213.70 (-0.19%)47210.90 (-0.12%)47167.70 (-0.16%)28.71 (-52.47%)
0a6c11c — 2025-12-04 00:39:100.18 (n/a)0.18 (n/a)0.18 (n/a)0.18 (n/a)0.00 (n/a)47405.00 (n/a)47301.72 (n/a)47265.90 (n/a)47241.80 (n/a)60.40 (n/a)

mha0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.18 (+0.03%)0.18 (+0.05%)0.18 (+0.17%)0.18 (-0.01%)0.00 (+11.88%)47624.10 (+0.01%)47440.68 (-0.05%)47378.90 (-0.17%)47354.70 (-0.03%)111.56 (+11.83%)
331dcca — 2026-01-08 18:34:100.18 (n/a)0.18 (n/a)0.18 (n/a)0.18 (n/a)0.00 (n/a)47620.40 (n/a)47465.20 (n/a)47460.90 (n/a)47368.00 (n/a)99.76 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (+1.32%)0.07 (+19.59%)0.07 (+19.74%)0.07 (+44.93%)0.00 (-79.57%)125.90 (-31.01%)120.58 (-18.54%)118.70 (-16.47%)117.40 (-1.26%)3.78 (-86.21%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)182.50 (n/a)148.02 (n/a)142.10 (n/a)118.90 (n/a)27.41 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.08 (+26.18%)0.07 (+27.69%)0.07 (+23.66%)0.06 (+40.21%)0.01 (-10.87%)129.00 (-28.69%)117.10 (-22.18%)114.90 (-19.14%)108.00 (-20.76%)9.54 (-49.55%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)180.90 (n/a)150.48 (n/a)142.10 (n/a)136.30 (n/a)18.90 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-17.96%)0.06 (-8.02%)0.06 (-2.31%)0.05 (-5.80%)0.01 (-28.79%)174.90 (+6.13%)138.06 (+7.66%)130.80 (+2.35%)115.60 (+21.94%)23.35 (-5.97%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.07 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)164.80 (n/a)128.24 (n/a)127.80 (n/a)94.80 (n/a)24.84 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.08 (+26.21%)0.07 (+6.74%)0.06 (-0.82%)0.05 (-3.14%)0.01 (+246.55%)149.80 (+3.24%)127.96 (-4.26%)134.80 (+0.82%)98.30 (-20.79%)21.34 (+182.28%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.00 (n/a)145.10 (n/a)133.66 (n/a)133.70 (n/a)124.10 (n/a)7.56 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (-19.95%)0.05 (-24.65%)0.06 (-14.01%)0.03 (-46.34%)0.01 (+124.18%)250.30 (+86.37%)168.56 (+39.88%)140.80 (+16.27%)133.90 (+24.91%)49.88 (+413.47%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)134.30 (n/a)120.50 (n/a)121.10 (n/a)107.20 (n/a)9.72 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (+1.10%)0.06 (+2.55%)0.06 (+13.17%)0.05 (+8.02%)0.01 (-20.83%)172.10 (-7.42%)143.20 (-4.10%)138.00 (-11.65%)110.70 (-1.07%)23.93 (-26.23%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)185.90 (n/a)149.32 (n/a)156.20 (n/a)111.90 (n/a)32.44 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (+1.49%)0.05 (-4.06%)0.06 (+9.11%)0.03 (-32.11%)0.01 (+67.74%)240.60 (+47.34%)158.70 (+8.56%)142.30 (-8.31%)123.10 (-1.52%)46.75 (+160.79%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)163.30 (n/a)146.18 (n/a)155.20 (n/a)125.00 (n/a)17.93 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-17.96%)0.06 (-2.48%)0.05 (+4.05%)0.05 (-2.54%)0.01 (-34.91%)178.30 (+2.59%)145.66 (+0.48%)152.00 (-3.92%)120.30 (+21.88%)24.34 (-20.37%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)173.80 (n/a)144.96 (n/a)158.20 (n/a)98.70 (n/a)30.57 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.08 (+3.45%)0.06 (-5.17%)0.06 (-5.23%)0.04 (-13.65%)0.01 (+30.03%)187.10 (+15.78%)148.98 (+7.04%)148.60 (+5.54%)106.70 (-3.35%)29.06 (+41.56%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)161.60 (n/a)139.18 (n/a)140.80 (n/a)110.40 (n/a)20.53 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (-16.95%)0.05 (-2.12%)0.06 (+14.75%)0.04 (-20.56%)0.01 (-18.91%)223.60 (+25.90%)157.36 (+2.34%)145.50 (-12.87%)129.80 (+20.41%)37.63 (+29.51%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)177.60 (n/a)153.76 (n/a)167.00 (n/a)107.80 (n/a)29.05 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.08 (+7.40%)0.05 (+15.17%)0.05 (+24.34%)0.04 (+14.16%)0.02 (-6.69%)216.40 (-12.42%)162.96 (-15.69%)180.50 (-19.56%)109.00 (-6.92%)44.14 (-26.96%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.05 (n/a)0.04 (n/a)0.03 (n/a)0.02 (n/a)247.10 (n/a)193.28 (n/a)224.40 (n/a)117.10 (n/a)60.43 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (-3.34%)0.05 (-14.00%)0.05 (-17.01%)0.04 (-14.01%)0.01 (+12.02%)199.70 (+16.31%)168.36 (+17.19%)170.70 (+20.55%)129.10 (+3.45%)27.38 (+36.47%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)171.70 (n/a)143.66 (n/a)141.60 (n/a)124.80 (n/a)20.06 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.22 (-1.47%)0.18 (-7.88%)0.16 (-18.70%)0.14 (-9.17%)0.03 (+8.74%)171.20 (+10.10%)142.94 (+9.21%)154.70 (+22.97%)112.80 (+1.53%)25.21 (+19.90%)
331dcca — 2026-01-08 18:34:100.22 (n/a)0.19 (n/a)0.20 (n/a)0.16 (n/a)0.03 (n/a)155.50 (n/a)130.88 (n/a)125.80 (n/a)111.10 (n/a)21.03 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.23 (-5.80%)0.18 (-0.72%)0.19 (+10.04%)0.13 (-15.60%)0.04 (+16.93%)183.00 (+18.45%)139.36 (+2.38%)128.30 (-9.07%)108.00 (+6.09%)30.92 (+54.20%)
331dcca — 2026-01-08 18:34:100.24 (n/a)0.18 (n/a)0.17 (n/a)0.16 (n/a)0.03 (n/a)154.50 (n/a)136.12 (n/a)141.10 (n/a)101.80 (n/a)20.05 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.22 (+17.01%)0.19 (+8.49%)0.18 (+9.20%)0.14 (-7.74%)0.03 (+110.61%)170.00 (+8.35%)134.10 (-6.01%)136.50 (-8.45%)109.90 (-14.61%)24.72 (+93.18%)
331dcca — 2026-01-08 18:34:100.19 (n/a)0.17 (n/a)0.16 (n/a)0.16 (n/a)0.02 (n/a)156.90 (n/a)142.68 (n/a)149.10 (n/a)128.70 (n/a)12.80 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.24 (+5.81%)0.16 (-14.21%)0.15 (-20.41%)0.11 (-25.74%)0.05 (+73.25%)226.70 (+34.62%)167.22 (+23.21%)166.70 (+25.72%)101.30 (-5.50%)48.22 (+116.67%)
331dcca — 2026-01-08 18:34:100.23 (n/a)0.18 (n/a)0.19 (n/a)0.15 (n/a)0.03 (n/a)168.40 (n/a)135.72 (n/a)132.60 (n/a)107.20 (n/a)22.26 (n/a)

sigmoid_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-22.03%)0.06 (-1.68%)0.06 (+0.98%)0.06 (+20.41%)0.00 (-72.04%)139.10 (-16.96%)127.70 (-1.54%)126.20 (-0.94%)119.30 (+28.14%)8.08 (-69.72%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.07 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)167.50 (n/a)129.70 (n/a)127.40 (n/a)93.10 (n/a)26.68 (n/a)

sigmoid_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (+0.96%)0.07 (+10.40%)0.07 (+12.53%)0.06 (+18.55%)0.00 (-45.32%)127.00 (-15.61%)117.28 (-9.99%)115.20 (-11.11%)112.10 (-0.97%)6.12 (-54.37%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)150.50 (n/a)130.30 (n/a)129.60 (n/a)113.20 (n/a)13.41 (n/a)

sigmoid_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-5.04%)0.06 (+13.32%)0.07 (+27.29%)0.05 (+31.46%)0.01 (-36.25%)159.20 (-23.90%)132.28 (-14.69%)123.30 (-21.46%)114.90 (+5.32%)19.96 (-48.81%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)209.20 (n/a)155.06 (n/a)157.00 (n/a)109.10 (n/a)39.00 (n/a)

sigmoid_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.08 (+9.62%)0.06 (+3.68%)0.05 (-0.04%)0.04 (+0.29%)0.01 (+35.41%)192.60 (-0.26%)148.50 (-1.95%)150.70 (+0.07%)108.90 (-8.79%)33.65 (+21.39%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)193.10 (n/a)151.46 (n/a)150.60 (n/a)119.40 (n/a)27.72 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (+11.45%)0.06 (+1.77%)0.06 (+3.95%)0.04 (-2.18%)0.01 (+55.80%)198.10 (+2.22%)152.20 (+0.36%)141.30 (-3.81%)117.00 (-10.28%)34.48 (+39.76%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)193.80 (n/a)151.66 (n/a)146.90 (n/a)130.40 (n/a)24.67 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (+12.42%)0.06 (+4.74%)0.05 (-1.49%)0.05 (-0.16%)0.01 (+41.07%)181.10 (+0.17%)149.76 (-3.53%)152.00 (+1.47%)113.00 (-11.09%)25.52 (+23.63%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)180.80 (n/a)155.24 (n/a)149.80 (n/a)127.10 (n/a)20.65 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.08 (+16.73%)0.05 (-16.02%)0.05 (-23.20%)0.04 (-34.67%)0.02 (+253.87%)230.00 (+53.13%)175.48 (+27.03%)177.80 (+30.26%)108.20 (-14.40%)47.56 (+356.24%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)150.20 (n/a)138.14 (n/a)136.50 (n/a)126.40 (n/a)10.43 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (-16.57%)0.05 (-16.96%)0.05 (-17.93%)0.04 (-24.00%)0.01 (+0.20%)225.70 (+31.60%)181.10 (+21.94%)177.10 (+21.89%)136.50 (+19.84%)36.80 (+59.19%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)171.50 (n/a)148.52 (n/a)145.30 (n/a)113.90 (n/a)23.12 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.15 (+1.51%)0.11 (-13.64%)0.11 (-20.84%)0.09 (-15.03%)0.02 (+38.05%)181.70 (+17.68%)148.62 (+17.62%)147.30 (+26.33%)111.50 (-1.50%)27.39 (+59.64%)
331dcca — 2026-01-08 18:34:100.14 (n/a)0.13 (n/a)0.14 (n/a)0.11 (n/a)0.02 (n/a)154.40 (n/a)126.36 (n/a)116.60 (n/a)113.20 (n/a)17.16 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.16 (+11.59%)0.13 (+7.37%)0.11 (-4.30%)0.11 (+26.65%)0.02 (-6.81%)153.30 (-21.02%)132.82 (-8.11%)145.50 (+4.53%)103.70 (-10.45%)22.37 (-31.75%)
331dcca — 2026-01-08 18:34:100.14 (n/a)0.12 (n/a)0.12 (n/a)0.08 (n/a)0.02 (n/a)194.10 (n/a)144.54 (n/a)139.20 (n/a)115.80 (n/a)32.77 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.12 (-26.80%)0.09 (-28.58%)0.08 (-35.28%)0.07 (-33.79%)0.03 (-3.06%)239.60 (+51.07%)184.04 (+44.01%)196.40 (+54.52%)132.40 (+36.64%)49.43 (+89.24%)
331dcca — 2026-01-08 18:34:100.17 (n/a)0.13 (n/a)0.13 (n/a)0.10 (n/a)0.03 (n/a)158.60 (n/a)127.80 (n/a)127.10 (n/a)96.90 (n/a)26.12 (n/a)

swiglu

No metrics available.

swiglu_decode_1x2048x2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.00 (-15.46%)0.00 (-27.20%)0.00 (-28.17%)0.00 (-33.90%)0.00 (+1834.83%)5187.20 (+51.28%)4720.84 (+38.38%)4750.90 (+39.22%)4015.10 (+18.29%)390.23 (+3298.45%)
0a6c11c — 2025-12-04 00:39:100.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)3428.80 (n/a)3411.62 (n/a)3412.60 (n/a)3394.20 (n/a)11.48 (n/a)

swiglu_decode_1x2048x2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.00 (-1.05%)0.00 (-1.93%)0.00 (-11.40%)0.00 (-1.19%)0.00 (+14.66%)5334.70 (+1.20%)4579.52 (+2.84%)4970.30 (+12.86%)3431.80 (+1.06%)853.00 (+20.76%)
331dcca — 2026-01-08 18:34:100.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)5271.20 (n/a)4452.98 (n/a)4403.80 (n/a)3395.80 (n/a)706.35 (n/a)

tanh_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.08 (+3.44%)0.06 (-10.68%)0.06 (-16.07%)0.05 (-14.80%)0.01 (+74.88%)165.80 (+17.34%)137.80 (+14.49%)143.80 (+19.14%)102.90 (-3.38%)26.47 (+97.93%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)141.30 (n/a)120.36 (n/a)120.70 (n/a)106.50 (n/a)13.37 (n/a)

tanh_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (+4.18%)0.05 (-3.50%)0.05 (-4.85%)0.05 (-6.97%)0.01 (+85.01%)166.20 (+7.50%)150.26 (+4.26%)151.70 (+5.06%)128.90 (-4.02%)15.15 (+91.65%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)154.60 (n/a)144.12 (n/a)144.40 (n/a)134.30 (n/a)7.91 (n/a)

tanh_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.09 (+35.36%)0.07 (+22.29%)0.07 (+29.24%)0.05 (-8.89%)0.02 (+172.73%)176.20 (+9.78%)127.20 (-14.16%)119.80 (-22.61%)90.20 (-26.13%)34.88 (+124.01%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)160.50 (n/a)148.18 (n/a)154.80 (n/a)122.10 (n/a)15.57 (n/a)

tanh_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (+0.17%)0.05 (-1.83%)0.05 (-3.23%)0.04 (+4.32%)0.01 (-16.06%)194.90 (-4.13%)154.96 (+0.48%)158.80 (+3.32%)116.60 (-0.17%)29.47 (-18.57%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)203.30 (n/a)154.22 (n/a)153.70 (n/a)116.80 (n/a)36.19 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:493.93 (-7.02%)3.68 (+2.48%)3.66 (+1.82%)3.45 (+15.62%)0.15 (-63.64%)151.80 (-13.50%)142.70 (-3.59%)143.40 (-1.78%)133.50 (+7.49%)5.90 (-66.22%)
0a6c11c — 2025-12-04 00:39:104.22 (n/a)3.59 (n/a)3.59 (n/a)2.99 (n/a)0.42 (n/a)175.50 (n/a)148.02 (n/a)146.00 (n/a)124.20 (n/a)17.46 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:003.71 (+20.31%)2.95 (+4.46%)3.01 (+3.34%)2.32 (-6.01%)0.57 (+126.69%)225.50 (+6.37%)183.44 (-1.99%)174.10 (-3.22%)141.30 (-16.88%)35.44 (+103.88%)
331dcca — 2026-01-08 18:34:103.08 (n/a)2.82 (n/a)2.91 (n/a)2.47 (n/a)0.25 (n/a)212.00 (n/a)187.16 (n/a)179.90 (n/a)170.00 (n/a)17.38 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:495.11 (+15.57%)3.85 (-3.32%)3.40 (-18.64%)3.29 (+7.09%)0.71 (+49.14%)159.60 (-6.61%)140.18 (+4.80%)154.20 (+22.97%)102.60 (-13.49%)22.70 (+19.77%)
0a6c11c — 2025-12-04 00:39:104.42 (n/a)3.99 (n/a)4.18 (n/a)3.07 (n/a)0.48 (n/a)170.90 (n/a)133.76 (n/a)125.40 (n/a)118.60 (n/a)18.95 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:003.87 (+12.16%)3.62 (+18.13%)3.58 (+17.44%)3.45 (+30.63%)0.15 (-51.31%)151.90 (-23.44%)145.18 (-15.98%)146.40 (-14.88%)135.60 (-10.85%)6.05 (-66.93%)
331dcca — 2026-01-08 18:34:103.45 (n/a)3.06 (n/a)3.05 (n/a)2.64 (n/a)0.32 (n/a)198.40 (n/a)172.80 (n/a)172.00 (n/a)152.10 (n/a)18.28 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-10.76%)0.06 (+1.62%)0.05 (+0.15%)0.05 (+5.32%)0.01 (-31.87%)160.10 (-5.04%)143.54 (-2.76%)151.10 (-0.13%)125.30 (+12.08%)16.77 (-29.55%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)168.60 (n/a)147.62 (n/a)151.30 (n/a)111.80 (n/a)23.81 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.07 (-10.08%)0.05 (-10.39%)0.06 (-10.77%)0.04 (-15.78%)0.01 (-14.52%)200.50 (+18.71%)154.68 (+11.31%)148.60 (+12.07%)117.40 (+11.17%)31.10 (+9.37%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)168.90 (n/a)138.96 (n/a)132.60 (n/a)105.60 (n/a)28.44 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (+5.65%)0.05 (+5.54%)0.05 (+0.95%)0.05 (+42.05%)0.01 (-42.97%)163.30 (-29.61%)153.22 (-8.21%)160.50 (-0.93%)126.50 (-5.31%)15.41 (-61.73%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)232.00 (n/a)166.92 (n/a)162.00 (n/a)133.60 (n/a)40.26 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
c3a30ff — 2026-01-12 20:55:000.06 (-23.17%)0.05 (-20.54%)0.05 (-16.02%)0.04 (-21.49%)0.01 (-24.36%)233.70 (+27.43%)182.20 (+25.60%)161.10 (+19.07%)145.60 (+30.23%)39.17 (+24.46%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)183.40 (n/a)145.06 (n/a)135.30 (n/a)111.80 (n/a)31.47 (n/a)

@github-actions
Copy link
Contributor

github-actions bot commented Jan 12, 2026

📊 Test Results for Test Example Applications

c3a30ff (2026_01_12_21_12_25)

IRONCLAD

Tested on 2026_01_12_21_12_25 at commit c3a30ff.

Test Checks TTFT (mean)TPS (mean)
llama_3.2_1b_prompt_13_tokens_1 ❌ 0/1 n/a n/a
llama_3.2_1b_prompt_13_tokens_40 ❌ 0/1 n/a n/a
llama_3.2_1b_prompt_2048_tokens_1 ❌ 0/1 n/a n/a
llama_3.2_1b_prompt_2048_tokens_40 ❌ 0/1 n/a n/a
📈 Trends (vs main branch) for Test Example Applications

c3a30ff (2026_01_12_21_12_25)

IRONCLAD Trends

llama_3.2_1b

Commit/Date Num Tokens (max)Num Tokens (mean)Num Tokens (median)Num Tokens (min)Num Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)Total (max)Total (mean)Total (median)Total (min)Total (stddev)
130b6ea — 2025-12-05 21:33:1240.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)0.00 (n/a)4.71 (-0.42%)4.64 (-0.09%)4.64 (+0.65%)4.55 (-0.22%)0.05 (-17.66%)4.41 (-0.34%)4.39 (-0.19%)4.38 (-0.33%)4.37 (-0.15%)0.01 (-25.90%)12.96 (-0.00%)12.80 (+0.07%)12.80 (-0.23%)12.67 (+0.44%)0.09 (-21.12%)
0a6c11c — 2025-12-03 23:35:1540.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.73 (n/a)4.64 (n/a)4.61 (n/a)4.56 (n/a)0.06 (n/a)4.42 (n/a)4.40 (n/a)4.40 (n/a)4.37 (n/a)0.02 (n/a)12.96 (n/a)12.79 (n/a)12.83 (n/a)12.62 (n/a)0.12 (n/a)

llama_3.2_1b_prompt_13_tokens_1

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
c3a30ff — 2026-01-12 21:05:17n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)
331dcca — 2026-01-08 18:44:241.00 (n/a)1.00 (n/a)1.00 (n/a)1.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.66 (n/a)0.66 (n/a)0.66 (n/a)0.66 (n/a)0.00 (n/a)

llama_3.2_1b_prompt_13_tokens_40

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
c3a30ff — 2026-01-12 21:05:17n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)
331dcca — 2026-01-08 18:44:2440.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)5.04 (n/a)5.04 (n/a)5.04 (n/a)5.04 (n/a)0.00 (n/a)0.61 (n/a)0.61 (n/a)0.61 (n/a)0.61 (n/a)0.00 (n/a)

llama_3.2_1b_prompt_2048_tokens_1

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
c3a30ff — 2026-01-12 21:05:17n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)
331dcca — 2026-01-08 18:44:241.00 (n/a)1.00 (n/a)1.00 (n/a)1.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)2.65 (n/a)2.65 (n/a)2.65 (n/a)2.65 (n/a)0.00 (n/a)

llama_3.2_1b_prompt_2048_tokens_40

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
c3a30ff — 2026-01-12 21:05:17n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)n/a (n/a)
331dcca — 2026-01-08 18:44:2440.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.78 (n/a)4.78 (n/a)4.78 (n/a)4.78 (n/a)0.00 (n/a)2.67 (n/a)2.67 (n/a)2.67 (n/a)2.67 (n/a)0.00 (n/a)

@andrej andrej changed the title Fix and use AIE RoPE in llama Fix and use AIE RoPE in llama + some optimizations Jan 12, 2026
@andrej andrej changed the title Fix and use AIE RoPE in llama + some optimizations Fix and use AIE RoPE in llama + RoPE optimizations Jan 12, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Jan 12, 2026

📊 Test Results for Test Example Applications

e8ebd3f (2026_01_12_23_27_54)

IRONCLAD

Tested on 2026_01_12_23_27_54 at commit e8ebd3f.

Test Checks TTFT (mean)TPS (mean)
llama_3.2_1b_prompt_13_tokens_1 ✅ 1/1 0.61 0.00
llama_3.2_1b_prompt_13_tokens_40 ✅ 1/1 0.61 4.32
llama_3.2_1b_prompt_2048_tokens_1 ✅ 1/1 2.71 0.00
llama_3.2_1b_prompt_2048_tokens_40 ✅ 1/1 2.70 4.12
📈 Trends (vs main branch) for Test Example Applications

e8ebd3f (2026_01_12_23_27_54)

IRONCLAD Trends

llama_3.2_1b

Commit/Date Num Tokens (max)Num Tokens (mean)Num Tokens (median)Num Tokens (min)Num Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)Total (max)Total (mean)Total (median)Total (min)Total (stddev)
130b6ea — 2025-12-05 21:33:1240.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)0.00 (n/a)4.71 (-0.42%)4.64 (-0.09%)4.64 (+0.65%)4.55 (-0.22%)0.05 (-17.66%)4.41 (-0.34%)4.39 (-0.19%)4.38 (-0.33%)4.37 (-0.15%)0.01 (-25.90%)12.96 (-0.00%)12.80 (+0.07%)12.80 (-0.23%)12.67 (+0.44%)0.09 (-21.12%)
0a6c11c — 2025-12-03 23:35:1540.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.73 (n/a)4.64 (n/a)4.61 (n/a)4.56 (n/a)0.06 (n/a)4.42 (n/a)4.40 (n/a)4.40 (n/a)4.37 (n/a)0.02 (n/a)12.96 (n/a)12.79 (n/a)12.83 (n/a)12.62 (n/a)0.12 (n/a)

llama_3.2_1b_prompt_13_tokens_1

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
e8ebd3f — 2026-01-12 23:22:591.00 (+0.00%)1.00 (+0.00%)1.00 (+0.00%)1.00 (+0.00%)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.61 (+1.65%)0.61 (+1.65%)0.61 (+1.65%)0.61 (+1.65%)0.00 (n/a)
d48746f — 2026-01-12 22:27:121.00 (n/a)1.00 (n/a)1.00 (n/a)1.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.60 (n/a)0.60 (n/a)0.60 (n/a)0.60 (n/a)0.00 (n/a)

llama_3.2_1b_prompt_13_tokens_40

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
e8ebd3f — 2026-01-12 23:22:5940.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)0.00 (n/a)4.32 (-2.70%)4.32 (-2.70%)4.32 (-2.70%)4.32 (-2.70%)0.00 (n/a)0.61 (+0.86%)0.61 (+0.86%)0.61 (+0.86%)0.61 (+0.86%)0.00 (n/a)
d48746f — 2026-01-12 22:27:1240.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.44 (n/a)4.44 (n/a)4.44 (n/a)4.44 (n/a)0.00 (n/a)0.61 (n/a)0.61 (n/a)0.61 (n/a)0.61 (n/a)0.00 (n/a)

llama_3.2_1b_prompt_2048_tokens_1

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
e8ebd3f — 2026-01-12 23:22:591.00 (+0.00%)1.00 (+0.00%)1.00 (+0.00%)1.00 (+0.00%)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)2.71 (+1.82%)2.71 (+1.82%)2.71 (+1.82%)2.71 (+1.82%)0.00 (n/a)
d48746f — 2026-01-12 22:27:121.00 (n/a)1.00 (n/a)1.00 (n/a)1.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)2.66 (n/a)2.66 (n/a)2.66 (n/a)2.66 (n/a)0.00 (n/a)

llama_3.2_1b_prompt_2048_tokens_40

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
e8ebd3f — 2026-01-12 23:22:5940.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)0.00 (n/a)4.12 (-1.44%)4.12 (-1.44%)4.12 (-1.44%)4.12 (-1.44%)0.00 (n/a)2.70 (+0.15%)2.70 (+0.15%)2.70 (+0.15%)2.70 (+0.15%)0.00 (n/a)
d48746f — 2026-01-12 22:27:1240.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.18 (n/a)4.18 (n/a)4.18 (n/a)4.18 (n/a)0.00 (n/a)2.70 (n/a)2.70 (n/a)2.70 (n/a)2.70 (n/a)0.00 (n/a)

@github-actions
Copy link
Contributor

github-actions bot commented Jan 12, 2026

📊 Test Results for Small Benchmark/Test Suite

e8ebd3f (2026_01_12_23_32_13)

IRONCLAD

Tested on 2026_01_12_23_32_13 at commit e8ebd3f.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
📈 Trends (vs main branch) for Small Benchmark/Test Suite

e8ebd3f (2026_01_12_23_32_13)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.13 (-1.96%)0.11 (+2.52%)0.10 (+1.86%)0.08 (-1.91%)0.02 (-1.72%)162.40 (+1.95%)120.96 (-2.36%)117.00 (-1.85%)94.40 (+2.05%)23.11 (+4.09%)
0a6c11c — 2025-12-04 00:39:100.13 (n/a)0.10 (n/a)0.10 (n/a)0.08 (n/a)0.02 (n/a)159.30 (n/a)123.88 (n/a)119.20 (n/a)92.50 (n/a)22.21 (n/a)

axpy_1_cols_2_channels_2048_tile_2048_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.12 (+3.21%)0.09 (-4.58%)0.08 (-15.47%)0.07 (-5.33%)0.02 (+6.79%)176.90 (+5.61%)141.30 (+5.12%)146.50 (+18.34%)101.50 (-3.15%)27.74 (+4.41%)
331dcca — 2026-01-08 18:34:100.12 (n/a)0.09 (n/a)0.10 (n/a)0.07 (n/a)0.02 (n/a)167.50 (n/a)134.42 (n/a)123.80 (n/a)104.80 (n/a)26.57 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.11 (-26.77%)0.09 (-9.09%)0.09 (-10.81%)0.08 (+8.25%)0.01 (-55.42%)152.00 (-7.60%)135.46 (+6.28%)142.80 (+12.18%)115.00 (+36.58%)15.03 (-41.36%)
0a6c11c — 2025-12-04 00:39:100.15 (n/a)0.10 (n/a)0.10 (n/a)0.07 (n/a)0.02 (n/a)164.50 (n/a)127.46 (n/a)127.30 (n/a)84.20 (n/a)25.64 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.10 (-4.53%)0.08 (-10.59%)0.08 (-5.62%)0.07 (-22.65%)0.02 (+58.18%)187.80 (+29.25%)157.20 (+14.05%)151.60 (+5.94%)120.30 (+4.70%)28.63 (+122.11%)
331dcca — 2026-01-08 18:34:100.11 (n/a)0.09 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)145.30 (n/a)137.84 (n/a)143.10 (n/a)114.90 (n/a)12.89 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.12 (-10.21%)0.10 (-8.41%)0.10 (-6.20%)0.07 (+3.52%)0.02 (-23.48%)166.70 (-3.36%)128.78 (+7.33%)121.80 (+6.65%)103.90 (+11.36%)22.95 (-18.82%)
0a6c11c — 2025-12-04 00:39:100.13 (n/a)0.11 (n/a)0.11 (n/a)0.07 (n/a)0.02 (n/a)172.50 (n/a)119.98 (n/a)114.20 (n/a)93.30 (n/a)28.27 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.12 (+3.30%)0.09 (-5.12%)0.09 (-2.31%)0.07 (-2.93%)0.02 (+6.73%)188.30 (+3.01%)148.38 (+5.88%)142.40 (+2.37%)104.40 (-3.15%)31.90 (+6.52%)
331dcca — 2026-01-08 18:34:100.11 (n/a)0.09 (n/a)0.09 (n/a)0.07 (n/a)0.02 (n/a)182.80 (n/a)140.14 (n/a)139.10 (n/a)107.80 (n/a)29.95 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.10 (-16.19%)0.08 (-10.40%)0.09 (-2.09%)0.07 (-17.38%)0.01 (-10.61%)184.40 (+21.00%)153.18 (+11.99%)144.10 (+2.20%)127.10 (+19.34%)21.26 (+34.76%)
0a6c11c — 2025-12-04 00:39:100.12 (n/a)0.09 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)152.40 (n/a)136.78 (n/a)141.00 (n/a)106.50 (n/a)15.78 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.09 (-0.91%)0.08 (-6.82%)0.07 (-10.86%)0.06 (-12.78%)0.01 (+40.98%)191.40 (+14.68%)166.34 (+8.31%)174.40 (+12.15%)133.40 (+0.91%)23.16 (+61.30%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)166.90 (n/a)153.58 (n/a)155.50 (n/a)132.20 (n/a)14.36 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (-18.83%)0.04 (-5.21%)0.04 (-2.69%)0.03 (+37.10%)0.00 (-53.98%)160.40 (-27.06%)141.12 (-0.91%)136.40 (+2.79%)114.30 (+23.17%)17.37 (-59.06%)
0a6c11c — 2025-12-04 00:39:100.06 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)219.90 (n/a)142.42 (n/a)132.70 (n/a)92.80 (n/a)42.43 (n/a)

dequant_1_cols_1_channels_2048_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.05 (+15.05%)0.04 (+3.44%)0.04 (+0.19%)0.03 (-2.42%)0.01 (+69.69%)160.30 (+2.49%)138.62 (-1.94%)142.10 (-0.21%)103.30 (-13.05%)22.17 (+48.47%)
331dcca — 2026-01-08 18:34:100.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)156.40 (n/a)141.36 (n/a)142.40 (n/a)118.80 (n/a)14.93 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.06 (-13.28%)0.05 (-8.93%)0.06 (-13.59%)0.04 (+4.63%)0.01 (-39.10%)133.60 (-4.43%)106.08 (+5.85%)95.10 (+15.69%)87.90 (+15.35%)17.90 (-31.97%)
0a6c11c — 2025-12-04 00:39:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)139.80 (n/a)100.22 (n/a)82.20 (n/a)76.20 (n/a)26.31 (n/a)

dequant_1_cols_2_channels_2048_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.05 (+14.12%)0.04 (+13.64%)0.04 (+16.70%)0.03 (+3.05%)0.01 (+46.98%)153.40 (-2.97%)127.76 (-11.30%)129.10 (-14.33%)105.40 (-12.39%)19.20 (+24.62%)
331dcca — 2026-01-08 18:34:100.04 (n/a)0.04 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)158.10 (n/a)144.04 (n/a)150.70 (n/a)120.30 (n/a)15.41 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.07 (+5.66%)0.05 (+1.21%)0.05 (+0.61%)0.04 (-15.02%)0.01 (+58.42%)143.40 (+17.64%)101.02 (+1.49%)97.60 (-0.61%)78.90 (-5.40%)22.56 (+78.52%)
0a6c11c — 2025-12-04 00:39:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)121.90 (n/a)99.54 (n/a)98.20 (n/a)83.40 (n/a)12.64 (n/a)

dequant_2_cols_1_channels_2048_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.05 (+4.10%)0.04 (-8.25%)0.04 (-17.21%)0.03 (-1.16%)0.01 (+38.71%)151.40 (+1.14%)136.48 (+10.08%)146.80 (+20.72%)102.40 (-3.94%)20.92 (+32.32%)
331dcca — 2026-01-08 18:34:100.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)149.70 (n/a)123.98 (n/a)121.60 (n/a)106.60 (n/a)15.81 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (+17.06%)0.04 (+8.98%)0.05 (+21.37%)0.03 (-11.65%)0.01 (+301.89%)159.70 (+13.18%)126.32 (-5.68%)109.00 (-17.67%)106.80 (-14.56%)22.48 (+280.15%)
0a6c11c — 2025-12-04 00:39:100.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)141.10 (n/a)133.92 (n/a)132.40 (n/a)125.00 (n/a)5.91 (n/a)

dequant_2_cols_2_channels_2048_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.04 (-5.74%)0.04 (+1.86%)0.04 (-5.19%)0.03 (+54.09%)0.00 (-62.07%)150.20 (-35.12%)138.68 (-7.62%)145.10 (+5.53%)120.00 (+6.10%)12.68 (-73.88%)
331dcca — 2026-01-08 18:34:100.05 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)231.50 (n/a)150.12 (n/a)137.50 (n/a)113.10 (n/a)48.55 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.06 (+20.24%)0.05 (-3.19%)0.05 (-6.73%)0.03 (-20.69%)0.01 (+194.26%)156.10 (+26.09%)120.86 (+7.15%)114.90 (+7.18%)88.30 (-16.85%)24.40 (+214.82%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)123.80 (n/a)112.80 (n/a)107.20 (n/a)106.20 (n/a)7.75 (n/a)

dequant_4_cols_1_channels_2048_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.05 (-2.42%)0.04 (-12.09%)0.04 (-8.94%)0.02 (-37.15%)0.01 (+86.65%)220.90 (+59.15%)151.08 (+19.36%)146.80 (+9.80%)107.20 (+2.49%)43.30 (+213.42%)
331dcca — 2026-01-08 18:34:100.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)138.80 (n/a)126.58 (n/a)133.70 (n/a)104.60 (n/a)13.82 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (-6.09%)0.04 (-8.04%)0.04 (-12.46%)0.03 (-0.41%)0.01 (-20.19%)168.10 (+0.42%)135.74 (+7.44%)132.20 (+14.26%)107.40 (+6.44%)22.91 (-12.67%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.04 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)167.40 (n/a)126.34 (n/a)115.70 (n/a)100.90 (n/a)26.23 (n/a)

dequant_4_cols_2_channels_2048_tile_256_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+82.57%)0.05 (+23.95%)0.05 (+28.35%)0.03 (-25.35%)0.02 (+484.95%)200.60 (+33.91%)126.06 (-9.24%)112.20 (-22.08%)67.90 (-45.20%)48.89 (+325.22%)
331dcca — 2026-01-08 18:34:100.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)149.80 (n/a)138.90 (n/a)144.00 (n/a)123.90 (n/a)11.50 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.04 (-13.65%)0.04 (-13.67%)0.04 (-18.56%)0.03 (-13.52%)0.00 (-23.88%)170.40 (+15.68%)140.12 (+15.33%)135.80 (+22.78%)119.60 (+15.78%)17.94 (+1.87%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.04 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)147.30 (n/a)121.50 (n/a)110.60 (n/a)103.30 (n/a)17.61 (n/a)

dequant_8_cols_1_channels_2048_tile_256_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.04 (+7.77%)0.04 (+8.20%)0.03 (+5.59%)0.03 (+11.44%)0.00 (+22.27%)168.40 (-10.28%)147.76 (-7.38%)150.30 (-5.29%)127.70 (-7.19%)18.04 (-0.34%)
331dcca — 2026-01-08 18:34:100.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)187.70 (n/a)159.54 (n/a)158.70 (n/a)137.60 (n/a)18.10 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (+17.21%)0.03 (-1.70%)0.03 (-3.04%)0.03 (-16.20%)0.01 (+95.59%)198.20 (+19.33%)160.00 (+4.92%)166.20 (+3.17%)106.50 (-14.66%)29.86 (+87.19%)
0a6c11c — 2025-12-04 00:39:100.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)166.10 (n/a)152.50 (n/a)161.10 (n/a)124.80 (n/a)15.95 (n/a)

dequant_8_cols_2_channels_2048_tile_128_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.04 (-7.10%)0.03 (-2.51%)0.03 (+2.66%)0.03 (-6.76%)0.01 (-3.44%)194.50 (+7.28%)165.30 (+2.84%)161.40 (-2.60%)131.00 (+7.64%)27.99 (+15.34%)
331dcca — 2026-01-08 18:34:100.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)181.30 (n/a)160.74 (n/a)165.70 (n/a)121.70 (n/a)24.27 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.09 (-9.43%)0.08 (-4.26%)0.08 (-7.85%)0.07 (+0.25%)0.01 (-35.64%)171.10 (-0.23%)146.12 (+3.31%)146.40 (+8.52%)130.40 (+10.41%)16.12 (-29.40%)
331dcca — 2026-01-08 18:34:100.10 (n/a)0.09 (n/a)0.09 (n/a)0.07 (n/a)0.01 (n/a)171.50 (n/a)141.44 (n/a)134.90 (n/a)118.10 (n/a)22.84 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.10 (+0.54%)0.09 (+8.09%)0.09 (+1.61%)0.07 (+22.92%)0.01 (-43.36%)169.80 (-18.64%)141.58 (-10.04%)133.00 (-1.55%)128.90 (-0.54%)17.00 (-52.94%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.08 (n/a)0.09 (n/a)0.06 (n/a)0.02 (n/a)208.70 (n/a)157.38 (n/a)135.10 (n/a)129.60 (n/a)36.12 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.10 (+0.23%)0.08 (+1.46%)0.09 (+1.52%)0.06 (+0.02%)0.02 (+2.27%)198.60 (+0.00%)152.28 (-1.33%)142.70 (-1.52%)120.80 (-0.25%)32.63 (+1.16%)
331dcca — 2026-01-08 18:34:100.10 (n/a)0.08 (n/a)0.08 (n/a)0.06 (n/a)0.02 (n/a)198.60 (n/a)154.34 (n/a)144.90 (n/a)121.10 (n/a)32.26 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.10 (+6.43%)0.08 (-6.24%)0.07 (-9.56%)0.06 (-12.90%)0.01 (+81.57%)196.90 (+14.81%)165.32 (+8.12%)165.50 (+10.55%)128.60 (-6.06%)24.76 (+91.25%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)171.50 (n/a)152.90 (n/a)149.70 (n/a)136.90 (n/a)12.95 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.12 (+2.60%)0.10 (+9.75%)0.09 (+9.50%)0.08 (+11.01%)0.01 (-12.51%)148.20 (-9.91%)130.80 (-9.46%)134.50 (-8.69%)106.10 (-2.57%)16.74 (-20.82%)
331dcca — 2026-01-08 18:34:100.11 (n/a)0.09 (n/a)0.08 (n/a)0.07 (n/a)0.02 (n/a)164.50 (n/a)144.46 (n/a)147.30 (n/a)108.90 (n/a)21.14 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.09 (-10.47%)0.08 (-11.45%)0.08 (-16.13%)0.07 (-8.94%)0.01 (-19.00%)170.40 (+9.79%)148.74 (+12.63%)144.70 (+19.19%)129.80 (+11.70%)17.39 (-0.48%)
331dcca — 2026-01-08 18:34:100.11 (n/a)0.09 (n/a)0.10 (n/a)0.08 (n/a)0.01 (n/a)155.20 (n/a)132.06 (n/a)121.40 (n/a)116.20 (n/a)17.47 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.10 (-6.84%)0.09 (+4.31%)0.09 (+11.01%)0.08 (+22.28%)0.01 (-60.06%)150.80 (-18.22%)138.68 (-5.94%)135.40 (-9.97%)128.40 (+7.36%)8.76 (-64.76%)
331dcca — 2026-01-08 18:34:100.10 (n/a)0.09 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)184.40 (n/a)147.44 (n/a)150.40 (n/a)119.60 (n/a)24.85 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.10 (+14.73%)0.07 (+3.20%)0.07 (+0.69%)0.06 (-4.25%)0.01 (+49.08%)221.80 (+4.43%)171.56 (-1.63%)169.70 (-0.70%)127.20 (-12.82%)33.56 (+33.72%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)212.40 (n/a)174.40 (n/a)170.90 (n/a)145.90 (n/a)25.10 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-17.04%)0.06 (-1.22%)0.06 (+5.11%)0.05 (+8.75%)0.01 (-44.78%)168.40 (-8.08%)142.32 (-1.22%)139.80 (-4.90%)121.60 (+20.52%)18.73 (-37.02%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)183.20 (n/a)144.08 (n/a)147.00 (n/a)100.90 (n/a)29.74 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (+12.64%)0.06 (-4.05%)0.05 (-7.85%)0.05 (-3.53%)0.01 (+72.03%)164.20 (+3.66%)148.26 (+5.51%)153.00 (+8.51%)111.60 (-11.22%)21.05 (+55.17%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)158.40 (n/a)140.52 (n/a)141.00 (n/a)125.70 (n/a)13.56 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-3.56%)0.06 (+2.78%)0.07 (+9.88%)0.05 (-9.26%)0.01 (+8.56%)166.20 (+10.21%)129.98 (-2.21%)119.50 (-8.99%)112.30 (+3.69%)21.81 (+24.02%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)150.80 (n/a)132.92 (n/a)131.30 (n/a)108.30 (n/a)17.59 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.05 (-35.42%)0.05 (-17.75%)0.05 (-19.96%)0.05 (+20.42%)0.00 (-92.47%)162.70 (-16.95%)158.20 (+15.85%)158.40 (+24.92%)154.20 (+54.82%)3.35 (-90.67%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)195.90 (n/a)136.56 (n/a)126.80 (n/a)99.60 (n/a)35.93 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (-10.01%)0.06 (-19.65%)0.05 (-29.78%)0.05 (-9.74%)0.01 (-6.91%)163.60 (+10.84%)147.30 (+24.54%)155.10 (+42.42%)106.90 (+11.12%)22.89 (+9.99%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.07 (n/a)0.08 (n/a)0.06 (n/a)0.01 (n/a)147.60 (n/a)118.28 (n/a)108.90 (n/a)96.20 (n/a)20.81 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-4.81%)0.05 (-20.76%)0.04 (-26.74%)0.04 (-7.66%)0.01 (-3.90%)227.50 (+8.28%)186.90 (+26.30%)183.90 (+36.42%)128.30 (+4.99%)39.06 (+7.39%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)210.10 (n/a)147.98 (n/a)134.80 (n/a)122.20 (n/a)36.38 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-9.65%)0.06 (-6.64%)0.05 (-15.50%)0.05 (+31.65%)0.01 (-44.26%)163.60 (-24.01%)149.06 (+0.81%)161.10 (+18.37%)110.00 (+10.66%)22.86 (-52.99%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.02 (n/a)215.30 (n/a)147.86 (n/a)136.10 (n/a)99.40 (n/a)48.64 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (+13.72%)0.05 (-8.15%)0.05 (-16.43%)0.04 (-14.55%)0.01 (+90.24%)216.00 (+17.01%)175.58 (+11.15%)177.20 (+19.65%)128.10 (-12.08%)31.61 (+90.48%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)184.60 (n/a)157.96 (n/a)148.10 (n/a)145.70 (n/a)16.60 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
3a053d3 — 2025-11-26 01:12:163.72 (-0.11%)3.55 (-2.75%)3.56 (-2.75%)3.36 (-5.33%)0.12 (+76.10%)2725.23 (-0.11%)2602.52 (-2.75%)2612.11 (-2.75%)2459.89 (-5.33%)86.27 (+76.10%)6984.00 (+5.63%)6608.60 (+2.91%)6577.00 (+2.83%)6304.00 (+0.11%)221.87 (+87.15%)
9e98049 — 2025-11-25 20:50:553.72 (n/a)3.65 (n/a)3.66 (n/a)3.54 (n/a)0.07 (n/a)2728.26 (n/a)2676.06 (n/a)2686.03 (n/a)2598.29 (n/a)48.99 (n/a)6612.00 (n/a)6422.00 (n/a)6396.00 (n/a)6297.00 (n/a)118.55 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
3a053d3 — 2025-11-26 01:12:163.40 (-3.14%)3.38 (-0.82%)3.38 (-0.82%)3.35 (+4.93%)0.02 (-84.51%)2493.81 (-3.14%)2475.27 (-0.82%)2479.06 (-0.82%)2453.92 (+4.93%)13.33 (-84.51%)7001.00 (-4.70%)6940.80 (+0.71%)6930.00 (+0.83%)6889.00 (+3.24%)37.43 (-84.76%)
9e98049 — 2025-11-25 20:50:553.51 (n/a)3.40 (n/a)3.41 (n/a)3.19 (n/a)0.12 (n/a)2574.53 (n/a)2495.72 (n/a)2499.62 (n/a)2338.67 (n/a)86.02 (n/a)7346.00 (n/a)6892.20 (n/a)6873.00 (n/a)6673.00 (n/a)245.57 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
3a053d3 — 2025-11-26 01:12:163.02 (+0.52%)2.87 (-2.05%)2.86 (-2.24%)2.70 (-6.16%)0.11 (+131.66%)2216.19 (+0.52%)2104.44 (-2.05%)2094.08 (-2.24%)1980.84 (-6.16%)80.25 (+131.67%)8673.00 (+6.56%)8175.60 (+2.21%)8204.00 (+2.29%)7752.00 (-0.51%)314.03 (+145.36%)
9e98049 — 2025-11-25 20:50:553.01 (n/a)2.93 (n/a)2.92 (n/a)2.88 (n/a)0.05 (n/a)2204.81 (n/a)2148.41 (n/a)2142.13 (n/a)2110.81 (n/a)34.64 (n/a)8139.00 (n/a)7998.60 (n/a)8020.00 (n/a)7792.00 (n/a)127.99 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:491.04 (+0.94%)1.03 (+0.23%)1.03 (+0.09%)1.02 (+0.07%)0.00 (+197.51%)24576.00 (-0.07%)24485.82 (-0.23%)24530.40 (-0.09%)24266.40 (-0.94%)111.26 (+194.35%)
0a6c11c — 2025-12-04 00:39:101.03 (n/a)1.03 (n/a)1.03 (n/a)1.02 (n/a)0.00 (n/a)24594.30 (n/a)24542.14 (n/a)24551.90 (n/a)24495.50 (n/a)37.80 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
a4b6ffe — 2026-01-05 19:24:051.04 (+0.28%)1.03 (-0.15%)1.03 (+0.05%)1.02 (-0.52%)0.01 (+42.72%)24719.80 (+0.52%)24512.42 (+0.16%)24529.20 (-0.05%)24092.60 (-0.28%)252.92 (+43.15%)713.08 (+0.28%)700.92 (-0.15%)700.38 (+0.05%)694.98 (-0.52%)7.30 (+42.71%)
50ad37c — 2025-12-29 20:35:531.04 (n/a)1.03 (n/a)1.03 (n/a)1.02 (n/a)0.01 (n/a)24592.30 (n/a)24473.70 (n/a)24540.90 (n/a)24160.80 (n/a)176.68 (n/a)711.06 (n/a)702.00 (n/a)700.05 (n/a)698.59 (n/a)5.12 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.99 (+1.69%)0.97 (+0.29%)0.97 (-0.04%)0.97 (-0.15%)0.01 (+434.92%)26025.30 (+0.15%)25839.34 (-0.29%)25916.70 (+0.04%)25446.00 (-1.67%)202.05 (+425.44%)
0a6c11c — 2025-12-04 00:39:100.97 (n/a)0.97 (n/a)0.97 (n/a)0.97 (n/a)0.00 (n/a)25986.90 (n/a)25913.52 (n/a)25905.70 (n/a)25877.00 (n/a)38.45 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
a4b6ffe — 2026-01-05 19:24:050.97 (-0.01%)0.97 (+0.03%)0.97 (+0.04%)0.97 (+0.00%)0.00 (-6.43%)25927.90 (-0.00%)25903.20 (-0.03%)25898.60 (-0.04%)25892.80 (+0.01%)14.05 (-6.56%)663.50 (-0.01%)663.23 (+0.03%)663.35 (+0.04%)662.60 (+0.00%)0.36 (-6.43%)
50ad37c — 2025-12-29 20:35:530.97 (n/a)0.97 (n/a)0.97 (n/a)0.97 (n/a)0.00 (n/a)25928.10 (n/a)25910.14 (n/a)25908.10 (n/a)25891.20 (n/a)15.04 (n/a)663.54 (n/a)663.06 (n/a)663.11 (n/a)662.60 (n/a)0.38 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.92 (-1.02%)0.92 (-0.66%)0.92 (-0.10%)0.91 (-0.78%)0.01 (-4.54%)27751.40 (+0.79%)27480.74 (+0.66%)27354.80 (+0.10%)27320.50 (+1.03%)182.69 (-2.84%)
0a6c11c — 2025-12-04 00:39:100.93 (n/a)0.92 (n/a)0.92 (n/a)0.91 (n/a)0.01 (n/a)27534.80 (n/a)27299.32 (n/a)27326.70 (n/a)27042.30 (n/a)188.04 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
a4b6ffe — 2026-01-05 19:24:050.92 (+0.11%)0.91 (-0.12%)0.91 (-0.21%)0.91 (-0.24%)0.00 (+30.34%)27723.50 (+0.24%)27548.94 (+0.12%)27522.90 (+0.21%)27403.60 (-0.11%)124.26 (+30.58%)626.92 (+0.11%)623.62 (-0.12%)624.20 (-0.21%)619.69 (-0.24%)2.81 (+30.34%)
50ad37c — 2025-12-29 20:35:530.92 (n/a)0.91 (n/a)0.92 (n/a)0.91 (n/a)0.00 (n/a)27657.10 (n/a)27515.58 (n/a)27464.70 (n/a)27434.60 (n/a)95.16 (n/a)626.21 (n/a)624.37 (n/a)625.52 (n/a)621.17 (n/a)2.16 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
31ab24e — 2025-11-22 02:01:563.65 (-1.06%)3.59 (+0.83%)3.63 (-0.26%)3.45 (+2.66%)0.07 (-44.71%)2678.08 (-1.06%)2632.13 (+0.83%)2658.60 (-0.26%)2528.31 (+2.66%)53.86 (-44.71%)6795.00 (-2.59%)6529.80 (-0.92%)6462.00 (+0.26%)6415.00 (+1.07%)137.14 (-45.27%)
d9a64c5 — 2025-11-21 20:49:353.69 (n/a)3.56 (n/a)3.64 (n/a)3.36 (n/a)0.13 (n/a)2706.77 (n/a)2610.50 (n/a)2665.61 (n/a)2462.71 (n/a)97.41 (n/a)6976.00 (n/a)6590.40 (n/a)6445.00 (n/a)6347.00 (n/a)250.58 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:103.98 (+0.20%)3.84 (-2.95%)3.76 (-5.27%)3.72 (-4.97%)0.13 (+473.97%)6760.00 (+5.23%)6559.50 (+3.13%)6697.10 (+5.56%)6321.00 (-0.20%)218.68 (+499.40%)2717.91 (+0.20%)2621.44 (-2.95%)2565.27 (-5.27%)2541.40 (-4.97%)88.37 (+473.97%)
331dcca — 2026-01-08 18:34:103.97 (n/a)3.96 (n/a)3.97 (n/a)3.92 (n/a)0.02 (n/a)6423.80 (n/a)6360.32 (n/a)6344.30 (n/a)6333.90 (n/a)36.48 (n/a)2712.39 (n/a)2701.17 (n/a)2707.91 (n/a)2674.40 (n/a)15.40 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:103.75 (+0.28%)3.70 (+1.25%)3.71 (-0.21%)3.65 (+4.77%)0.04 (-66.90%)6901.80 (-4.56%)6795.46 (-1.30%)6790.20 (+0.21%)6715.90 (-0.28%)67.05 (-68.40%)2558.08 (+0.28%)2528.33 (+1.25%)2530.10 (-0.21%)2489.18 (+4.77%)24.81 (-66.90%)
331dcca — 2026-01-08 18:34:103.74 (n/a)3.66 (n/a)3.71 (n/a)3.48 (n/a)0.11 (n/a)7231.20 (n/a)6885.18 (n/a)6775.70 (n/a)6734.90 (n/a)212.21 (n/a)2550.87 (n/a)2497.04 (n/a)2535.50 (n/a)2375.78 (n/a)74.96 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:103.62 (-0.77%)3.54 (+0.14%)3.60 (-0.04%)3.44 (+2.17%)0.09 (-25.77%)7307.40 (-2.13%)7103.46 (-0.18%)6982.50 (+0.04%)6948.20 (+0.77%)182.95 (-26.55%)2472.55 (-0.77%)2419.80 (+0.14%)2460.41 (-0.04%)2351.04 (+2.17%)61.76 (-25.77%)
331dcca — 2026-01-08 18:34:103.65 (n/a)3.54 (n/a)3.61 (n/a)3.37 (n/a)0.12 (n/a)7466.20 (n/a)7116.40 (n/a)6979.60 (n/a)6895.10 (n/a)249.09 (n/a)2491.61 (n/a)2416.45 (n/a)2461.45 (n/a)2301.00 (n/a)83.20 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+9.62%)0.06 (-13.65%)0.05 (-17.92%)0.04 (-28.83%)0.01 (+273.26%)189.10 (+40.49%)148.86 (+19.86%)150.30 (+21.80%)108.20 (-8.77%)30.91 (+374.29%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.00 (n/a)134.60 (n/a)124.20 (n/a)123.40 (n/a)118.60 (n/a)6.52 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.09 (+43.57%)0.07 (+17.83%)0.06 (+4.14%)0.05 (+1.02%)0.02 (+136.16%)166.90 (-1.01%)130.24 (-12.19%)136.90 (-4.00%)87.20 (-30.35%)29.74 (+53.81%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)168.60 (n/a)148.32 (n/a)142.60 (n/a)125.20 (n/a)19.34 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (-1.54%)0.06 (+2.49%)0.06 (-0.57%)0.05 (+6.18%)0.01 (-22.10%)157.20 (-5.81%)130.48 (-3.58%)127.20 (+0.55%)106.90 (+1.62%)18.43 (-26.59%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)166.90 (n/a)135.32 (n/a)126.50 (n/a)105.20 (n/a)25.11 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+11.47%)0.06 (-8.23%)0.06 (-12.73%)0.05 (-17.69%)0.01 (+127.45%)160.90 (+21.53%)135.78 (+11.19%)138.40 (+14.57%)101.50 (-10.26%)22.29 (+142.34%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)132.40 (n/a)122.12 (n/a)120.80 (n/a)113.10 (n/a)9.20 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+19.11%)0.06 (-8.09%)0.06 (-14.67%)0.04 (-26.67%)0.02 (+139.40%)205.60 (+36.43%)147.86 (+14.25%)141.10 (+17.19%)99.90 (-16.05%)39.80 (+179.04%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)150.70 (n/a)129.42 (n/a)120.40 (n/a)119.00 (n/a)14.26 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-18.37%)0.05 (-8.32%)0.05 (-2.69%)0.05 (-4.63%)0.01 (-41.74%)173.90 (+4.89%)157.02 (+7.75%)158.80 (+2.78%)132.40 (+22.48%)17.43 (-21.76%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)165.80 (n/a)145.72 (n/a)154.50 (n/a)108.10 (n/a)22.27 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (+21.62%)0.06 (+20.04%)0.06 (+2.48%)0.06 (+64.18%)0.01 (-22.89%)148.80 (-39.09%)135.96 (-19.07%)147.00 (-2.46%)115.80 (-17.76%)16.27 (-62.29%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)244.30 (n/a)168.00 (n/a)150.70 (n/a)140.80 (n/a)43.15 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (+19.50%)0.05 (+3.29%)0.05 (+1.25%)0.03 (-7.84%)0.01 (+62.83%)241.90 (+8.52%)178.70 (-0.96%)175.10 (-1.24%)130.20 (-16.32%)40.47 (+49.90%)
331dcca — 2026-01-08 18:34:100.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)222.90 (n/a)180.44 (n/a)177.30 (n/a)155.60 (n/a)27.00 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:490.37 (+17.13%)0.30 (+24.87%)0.30 (+38.03%)0.23 (+12.47%)0.06 (+35.23%)
0a6c11c — 2025-12-04 00:39:100.32 (n/a)0.24 (n/a)0.22 (n/a)0.20 (n/a)0.04 (n/a)

matrix_vector_mul_128x128_32_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:100.26 (-1.81%)0.24 (+4.06%)0.24 (+0.52%)0.21 (+16.97%)0.02 (-48.16%)0.26 (-1.81%)0.24 (+4.06%)0.24 (+0.52%)0.20 (+16.97%)0.02 (-48.16%)
a4b6ffe — 2026-01-05 19:24:050.26 (n/a)0.23 (n/a)0.24 (n/a)0.18 (n/a)0.04 (n/a)0.26 (n/a)0.23 (n/a)0.24 (n/a)0.17 (n/a)0.04 (n/a)

matrix_vector_mul_128x128_32tsi_128tso_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:100.26 (n/a)0.23 (n/a)0.22 (n/a)0.20 (n/a)0.02 (n/a)0.25 (n/a)0.22 (n/a)0.21 (n/a)0.20 (n/a)0.02 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4913.57 (+3.47%)13.15 (+1.09%)13.10 (+0.16%)12.52 (-1.58%)0.37 (+153.19%)
0a6c11c — 2025-12-04 00:39:1013.11 (n/a)13.01 (n/a)13.07 (n/a)12.72 (n/a)0.15 (n/a)

matrix_vector_mul_2048x8192_1_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1013.43 (-0.07%)13.30 (+4.62%)13.27 (+1.29%)13.16 (+16.70%)0.12 (-86.69%)13.42 (-0.07%)13.29 (+4.62%)13.26 (+1.29%)13.16 (+16.70%)0.12 (-86.69%)
a4b6ffe — 2026-01-05 19:24:0513.44 (n/a)12.71 (n/a)13.10 (n/a)11.28 (n/a)0.87 (n/a)13.43 (n/a)12.70 (n/a)13.09 (n/a)11.27 (n/a)0.87 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4925.06 (+2.47%)23.71 (+1.81%)24.13 (+0.50%)20.90 (+5.41%)1.48 (-15.60%)
0a6c11c — 2025-12-04 00:39:1024.46 (n/a)23.29 (n/a)24.01 (n/a)19.83 (n/a)1.75 (n/a)

matrix_vector_mul_2048x8192_1_2col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1024.46 (-0.60%)21.07 (-8.03%)19.75 (-17.83%)18.08 (+1.18%)3.03 (+7.07%)24.44 (-0.60%)21.06 (-8.03%)19.74 (-17.83%)18.07 (+1.18%)3.03 (+7.07%)
a4b6ffe — 2026-01-05 19:24:0524.60 (n/a)22.91 (n/a)24.04 (n/a)17.87 (n/a)2.83 (n/a)24.59 (n/a)22.90 (n/a)24.02 (n/a)17.86 (n/a)2.83 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4942.05 (+1.54%)40.50 (+12.60%)40.49 (+2.36%)38.98 (+97.53%)0.97 (-88.09%)
0a6c11c — 2025-12-04 00:39:1041.41 (n/a)35.97 (n/a)39.55 (n/a)19.73 (n/a)8.15 (n/a)

matrix_vector_mul_2048x8192_1_4col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1042.58 (+1.51%)41.37 (+14.29%)41.25 (+4.89%)40.33 (+91.42%)0.92 (-89.18%)42.56 (+1.51%)41.34 (+14.29%)41.23 (+4.89%)40.30 (+91.42%)0.92 (-89.18%)
a4b6ffe — 2026-01-05 19:24:0541.95 (n/a)36.20 (n/a)39.33 (n/a)21.07 (n/a)8.54 (n/a)41.92 (n/a)36.17 (n/a)39.31 (n/a)21.05 (n/a)8.53 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4946.62 (+3.11%)44.82 (+0.17%)44.78 (+0.17%)42.60 (-3.80%)1.60 (+367.72%)
0a6c11c — 2025-12-04 00:39:1045.21 (n/a)44.75 (n/a)44.70 (n/a)44.29 (n/a)0.34 (n/a)

matrix_vector_mul_2048x8192_1_8col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1046.04 (+4.14%)45.06 (+3.47%)44.55 (+2.76%)44.30 (+2.84%)0.87 (+66.58%)46.01 (+4.14%)45.03 (+3.47%)44.52 (+2.76%)44.27 (+2.84%)0.87 (+66.58%)
a4b6ffe — 2026-01-05 19:24:0544.21 (n/a)43.55 (n/a)43.35 (n/a)43.07 (n/a)0.52 (n/a)44.18 (n/a)43.52 (n/a)43.32 (n/a)43.05 (n/a)0.52 (n/a)

matrix_vector_mul_2048x8192_1tsi_1024tso_2col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:1025.56 (n/a)23.69 (n/a)24.66 (n/a)18.95 (n/a)2.68 (n/a)25.55 (n/a)23.68 (n/a)24.65 (n/a)18.94 (n/a)2.68 (n/a)

matrix_vector_mul_2048x8192_1tsi_2048tso_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:1013.52 (n/a)13.28 (n/a)13.37 (n/a)12.69 (n/a)0.34 (n/a)13.51 (n/a)13.27 (n/a)13.36 (n/a)12.68 (n/a)0.34 (n/a)

matrix_vector_mul_2048x8192_1tsi_256tso_8col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:1045.93 (n/a)44.26 (n/a)45.01 (n/a)40.46 (n/a)2.18 (n/a)45.90 (n/a)44.23 (n/a)44.99 (n/a)40.43 (n/a)2.18 (n/a)

matrix_vector_mul_2048x8192_1tsi_512tso_4col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:1041.06 (n/a)37.05 (n/a)40.36 (n/a)22.60 (n/a)8.08 (n/a)41.04 (n/a)37.02 (n/a)40.33 (n/a)22.59 (n/a)8.08 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4913.29 (+1.63%)13.19 (+6.08%)13.19 (+1.17%)13.09 (+26.86%)0.08 (-92.94%)
0a6c11c — 2025-12-04 00:39:1013.08 (n/a)12.44 (n/a)13.03 (n/a)10.32 (n/a)1.07 (n/a)

matrix_vector_mul_8192x2048_4_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1013.68 (+3.42%)13.30 (+8.54%)13.38 (+7.25%)12.72 (+14.96%)0.35 (-66.09%)13.67 (+3.42%)13.29 (+8.54%)13.38 (+7.25%)12.71 (+14.96%)0.35 (-66.09%)
a4b6ffe — 2026-01-05 19:24:0513.23 (n/a)12.25 (n/a)12.48 (n/a)11.07 (n/a)1.04 (n/a)13.22 (n/a)12.24 (n/a)12.47 (n/a)11.06 (n/a)1.04 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4925.58 (+4.24%)24.23 (+6.59%)24.03 (+0.29%)23.58 (+37.29%)0.70 (-74.97%)
0a6c11c — 2025-12-04 00:39:1024.54 (n/a)22.73 (n/a)23.96 (n/a)17.18 (n/a)2.79 (n/a)

matrix_vector_mul_8192x2048_4_2col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1025.08 (+1.32%)24.68 (+13.42%)24.61 (+3.26%)24.47 (+48.32%)0.24 (-93.56%)25.07 (+1.32%)24.67 (+13.42%)24.59 (+3.26%)24.46 (+48.32%)0.24 (-93.56%)
a4b6ffe — 2026-01-05 19:24:0524.76 (n/a)21.76 (n/a)23.83 (n/a)16.50 (n/a)3.74 (n/a)24.74 (n/a)21.75 (n/a)23.82 (n/a)16.49 (n/a)3.73 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4940.94 (-2.19%)39.74 (-1.10%)39.76 (-0.60%)38.17 (-2.14%)1.04 (+4.39%)
0a6c11c — 2025-12-04 00:39:1041.86 (n/a)40.18 (n/a)40.00 (n/a)39.00 (n/a)1.00 (n/a)

matrix_vector_mul_8192x2048_4_4col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1040.74 (-1.09%)37.16 (-7.15%)40.25 (+1.47%)24.51 (-37.44%)7.07 (+736.13%)40.72 (-1.09%)37.13 (-7.15%)40.23 (+1.47%)24.50 (-37.44%)7.07 (+736.13%)
a4b6ffe — 2026-01-05 19:24:0541.19 (n/a)40.02 (n/a)39.67 (n/a)39.18 (n/a)0.85 (n/a)41.17 (n/a)39.99 (n/a)39.64 (n/a)39.16 (n/a)0.85 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4946.71 (-1.04%)44.91 (-2.34%)44.71 (-2.98%)43.80 (-1.44%)0.96 (+6.93%)
0a6c11c — 2025-12-04 00:39:1047.20 (n/a)45.98 (n/a)46.08 (n/a)44.44 (n/a)0.90 (n/a)

matrix_vector_mul_8192x2048_4_8col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1046.28 (+5.68%)44.89 (+14.59%)44.74 (+4.26%)44.20 (+62.80%)0.84 (-87.96%)46.25 (+5.68%)44.86 (+14.59%)44.71 (+4.26%)44.17 (+62.80%)0.84 (-87.96%)
a4b6ffe — 2026-01-05 19:24:0543.79 (n/a)39.17 (n/a)42.91 (n/a)27.15 (n/a)6.98 (n/a)43.77 (n/a)39.15 (n/a)42.88 (n/a)27.13 (n/a)6.98 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:1013.49 (n/a)13.08 (n/a)12.88 (n/a)12.76 (n/a)0.36 (n/a)13.48 (n/a)13.07 (n/a)12.88 (n/a)12.76 (n/a)0.36 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_2col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:1024.99 (n/a)24.61 (n/a)24.67 (n/a)24.13 (n/a)0.35 (n/a)24.98 (n/a)24.59 (n/a)24.66 (n/a)24.12 (n/a)0.35 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_4col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:1040.68 (n/a)39.94 (n/a)40.38 (n/a)38.75 (n/a)0.80 (n/a)40.65 (n/a)39.92 (n/a)40.36 (n/a)38.73 (n/a)0.80 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_8col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d48746f — 2026-01-12 22:17:1047.39 (n/a)40.91 (n/a)44.87 (n/a)21.41 (n/a)10.96 (n/a)47.36 (n/a)40.89 (n/a)44.84 (n/a)21.39 (n/a)10.96 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.07 (+22.03%)0.06 (+27.86%)0.06 (+35.49%)0.05 (+15.00%)0.01 (+49.69%)173.30 (-13.00%)137.94 (-21.32%)133.60 (-26.19%)123.40 (-18.06%)18.40 (+8.53%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)199.20 (n/a)175.32 (n/a)181.00 (n/a)150.60 (n/a)16.96 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-1.08%)0.05 (+7.16%)0.05 (+13.32%)0.04 (+6.58%)0.01 (-16.82%)194.90 (-6.16%)172.24 (-7.30%)171.90 (-11.76%)140.80 (+1.08%)22.13 (-18.09%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)207.70 (n/a)185.80 (n/a)194.80 (n/a)139.30 (n/a)27.01 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-16.99%)0.05 (-12.47%)0.05 (-7.32%)0.04 (-11.17%)0.00 (-29.61%)197.00 (+12.57%)171.00 (+13.70%)164.00 (+7.89%)153.00 (+20.47%)17.49 (-4.32%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)175.00 (n/a)150.40 (n/a)152.00 (n/a)127.00 (n/a)18.28 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+5.56%)0.05 (-1.59%)0.05 (-1.39%)0.03 (-14.07%)0.01 (+25.03%)263.00 (+16.37%)166.00 (+4.53%)144.00 (+1.41%)126.00 (-5.26%)49.38 (+43.17%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)226.00 (n/a)158.80 (n/a)142.00 (n/a)133.00 (n/a)34.49 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.08 (+10.93%)0.07 (+7.79%)0.07 (+3.55%)0.05 (-1.73%)0.01 (+36.73%)150.20 (+1.76%)121.68 (-6.36%)125.60 (-3.38%)97.90 (-9.85%)18.56 (+21.98%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.01 (n/a)147.60 (n/a)129.94 (n/a)130.00 (n/a)108.60 (n/a)15.21 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.09 (+34.06%)0.07 (+10.45%)0.07 (+18.21%)0.04 (-27.78%)0.02 (+264.90%)204.20 (+38.44%)133.96 (-3.33%)123.20 (-15.38%)94.00 (-25.40%)43.07 (+286.52%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.00 (n/a)147.50 (n/a)138.58 (n/a)145.60 (n/a)126.00 (n/a)11.14 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-15.32%)0.05 (-17.09%)0.05 (-23.81%)0.04 (-15.54%)0.01 (-18.18%)193.00 (+18.40%)160.80 (+20.36%)168.00 (+31.25%)124.00 (+18.10%)22.92 (+11.39%)
0999a9a — 2025-11-13 19:24:080.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)163.00 (n/a)133.60 (n/a)128.00 (n/a)105.00 (n/a)20.58 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-23.02%)0.05 (-6.98%)0.05 (-2.13%)0.04 (-15.31%)0.01 (-33.29%)196.00 (+18.07%)147.00 (+6.52%)141.00 (+2.17%)126.00 (+29.90%)25.27 (+8.13%)
0999a9a — 2025-11-13 19:24:080.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)166.00 (n/a)138.00 (n/a)138.00 (n/a)97.00 (n/a)23.37 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.10 (+31.37%)0.08 (+29.12%)0.08 (+29.06%)0.07 (+41.80%)0.01 (+0.23%)109.90 (-29.46%)98.30 (-23.38%)100.80 (-22.52%)79.40 (-23.87%)10.54 (-46.17%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.07 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)155.80 (n/a)128.30 (n/a)130.10 (n/a)104.30 (n/a)19.58 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+9.16%)0.07 (+16.32%)0.06 (+15.81%)0.06 (+19.95%)0.01 (-19.29%)140.50 (-16.67%)125.22 (-14.79%)127.30 (-13.64%)105.50 (-8.42%)12.60 (-38.85%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)168.60 (n/a)146.96 (n/a)147.40 (n/a)115.20 (n/a)20.60 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.10 (+25.02%)0.07 (+10.01%)0.07 (+7.53%)0.05 (-1.99%)0.01 (+77.08%)150.10 (+2.04%)114.60 (-7.22%)111.70 (-6.99%)83.90 (-20.02%)21.23 (+43.54%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)147.10 (n/a)123.52 (n/a)120.10 (n/a)104.90 (n/a)14.79 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (+9.30%)0.06 (+0.34%)0.05 (-14.99%)0.05 (+1.76%)0.01 (+41.67%)160.40 (-1.72%)140.22 (+0.57%)151.20 (+17.67%)115.70 (-8.54%)21.73 (+27.50%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)163.20 (n/a)139.42 (n/a)128.50 (n/a)126.50 (n/a)17.04 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.07 (+11.97%)0.05 (+3.09%)0.05 (+2.10%)0.03 (-11.35%)0.01 (+41.65%)229.00 (+12.81%)156.00 (-0.51%)143.00 (-2.05%)117.00 (-10.69%)38.21 (+48.71%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)203.00 (n/a)156.80 (n/a)146.00 (n/a)131.00 (n/a)25.69 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+9.02%)0.05 (+5.59%)0.05 (+0.00%)0.04 (+3.63%)0.01 (+25.48%)193.00 (-3.50%)147.40 (-4.66%)147.00 (+0.00%)122.00 (-8.27%)25.24 (+7.48%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)154.60 (n/a)147.00 (n/a)133.00 (n/a)23.48 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.09 (-3.98%)0.07 (+4.00%)0.07 (+7.04%)0.06 (+3.67%)0.01 (-15.76%)129.70 (-3.57%)113.30 (-4.50%)116.90 (-6.55%)90.40 (+4.15%)15.04 (-13.80%)
0a6c11c — 2025-12-04 00:39:100.09 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)134.50 (n/a)118.64 (n/a)125.10 (n/a)86.80 (n/a)17.45 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (-3.98%)0.06 (+8.28%)0.06 (+19.80%)0.05 (+22.45%)0.01 (-38.63%)158.50 (-18.34%)133.36 (-10.47%)132.90 (-16.57%)107.60 (+4.16%)18.11 (-47.50%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)194.10 (n/a)148.96 (n/a)159.30 (n/a)103.30 (n/a)34.50 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.08 (+9.57%)0.07 (+16.85%)0.07 (+19.58%)0.06 (+24.52%)0.01 (+1.05%)134.50 (-19.70%)116.64 (-14.92%)116.80 (-16.39%)98.00 (-8.75%)15.71 (-25.13%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)167.50 (n/a)137.10 (n/a)139.70 (n/a)107.40 (n/a)20.99 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-21.05%)0.05 (-18.52%)0.05 (-6.65%)0.04 (-24.12%)0.01 (-12.44%)188.00 (+31.84%)161.92 (+23.06%)149.70 (+7.16%)145.00 (+26.64%)19.72 (+45.10%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.01 (n/a)142.60 (n/a)131.58 (n/a)139.70 (n/a)114.50 (n/a)13.59 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-13.48%)0.05 (-17.79%)0.05 (-15.33%)0.03 (-25.09%)0.01 (+6.67%)267.00 (+33.50%)176.80 (+24.51%)150.00 (+18.11%)141.00 (+15.57%)47.41 (+61.41%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)142.00 (n/a)127.00 (n/a)122.00 (n/a)29.37 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (+13.38%)0.05 (+23.85%)0.05 (+37.91%)0.05 (+30.72%)0.00 (-56.85%)166.00 (-23.50%)153.40 (-20.60%)153.00 (-27.49%)142.00 (-11.80%)7.63 (-70.60%)
0999a9a — 2025-11-13 19:24:080.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)217.00 (n/a)193.20 (n/a)211.00 (n/a)161.00 (n/a)25.96 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.09 (+16.31%)0.08 (+15.34%)0.08 (+14.60%)0.07 (+19.30%)0.01 (-5.41%)117.30 (-16.15%)107.80 (-13.61%)108.50 (-12.78%)94.10 (-13.99%)8.29 (-32.01%)
0a6c11c — 2025-12-04 00:39:100.07 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)139.90 (n/a)124.78 (n/a)124.40 (n/a)109.40 (n/a)12.20 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (+24.33%)0.05 (+1.22%)0.05 (-15.17%)0.04 (+15.91%)0.01 (+35.34%)194.90 (-13.72%)161.40 (-0.63%)171.70 (+17.93%)109.70 (-19.57%)32.06 (-12.37%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)225.90 (n/a)162.42 (n/a)145.60 (n/a)136.40 (n/a)36.59 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.09 (+12.61%)0.07 (-2.24%)0.07 (-8.85%)0.06 (+5.13%)0.01 (+35.50%)136.50 (-4.88%)120.86 (+2.96%)125.10 (+9.64%)91.60 (-11.15%)15.72 (+10.46%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)143.50 (n/a)117.38 (n/a)114.10 (n/a)103.10 (n/a)14.23 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-2.94%)0.05 (-9.05%)0.05 (-14.72%)0.04 (-21.38%)0.01 (+31.76%)228.10 (+27.22%)162.26 (+13.50%)151.90 (+17.21%)119.40 (+3.02%)45.62 (+67.44%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)179.30 (n/a)142.96 (n/a)129.60 (n/a)115.90 (n/a)27.25 (n/a)

mha

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.18 (+0.16%)0.18 (+0.19%)0.18 (+0.12%)0.18 (+0.32%)0.00 (-52.24%)47253.90 (-0.32%)47213.70 (-0.19%)47210.90 (-0.12%)47167.70 (-0.16%)28.71 (-52.47%)
0a6c11c — 2025-12-04 00:39:100.18 (n/a)0.18 (n/a)0.18 (n/a)0.18 (n/a)0.00 (n/a)47405.00 (n/a)47301.72 (n/a)47265.90 (n/a)47241.80 (n/a)60.40 (n/a)

mha0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.18 (+0.21%)0.18 (+0.19%)0.18 (+0.21%)0.18 (+0.18%)0.00 (+1.85%)47533.00 (-0.18%)47377.04 (-0.19%)47360.70 (-0.21%)47268.30 (-0.21%)101.19 (+1.44%)
331dcca — 2026-01-08 18:34:100.18 (n/a)0.18 (n/a)0.18 (n/a)0.18 (n/a)0.00 (n/a)47620.40 (n/a)47465.20 (n/a)47460.90 (n/a)47368.00 (n/a)99.76 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (+0.41%)0.06 (+7.20%)0.06 (+7.38%)0.05 (+13.86%)0.01 (-36.34%)160.30 (-12.16%)135.72 (-8.31%)132.30 (-6.90%)118.50 (-0.34%)15.42 (-43.73%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)182.50 (n/a)148.02 (n/a)142.10 (n/a)118.90 (n/a)27.41 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+27.95%)0.06 (+12.11%)0.06 (+0.43%)0.05 (+12.05%)0.01 (+61.44%)161.40 (-10.78%)135.48 (-9.97%)141.50 (-0.42%)106.60 (-21.79%)21.13 (+11.79%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)180.90 (n/a)150.48 (n/a)142.10 (n/a)136.30 (n/a)18.90 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-24.14%)0.06 (-10.18%)0.06 (-6.85%)0.05 (+5.86%)0.00 (-62.28%)155.60 (-5.58%)139.24 (+8.58%)137.20 (+7.36%)125.00 (+31.86%)11.80 (-52.51%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.07 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)164.80 (n/a)128.24 (n/a)127.80 (n/a)94.80 (n/a)24.84 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.05 (-20.19%)0.04 (-27.62%)0.05 (-25.15%)0.04 (-34.13%)0.01 (+88.89%)220.30 (+51.83%)187.42 (+40.22%)178.60 (+33.58%)155.50 (+25.30%)27.55 (+264.47%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.00 (n/a)145.10 (n/a)133.66 (n/a)133.70 (n/a)124.10 (n/a)7.56 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+5.60%)0.06 (-9.20%)0.06 (-16.15%)0.05 (-17.82%)0.01 (+134.98%)163.40 (+21.67%)136.40 (+13.20%)144.40 (+19.24%)101.50 (-5.32%)26.42 (+171.90%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)134.30 (n/a)120.50 (n/a)121.10 (n/a)107.20 (n/a)9.72 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.10 (+30.83%)0.07 (+16.06%)0.07 (+25.97%)0.04 (-12.18%)0.02 (+58.73%)211.70 (+13.88%)134.68 (-9.80%)124.00 (-20.61%)85.50 (-23.59%)47.01 (+44.94%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)185.90 (n/a)149.32 (n/a)156.20 (n/a)111.90 (n/a)32.44 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+22.75%)0.07 (+23.34%)0.07 (+40.30%)0.05 (+5.93%)0.01 (+44.33%)154.20 (-5.57%)119.48 (-18.27%)110.70 (-28.67%)101.80 (-18.56%)20.60 (+14.93%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)163.30 (n/a)146.18 (n/a)155.20 (n/a)125.00 (n/a)17.93 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (-8.76%)0.06 (-1.77%)0.06 (+15.62%)0.04 (-18.66%)0.01 (-9.08%)213.60 (+22.90%)148.46 (+2.41%)136.80 (-13.53%)108.10 (+9.52%)39.28 (+28.50%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)173.80 (n/a)144.96 (n/a)158.20 (n/a)98.70 (n/a)30.57 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+6.17%)0.06 (+4.73%)0.06 (+4.27%)0.05 (+0.25%)0.01 (+7.82%)161.20 (-0.25%)133.08 (-4.38%)135.10 (-4.05%)104.00 (-5.80%)20.46 (-0.34%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)161.60 (n/a)139.18 (n/a)140.80 (n/a)110.40 (n/a)20.53 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-24.49%)0.05 (-12.86%)0.05 (+0.50%)0.04 (-20.02%)0.01 (-36.82%)222.10 (+25.06%)174.46 (+13.46%)166.20 (-0.48%)142.70 (+32.37%)30.87 (+6.24%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)177.60 (n/a)153.76 (n/a)167.00 (n/a)107.80 (n/a)29.05 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.05 (-22.11%)0.05 (+8.44%)0.05 (+38.99%)0.04 (+32.73%)0.00 (-76.37%)186.10 (-24.69%)163.14 (-15.59%)161.50 (-28.03%)150.30 (+28.35%)13.73 (-77.28%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.05 (n/a)0.04 (n/a)0.03 (n/a)0.02 (n/a)247.10 (n/a)193.28 (n/a)224.40 (n/a)117.10 (n/a)60.43 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-10.12%)0.05 (-9.15%)0.05 (-10.01%)0.05 (-3.43%)0.00 (-39.40%)177.80 (+3.55%)156.76 (+9.12%)157.40 (+11.16%)138.80 (+11.22%)14.34 (-28.51%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)171.70 (n/a)143.66 (n/a)141.60 (n/a)124.80 (n/a)20.06 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.24 (+9.29%)0.18 (-5.22%)0.17 (-11.78%)0.15 (-4.24%)0.04 (+16.93%)162.40 (+4.44%)138.80 (+6.05%)142.50 (+13.28%)101.70 (-8.46%)22.79 (+8.38%)
331dcca — 2026-01-08 18:34:100.22 (n/a)0.19 (n/a)0.20 (n/a)0.16 (n/a)0.03 (n/a)155.50 (n/a)130.88 (n/a)125.80 (n/a)111.10 (n/a)21.03 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.21 (-12.74%)0.19 (+0.44%)0.18 (+5.26%)0.15 (-2.94%)0.02 (-26.35%)159.20 (+3.04%)134.58 (-1.13%)134.10 (-4.96%)116.60 (+14.54%)17.86 (-10.90%)
331dcca — 2026-01-08 18:34:100.24 (n/a)0.18 (n/a)0.17 (n/a)0.16 (n/a)0.03 (n/a)154.50 (n/a)136.12 (n/a)141.10 (n/a)101.80 (n/a)20.05 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.19 (-1.73%)0.16 (-7.34%)0.16 (-4.69%)0.14 (-7.87%)0.02 (+3.75%)170.30 (+8.54%)154.16 (+8.05%)156.40 (+4.90%)130.90 (+1.71%)14.69 (+14.75%)
331dcca — 2026-01-08 18:34:100.19 (n/a)0.17 (n/a)0.16 (n/a)0.16 (n/a)0.02 (n/a)156.90 (n/a)142.68 (n/a)149.10 (n/a)128.70 (n/a)12.80 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.17 (-25.86%)0.14 (-23.46%)0.16 (-13.16%)0.10 (-31.09%)0.03 (+9.33%)244.30 (+45.07%)182.30 (+34.32%)152.70 (+15.16%)144.60 (+34.89%)46.98 (+111.07%)
331dcca — 2026-01-08 18:34:100.23 (n/a)0.18 (n/a)0.19 (n/a)0.15 (n/a)0.03 (n/a)168.40 (n/a)135.72 (n/a)132.60 (n/a)107.20 (n/a)22.26 (n/a)

sigmoid_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-21.28%)0.06 (-15.05%)0.05 (-19.84%)0.05 (-5.56%)0.01 (-36.63%)177.30 (+5.85%)150.26 (+15.85%)159.00 (+24.80%)118.20 (+26.96%)22.83 (-14.44%)
331dcca — 2026-01-08 18:34:100.09 (n/a)0.07 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)167.50 (n/a)129.70 (n/a)127.40 (n/a)93.10 (n/a)26.68 (n/a)

sigmoid_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-0.90%)0.06 (-6.53%)0.05 (-13.02%)0.05 (-10.21%)0.01 (+68.36%)167.60 (+11.36%)141.84 (+8.86%)149.00 (+14.97%)114.20 (+0.88%)24.85 (+85.27%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)150.50 (n/a)130.30 (n/a)129.60 (n/a)113.20 (n/a)13.41 (n/a)

sigmoid_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+0.73%)0.06 (+8.57%)0.06 (+12.12%)0.05 (+24.80%)0.01 (-17.63%)167.70 (-19.84%)139.70 (-9.91%)140.00 (-10.83%)108.40 (-0.64%)26.15 (-32.94%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)209.20 (n/a)155.06 (n/a)157.00 (n/a)109.10 (n/a)39.00 (n/a)

sigmoid_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-11.87%)0.05 (-12.09%)0.06 (+4.62%)0.03 (-18.85%)0.01 (+33.02%)238.00 (+23.25%)179.18 (+18.30%)144.00 (-4.38%)135.50 (+13.48%)52.75 (+90.28%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)193.10 (n/a)151.46 (n/a)150.60 (n/a)119.40 (n/a)27.72 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (+1.10%)0.06 (+4.23%)0.06 (+6.03%)0.05 (+17.79%)0.01 (-33.43%)164.50 (-15.12%)143.80 (-5.18%)138.50 (-5.72%)128.90 (-1.15%)13.53 (-45.17%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)193.80 (n/a)151.66 (n/a)146.90 (n/a)130.40 (n/a)24.67 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-11.27%)0.05 (-0.85%)0.05 (-1.28%)0.05 (+5.94%)0.00 (-52.46%)170.70 (-5.59%)154.84 (-0.26%)151.70 (+1.27%)143.20 (+12.67%)10.51 (-49.10%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)180.80 (n/a)155.24 (n/a)149.80 (n/a)127.10 (n/a)20.65 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (+10.68%)0.06 (-4.64%)0.06 (-4.47%)0.04 (-27.09%)0.01 (+177.34%)206.10 (+37.22%)150.40 (+8.88%)142.90 (+4.69%)114.20 (-9.65%)35.99 (+245.25%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)150.20 (n/a)138.14 (n/a)136.50 (n/a)126.40 (n/a)10.43 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-5.57%)0.05 (-6.31%)0.05 (-8.15%)0.04 (-7.96%)0.01 (-6.43%)186.30 (+8.63%)158.42 (+6.67%)158.20 (+8.88%)120.60 (+5.88%)24.09 (+4.22%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)171.50 (n/a)148.52 (n/a)145.30 (n/a)113.90 (n/a)23.12 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.16 (+11.75%)0.12 (-6.55%)0.12 (-14.12%)0.08 (-27.05%)0.03 (+91.28%)211.70 (+37.11%)141.58 (+12.04%)135.70 (+16.38%)101.30 (-10.51%)41.91 (+144.30%)
331dcca — 2026-01-08 18:34:100.14 (n/a)0.13 (n/a)0.14 (n/a)0.11 (n/a)0.02 (n/a)154.40 (n/a)126.36 (n/a)116.60 (n/a)113.20 (n/a)17.16 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.15 (+2.45%)0.11 (-7.82%)0.10 (-13.36%)0.09 (+2.04%)0.02 (-5.21%)190.20 (-2.01%)156.06 (+7.97%)160.70 (+15.45%)113.00 (-2.42%)30.29 (-7.57%)
331dcca — 2026-01-08 18:34:100.14 (n/a)0.12 (n/a)0.12 (n/a)0.08 (n/a)0.02 (n/a)194.10 (n/a)144.54 (n/a)139.20 (n/a)115.80 (n/a)32.77 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.15 (-13.80%)0.11 (-16.46%)0.12 (-8.26%)0.08 (-20.57%)0.03 (-0.89%)199.70 (+25.91%)155.62 (+21.77%)138.60 (+9.05%)112.40 (+16.00%)39.58 (+51.55%)
331dcca — 2026-01-08 18:34:100.17 (n/a)0.13 (n/a)0.13 (n/a)0.10 (n/a)0.03 (n/a)158.60 (n/a)127.80 (n/a)127.10 (n/a)96.90 (n/a)26.12 (n/a)

swiglu

No metrics available.

swiglu_decode_1x2048x2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.00 (-15.46%)0.00 (-27.20%)0.00 (-28.17%)0.00 (-33.90%)0.00 (+1834.83%)5187.20 (+51.28%)4720.84 (+38.38%)4750.90 (+39.22%)4015.10 (+18.29%)390.23 (+3298.45%)
0a6c11c — 2025-12-04 00:39:100.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)3428.80 (n/a)3411.62 (n/a)3412.60 (n/a)3394.20 (n/a)11.48 (n/a)

swiglu_decode_1x2048x2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.00 (-1.01%)0.00 (+13.91%)0.00 (+28.00%)0.00 (+12.56%)0.00 (+1.34%)4683.00 (-11.16%)3903.40 (-12.34%)3440.50 (-21.87%)3430.50 (+1.02%)644.34 (-8.78%)
331dcca — 2026-01-08 18:34:100.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)5271.20 (n/a)4452.98 (n/a)4403.80 (n/a)3395.80 (n/a)706.35 (n/a)

tanh_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.08 (+4.70%)0.06 (-10.03%)0.06 (-7.37%)0.05 (-19.39%)0.01 (+79.68%)175.20 (+23.99%)137.24 (+14.02%)130.30 (+7.95%)101.70 (-4.51%)28.47 (+112.90%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)141.30 (n/a)120.36 (n/a)120.70 (n/a)106.50 (n/a)13.37 (n/a)

tanh_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-1.16%)0.05 (-4.58%)0.06 (-2.78%)0.05 (-9.07%)0.00 (+44.69%)170.10 (+10.03%)151.56 (+5.16%)148.50 (+2.84%)135.90 (+1.19%)12.82 (+62.19%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)154.60 (n/a)144.12 (n/a)144.40 (n/a)134.30 (n/a)7.91 (n/a)

tanh_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-2.86%)0.06 (+0.67%)0.05 (+2.32%)0.05 (-7.37%)0.01 (+13.55%)173.30 (+7.98%)147.84 (-0.23%)151.30 (-2.26%)125.70 (+2.95%)19.59 (+25.82%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)160.50 (n/a)148.18 (n/a)154.80 (n/a)122.10 (n/a)15.57 (n/a)

tanh_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-12.08%)0.06 (+4.23%)0.06 (+8.35%)0.05 (+30.60%)0.00 (-69.24%)155.70 (-23.41%)142.16 (-7.82%)141.80 (-7.74%)132.80 (+13.70%)9.83 (-72.84%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)203.30 (n/a)154.22 (n/a)153.70 (n/a)116.80 (n/a)36.19 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:493.93 (-7.02%)3.68 (+2.48%)3.66 (+1.82%)3.45 (+15.62%)0.15 (-63.64%)151.80 (-13.50%)142.70 (-3.59%)143.40 (-1.78%)133.50 (+7.49%)5.90 (-66.22%)
0a6c11c — 2025-12-04 00:39:104.22 (n/a)3.59 (n/a)3.59 (n/a)2.99 (n/a)0.42 (n/a)175.50 (n/a)148.02 (n/a)146.00 (n/a)124.20 (n/a)17.46 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:103.66 (+18.71%)3.24 (+14.94%)3.47 (+19.20%)2.70 (+9.06%)0.45 (+77.88%)194.40 (-8.30%)164.40 (-12.16%)150.90 (-16.12%)143.20 (-15.76%)23.89 (+37.47%)
331dcca — 2026-01-08 18:34:103.08 (n/a)2.82 (n/a)2.91 (n/a)2.47 (n/a)0.25 (n/a)212.00 (n/a)187.16 (n/a)179.90 (n/a)170.00 (n/a)17.38 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:495.11 (+15.57%)3.85 (-3.32%)3.40 (-18.64%)3.29 (+7.09%)0.71 (+49.14%)159.60 (-6.61%)140.18 (+4.80%)154.20 (+22.97%)102.60 (-13.49%)22.70 (+19.77%)
0a6c11c — 2025-12-04 00:39:104.42 (n/a)3.99 (n/a)4.18 (n/a)3.07 (n/a)0.48 (n/a)170.90 (n/a)133.76 (n/a)125.40 (n/a)118.60 (n/a)18.95 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:103.78 (+9.63%)3.58 (+17.02%)3.66 (+20.11%)3.21 (+21.29%)0.22 (-29.86%)163.60 (-17.54%)146.84 (-15.02%)143.20 (-16.74%)138.70 (-8.81%)9.80 (-46.42%)
331dcca — 2026-01-08 18:34:103.45 (n/a)3.06 (n/a)3.05 (n/a)2.64 (n/a)0.32 (n/a)198.40 (n/a)172.80 (n/a)172.00 (n/a)152.10 (n/a)18.28 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-9.97%)0.06 (+2.53%)0.06 (+11.63%)0.04 (-7.91%)0.01 (-15.14%)183.00 (+8.54%)143.48 (-2.80%)135.50 (-10.44%)124.20 (+11.09%)24.14 (+1.38%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)168.60 (n/a)147.62 (n/a)151.30 (n/a)111.80 (n/a)23.81 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.06 (-17.02%)0.06 (-6.66%)0.06 (-9.61%)0.05 (+6.80%)0.00 (-60.26%)158.10 (-6.39%)144.76 (+4.17%)146.70 (+10.63%)127.30 (+20.55%)12.22 (-57.04%)
331dcca — 2026-01-08 18:34:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)168.90 (n/a)138.96 (n/a)132.60 (n/a)105.60 (n/a)28.44 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (+20.32%)0.06 (+14.49%)0.06 (+15.18%)0.03 (-2.37%)0.02 (+42.32%)237.60 (+2.41%)150.44 (-9.87%)140.70 (-13.15%)111.10 (-16.84%)50.92 (+26.50%)
331dcca — 2026-01-08 18:34:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)232.00 (n/a)166.92 (n/a)162.00 (n/a)133.60 (n/a)40.26 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.07 (-4.47%)0.06 (-6.14%)0.06 (-6.53%)0.04 (-11.15%)0.01 (-11.38%)206.50 (+12.60%)154.10 (+6.23%)144.80 (+7.02%)117.10 (+4.74%)32.96 (+4.73%)
331dcca — 2026-01-08 18:34:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)183.40 (n/a)145.06 (n/a)135.30 (n/a)111.80 (n/a)31.47 (n/a)

@github-actions
Copy link
Contributor

github-actions bot commented Jan 13, 2026

📊 Test Results for Test Example Applications

8a880b4 (2026_01_13_00_00_09)

IRONCLAD

Tested on 2026_01_13_00_00_09 at commit 8a880b4.

Test Checks TTFT (mean)TPS (mean)
llama_3.2_1b_prompt_13_tokens_1 ✅ 1/1 0.60 0.00
llama_3.2_1b_prompt_13_tokens_40 ✅ 1/1 0.61 4.31
llama_3.2_1b_prompt_2048_tokens_1 ✅ 1/1 2.72 0.00
llama_3.2_1b_prompt_2048_tokens_40 ✅ 1/1 2.71 4.10
📈 Trends (vs main branch) for Test Example Applications

8a880b4 (2026_01_13_00_00_09)

IRONCLAD Trends

llama_3.2_1b

Commit/Date Num Tokens (max)Num Tokens (mean)Num Tokens (median)Num Tokens (min)Num Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)Total (max)Total (mean)Total (median)Total (min)Total (stddev)
130b6ea — 2025-12-05 21:33:1240.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)0.00 (n/a)4.71 (-0.42%)4.64 (-0.09%)4.64 (+0.65%)4.55 (-0.22%)0.05 (-17.66%)4.41 (-0.34%)4.39 (-0.19%)4.38 (-0.33%)4.37 (-0.15%)0.01 (-25.90%)12.96 (-0.00%)12.80 (+0.07%)12.80 (-0.23%)12.67 (+0.44%)0.09 (-21.12%)
0a6c11c — 2025-12-03 23:35:1540.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.73 (n/a)4.64 (n/a)4.61 (n/a)4.56 (n/a)0.06 (n/a)4.42 (n/a)4.40 (n/a)4.40 (n/a)4.37 (n/a)0.02 (n/a)12.96 (n/a)12.79 (n/a)12.83 (n/a)12.62 (n/a)0.12 (n/a)

llama_3.2_1b_prompt_13_tokens_1

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
8a880b4 — 2026-01-12 23:55:141.00 (+0.00%)1.00 (+0.00%)1.00 (+0.00%)1.00 (+0.00%)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.60 (-0.76%)0.60 (-0.76%)0.60 (-0.76%)0.60 (-0.76%)0.00 (n/a)
d48746f — 2026-01-12 22:27:121.00 (n/a)1.00 (n/a)1.00 (n/a)1.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.60 (n/a)0.60 (n/a)0.60 (n/a)0.60 (n/a)0.00 (n/a)

llama_3.2_1b_prompt_13_tokens_40

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
8a880b4 — 2026-01-12 23:55:1440.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)0.00 (n/a)4.31 (-2.93%)4.31 (-2.93%)4.31 (-2.93%)4.31 (-2.93%)0.00 (n/a)0.61 (+0.68%)0.61 (+0.68%)0.61 (+0.68%)0.61 (+0.68%)0.00 (n/a)
d48746f — 2026-01-12 22:27:1240.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.44 (n/a)4.44 (n/a)4.44 (n/a)4.44 (n/a)0.00 (n/a)0.61 (n/a)0.61 (n/a)0.61 (n/a)0.61 (n/a)0.00 (n/a)

llama_3.2_1b_prompt_2048_tokens_1

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
8a880b4 — 2026-01-12 23:55:141.00 (+0.00%)1.00 (+0.00%)1.00 (+0.00%)1.00 (+0.00%)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)2.72 (+2.05%)2.72 (+2.05%)2.72 (+2.05%)2.72 (+2.05%)0.00 (n/a)
d48746f — 2026-01-12 22:27:121.00 (n/a)1.00 (n/a)1.00 (n/a)1.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)2.66 (n/a)2.66 (n/a)2.66 (n/a)2.66 (n/a)0.00 (n/a)

llama_3.2_1b_prompt_2048_tokens_40

Commit/Date Num_Tokens (max)Num_Tokens (mean)Num_Tokens (median)Num_Tokens (min)Num_Tokens (stddev)TPS (max)TPS (mean)TPS (median)TPS (min)TPS (stddev)TTFT (max)TTFT (mean)TTFT (median)TTFT (min)TTFT (stddev)
8a880b4 — 2026-01-12 23:55:1440.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)40.00 (+0.00%)0.00 (n/a)4.10 (-1.91%)4.10 (-1.91%)4.10 (-1.91%)4.10 (-1.91%)0.00 (n/a)2.71 (+0.59%)2.71 (+0.59%)2.71 (+0.59%)2.71 (+0.59%)0.00 (n/a)
d48746f — 2026-01-12 22:27:1240.00 (n/a)40.00 (n/a)40.00 (n/a)40.00 (n/a)0.00 (n/a)4.18 (n/a)4.18 (n/a)4.18 (n/a)4.18 (n/a)0.00 (n/a)2.70 (n/a)2.70 (n/a)2.70 (n/a)2.70 (n/a)0.00 (n/a)

@github-actions
Copy link
Contributor

github-actions bot commented Jan 13, 2026

📊 Test Results for Small Benchmark/Test Suite

8a880b4 (2026_01_13_00_09_38)

IRONCLAD

Tested on 2026_01_13_00_09_38 at commit 8a880b4.

Test Checks Latency (mean)Bandwidth (mean)GFLOP/s (mean)
axpy_1_cols_2_channels_2048_tile_2048_3.0_0 ✅ 5/5 134.94 0.09 n/a
axpy_2_cols_2_channels_2048_tile_1024_3.0_0 ✅ 5/5 138.64 0.09 n/a
axpy_4_cols_2_channels_2048_tile_512_3.0_0 ✅ 5/5 143.88 0.09 n/a
axpy_8_cols_2_channels_2048_tile_256_3.0_0 ✅ 5/5 156.66 0.08 n/a
dequant_1_cols_1_channels_2048_tile_2048_0 ✅ 5/5 154.72 0.04 n/a
dequant_1_cols_2_channels_2048_tile_1024_0 ✅ 5/5 131.18 0.04 n/a
dequant_2_cols_1_channels_2048_tile_1024_0 ✅ 5/5 127.00 0.04 n/a
dequant_2_cols_2_channels_2048_tile_512_0 ✅ 5/5 130.32 0.04 n/a
dequant_4_cols_1_channels_2048_tile_512_0 ✅ 5/5 125.86 0.04 n/a
dequant_4_cols_2_channels_2048_tile_256_0 ✅ 5/5 129.84 0.04 n/a
dequant_8_cols_1_channels_2048_tile_256_0 ✅ 5/5 137.30 0.04 n/a
dequant_8_cols_2_channels_2048_tile_128_0 ✅ 5/5 152.94 0.04 n/a
eltwise_add_1_cols_2_channels_2048_tile_2048 ✅ 5/5 151.98 0.08 n/a
eltwise_add_2_cols_2_channels_2048_tile_1024 ✅ 5/5 150.10 0.08 n/a
eltwise_add_4_cols_2_channels_2048_tile_512 ✅ 5/5 150.20 0.08 n/a
eltwise_add_8_cols_2_channels_2048_tile_256 ✅ 5/5 142.90 0.09 n/a
eltwise_mul_1_cols_2_channels_2048_tile_2048 ✅ 5/5 147.62 0.08 n/a
eltwise_mul_2_cols_2_channels_2048_tile_1024 ✅ 5/5 171.86 0.08 n/a
eltwise_mul_4_cols_2_channels_2048_tile_512 ✅ 5/5 148.64 0.08 n/a
eltwise_mul_8_cols_2_channels_2048_tile_256 ✅ 5/5 178.60 0.07 n/a
gelu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 137.50 0.06 n/a
gelu_1_cols_2_channels_2048_tile_1024 ✅ 5/5 132.54 0.06 n/a
gelu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 131.58 0.06 n/a
gelu_2_cols_2_channels_2048_tile_512 ✅ 5/5 145.06 0.06 n/a
gelu_4_cols_1_channels_2048_tile_512 ✅ 5/5 132.48 0.06 n/a
gelu_4_cols_2_channels_2048_tile_256 ✅ 5/5 139.32 0.06 n/a
gelu_8_cols_1_channels_2048_tile_256 ✅ 5/5 163.12 0.05 n/a
gelu_8_cols_2_channels_2048_tile_128 ✅ 5/5 173.50 0.05 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0_0 ✅ 5/5 6607.10 3.81 n/a
gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_1_ccolmaj_0_0 ✅ 5/5 6999.38 3.60 n/a
gemm_2048x2048x2048_64x64x64_8_cols_1_bcolmaj_0_ccolmaj_0_0 ✅ 5/5 6959.46 3.62 n/a
layer_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 139.04 0.06 n/a
layer_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 138.28 0.06 n/a
layer_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 131.50 0.06 n/a
layer_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 148.24 0.06 n/a
layer_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 139.46 0.06 n/a
layer_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 146.10 0.06 n/a
layer_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 160.98 0.05 n/a
layer_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 193.38 0.04 n/a
matrix_vector_mul_128x128_32tsi_128tso_1col0 ✅ 5/5 n/a 0.25 n/a
matrix_vector_mul_2048x8192_1tsi_1024tso_2col0 ✅ 5/5 n/a 24.99 n/a
matrix_vector_mul_2048x8192_1tsi_2048tso_1col0 ✅ 5/5 n/a 13.21 n/a
matrix_vector_mul_2048x8192_1tsi_256tso_8col0 ✅ 5/5 n/a 45.50 n/a
matrix_vector_mul_2048x8192_1tsi_512tso_4col0 ✅ 5/5 n/a 36.98 n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_1col0 ✅ 5/5 n/a 12.87 n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_2col0 ✅ 5/5 n/a 23.73 n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_4col0 ✅ 5/5 n/a 39.82 n/a
matrix_vector_mul_8192x2048_4tsi_1024tso_8col0 ✅ 5/5 n/a 46.13 n/a
mem_copy_16_cores_2_chans_2048_tile_128_False0 ✅ 5/5 181.84 0.05 n/a
mem_copy_1_cores_1_chans_2048_tile_2048_False0 ✅ 5/5 144.26 0.06 n/a
mem_copy_2_cores_1_chans_2048_tile_1024_False0 ✅ 5/5 154.30 0.05 n/a
mem_copy_2_cores_2_chans_2048_tile_1024_False0 ✅ 5/5 161.80 0.05 n/a
mem_copy_4_cores_1_chans_2048_tile_512_False0 ✅ 5/5 188.34 0.05 n/a
mem_copy_4_cores_2_chans_2048_tile_512_False0 ✅ 5/5 169.78 0.05 n/a
mem_copy_8_cores_1_chans_2048_tile_256_False0 ✅ 5/5 136.28 0.06 n/a
mem_copy_8_cores_2_chans_2048_tile_256_False0 ✅ 5/5 159.58 0.05 n/a
mha0 ✅ 5/5 47402.08 0.18 n/a
relu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 136.52 0.06 n/a
relu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 146.62 0.06 n/a
relu_4_cols_1_channels_2048_tile_512 ✅ 5/5 137.52 0.06 n/a
relu_8_cols_1_channels_2048_tile_256 ✅ 5/5 157.16 0.05 n/a
rms_norm_1_cols_1_channels_2048_tile_2048 ✅ 5/5 140.88 0.06 n/a
rms_norm_1_cols_2_channels_2048_tile_1024 ✅ 5/5 145.20 0.06 n/a
rms_norm_2_cols_1_channels_2048_tile_1024 ✅ 5/5 130.66 0.06 n/a
rms_norm_2_cols_2_channels_2048_tile_512 ✅ 5/5 160.36 0.05 n/a
rms_norm_4_cols_1_channels_2048_tile_512 ✅ 5/5 165.80 0.05 n/a
rms_norm_4_cols_2_channels_2048_tile_256 ✅ 5/5 139.70 0.06 n/a
rms_norm_8_cols_1_channels_2048_tile_256 ✅ 5/5 174.84 0.05 n/a
rms_norm_8_cols_2_channels_2048_tile_128 ✅ 5/5 157.86 0.05 n/a
rope_1c_32rows_512cols_32arows_0m ✅ 5/5 153.28 0.66 n/a
rope_1c_32rows_512cols_8arows_0m ✅ 5/5 138.66 0.54 n/a
rope_2c_32rows_512cols_32arows_0m ✅ 5/5 158.74 0.64 n/a
rope_2c_32rows_512cols_8arows_0m ✅ 5/5 158.64 0.47 n/a
rope_8c_32rows_512cols_32arows_0m ✅ 5/5 172.44 0.58 n/a
rope_8c_32rows_512cols_8arows_0m ✅ 5/5 160.54 0.47 n/a
sigmoid_1_cols_1_channels_2048_tile_2048 ✅ 5/5 139.18 0.06 n/a
sigmoid_2_cols_1_channels_2048_tile_1024 ✅ 5/5 157.56 0.05 n/a
sigmoid_4_cols_1_channels_2048_tile_512 ✅ 5/5 144.86 0.06 n/a
sigmoid_8_cols_1_channels_2048_tile_256 ✅ 5/5 169.14 0.05 n/a
silu_1_cols_1_channels_2048_tile_2048 ✅ 5/5 153.94 0.05 n/a
silu_2_cols_1_channels_2048_tile_1024 ✅ 5/5 138.68 0.06 n/a
silu_4_cols_1_channels_2048_tile_512 ✅ 5/5 125.96 0.07 n/a
silu_8_cols_1_channels_2048_tile_256 ✅ 5/5 159.32 0.05 n/a
softmax_1_cols_2_channels_4096_tile_2048 ✅ 5/5 150.14 0.11 n/a
softmax_2_cols_2_channels_4096_tile_1024 ✅ 5/5 147.34 0.11 n/a
softmax_2_cols_2_channels_4096_tile_512 ✅ 5/5 137.08 0.12 n/a
swiglu_decode_1x2048x2048_0 ✅ 5/5 4025.90 0.00 n/a
tanh_1_cols_1_channels_2048_tile_2048 ✅ 5/5 136.88 0.06 n/a
tanh_2_cols_1_channels_2048_tile_1024 ✅ 5/5 158.16 0.05 n/a
tanh_4_cols_1_channels_2048_tile_512 ✅ 5/5 163.94 0.05 n/a
tanh_8_cols_1_channels_2048_tile_256 ✅ 5/5 136.08 0.06 n/a
transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0 ✅ 5/5 182.40 2.88 n/a
transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0 ✅ 5/5 163.16 3.28 n/a
weighted_rms_norm_1_cols_2_channels_2048_weights_2048 ✅ 5/5 148.30 0.06 n/a
weighted_rms_norm_2_cols_2_channels_2048_weights_1024 ✅ 5/5 152.32 0.06 n/a
weighted_rms_norm_4_cols_2_channels_2048_weights_512 ✅ 5/5 147.74 0.06 n/a
weighted_rms_norm_8_cols_2_channels_2048_weights_256 ✅ 5/5 181.62 0.05 n/a
📈 Trends (vs main branch) for Small Benchmark/Test Suite

8a880b4 (2026_01_13_00_09_38)

IRONCLAD Trends

axpy_1_cols_2_channels_2048_tile_2048_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.13 (-1.96%)0.11 (+2.52%)0.10 (+1.86%)0.08 (-1.91%)0.02 (-1.72%)162.40 (+1.95%)120.96 (-2.36%)117.00 (-1.85%)94.40 (+2.05%)23.11 (+4.09%)
0a6c11c — 2025-12-04 00:39:100.13 (n/a)0.10 (n/a)0.10 (n/a)0.08 (n/a)0.02 (n/a)159.30 (n/a)123.88 (n/a)119.20 (n/a)92.50 (n/a)22.21 (n/a)

axpy_1_cols_2_channels_2048_tile_2048_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.11 (-5.38%)0.09 (+2.56%)0.09 (+4.61%)0.08 (+18.74%)0.01 (-34.60%)149.00 (-15.77%)134.94 (-4.50%)140.00 (-4.44%)107.30 (+5.71%)16.05 (-42.16%)
d48746f — 2026-01-12 22:17:100.12 (n/a)0.09 (n/a)0.08 (n/a)0.07 (n/a)0.02 (n/a)176.90 (n/a)141.30 (n/a)146.50 (n/a)101.50 (n/a)27.74 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.11 (-26.77%)0.09 (-9.09%)0.09 (-10.81%)0.08 (+8.25%)0.01 (-55.42%)152.00 (-7.60%)135.46 (+6.28%)142.80 (+12.18%)115.00 (+36.58%)15.03 (-41.36%)
0a6c11c — 2025-12-04 00:39:100.15 (n/a)0.10 (n/a)0.10 (n/a)0.07 (n/a)0.02 (n/a)164.50 (n/a)127.46 (n/a)127.30 (n/a)84.20 (n/a)25.64 (n/a)

axpy_2_cols_2_channels_2048_tile_1024_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.10 (-2.90%)0.09 (+10.66%)0.09 (+7.96%)0.08 (+29.43%)0.01 (-61.13%)145.10 (-22.74%)138.64 (-11.81%)140.40 (-7.39%)123.90 (+2.99%)8.56 (-70.10%)
d48746f — 2026-01-12 22:17:100.10 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.02 (n/a)187.80 (n/a)157.20 (n/a)151.60 (n/a)120.30 (n/a)28.63 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.12 (-10.21%)0.10 (-8.41%)0.10 (-6.20%)0.07 (+3.52%)0.02 (-23.48%)166.70 (-3.36%)128.78 (+7.33%)121.80 (+6.65%)103.90 (+11.36%)22.95 (-18.82%)
0a6c11c — 2025-12-04 00:39:100.13 (n/a)0.11 (n/a)0.11 (n/a)0.07 (n/a)0.02 (n/a)172.50 (n/a)119.98 (n/a)114.20 (n/a)93.30 (n/a)28.27 (n/a)

axpy_4_cols_2_channels_2048_tile_512_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.10 (-18.29%)0.09 (+0.12%)0.09 (+1.07%)0.07 (+9.96%)0.01 (-51.81%)171.20 (-9.08%)143.88 (-3.03%)140.80 (-1.12%)127.70 (+22.32%)17.29 (-45.78%)
d48746f — 2026-01-12 22:17:100.12 (n/a)0.09 (n/a)0.09 (n/a)0.07 (n/a)0.02 (n/a)188.30 (n/a)148.38 (n/a)142.40 (n/a)104.40 (n/a)31.90 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.10 (-16.19%)0.08 (-10.40%)0.09 (-2.09%)0.07 (-17.38%)0.01 (-10.61%)184.40 (+21.00%)153.18 (+11.99%)144.10 (+2.20%)127.10 (+19.34%)21.26 (+34.76%)
0a6c11c — 2025-12-04 00:39:100.12 (n/a)0.09 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)152.40 (n/a)136.78 (n/a)141.00 (n/a)106.50 (n/a)15.78 (n/a)

axpy_8_cols_2_channels_2048_tile_256_3.0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.09 (-3.83%)0.08 (+4.82%)0.08 (+8.54%)0.07 (+16.71%)0.01 (-50.06%)164.00 (-14.32%)156.66 (-5.82%)160.70 (-7.86%)138.70 (+3.97%)10.28 (-55.60%)
d48746f — 2026-01-12 22:17:100.09 (n/a)0.08 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)191.40 (n/a)166.34 (n/a)174.40 (n/a)133.40 (n/a)23.16 (n/a)

dequant_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (-18.83%)0.04 (-5.21%)0.04 (-2.69%)0.03 (+37.10%)0.00 (-53.98%)160.40 (-27.06%)141.12 (-0.91%)136.40 (+2.79%)114.30 (+23.17%)17.37 (-59.06%)
0a6c11c — 2025-12-04 00:39:100.06 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)219.90 (n/a)142.42 (n/a)132.70 (n/a)92.80 (n/a)42.43 (n/a)

dequant_1_cols_1_channels_2048_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.04 (-21.12%)0.04 (-9.68%)0.04 (+2.84%)0.02 (-24.71%)0.01 (-12.20%)212.90 (+32.81%)154.72 (+11.61%)138.20 (-2.74%)130.90 (+26.72%)33.95 (+53.13%)
d48746f — 2026-01-12 22:17:100.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)160.30 (n/a)138.62 (n/a)142.10 (n/a)103.30 (n/a)22.17 (n/a)

dequant_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.06 (-13.28%)0.05 (-8.93%)0.06 (-13.59%)0.04 (+4.63%)0.01 (-39.10%)133.60 (-4.43%)106.08 (+5.85%)95.10 (+15.69%)87.90 (+15.35%)17.90 (-31.97%)
0a6c11c — 2025-12-04 00:39:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)139.80 (n/a)100.22 (n/a)82.20 (n/a)76.20 (n/a)26.31 (n/a)

dequant_1_cols_2_channels_2048_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.05 (-8.24%)0.04 (-3.50%)0.04 (-4.19%)0.04 (+2.93%)0.00 (-32.65%)149.00 (-2.87%)131.18 (+2.68%)134.80 (+4.42%)114.90 (+9.01%)13.66 (-28.84%)
d48746f — 2026-01-12 22:17:100.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)153.40 (n/a)127.76 (n/a)129.10 (n/a)105.40 (n/a)19.20 (n/a)

dequant_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.07 (+5.66%)0.05 (+1.21%)0.05 (+0.61%)0.04 (-15.02%)0.01 (+58.42%)143.40 (+17.64%)101.02 (+1.49%)97.60 (-0.61%)78.90 (-5.40%)22.56 (+78.52%)
0a6c11c — 2025-12-04 00:39:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)121.90 (n/a)99.54 (n/a)98.20 (n/a)83.40 (n/a)12.64 (n/a)

dequant_2_cols_1_channels_2048_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (+16.32%)0.04 (+11.82%)0.05 (+31.40%)0.03 (-11.88%)0.01 (+69.36%)171.80 (+13.47%)127.00 (-6.95%)111.80 (-23.84%)88.00 (-14.06%)35.58 (+70.09%)
d48746f — 2026-01-12 22:17:100.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)151.40 (n/a)136.48 (n/a)146.80 (n/a)102.40 (n/a)20.92 (n/a)

dequant_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (+17.06%)0.04 (+8.98%)0.05 (+21.37%)0.03 (-11.65%)0.01 (+301.89%)159.70 (+13.18%)126.32 (-5.68%)109.00 (-17.67%)106.80 (-14.56%)22.48 (+280.15%)
0a6c11c — 2025-12-04 00:39:100.04 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.00 (n/a)141.10 (n/a)133.92 (n/a)132.40 (n/a)125.00 (n/a)5.91 (n/a)

dequant_2_cols_2_channels_2048_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (+28.27%)0.04 (+9.46%)0.04 (+8.88%)0.03 (-9.81%)0.01 (+146.27%)166.60 (+10.92%)130.32 (-6.03%)133.20 (-8.20%)93.50 (-22.08%)26.50 (+108.98%)
d48746f — 2026-01-12 22:17:100.04 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.00 (n/a)150.20 (n/a)138.68 (n/a)145.10 (n/a)120.00 (n/a)12.68 (n/a)

dequant_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.06 (+20.24%)0.05 (-3.19%)0.05 (-6.73%)0.03 (-20.69%)0.01 (+194.26%)156.10 (+26.09%)120.86 (+7.15%)114.90 (+7.18%)88.30 (-16.85%)24.40 (+214.82%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)123.80 (n/a)112.80 (n/a)107.20 (n/a)106.20 (n/a)7.75 (n/a)

dequant_4_cols_1_channels_2048_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.05 (-1.15%)0.04 (+15.18%)0.04 (+20.45%)0.03 (+40.77%)0.01 (-36.93%)156.90 (-28.97%)125.86 (-16.69%)121.90 (-16.96%)108.40 (+1.12%)19.33 (-55.37%)
d48746f — 2026-01-12 22:17:100.05 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)220.90 (n/a)151.08 (n/a)146.80 (n/a)107.20 (n/a)43.30 (n/a)

dequant_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (-6.09%)0.04 (-8.04%)0.04 (-12.46%)0.03 (-0.41%)0.01 (-20.19%)168.10 (+0.42%)135.74 (+7.44%)132.20 (+14.26%)107.40 (+6.44%)22.91 (-12.67%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.04 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)167.40 (n/a)126.34 (n/a)115.70 (n/a)100.90 (n/a)26.23 (n/a)

dequant_4_cols_2_channels_2048_tile_256_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.04 (-42.84%)0.04 (-13.61%)0.04 (-12.45%)0.03 (+33.27%)0.00 (-81.24%)150.60 (-24.93%)129.84 (+3.00%)128.20 (+14.26%)118.70 (+74.82%)12.34 (-74.75%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.02 (n/a)200.60 (n/a)126.06 (n/a)112.20 (n/a)67.90 (n/a)48.89 (n/a)

dequant_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.04 (-13.65%)0.04 (-13.67%)0.04 (-18.56%)0.03 (-13.52%)0.00 (-23.88%)170.40 (+15.68%)140.12 (+15.33%)135.80 (+22.78%)119.60 (+15.78%)17.94 (+1.87%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.04 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)147.30 (n/a)121.50 (n/a)110.60 (n/a)103.30 (n/a)17.61 (n/a)

dequant_8_cols_1_channels_2048_tile_256_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.05 (+15.46%)0.04 (+8.33%)0.04 (+4.84%)0.03 (+5.87%)0.01 (+36.21%)159.10 (-5.52%)137.30 (-7.08%)143.40 (-4.59%)110.60 (-13.39%)20.25 (+12.27%)
d48746f — 2026-01-12 22:17:100.04 (n/a)0.04 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)168.40 (n/a)147.76 (n/a)150.30 (n/a)127.70 (n/a)18.04 (n/a)

dequant_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.05 (+17.21%)0.03 (-1.70%)0.03 (-3.04%)0.03 (-16.20%)0.01 (+95.59%)198.20 (+19.33%)160.00 (+4.92%)166.20 (+3.17%)106.50 (-14.66%)29.86 (+87.19%)
0a6c11c — 2025-12-04 00:39:100.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)166.10 (n/a)152.50 (n/a)161.10 (n/a)124.80 (n/a)15.95 (n/a)

dequant_8_cols_2_channels_2048_tile_128_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.05 (+12.71%)0.04 (+10.35%)0.04 (+15.15%)0.03 (-5.35%)0.01 (+44.93%)205.40 (+5.60%)152.94 (-7.48%)140.20 (-13.14%)116.20 (-11.30%)37.13 (+32.65%)
d48746f — 2026-01-12 22:17:100.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)194.50 (n/a)165.30 (n/a)161.40 (n/a)131.00 (n/a)27.99 (n/a)

eltwise_add_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.10 (+9.23%)0.08 (-1.11%)0.09 (+7.36%)0.06 (-15.12%)0.02 (+94.13%)201.60 (+17.83%)151.98 (+4.01%)136.40 (-6.83%)119.40 (-8.44%)34.08 (+111.35%)
d48746f — 2026-01-12 22:17:100.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)171.10 (n/a)146.12 (n/a)146.40 (n/a)130.40 (n/a)16.12 (n/a)

eltwise_add_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.09 (-5.51%)0.08 (-6.12%)0.08 (-8.07%)0.07 (+0.12%)0.01 (-28.62%)169.60 (-0.12%)150.10 (+6.02%)144.70 (+8.80%)136.50 (+5.90%)12.87 (-24.27%)
d48746f — 2026-01-12 22:17:100.10 (n/a)0.09 (n/a)0.09 (n/a)0.07 (n/a)0.01 (n/a)169.80 (n/a)141.58 (n/a)133.00 (n/a)128.90 (n/a)17.00 (n/a)

eltwise_add_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.11 (+11.45%)0.08 (+1.23%)0.08 (-7.12%)0.07 (+7.73%)0.02 (+7.94%)184.30 (-7.20%)150.20 (-1.37%)153.70 (+7.71%)108.40 (-10.26%)29.00 (-11.14%)
d48746f — 2026-01-12 22:17:100.10 (n/a)0.08 (n/a)0.09 (n/a)0.06 (n/a)0.02 (n/a)198.60 (n/a)152.28 (n/a)142.70 (n/a)120.80 (n/a)32.63 (n/a)

eltwise_add_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.10 (+5.94%)0.09 (+15.74%)0.09 (+26.99%)0.07 (+10.77%)0.01 (+8.50%)177.70 (-9.75%)142.90 (-13.56%)130.30 (-21.27%)121.40 (-5.60%)23.45 (-5.31%)
d48746f — 2026-01-12 22:17:100.10 (n/a)0.08 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)196.90 (n/a)165.32 (n/a)165.50 (n/a)128.60 (n/a)24.76 (n/a)

eltwise_mul_1_cols_2_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.10 (-14.94%)0.08 (-11.22%)0.09 (-3.22%)0.07 (-16.33%)0.01 (-10.95%)177.10 (+19.50%)147.62 (+12.86%)139.00 (+3.35%)124.70 (+17.53%)21.25 (+26.92%)
d48746f — 2026-01-12 22:17:100.12 (n/a)0.10 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)148.20 (n/a)130.80 (n/a)134.50 (n/a)106.10 (n/a)16.74 (n/a)

eltwise_mul_2_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.11 (+12.84%)0.08 (-6.28%)0.08 (-9.80%)0.04 (-38.47%)0.02 (+147.45%)277.00 (+62.56%)171.86 (+15.54%)160.40 (+10.85%)115.00 (-11.40%)63.36 (+264.39%)
d48746f — 2026-01-12 22:17:100.09 (n/a)0.08 (n/a)0.08 (n/a)0.07 (n/a)0.01 (n/a)170.40 (n/a)148.74 (n/a)144.70 (n/a)129.80 (n/a)17.39 (n/a)

eltwise_mul_4_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.09 (-4.22%)0.08 (-6.38%)0.08 (-7.67%)0.08 (-7.41%)0.01 (+34.10%)162.90 (+8.02%)148.64 (+7.18%)146.70 (+8.35%)134.00 (+4.36%)13.34 (+52.38%)
d48746f — 2026-01-12 22:17:100.10 (n/a)0.09 (n/a)0.09 (n/a)0.08 (n/a)0.01 (n/a)150.80 (n/a)138.68 (n/a)135.40 (n/a)128.40 (n/a)8.76 (n/a)

eltwise_mul_8_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.08 (-15.98%)0.07 (-4.21%)0.07 (-0.22%)0.05 (-7.83%)0.01 (-17.74%)240.70 (+8.52%)178.60 (+4.10%)170.10 (+0.24%)151.40 (+19.03%)36.37 (+8.36%)
d48746f — 2026-01-12 22:17:100.10 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)221.80 (n/a)171.56 (n/a)169.70 (n/a)127.20 (n/a)33.56 (n/a)

gelu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (-1.25%)0.06 (+2.50%)0.06 (-0.95%)0.06 (+13.76%)0.00 (-42.71%)148.00 (-12.11%)137.50 (-3.39%)141.10 (+0.93%)123.10 (+1.23%)9.47 (-49.44%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)168.40 (n/a)142.32 (n/a)139.80 (n/a)121.60 (n/a)18.73 (n/a)

gelu_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+1.23%)0.06 (+11.03%)0.06 (+12.23%)0.05 (+8.68%)0.01 (-17.76%)151.00 (-8.04%)132.54 (-10.60%)136.30 (-10.92%)110.20 (-1.25%)16.05 (-23.73%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)164.20 (n/a)148.26 (n/a)153.00 (n/a)111.60 (n/a)21.05 (n/a)

gelu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.08 (+12.50%)0.06 (-1.04%)0.06 (-9.55%)0.05 (+9.70%)0.01 (+17.79%)151.50 (-8.84%)131.58 (+1.23%)132.10 (+10.54%)99.80 (-11.13%)20.31 (-6.88%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)166.20 (n/a)129.98 (n/a)119.50 (n/a)112.30 (n/a)21.81 (n/a)

gelu_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+32.03%)0.06 (+11.07%)0.05 (+4.95%)0.05 (-3.98%)0.01 (+719.30%)169.40 (+4.12%)145.06 (-8.31%)151.00 (-4.67%)116.80 (-24.25%)21.55 (+542.93%)
d48746f — 2026-01-12 22:17:100.05 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)162.70 (n/a)158.20 (n/a)158.40 (n/a)154.20 (n/a)3.35 (n/a)

gelu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (-9.45%)0.06 (+10.14%)0.06 (+20.79%)0.05 (-0.95%)0.01 (-27.05%)165.10 (+0.92%)132.48 (-10.06%)128.40 (-17.21%)118.00 (+10.38%)19.29 (-15.73%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)163.60 (n/a)147.30 (n/a)155.10 (n/a)106.90 (n/a)22.89 (n/a)

gelu_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+3.01%)0.06 (+30.55%)0.06 (+42.61%)0.05 (+37.97%)0.01 (-32.28%)164.90 (-27.52%)139.32 (-25.46%)129.00 (-29.85%)124.60 (-2.88%)18.52 (-52.58%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)227.50 (n/a)186.90 (n/a)183.90 (n/a)128.30 (n/a)39.06 (n/a)

gelu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (-4.22%)0.05 (-7.56%)0.05 (+0.16%)0.04 (-15.32%)0.01 (+11.47%)193.10 (+18.03%)163.12 (+9.43%)160.80 (-0.19%)114.90 (+4.45%)31.38 (+37.26%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)163.60 (n/a)149.06 (n/a)161.10 (n/a)110.00 (n/a)22.86 (n/a)

gelu_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-6.66%)0.05 (+3.49%)0.05 (+16.62%)0.03 (-15.04%)0.01 (+16.79%)254.30 (+17.73%)173.50 (-1.18%)151.90 (-14.28%)137.20 (+7.10%)48.42 (+53.16%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)216.00 (n/a)175.58 (n/a)177.20 (n/a)128.10 (n/a)31.61 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
3a053d3 — 2025-11-26 01:12:163.72 (-0.11%)3.55 (-2.75%)3.56 (-2.75%)3.36 (-5.33%)0.12 (+76.10%)2725.23 (-0.11%)2602.52 (-2.75%)2612.11 (-2.75%)2459.89 (-5.33%)86.27 (+76.10%)6984.00 (+5.63%)6608.60 (+2.91%)6577.00 (+2.83%)6304.00 (+0.11%)221.87 (+87.15%)
9e98049 — 2025-11-25 20:50:553.72 (n/a)3.65 (n/a)3.66 (n/a)3.54 (n/a)0.07 (n/a)2728.26 (n/a)2676.06 (n/a)2686.03 (n/a)2598.29 (n/a)48.99 (n/a)6612.00 (n/a)6422.00 (n/a)6396.00 (n/a)6297.00 (n/a)118.55 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
3a053d3 — 2025-11-26 01:12:163.40 (-3.14%)3.38 (-0.82%)3.38 (-0.82%)3.35 (+4.93%)0.02 (-84.51%)2493.81 (-3.14%)2475.27 (-0.82%)2479.06 (-0.82%)2453.92 (+4.93%)13.33 (-84.51%)7001.00 (-4.70%)6940.80 (+0.71%)6930.00 (+0.83%)6889.00 (+3.24%)37.43 (-84.76%)
9e98049 — 2025-11-25 20:50:553.51 (n/a)3.40 (n/a)3.41 (n/a)3.19 (n/a)0.12 (n/a)2574.53 (n/a)2495.72 (n/a)2499.62 (n/a)2338.67 (n/a)86.02 (n/a)7346.00 (n/a)6892.20 (n/a)6873.00 (n/a)6673.00 (n/a)245.57 (n/a)

gemm_2048x2048x2048_64x64x32_8_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
3a053d3 — 2025-11-26 01:12:163.02 (+0.52%)2.87 (-2.05%)2.86 (-2.24%)2.70 (-6.16%)0.11 (+131.66%)2216.19 (+0.52%)2104.44 (-2.05%)2094.08 (-2.24%)1980.84 (-6.16%)80.25 (+131.67%)8673.00 (+6.56%)8175.60 (+2.21%)8204.00 (+2.29%)7752.00 (-0.51%)314.03 (+145.36%)
9e98049 — 2025-11-25 20:50:553.01 (n/a)2.93 (n/a)2.92 (n/a)2.88 (n/a)0.05 (n/a)2204.81 (n/a)2148.41 (n/a)2142.13 (n/a)2110.81 (n/a)34.64 (n/a)8139.00 (n/a)7998.60 (n/a)8020.00 (n/a)7792.00 (n/a)127.99 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:491.04 (+0.94%)1.03 (+0.23%)1.03 (+0.09%)1.02 (+0.07%)0.00 (+197.51%)24576.00 (-0.07%)24485.82 (-0.23%)24530.40 (-0.09%)24266.40 (-0.94%)111.26 (+194.35%)
0a6c11c — 2025-12-04 00:39:101.03 (n/a)1.03 (n/a)1.03 (n/a)1.02 (n/a)0.00 (n/a)24594.30 (n/a)24542.14 (n/a)24551.90 (n/a)24495.50 (n/a)37.80 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
a4b6ffe — 2026-01-05 19:24:051.04 (+0.28%)1.03 (-0.15%)1.03 (+0.05%)1.02 (-0.52%)0.01 (+42.72%)24719.80 (+0.52%)24512.42 (+0.16%)24529.20 (-0.05%)24092.60 (-0.28%)252.92 (+43.15%)713.08 (+0.28%)700.92 (-0.15%)700.38 (+0.05%)694.98 (-0.52%)7.30 (+42.71%)
50ad37c — 2025-12-29 20:35:531.04 (n/a)1.03 (n/a)1.03 (n/a)1.02 (n/a)0.01 (n/a)24592.30 (n/a)24473.70 (n/a)24540.90 (n/a)24160.80 (n/a)176.68 (n/a)711.06 (n/a)702.00 (n/a)700.05 (n/a)698.59 (n/a)5.12 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.99 (+1.69%)0.97 (+0.29%)0.97 (-0.04%)0.97 (-0.15%)0.01 (+434.92%)26025.30 (+0.15%)25839.34 (-0.29%)25916.70 (+0.04%)25446.00 (-1.67%)202.05 (+425.44%)
0a6c11c — 2025-12-04 00:39:100.97 (n/a)0.97 (n/a)0.97 (n/a)0.97 (n/a)0.00 (n/a)25986.90 (n/a)25913.52 (n/a)25905.70 (n/a)25877.00 (n/a)38.45 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
a4b6ffe — 2026-01-05 19:24:050.97 (-0.01%)0.97 (+0.03%)0.97 (+0.04%)0.97 (+0.00%)0.00 (-6.43%)25927.90 (-0.00%)25903.20 (-0.03%)25898.60 (-0.04%)25892.80 (+0.01%)14.05 (-6.56%)663.50 (-0.01%)663.23 (+0.03%)663.35 (+0.04%)662.60 (+0.00%)0.36 (-6.43%)
50ad37c — 2025-12-29 20:35:530.97 (n/a)0.97 (n/a)0.97 (n/a)0.97 (n/a)0.00 (n/a)25928.10 (n/a)25910.14 (n/a)25908.10 (n/a)25891.20 (n/a)15.04 (n/a)663.54 (n/a)663.06 (n/a)663.11 (n/a)662.60 (n/a)0.38 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.92 (-1.02%)0.92 (-0.66%)0.92 (-0.10%)0.91 (-0.78%)0.01 (-4.54%)27751.40 (+0.79%)27480.74 (+0.66%)27354.80 (+0.10%)27320.50 (+1.03%)182.69 (-2.84%)
0a6c11c — 2025-12-04 00:39:100.93 (n/a)0.92 (n/a)0.92 (n/a)0.91 (n/a)0.01 (n/a)27534.80 (n/a)27299.32 (n/a)27326.70 (n/a)27042.30 (n/a)188.04 (n/a)

gemm_2048x2048x2048_64x64x64_2_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
a4b6ffe — 2026-01-05 19:24:050.92 (+0.11%)0.91 (-0.12%)0.91 (-0.21%)0.91 (-0.24%)0.00 (+30.34%)27723.50 (+0.24%)27548.94 (+0.12%)27522.90 (+0.21%)27403.60 (-0.11%)124.26 (+30.58%)626.92 (+0.11%)623.62 (-0.12%)624.20 (-0.21%)619.69 (-0.24%)2.81 (+30.34%)
50ad37c — 2025-12-29 20:35:530.92 (n/a)0.91 (n/a)0.92 (n/a)0.91 (n/a)0.00 (n/a)27657.10 (n/a)27515.58 (n/a)27464.70 (n/a)27434.60 (n/a)95.16 (n/a)626.21 (n/a)624.37 (n/a)625.52 (n/a)621.17 (n/a)2.16 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)GFLOP/s (max)GFLOP/s (mean)GFLOP/s (median)GFLOP/s (min)GFLOP/s (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
31ab24e — 2025-11-22 02:01:563.65 (-1.06%)3.59 (+0.83%)3.63 (-0.26%)3.45 (+2.66%)0.07 (-44.71%)2678.08 (-1.06%)2632.13 (+0.83%)2658.60 (-0.26%)2528.31 (+2.66%)53.86 (-44.71%)6795.00 (-2.59%)6529.80 (-0.92%)6462.00 (+0.26%)6415.00 (+1.07%)137.14 (-45.27%)
d9a64c5 — 2025-11-21 20:49:353.69 (n/a)3.56 (n/a)3.64 (n/a)3.36 (n/a)0.13 (n/a)2706.77 (n/a)2610.50 (n/a)2665.61 (n/a)2462.71 (n/a)97.41 (n/a)6976.00 (n/a)6590.40 (n/a)6445.00 (n/a)6347.00 (n/a)250.58 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:063.97 (-0.36%)3.81 (-0.77%)3.79 (+0.81%)3.74 (+0.56%)0.09 (-30.54%)6722.50 (-0.55%)6607.10 (+0.73%)6643.50 (-0.80%)6344.10 (+0.37%)151.78 (-30.59%)2708.01 (-0.36%)2601.34 (-0.77%)2585.96 (+0.81%)2555.58 (+0.56%)61.38 (-30.54%)
d48746f — 2026-01-12 22:17:103.98 (n/a)3.84 (n/a)3.76 (n/a)3.72 (n/a)0.13 (n/a)6760.00 (n/a)6559.50 (n/a)6697.10 (n/a)6321.00 (n/a)218.68 (n/a)2717.91 (n/a)2621.44 (n/a)2565.27 (n/a)2541.40 (n/a)88.37 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_0_bcolmaj_1_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:063.74 (-0.13%)3.60 (-2.85%)3.60 (-2.94%)3.47 (-4.82%)0.11 (+201.68%)7251.00 (+5.06%)6999.38 (+3.00%)6995.80 (+3.03%)6724.40 (+0.13%)212.60 (+217.07%)2554.87 (-0.13%)2456.30 (-2.85%)2455.73 (-2.94%)2369.31 (-4.82%)74.85 (+201.67%)
d48746f — 2026-01-12 22:17:103.75 (n/a)3.70 (n/a)3.71 (n/a)3.65 (n/a)0.04 (n/a)6901.80 (n/a)6795.46 (n/a)6790.20 (n/a)6715.90 (n/a)67.05 (n/a)2558.08 (n/a)2528.33 (n/a)2530.10 (n/a)2489.18 (n/a)24.81 (n/a)

gemm_2048x2048x2048_64x64x64_8_cols_1_bcolmaj_0_ccolmaj_0_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:063.68 (+1.74%)3.62 (+2.04%)3.61 (+0.30%)3.53 (+2.52%)0.06 (-32.17%)7128.00 (-2.46%)6959.46 (-2.03%)6961.80 (-0.30%)6829.70 (-1.71%)118.66 (-35.14%)2515.47 (+1.74%)2469.14 (+2.04%)2467.73 (+0.30%)2410.21 (+2.52%)41.89 (-32.17%)
d48746f — 2026-01-12 22:17:103.62 (n/a)3.54 (n/a)3.60 (n/a)3.44 (n/a)0.09 (n/a)7307.40 (n/a)7103.46 (n/a)6982.50 (n/a)6948.20 (n/a)182.95 (n/a)2472.55 (n/a)2419.80 (n/a)2460.41 (n/a)2351.04 (n/a)61.76 (n/a)

layer_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.08 (+6.89%)0.06 (+5.94%)0.06 (+1.75%)0.05 (+18.79%)0.01 (-4.81%)159.20 (-15.81%)139.04 (-6.60%)147.70 (-1.73%)101.20 (-6.47%)22.77 (-26.34%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)189.10 (n/a)148.86 (n/a)150.30 (n/a)108.20 (n/a)30.91 (n/a)

layer_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.08 (-16.98%)0.06 (-8.27%)0.06 (-6.00%)0.05 (+4.41%)0.01 (-38.94%)159.90 (-4.19%)138.28 (+6.17%)145.60 (+6.36%)105.10 (+20.53%)21.09 (-29.10%)
d48746f — 2026-01-12 22:17:100.09 (n/a)0.07 (n/a)0.06 (n/a)0.05 (n/a)0.02 (n/a)166.90 (n/a)130.24 (n/a)136.90 (n/a)87.20 (n/a)29.74 (n/a)

layer_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (-6.32%)0.06 (-1.65%)0.06 (-2.48%)0.06 (+7.96%)0.01 (-33.59%)145.60 (-7.38%)131.50 (+0.78%)130.40 (+2.52%)114.10 (+6.74%)12.04 (-34.68%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)157.20 (n/a)130.48 (n/a)127.20 (n/a)106.90 (n/a)18.43 (n/a)

layer_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-19.63%)0.06 (-9.45%)0.06 (-4.58%)0.05 (-10.26%)0.01 (-39.16%)179.30 (+11.44%)148.24 (+9.18%)145.00 (+4.77%)126.30 (+24.43%)19.57 (-12.20%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)160.90 (n/a)135.78 (n/a)138.40 (n/a)101.50 (n/a)22.29 (n/a)

layer_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (-8.58%)0.06 (+3.75%)0.06 (+7.28%)0.05 (+13.05%)0.01 (-20.45%)181.80 (-11.58%)139.46 (-5.68%)131.50 (-6.80%)109.30 (+9.41%)30.43 (-23.55%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.02 (n/a)205.60 (n/a)147.86 (n/a)141.10 (n/a)99.90 (n/a)39.80 (n/a)

layer_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (+1.03%)0.06 (+7.12%)0.06 (+10.30%)0.05 (+6.62%)0.01 (-13.60%)163.10 (-6.21%)146.10 (-6.95%)143.90 (-9.38%)131.10 (-0.98%)13.83 (-20.62%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)173.90 (n/a)157.02 (n/a)158.80 (n/a)132.40 (n/a)17.43 (n/a)

layer_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-21.99%)0.05 (-16.31%)0.05 (-9.86%)0.05 (-12.57%)0.00 (-59.77%)170.20 (+14.38%)160.98 (+18.40%)163.10 (+10.95%)148.40 (+28.15%)9.58 (-41.13%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.01 (n/a)148.80 (n/a)135.96 (n/a)147.00 (n/a)115.80 (n/a)16.27 (n/a)

layer_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.05 (-26.71%)0.04 (-9.96%)0.05 (-2.62%)0.03 (+0.61%)0.01 (-50.86%)240.40 (-0.62%)193.38 (+8.21%)179.80 (+2.68%)177.70 (+36.48%)26.82 (-33.71%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)241.90 (n/a)178.70 (n/a)175.10 (n/a)130.20 (n/a)40.47 (n/a)

matrix_vector_mul_128x128_32_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:490.37 (+17.13%)0.30 (+24.87%)0.30 (+38.03%)0.23 (+12.47%)0.06 (+35.23%)
0a6c11c — 2025-12-04 00:39:100.32 (n/a)0.24 (n/a)0.22 (n/a)0.20 (n/a)0.04 (n/a)

matrix_vector_mul_128x128_32_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:100.26 (-1.81%)0.24 (+4.06%)0.24 (+0.52%)0.21 (+16.97%)0.02 (-48.16%)0.26 (-1.81%)0.24 (+4.06%)0.24 (+0.52%)0.20 (+16.97%)0.02 (-48.16%)
a4b6ffe — 2026-01-05 19:24:050.26 (n/a)0.23 (n/a)0.24 (n/a)0.18 (n/a)0.04 (n/a)0.26 (n/a)0.23 (n/a)0.24 (n/a)0.17 (n/a)0.04 (n/a)

matrix_vector_mul_128x128_32tsi_128tso_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:060.32 (+25.39%)0.25 (+10.36%)0.24 (+12.12%)0.21 (+2.73%)0.04 (+92.01%)0.32 (+25.39%)0.25 (+10.36%)0.24 (+12.12%)0.20 (+2.73%)0.04 (+92.01%)
d48746f — 2026-01-12 22:17:100.26 (n/a)0.23 (n/a)0.22 (n/a)0.20 (n/a)0.02 (n/a)0.25 (n/a)0.22 (n/a)0.21 (n/a)0.20 (n/a)0.02 (n/a)

matrix_vector_mul_2048x8192_1_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4913.57 (+3.47%)13.15 (+1.09%)13.10 (+0.16%)12.52 (-1.58%)0.37 (+153.19%)
0a6c11c — 2025-12-04 00:39:1013.11 (n/a)13.01 (n/a)13.07 (n/a)12.72 (n/a)0.15 (n/a)

matrix_vector_mul_2048x8192_1_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1013.43 (-0.07%)13.30 (+4.62%)13.27 (+1.29%)13.16 (+16.70%)0.12 (-86.69%)13.42 (-0.07%)13.29 (+4.62%)13.26 (+1.29%)13.16 (+16.70%)0.12 (-86.69%)
a4b6ffe — 2026-01-05 19:24:0513.44 (n/a)12.71 (n/a)13.10 (n/a)11.28 (n/a)0.87 (n/a)13.43 (n/a)12.70 (n/a)13.09 (n/a)11.27 (n/a)0.87 (n/a)

matrix_vector_mul_2048x8192_1_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4925.06 (+2.47%)23.71 (+1.81%)24.13 (+0.50%)20.90 (+5.41%)1.48 (-15.60%)
0a6c11c — 2025-12-04 00:39:1024.46 (n/a)23.29 (n/a)24.01 (n/a)19.83 (n/a)1.75 (n/a)

matrix_vector_mul_2048x8192_1_2col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1024.46 (-0.60%)21.07 (-8.03%)19.75 (-17.83%)18.08 (+1.18%)3.03 (+7.07%)24.44 (-0.60%)21.06 (-8.03%)19.74 (-17.83%)18.07 (+1.18%)3.03 (+7.07%)
a4b6ffe — 2026-01-05 19:24:0524.60 (n/a)22.91 (n/a)24.04 (n/a)17.87 (n/a)2.83 (n/a)24.59 (n/a)22.90 (n/a)24.02 (n/a)17.86 (n/a)2.83 (n/a)

matrix_vector_mul_2048x8192_1_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4942.05 (+1.54%)40.50 (+12.60%)40.49 (+2.36%)38.98 (+97.53%)0.97 (-88.09%)
0a6c11c — 2025-12-04 00:39:1041.41 (n/a)35.97 (n/a)39.55 (n/a)19.73 (n/a)8.15 (n/a)

matrix_vector_mul_2048x8192_1_4col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1042.58 (+1.51%)41.37 (+14.29%)41.25 (+4.89%)40.33 (+91.42%)0.92 (-89.18%)42.56 (+1.51%)41.34 (+14.29%)41.23 (+4.89%)40.30 (+91.42%)0.92 (-89.18%)
a4b6ffe — 2026-01-05 19:24:0541.95 (n/a)36.20 (n/a)39.33 (n/a)21.07 (n/a)8.54 (n/a)41.92 (n/a)36.17 (n/a)39.31 (n/a)21.05 (n/a)8.53 (n/a)

matrix_vector_mul_2048x8192_1_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4946.62 (+3.11%)44.82 (+0.17%)44.78 (+0.17%)42.60 (-3.80%)1.60 (+367.72%)
0a6c11c — 2025-12-04 00:39:1045.21 (n/a)44.75 (n/a)44.70 (n/a)44.29 (n/a)0.34 (n/a)

matrix_vector_mul_2048x8192_1_8col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1046.04 (+4.14%)45.06 (+3.47%)44.55 (+2.76%)44.30 (+2.84%)0.87 (+66.58%)46.01 (+4.14%)45.03 (+3.47%)44.52 (+2.76%)44.27 (+2.84%)0.87 (+66.58%)
a4b6ffe — 2026-01-05 19:24:0544.21 (n/a)43.55 (n/a)43.35 (n/a)43.07 (n/a)0.52 (n/a)44.18 (n/a)43.52 (n/a)43.32 (n/a)43.05 (n/a)0.52 (n/a)

matrix_vector_mul_2048x8192_1tsi_1024tso_2col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:0625.60 (+0.16%)24.99 (+5.47%)24.98 (+1.31%)24.46 (+29.05%)0.41 (-84.54%)25.59 (+0.16%)24.97 (+5.47%)24.97 (+1.31%)24.44 (+29.05%)0.41 (-84.54%)
d48746f — 2026-01-12 22:17:1025.56 (n/a)23.69 (n/a)24.66 (n/a)18.95 (n/a)2.68 (n/a)25.55 (n/a)23.68 (n/a)24.65 (n/a)18.94 (n/a)2.68 (n/a)

matrix_vector_mul_2048x8192_1tsi_2048tso_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:0613.63 (+0.79%)13.21 (-0.51%)13.39 (+0.17%)12.28 (-3.24%)0.53 (+56.92%)13.62 (+0.79%)13.21 (-0.51%)13.38 (+0.17%)12.27 (-3.24%)0.53 (+56.92%)
d48746f — 2026-01-12 22:17:1013.52 (n/a)13.28 (n/a)13.37 (n/a)12.69 (n/a)0.34 (n/a)13.51 (n/a)13.27 (n/a)13.36 (n/a)12.68 (n/a)0.34 (n/a)

matrix_vector_mul_2048x8192_1tsi_256tso_8col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:0647.58 (+3.59%)45.50 (+2.81%)44.76 (-0.56%)44.22 (+9.30%)1.55 (-28.97%)47.55 (+3.59%)45.47 (+2.81%)44.74 (-0.56%)44.19 (+9.30%)1.55 (-28.97%)
d48746f — 2026-01-12 22:17:1045.93 (n/a)44.26 (n/a)45.01 (n/a)40.46 (n/a)2.18 (n/a)45.90 (n/a)44.23 (n/a)44.99 (n/a)40.43 (n/a)2.18 (n/a)

matrix_vector_mul_2048x8192_1tsi_512tso_4col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:0642.01 (+2.30%)36.98 (-0.18%)40.31 (-0.13%)23.41 (+3.59%)7.68 (-4.92%)41.98 (+2.30%)36.96 (-0.18%)40.28 (-0.13%)23.40 (+3.59%)7.68 (-4.92%)
d48746f — 2026-01-12 22:17:1041.06 (n/a)37.05 (n/a)40.36 (n/a)22.60 (n/a)8.08 (n/a)41.04 (n/a)37.02 (n/a)40.33 (n/a)22.59 (n/a)8.08 (n/a)

matrix_vector_mul_8192x2048_4_1col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4913.29 (+1.63%)13.19 (+6.08%)13.19 (+1.17%)13.09 (+26.86%)0.08 (-92.94%)
0a6c11c — 2025-12-04 00:39:1013.08 (n/a)12.44 (n/a)13.03 (n/a)10.32 (n/a)1.07 (n/a)

matrix_vector_mul_8192x2048_4_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1013.68 (+3.42%)13.30 (+8.54%)13.38 (+7.25%)12.72 (+14.96%)0.35 (-66.09%)13.67 (+3.42%)13.29 (+8.54%)13.38 (+7.25%)12.71 (+14.96%)0.35 (-66.09%)
a4b6ffe — 2026-01-05 19:24:0513.23 (n/a)12.25 (n/a)12.48 (n/a)11.07 (n/a)1.04 (n/a)13.22 (n/a)12.24 (n/a)12.47 (n/a)11.06 (n/a)1.04 (n/a)

matrix_vector_mul_8192x2048_4_2col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4925.58 (+4.24%)24.23 (+6.59%)24.03 (+0.29%)23.58 (+37.29%)0.70 (-74.97%)
0a6c11c — 2025-12-04 00:39:1024.54 (n/a)22.73 (n/a)23.96 (n/a)17.18 (n/a)2.79 (n/a)

matrix_vector_mul_8192x2048_4_2col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1025.08 (+1.32%)24.68 (+13.42%)24.61 (+3.26%)24.47 (+48.32%)0.24 (-93.56%)25.07 (+1.32%)24.67 (+13.42%)24.59 (+3.26%)24.46 (+48.32%)0.24 (-93.56%)
a4b6ffe — 2026-01-05 19:24:0524.76 (n/a)21.76 (n/a)23.83 (n/a)16.50 (n/a)3.74 (n/a)24.74 (n/a)21.75 (n/a)23.82 (n/a)16.49 (n/a)3.73 (n/a)

matrix_vector_mul_8192x2048_4_4col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4940.94 (-2.19%)39.74 (-1.10%)39.76 (-0.60%)38.17 (-2.14%)1.04 (+4.39%)
0a6c11c — 2025-12-04 00:39:1041.86 (n/a)40.18 (n/a)40.00 (n/a)39.00 (n/a)1.00 (n/a)

matrix_vector_mul_8192x2048_4_4col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1040.74 (-1.09%)37.16 (-7.15%)40.25 (+1.47%)24.51 (-37.44%)7.07 (+736.13%)40.72 (-1.09%)37.13 (-7.15%)40.23 (+1.47%)24.50 (-37.44%)7.07 (+736.13%)
a4b6ffe — 2026-01-05 19:24:0541.19 (n/a)40.02 (n/a)39.67 (n/a)39.18 (n/a)0.85 (n/a)41.17 (n/a)39.99 (n/a)39.64 (n/a)39.16 (n/a)0.85 (n/a)

matrix_vector_mul_8192x2048_4_8col

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)
130b6ea — 2025-12-05 21:15:4946.71 (-1.04%)44.91 (-2.34%)44.71 (-2.98%)43.80 (-1.44%)0.96 (+6.93%)
0a6c11c — 2025-12-04 00:39:1047.20 (n/a)45.98 (n/a)46.08 (n/a)44.44 (n/a)0.90 (n/a)

matrix_vector_mul_8192x2048_4_8col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
331dcca — 2026-01-08 18:34:1046.28 (+5.68%)44.89 (+14.59%)44.74 (+4.26%)44.20 (+62.80%)0.84 (-87.96%)46.25 (+5.68%)44.86 (+14.59%)44.71 (+4.26%)44.17 (+62.80%)0.84 (-87.96%)
a4b6ffe — 2026-01-05 19:24:0543.79 (n/a)39.17 (n/a)42.91 (n/a)27.15 (n/a)6.98 (n/a)43.77 (n/a)39.15 (n/a)42.88 (n/a)27.13 (n/a)6.98 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_1col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:0613.68 (+1.41%)12.87 (-1.53%)13.39 (+3.93%)11.44 (-10.37%)0.92 (+157.45%)13.67 (+1.41%)12.87 (-1.53%)13.38 (+3.93%)11.43 (-10.37%)0.92 (+157.45%)
d48746f — 2026-01-12 22:17:1013.49 (n/a)13.08 (n/a)12.88 (n/a)12.76 (n/a)0.36 (n/a)13.48 (n/a)13.07 (n/a)12.88 (n/a)12.76 (n/a)0.36 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_2col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:0625.41 (+1.68%)23.73 (-3.58%)24.55 (-0.52%)19.32 (-19.94%)2.49 (+616.76%)25.40 (+1.68%)23.71 (-3.58%)24.53 (-0.52%)19.31 (-19.94%)2.49 (+616.76%)
d48746f — 2026-01-12 22:17:1024.99 (n/a)24.61 (n/a)24.67 (n/a)24.13 (n/a)0.35 (n/a)24.98 (n/a)24.59 (n/a)24.66 (n/a)24.12 (n/a)0.35 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_4col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:0640.64 (-0.09%)39.82 (-0.30%)39.68 (-1.74%)39.28 (+1.37%)0.57 (-28.63%)40.62 (-0.09%)39.80 (-0.30%)39.65 (-1.74%)39.26 (+1.37%)0.57 (-28.63%)
d48746f — 2026-01-12 22:17:1040.68 (n/a)39.94 (n/a)40.38 (n/a)38.75 (n/a)0.80 (n/a)40.65 (n/a)39.92 (n/a)40.36 (n/a)38.73 (n/a)0.80 (n/a)

matrix_vector_mul_8192x2048_4tsi_1024tso_8col0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
8a880b4 — 2026-01-13 00:04:0648.05 (+1.38%)46.13 (+12.75%)46.23 (+3.05%)44.69 (+108.77%)1.35 (-87.73%)48.02 (+1.38%)46.10 (+12.75%)46.20 (+3.05%)44.67 (+108.77%)1.34 (-87.73%)
d48746f — 2026-01-12 22:17:1047.39 (n/a)40.91 (n/a)44.87 (n/a)21.41 (n/a)10.96 (n/a)47.36 (n/a)40.89 (n/a)44.84 (n/a)21.39 (n/a)10.96 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.07 (+22.03%)0.06 (+27.86%)0.06 (+35.49%)0.05 (+15.00%)0.01 (+49.69%)173.30 (-13.00%)137.94 (-21.32%)133.60 (-26.19%)123.40 (-18.06%)18.40 (+8.53%)
0a6c11c — 2025-12-04 00:39:100.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)199.20 (n/a)175.32 (n/a)181.00 (n/a)150.60 (n/a)16.96 (n/a)

mem_copy_16_cores_2_chans_2048_tile_128_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.05 (-7.78%)0.05 (-4.35%)0.05 (-1.14%)0.04 (-15.62%)0.01 (+16.13%)231.00 (+18.52%)181.84 (+5.57%)173.90 (+1.16%)152.70 (+8.45%)32.41 (+46.48%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)194.90 (n/a)172.24 (n/a)171.90 (n/a)140.80 (n/a)22.13 (n/a)

mem_copy_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-16.99%)0.05 (-12.47%)0.05 (-7.32%)0.04 (-11.17%)0.00 (-29.61%)197.00 (+12.57%)171.00 (+13.70%)164.00 (+7.89%)153.00 (+20.47%)17.49 (-4.32%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)175.00 (n/a)150.40 (n/a)152.00 (n/a)127.00 (n/a)18.28 (n/a)

mem_copy_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+5.56%)0.05 (-1.59%)0.05 (-1.39%)0.03 (-14.07%)0.01 (+25.03%)263.00 (+16.37%)166.00 (+4.53%)144.00 (+1.41%)126.00 (-5.26%)49.38 (+43.17%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)226.00 (n/a)158.80 (n/a)142.00 (n/a)133.00 (n/a)34.49 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.08 (+10.93%)0.07 (+7.79%)0.07 (+3.55%)0.05 (-1.73%)0.01 (+36.73%)150.20 (+1.76%)121.68 (-6.36%)125.60 (-3.38%)97.90 (-9.85%)18.56 (+21.98%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.06 (n/a)0.01 (n/a)147.60 (n/a)129.94 (n/a)130.00 (n/a)108.60 (n/a)15.21 (n/a)

mem_copy_1_cores_1_chans_2048_tile_2048_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (-24.28%)0.06 (-12.77%)0.06 (-14.08%)0.05 (+25.83%)0.01 (-66.88%)162.30 (-20.52%)144.26 (+7.69%)143.30 (+16.31%)124.10 (+32.02%)14.63 (-66.04%)
d48746f — 2026-01-12 22:17:100.09 (n/a)0.07 (n/a)0.07 (n/a)0.04 (n/a)0.02 (n/a)204.20 (n/a)133.96 (n/a)123.20 (n/a)94.00 (n/a)43.07 (n/a)

mem_copy_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-15.32%)0.05 (-17.09%)0.05 (-23.81%)0.04 (-15.54%)0.01 (-18.18%)193.00 (+18.40%)160.80 (+20.36%)168.00 (+31.25%)124.00 (+18.10%)22.92 (+11.39%)
0999a9a — 2025-11-13 19:24:080.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)163.00 (n/a)133.60 (n/a)128.00 (n/a)105.00 (n/a)20.58 (n/a)

mem_copy_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (-23.02%)0.05 (-6.98%)0.05 (-2.13%)0.04 (-15.31%)0.01 (-33.29%)196.00 (+18.07%)147.00 (+6.52%)141.00 (+2.17%)126.00 (+29.90%)25.27 (+8.13%)
0999a9a — 2025-11-13 19:24:080.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)166.00 (n/a)138.00 (n/a)138.00 (n/a)97.00 (n/a)23.37 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.10 (+31.37%)0.08 (+29.12%)0.08 (+29.06%)0.07 (+41.80%)0.01 (+0.23%)109.90 (-29.46%)98.30 (-23.38%)100.80 (-22.52%)79.40 (-23.87%)10.54 (-46.17%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.07 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)155.80 (n/a)128.30 (n/a)130.10 (n/a)104.30 (n/a)19.58 (n/a)

mem_copy_2_cores_1_chans_2048_tile_1024_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-19.55%)0.05 (-17.75%)0.06 (-13.11%)0.04 (-29.12%)0.01 (+18.94%)198.30 (+41.14%)154.30 (+23.22%)146.50 (+15.08%)131.20 (+24.36%)27.00 (+114.38%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.07 (n/a)0.06 (n/a)0.06 (n/a)0.01 (n/a)140.50 (n/a)125.22 (n/a)127.30 (n/a)105.50 (n/a)12.60 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.10 (+25.02%)0.07 (+10.01%)0.07 (+7.53%)0.05 (-1.99%)0.01 (+77.08%)150.10 (+2.04%)114.60 (-7.22%)111.70 (-6.99%)83.90 (-20.02%)21.23 (+43.54%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)147.10 (n/a)123.52 (n/a)120.10 (n/a)104.90 (n/a)14.79 (n/a)

mem_copy_2_cores_2_chans_2048_tile_1024_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-13.00%)0.05 (-13.57%)0.05 (-6.30%)0.04 (-19.92%)0.01 (-23.10%)200.30 (+24.88%)161.80 (+15.39%)161.40 (+6.75%)133.00 (+14.95%)24.63 (+13.34%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)160.40 (n/a)140.22 (n/a)151.20 (n/a)115.70 (n/a)21.73 (n/a)

mem_copy_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.07 (+11.97%)0.05 (+3.09%)0.05 (+2.10%)0.03 (-11.35%)0.01 (+41.65%)229.00 (+12.81%)156.00 (-0.51%)143.00 (-2.05%)117.00 (-10.69%)38.21 (+48.71%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)203.00 (n/a)156.80 (n/a)146.00 (n/a)131.00 (n/a)25.69 (n/a)

mem_copy_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.06 (+9.02%)0.05 (+5.59%)0.05 (+0.00%)0.04 (+3.63%)0.01 (+25.48%)193.00 (-3.50%)147.40 (-4.66%)147.00 (+0.00%)122.00 (-8.27%)25.24 (+7.48%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)154.60 (n/a)147.00 (n/a)133.00 (n/a)23.48 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.09 (-3.98%)0.07 (+4.00%)0.07 (+7.04%)0.06 (+3.67%)0.01 (-15.76%)129.70 (-3.57%)113.30 (-4.50%)116.90 (-6.55%)90.40 (+4.15%)15.04 (-13.80%)
0a6c11c — 2025-12-04 00:39:100.09 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)134.50 (n/a)118.64 (n/a)125.10 (n/a)86.80 (n/a)17.45 (n/a)

mem_copy_4_cores_1_chans_2048_tile_512_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-23.33%)0.05 (-27.09%)0.04 (-28.89%)0.03 (-34.13%)0.01 (+21.63%)240.60 (+51.80%)188.34 (+41.23%)186.90 (+40.63%)140.40 (+30.48%)43.88 (+142.25%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)158.50 (n/a)133.36 (n/a)132.90 (n/a)107.60 (n/a)18.11 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.08 (+9.57%)0.07 (+16.85%)0.07 (+19.58%)0.06 (+24.52%)0.01 (+1.05%)134.50 (-19.70%)116.64 (-14.92%)116.80 (-16.39%)98.00 (-8.75%)15.71 (-25.13%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)167.50 (n/a)137.10 (n/a)139.70 (n/a)107.40 (n/a)20.99 (n/a)

mem_copy_4_cores_2_chans_2048_tile_512_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.05 (-2.66%)0.05 (-4.21%)0.05 (-7.59%)0.04 (-12.20%)0.01 (+7.29%)214.10 (+13.88%)169.78 (+4.85%)162.00 (+8.22%)149.00 (+2.76%)25.57 (+29.64%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)188.00 (n/a)161.92 (n/a)149.70 (n/a)145.00 (n/a)19.72 (n/a)

mem_copy_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (-13.48%)0.05 (-17.79%)0.05 (-15.33%)0.03 (-25.09%)0.01 (+6.67%)267.00 (+33.50%)176.80 (+24.51%)150.00 (+18.11%)141.00 (+15.57%)47.41 (+61.41%)
0999a9a — 2025-11-13 19:24:080.06 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)200.00 (n/a)142.00 (n/a)127.00 (n/a)122.00 (n/a)29.37 (n/a)

mem_copy_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
003b49d — 2025-11-14 19:30:540.05 (+13.38%)0.05 (+23.85%)0.05 (+37.91%)0.05 (+30.72%)0.00 (-56.85%)166.00 (-23.50%)153.40 (-20.60%)153.00 (-27.49%)142.00 (-11.80%)7.63 (-70.60%)
0999a9a — 2025-11-13 19:24:080.05 (n/a)0.04 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)217.00 (n/a)193.20 (n/a)211.00 (n/a)161.00 (n/a)25.96 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.09 (+16.31%)0.08 (+15.34%)0.08 (+14.60%)0.07 (+19.30%)0.01 (-5.41%)117.30 (-16.15%)107.80 (-13.61%)108.50 (-12.78%)94.10 (-13.99%)8.29 (-32.01%)
0a6c11c — 2025-12-04 00:39:100.07 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)139.90 (n/a)124.78 (n/a)124.40 (n/a)109.40 (n/a)12.20 (n/a)

mem_copy_8_cores_1_chans_2048_tile_256_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.08 (+7.31%)0.06 (+17.95%)0.06 (+35.91%)0.05 (+12.26%)0.01 (+1.31%)173.60 (-10.93%)136.28 (-15.56%)126.30 (-26.44%)102.20 (-6.84%)28.51 (-11.07%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)194.90 (n/a)161.40 (n/a)171.70 (n/a)109.70 (n/a)32.06 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.09 (+12.61%)0.07 (-2.24%)0.07 (-8.85%)0.06 (+5.13%)0.01 (+35.50%)136.50 (-4.88%)120.86 (+2.96%)125.10 (+9.64%)91.60 (-11.15%)15.72 (+10.46%)
0a6c11c — 2025-12-04 00:39:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.06 (n/a)0.01 (n/a)143.50 (n/a)117.38 (n/a)114.10 (n/a)103.10 (n/a)14.23 (n/a)

mem_copy_8_cores_2_chans_2048_tile_256_False0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-14.85%)0.05 (-3.60%)0.05 (-6.36%)0.05 (+27.75%)0.00 (-66.58%)178.50 (-21.74%)159.58 (-1.65%)162.20 (+6.78%)140.20 (+17.42%)14.21 (-68.85%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)228.10 (n/a)162.26 (n/a)151.90 (n/a)119.40 (n/a)45.62 (n/a)

mha

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.18 (+0.16%)0.18 (+0.19%)0.18 (+0.12%)0.18 (+0.32%)0.00 (-52.24%)47253.90 (-0.32%)47213.70 (-0.19%)47210.90 (-0.12%)47167.70 (-0.16%)28.71 (-52.47%)
0a6c11c — 2025-12-04 00:39:100.18 (n/a)0.18 (n/a)0.18 (n/a)0.18 (n/a)0.00 (n/a)47405.00 (n/a)47301.72 (n/a)47265.90 (n/a)47241.80 (n/a)60.40 (n/a)

mha0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.18 (-0.02%)0.18 (-0.05%)0.18 (-0.15%)0.18 (+0.00%)0.00 (-1.93%)47531.30 (-0.00%)47402.08 (+0.05%)47430.90 (+0.15%)47276.10 (+0.02%)99.24 (-1.93%)
d48746f — 2026-01-12 22:17:100.18 (n/a)0.18 (n/a)0.18 (n/a)0.18 (n/a)0.00 (n/a)47533.00 (n/a)47377.04 (n/a)47360.70 (n/a)47268.30 (n/a)101.19 (n/a)

relu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (-1.72%)0.06 (-0.20%)0.06 (+2.93%)0.05 (-1.78%)0.01 (+17.16%)163.20 (+1.81%)136.52 (+0.59%)128.60 (-2.80%)120.50 (+1.69%)18.34 (+18.90%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)160.30 (n/a)135.72 (n/a)132.30 (n/a)118.50 (n/a)15.42 (n/a)

relu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-17.55%)0.06 (-7.57%)0.06 (+3.44%)0.04 (-16.41%)0.01 (-18.01%)193.10 (+19.64%)146.62 (+8.22%)136.80 (-3.32%)129.20 (+21.20%)26.24 (+24.18%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)161.40 (n/a)135.48 (n/a)141.50 (n/a)106.60 (n/a)21.13 (n/a)

relu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+1.13%)0.06 (+1.52%)0.06 (+1.64%)0.05 (-0.85%)0.01 (+21.60%)157.00 (+0.90%)137.52 (-1.24%)135.00 (-1.60%)123.60 (-1.12%)14.18 (+20.25%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)155.60 (n/a)139.24 (n/a)137.20 (n/a)125.00 (n/a)11.80 (n/a)

relu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (+21.03%)0.05 (+22.92%)0.06 (+35.78%)0.04 (-2.08%)0.01 (+86.48%)225.00 (+2.13%)157.16 (-16.15%)131.50 (-26.37%)128.50 (-17.36%)41.73 (+51.45%)
d48746f — 2026-01-12 22:17:100.05 (n/a)0.04 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)220.30 (n/a)187.42 (n/a)178.60 (n/a)155.50 (n/a)27.55 (n/a)

rms_norm_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.08 (+4.38%)0.06 (-0.18%)0.07 (+19.36%)0.04 (-12.35%)0.02 (+31.01%)186.40 (+14.08%)140.88 (+3.28%)121.00 (-16.20%)97.30 (-4.14%)39.72 (+50.35%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)163.40 (n/a)136.40 (n/a)144.40 (n/a)101.50 (n/a)26.42 (n/a)

rms_norm_1_cols_2_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (-25.50%)0.06 (-13.69%)0.05 (-17.99%)0.05 (+32.30%)0.01 (-60.87%)160.10 (-24.37%)145.20 (+7.81%)151.20 (+21.94%)114.80 (+34.27%)17.56 (-62.65%)
d48746f — 2026-01-12 22:17:100.10 (n/a)0.07 (n/a)0.07 (n/a)0.04 (n/a)0.02 (n/a)211.70 (n/a)134.68 (n/a)124.00 (n/a)85.50 (n/a)47.01 (n/a)

rms_norm_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.08 (-5.97%)0.06 (-8.69%)0.06 (-15.51%)0.05 (-4.69%)0.01 (-7.60%)161.80 (+4.93%)130.66 (+9.36%)131.00 (+18.34%)108.30 (+6.39%)20.71 (+0.52%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.07 (n/a)0.07 (n/a)0.05 (n/a)0.01 (n/a)154.20 (n/a)119.48 (n/a)110.70 (n/a)101.80 (n/a)20.60 (n/a)

rms_norm_2_cols_2_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-25.45%)0.05 (-11.00%)0.05 (-11.12%)0.04 (+12.48%)0.01 (-59.97%)189.90 (-11.10%)160.36 (+8.02%)153.90 (+12.50%)145.00 (+34.14%)18.13 (-53.85%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)213.60 (n/a)148.46 (n/a)136.80 (n/a)108.10 (n/a)39.28 (n/a)

rms_norm_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-18.12%)0.05 (-18.08%)0.05 (-13.92%)0.04 (-30.34%)0.01 (+6.18%)231.40 (+43.55%)165.80 (+24.59%)156.90 (+16.14%)127.00 (+22.12%)39.84 (+94.75%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)161.20 (n/a)133.08 (n/a)135.10 (n/a)104.00 (n/a)20.46 (n/a)

rms_norm_4_cols_2_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+18.99%)0.06 (+23.25%)0.06 (+13.51%)0.05 (+42.57%)0.01 (-13.78%)155.80 (-29.85%)139.70 (-19.92%)146.40 (-11.91%)119.90 (-15.98%)15.46 (-49.91%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)222.10 (n/a)174.46 (n/a)166.20 (n/a)142.70 (n/a)30.87 (n/a)

rms_norm_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (+8.50%)0.05 (-4.05%)0.05 (-9.15%)0.04 (-14.97%)0.01 (+147.99%)218.90 (+17.62%)174.84 (+7.17%)177.70 (+10.03%)138.60 (-7.78%)35.24 (+156.70%)
d48746f — 2026-01-12 22:17:100.05 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.00 (n/a)186.10 (n/a)163.14 (n/a)161.50 (n/a)150.30 (n/a)13.73 (n/a)

rms_norm_8_cols_2_channels_2048_tile_128

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+13.62%)0.05 (+1.13%)0.05 (-7.91%)0.04 (-3.69%)0.01 (+103.46%)184.70 (+3.88%)157.86 (+0.70%)170.90 (+8.58%)122.20 (-11.96%)26.53 (+85.00%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)177.80 (n/a)156.76 (n/a)157.40 (n/a)138.80 (n/a)14.34 (n/a)

rope_1_cols_2_channels_4096_tile_4096_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.24 (+9.29%)0.18 (-5.22%)0.17 (-11.78%)0.15 (-4.24%)0.04 (+16.93%)162.40 (+4.44%)138.80 (+6.05%)142.50 (+13.28%)101.70 (-8.46%)22.79 (+8.38%)
331dcca — 2026-01-08 18:34:100.22 (n/a)0.19 (n/a)0.20 (n/a)0.16 (n/a)0.03 (n/a)155.50 (n/a)130.88 (n/a)125.80 (n/a)111.10 (n/a)21.03 (n/a)

rope_1c_32rows_512cols_32arows_0m

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.88 (n/a)0.66 (n/a)0.66 (n/a)0.51 (n/a)0.14 (n/a)192.10 (n/a)153.28 (n/a)148.40 (n/a)111.20 (n/a)29.65 (n/a)

rope_1c_32rows_512cols_8arows_0m

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.65 (n/a)0.54 (n/a)0.52 (n/a)0.49 (n/a)0.06 (n/a)151.50 (n/a)138.66 (n/a)142.10 (n/a)113.70 (n/a)14.98 (n/a)

rope_2_cols_2_channels_4096_tile_2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.21 (-12.74%)0.19 (+0.44%)0.18 (+5.26%)0.15 (-2.94%)0.02 (-26.35%)159.20 (+3.04%)134.58 (-1.13%)134.10 (-4.96%)116.60 (+14.54%)17.86 (-10.90%)
331dcca — 2026-01-08 18:34:100.24 (n/a)0.18 (n/a)0.17 (n/a)0.16 (n/a)0.03 (n/a)154.50 (n/a)136.12 (n/a)141.10 (n/a)101.80 (n/a)20.05 (n/a)

rope_2c_32rows_512cols_32arows_0m

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.88 (n/a)0.64 (n/a)0.62 (n/a)0.52 (n/a)0.15 (n/a)190.40 (n/a)158.74 (n/a)157.70 (n/a)111.30 (n/a)31.48 (n/a)

rope_2c_32rows_512cols_8arows_0m

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.58 (n/a)0.47 (n/a)0.46 (n/a)0.41 (n/a)0.07 (n/a)180.90 (n/a)158.64 (n/a)159.80 (n/a)126.30 (n/a)20.97 (n/a)

rope_4_cols_2_channels_4096_tile_1024_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.19 (-1.73%)0.16 (-7.34%)0.16 (-4.69%)0.14 (-7.87%)0.02 (+3.75%)170.30 (+8.54%)154.16 (+8.05%)156.40 (+4.90%)130.90 (+1.71%)14.69 (+14.75%)
331dcca — 2026-01-08 18:34:100.19 (n/a)0.17 (n/a)0.16 (n/a)0.16 (n/a)0.02 (n/a)156.90 (n/a)142.68 (n/a)149.10 (n/a)128.70 (n/a)12.80 (n/a)

rope_8_cols_2_channels_4096_tile_512_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d48746f — 2026-01-12 22:17:100.17 (-25.86%)0.14 (-23.46%)0.16 (-13.16%)0.10 (-31.09%)0.03 (+9.33%)244.30 (+45.07%)182.30 (+34.32%)152.70 (+15.16%)144.60 (+34.89%)46.98 (+111.07%)
331dcca — 2026-01-08 18:34:100.23 (n/a)0.18 (n/a)0.19 (n/a)0.15 (n/a)0.03 (n/a)168.40 (n/a)135.72 (n/a)132.60 (n/a)107.20 (n/a)22.26 (n/a)

rope_8c_32rows_512cols_32arows_0m

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.70 (n/a)0.58 (n/a)0.57 (n/a)0.46 (n/a)0.10 (n/a)215.80 (n/a)172.44 (n/a)171.40 (n/a)140.30 (n/a)30.90 (n/a)

rope_8c_32rows_512cols_8arows_0m

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.58 (n/a)0.47 (n/a)0.45 (n/a)0.38 (n/a)0.08 (n/a)194.20 (n/a)160.54 (n/a)163.90 (n/a)127.30 (n/a)28.18 (n/a)

sigmoid_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+0.11%)0.06 (+8.91%)0.06 (+22.26%)0.04 (-4.58%)0.01 (+16.65%)185.90 (+4.85%)139.18 (-7.37%)130.00 (-18.24%)118.10 (-0.08%)28.16 (+23.36%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)177.30 (n/a)150.26 (n/a)159.00 (n/a)118.20 (n/a)22.83 (n/a)

sigmoid_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-9.70%)0.05 (-9.84%)0.05 (-6.66%)0.04 (-12.31%)0.01 (-8.80%)191.20 (+14.08%)157.56 (+11.08%)159.60 (+7.11%)126.50 (+10.77%)28.71 (+15.55%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)167.60 (n/a)141.84 (n/a)149.00 (n/a)114.20 (n/a)24.85 (n/a)

sigmoid_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-15.34%)0.06 (-5.49%)0.06 (-0.16%)0.05 (-0.58%)0.01 (-48.71%)168.60 (+0.54%)144.86 (+3.69%)140.20 (+0.14%)128.00 (+18.08%)15.82 (-39.50%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)167.70 (n/a)139.70 (n/a)140.00 (n/a)108.40 (n/a)26.15 (n/a)

sigmoid_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-5.89%)0.05 (+1.29%)0.05 (-7.79%)0.04 (+11.92%)0.01 (-42.87%)212.70 (-10.63%)169.14 (-5.60%)156.10 (+8.40%)144.00 (+6.27%)28.01 (-46.91%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.06 (n/a)0.03 (n/a)0.01 (n/a)238.00 (n/a)179.18 (n/a)144.00 (n/a)135.50 (n/a)52.75 (n/a)

silu_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.05 (-14.75%)0.05 (-7.18%)0.05 (-9.86%)0.05 (+4.32%)0.00 (-81.08%)157.70 (-4.13%)153.94 (+7.05%)153.70 (+10.97%)151.20 (+17.30%)2.83 (-79.05%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)164.50 (n/a)143.80 (n/a)138.50 (n/a)128.90 (n/a)13.53 (n/a)

silu_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+29.36%)0.06 (+12.89%)0.06 (+2.85%)0.05 (+10.33%)0.01 (+144.95%)154.70 (-9.37%)138.68 (-10.44%)147.50 (-2.77%)110.70 (-22.70%)17.76 (+69.02%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.05 (n/a)0.05 (n/a)0.00 (n/a)170.70 (n/a)154.84 (n/a)151.70 (n/a)143.20 (n/a)10.51 (n/a)

silu_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.08 (+9.41%)0.07 (+16.54%)0.07 (+21.77%)0.05 (+36.01%)0.01 (-21.47%)151.50 (-26.49%)125.96 (-16.25%)117.40 (-17.84%)104.30 (-8.67%)19.05 (-47.06%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)206.10 (n/a)150.40 (n/a)142.90 (n/a)114.20 (n/a)35.99 (n/a)

silu_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-9.45%)0.05 (-0.87%)0.05 (+5.12%)0.04 (-3.68%)0.01 (-16.07%)193.50 (+3.86%)159.32 (+0.57%)150.50 (-4.87%)133.20 (+10.45%)24.12 (+0.09%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.05 (n/a)0.05 (n/a)0.04 (n/a)0.01 (n/a)186.30 (n/a)158.42 (n/a)158.20 (n/a)120.60 (n/a)24.09 (n/a)

softmax_1_cols_2_channels_4096_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.13 (-18.19%)0.11 (-9.48%)0.11 (-6.40%)0.09 (+13.68%)0.02 (-46.46%)186.20 (-12.05%)150.14 (+6.05%)145.00 (+6.85%)123.80 (+22.21%)23.44 (-44.06%)
d48746f — 2026-01-12 22:17:100.16 (n/a)0.12 (n/a)0.12 (n/a)0.08 (n/a)0.03 (n/a)211.70 (n/a)141.58 (n/a)135.70 (n/a)101.30 (n/a)41.91 (n/a)

softmax_2_cols_2_channels_4096_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.13 (-11.91%)0.11 (+3.60%)0.11 (+8.71%)0.09 (+8.19%)0.01 (-44.35%)175.80 (-7.57%)147.34 (-5.59%)147.80 (-8.03%)128.30 (+13.54%)18.02 (-40.52%)
d48746f — 2026-01-12 22:17:100.15 (n/a)0.11 (n/a)0.10 (n/a)0.09 (n/a)0.02 (n/a)190.20 (n/a)156.06 (n/a)160.70 (n/a)113.00 (n/a)30.29 (n/a)

softmax_2_cols_2_channels_4096_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.15 (+2.49%)0.12 (+10.66%)0.12 (+2.18%)0.10 (+18.97%)0.02 (-20.07%)167.80 (-15.97%)137.08 (-11.91%)135.60 (-2.16%)109.70 (-2.40%)24.57 (-37.91%)
d48746f — 2026-01-12 22:17:100.15 (n/a)0.11 (n/a)0.12 (n/a)0.08 (n/a)0.03 (n/a)199.70 (n/a)155.62 (n/a)138.60 (n/a)112.40 (n/a)39.58 (n/a)

swiglu

No metrics available.

swiglu_decode_1x2048x2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:490.00 (-15.46%)0.00 (-27.20%)0.00 (-28.17%)0.00 (-33.90%)0.00 (+1834.83%)5187.20 (+51.28%)4720.84 (+38.38%)4750.90 (+39.22%)4015.10 (+18.29%)390.23 (+3298.45%)
0a6c11c — 2025-12-04 00:39:100.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)3428.80 (n/a)3411.62 (n/a)3412.60 (n/a)3394.20 (n/a)11.48 (n/a)

swiglu_decode_1x2048x2048_0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.00 (+0.04%)0.00 (-2.09%)0.00 (-0.44%)0.00 (-9.03%)0.00 (+16.89%)5147.60 (+9.92%)4025.90 (+3.14%)3455.50 (+0.44%)3429.20 (-0.04%)815.69 (+26.59%)
d48746f — 2026-01-12 22:17:100.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)4683.00 (n/a)3903.40 (n/a)3440.50 (n/a)3430.50 (n/a)644.34 (n/a)

tanh_1_cols_1_channels_2048_tile_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.09 (+7.36%)0.06 (+3.79%)0.06 (-4.96%)0.04 (-7.64%)0.02 (+44.18%)189.70 (+8.28%)136.88 (-0.26%)137.10 (+5.22%)94.70 (-6.88%)40.03 (+40.59%)
d48746f — 2026-01-12 22:17:100.08 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.01 (n/a)175.20 (n/a)137.24 (n/a)130.30 (n/a)101.70 (n/a)28.47 (n/a)

tanh_2_cols_1_channels_2048_tile_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-6.60%)0.05 (-3.79%)0.05 (-2.22%)0.04 (-10.47%)0.01 (+19.78%)190.00 (+11.70%)158.16 (+4.35%)151.90 (+2.29%)145.50 (+7.06%)18.45 (+43.88%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.05 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)170.10 (n/a)151.56 (n/a)148.50 (n/a)135.90 (n/a)12.82 (n/a)

tanh_4_cols_1_channels_2048_tile_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+10.46%)0.05 (-5.33%)0.06 (+2.92%)0.04 (-20.49%)0.01 (+95.64%)217.90 (+25.74%)163.94 (+10.89%)147.00 (-2.84%)113.80 (-9.47%)46.08 (+135.20%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.05 (n/a)0.05 (n/a)0.01 (n/a)173.30 (n/a)147.84 (n/a)151.30 (n/a)125.70 (n/a)19.59 (n/a)

tanh_8_cols_1_channels_2048_tile_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.08 (+24.26%)0.06 (+5.84%)0.06 (+3.65%)0.05 (-2.32%)0.01 (+136.66%)159.40 (+2.38%)136.08 (-4.28%)136.80 (-3.53%)106.90 (-19.50%)18.84 (+91.64%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)155.70 (n/a)142.16 (n/a)141.80 (n/a)132.80 (n/a)9.83 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:493.93 (-7.02%)3.68 (+2.48%)3.66 (+1.82%)3.45 (+15.62%)0.15 (-63.64%)151.80 (-13.50%)142.70 (-3.59%)143.40 (-1.78%)133.50 (+7.49%)5.90 (-66.22%)
0a6c11c — 2025-12-04 00:39:104.22 (n/a)3.59 (n/a)3.59 (n/a)2.99 (n/a)0.42 (n/a)175.50 (n/a)148.02 (n/a)146.00 (n/a)124.20 (n/a)17.46 (n/a)

transpose_2048_M_64_N_1_cols_1_channels_64_m_64_n_8_s0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:063.03 (-17.30%)2.88 (-11.01%)2.95 (-14.93%)2.58 (-4.20%)0.19 (-58.59%)202.90 (+4.37%)182.40 (+10.95%)177.40 (+17.56%)173.20 (+20.95%)12.43 (-47.97%)
d48746f — 2026-01-12 22:17:103.66 (n/a)3.24 (n/a)3.47 (n/a)2.70 (n/a)0.45 (n/a)194.40 (n/a)164.40 (n/a)150.90 (n/a)143.20 (n/a)23.89 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
130b6ea — 2025-12-05 21:15:495.11 (+15.57%)3.85 (-3.32%)3.40 (-18.64%)3.29 (+7.09%)0.71 (+49.14%)159.60 (-6.61%)140.18 (+4.80%)154.20 (+22.97%)102.60 (-13.49%)22.70 (+19.77%)
0a6c11c — 2025-12-04 00:39:104.42 (n/a)3.99 (n/a)4.18 (n/a)3.07 (n/a)0.48 (n/a)170.90 (n/a)133.76 (n/a)125.40 (n/a)118.60 (n/a)18.95 (n/a)

transpose_2048_M_64_N_1_cols_2_channels_64_m_64_n_8_s0

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:064.16 (+10.00%)3.28 (-8.50%)2.96 (-19.16%)2.87 (-10.46%)0.55 (+144.87%)182.70 (+11.67%)163.16 (+11.11%)177.10 (+23.67%)126.10 (-9.08%)24.16 (+146.59%)
d48746f — 2026-01-12 22:17:103.78 (n/a)3.58 (n/a)3.66 (n/a)3.21 (n/a)0.22 (n/a)163.60 (n/a)146.84 (n/a)143.20 (n/a)138.70 (n/a)9.80 (n/a)

weighted_rms_norm_1_cols_2_channels_2048_weights_2048

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.08 (+15.64%)0.06 (-2.32%)0.06 (-7.64%)0.05 (+1.85%)0.01 (+34.12%)179.70 (-1.80%)148.30 (+3.36%)146.80 (+8.34%)107.40 (-13.53%)26.63 (+10.34%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)183.00 (n/a)143.48 (n/a)135.50 (n/a)124.20 (n/a)24.14 (n/a)

weighted_rms_norm_2_cols_2_channels_2048_weights_1024

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+11.41%)0.06 (-1.09%)0.05 (-3.30%)0.04 (-24.81%)0.01 (+159.53%)210.30 (+33.02%)152.32 (+5.22%)151.70 (+3.41%)114.20 (-10.29%)37.80 (+209.39%)
d48746f — 2026-01-12 22:17:100.06 (n/a)0.06 (n/a)0.06 (n/a)0.05 (n/a)0.00 (n/a)158.10 (n/a)144.76 (n/a)146.70 (n/a)127.30 (n/a)12.22 (n/a)

weighted_rms_norm_4_cols_2_channels_2048_weights_512

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.07 (+0.72%)0.06 (-0.09%)0.06 (+5.38%)0.04 (+9.61%)0.01 (-10.55%)216.80 (-8.75%)147.74 (-1.79%)133.50 (-5.12%)110.30 (-0.72%)41.54 (-18.42%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.03 (n/a)0.02 (n/a)237.60 (n/a)150.44 (n/a)140.70 (n/a)111.10 (n/a)50.92 (n/a)

weighted_rms_norm_8_cols_2_channels_2048_weights_256

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
8a880b4 — 2026-01-13 00:04:060.06 (-10.70%)0.05 (-15.44%)0.05 (-19.61%)0.04 (-7.99%)0.01 (-11.70%)224.40 (+8.67%)181.62 (+17.86%)180.10 (+24.38%)131.10 (+11.96%)33.58 (+1.88%)
d48746f — 2026-01-12 22:17:100.07 (n/a)0.06 (n/a)0.06 (n/a)0.04 (n/a)0.01 (n/a)206.50 (n/a)154.10 (n/a)144.80 (n/a)117.10 (n/a)32.96 (n/a)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jgmelber jgmelber Awaiting requested review from jgmelber jgmelber is a code owner

@hunhoffe hunhoffe Awaiting requested review from hunhoffe hunhoffe is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@andrej