Skip to content
Multi-Turn Benchmark Sweep

Multi-Turn Sweep - tp=[1, 2, 4, 8] users=[8, 16, 32, 64, 128, 256, 512, 1024, 2048] offload=["on", "off"] #15

Sign in to view logs

Multi-Turn Sweep - tp=[1, 2, 4, 8] users=[8, 16, 32, 64, 128, 256, 512, 1024, 2048] offload=["on", "off"]

Multi-Turn Sweep - tp=[1, 2, 4, 8] users=[8, 16, 32, 64, 128, 256, 512, 1024, 2048] offload=["on", "off"] #15

Manually triggered March 9, 2026 13:31
@cquil11cquil11
⁠ ee10ce4
experimental/multi-turn-benchmark
Status Cancelled
Total duration 19m 21s
Artifacts 41

multiturn-sweep.yml

on: workflow_dispatch
Matrix: sweep /
Collect results
29s
Collect results
Fit to window
Zoom out
Zoom in

Annotations

110 errors
sweep / (1, 8, on) / multiturn_tp1_users8_offloadon tp=1 users=8 offload=on
Process completed with exit code 1.
sweep / (1, 16, off) / multiturn_tp1_users16_offloadoff tp=1 users=16 offload=off
Process completed with exit code 1.
sweep / (8, 32, on) / multiturn_tp8_users32_offloadon tp=8 users=32 offload=on
Process completed with exit code 1.
sweep / (4, 16, on) / multiturn_tp4_users16_offloadon tp=4 users=16 offload=on
Process completed with exit code 1.
sweep / (8, 128, off) / multiturn_tp8_users128_offloadoff tp=8 users=128 offload=off
Process completed with exit code 1.
sweep / (2, 128, on) / multiturn_tp2_users128_offloadon tp=2 users=128 offload=on
Process completed with exit code 1.
sweep / (2, 256, off) / multiturn_tp2_users256_offloadoff tp=2 users=256 offload=off
Process completed with exit code 1.
sweep / (2, 2048, off) / multiturn_tp2_users2048_offloadoff tp=2 users=2048 offload=off
Process completed with exit code 1.
sweep / (4, 1024, on) / multiturn_tp4_users1024_offloadon tp=4 users=1024 offload=on
Process completed with exit code 1.
sweep / (8, 512, off) / multiturn_tp8_users512_offloadoff tp=8 users=512 offload=off
Process completed with exit code 1.
sweep / (1, 32, on) / multiturn_tp1_users32_offloadon tp=1 users=32 offload=on
The run was canceled by @cquil11.
sweep / (1, 8, off) / multiturn_tp1_users8_offloadoff tp=1 users=8 offload=off
The run was canceled by @cquil11.
sweep / (1, 16, on) / multiturn_tp1_users16_offloadon tp=1 users=16 offload=on
The run was canceled by @cquil11.
sweep / (1, 64, on) / multiturn_tp1_users64_offloadon tp=1 users=64 offload=on
The run was canceled by @cquil11.
sweep / (1, 128, on) / multiturn_tp1_users128_offloadon tp=1 users=128 offload=on
The run was canceled by @cquil11.
sweep / (1, 32, off) / multiturn_tp1_users32_offloadoff tp=1 users=32 offload=off
The run was canceled by @cquil11.
sweep / (1, 128, off) / multiturn_tp1_users128_offloadoff tp=1 users=128 offload=off
The run was canceled by @cquil11.
sweep / (1, 64, off) / multiturn_tp1_users64_offloadoff tp=1 users=64 offload=off
The run was canceled by @cquil11.
sweep / (1, 256, off) / multiturn_tp1_users256_offloadoff tp=1 users=256 offload=off
The run was canceled by @cquil11.
sweep / (1, 512, on) / multiturn_tp1_users512_offloadon tp=1 users=512 offload=on
The run was canceled by @cquil11.
sweep / (1, 2048, on) / multiturn_tp1_users2048_offloadon tp=1 users=2048 offload=on
The run was canceled by @cquil11.
sweep / (1, 2048, off) / multiturn_tp1_users2048_offloadoff tp=1 users=2048 offload=off
The run was canceled by @cquil11.
sweep / (1, 1024, on) / multiturn_tp1_users1024_offloadon tp=1 users=1024 offload=on
The run was canceled by @cquil11.
sweep / (2, 8, off) / multiturn_tp2_users8_offloadoff tp=2 users=8 offload=off
The run was canceled by @cquil11.
sweep / (2, 8, on) / multiturn_tp2_users8_offloadon tp=2 users=8 offload=on
The run was canceled by @cquil11.
sweep / (1, 256, on) / multiturn_tp1_users256_offloadon tp=1 users=256 offload=on
The run was canceled by @cquil11.
sweep / (2, 16, on) / multiturn_tp2_users16_offloadon tp=2 users=16 offload=on
The run was canceled by @cquil11.
sweep / (2, 16, off) / multiturn_tp2_users16_offloadoff tp=2 users=16 offload=off
The run was canceled by @cquil11.
sweep / (2, 512, off) / multiturn_tp2_users512_offloadoff tp=2 users=512 offload=off
The run was canceled by @cquil11.
sweep / (2, 128, off) / multiturn_tp2_users128_offloadoff tp=2 users=128 offload=off
The run was canceled by @cquil11.
sweep / (2, 32, on) / multiturn_tp2_users32_offloadon tp=2 users=32 offload=on
The run was canceled by @cquil11.
sweep / (2, 32, off) / multiturn_tp2_users32_offloadoff tp=2 users=32 offload=off
The run was canceled by @cquil11.
sweep / (4, 8, off) / multiturn_tp4_users8_offloadoff tp=4 users=8 offload=off
The run was canceled by @cquil11.
sweep / (2, 512, on) / multiturn_tp2_users512_offloadon tp=2 users=512 offload=on
The run was canceled by @cquil11.
sweep / (2, 256, on) / multiturn_tp2_users256_offloadon tp=2 users=256 offload=on
The run was canceled by @cquil11.
sweep / (4, 64, on) / multiturn_tp4_users64_offloadon tp=4 users=64 offload=on
The run was canceled by @cquil11.
sweep / (2, 2048, on) / multiturn_tp2_users2048_offloadon tp=2 users=2048 offload=on
The run was canceled by @cquil11.
sweep / (4, 16, off) / multiturn_tp4_users16_offloadoff tp=4 users=16 offload=off
The run was canceled by @cquil11.
sweep / (4, 8, on) / multiturn_tp4_users8_offloadon tp=4 users=8 offload=on
The run was canceled by @cquil11.
sweep / (4, 32, on) / multiturn_tp4_users32_offloadon tp=4 users=32 offload=on
The run was canceled by @cquil11.
sweep / (4, 128, off) / multiturn_tp4_users128_offloadoff tp=4 users=128 offload=off
The run was canceled by @cquil11.
sweep / (2, 1024, off) / multiturn_tp2_users1024_offloadoff tp=2 users=1024 offload=off
The run was canceled by @cquil11.
sweep / (4, 128, on) / multiturn_tp4_users128_offloadon tp=4 users=128 offload=on
The run was canceled by @cquil11.
sweep / (4, 32, off) / multiturn_tp4_users32_offloadoff tp=4 users=32 offload=off
The run was canceled by @cquil11.
sweep / (4, 64, off) / multiturn_tp4_users64_offloadoff tp=4 users=64 offload=off
The run was canceled by @cquil11.
sweep / (4, 256, off) / multiturn_tp4_users256_offloadoff tp=4 users=256 offload=off
The run was canceled by @cquil11.
sweep / (4, 512, on) / multiturn_tp4_users512_offloadon tp=4 users=512 offload=on
The run was canceled by @cquil11.
sweep / (8, 8, on) / multiturn_tp8_users8_offloadon tp=8 users=8 offload=on
The run was canceled by @cquil11.
sweep / (4, 256, on) / multiturn_tp4_users256_offloadon tp=4 users=256 offload=on
The run was canceled by @cquil11.
sweep / (4, 1024, off) / multiturn_tp4_users1024_offloadoff tp=4 users=1024 offload=off
The run was canceled by @cquil11.
sweep / (4, 2048, on) / multiturn_tp4_users2048_offloadon tp=4 users=2048 offload=on
The run was canceled by @cquil11.
sweep / (8, 2048, on) / multiturn_tp8_users2048_offloadon tp=8 users=2048 offload=on
The run was canceled by @cquil11.
sweep / (8, 64, off) / multiturn_tp8_users64_offloadoff tp=8 users=64 offload=off
The run was canceled by @cquil11.
sweep / (8, 256, off) / multiturn_tp8_users256_offloadoff tp=8 users=256 offload=off
The run was canceled by @cquil11.
sweep / (8, 1024, on) / multiturn_tp8_users1024_offloadon tp=8 users=1024 offload=on
The run was canceled by @cquil11.
sweep / (8, 64, on) / multiturn_tp8_users64_offloadon tp=8 users=64 offload=on
The run was canceled by @cquil11.
sweep / (8, 2048, off) / multiturn_tp8_users2048_offloadoff tp=8 users=2048 offload=off
The run was canceled by @cquil11.
sweep / (8, 128, on) / multiturn_tp8_users128_offloadon tp=8 users=128 offload=on
The run was canceled by @cquil11.
sweep / (8, 32, off) / multiturn_tp8_users32_offloadoff tp=8 users=32 offload=off
The run was canceled by @cquil11.
sweep / (8, 1024, off) / multiturn_tp8_users1024_offloadoff tp=8 users=1024 offload=off
The run was canceled by @cquil11.
sweep / (8, 1024, off) / multiturn_tp8_users1024_offloadoff tp=8 users=1024 offload=off
The operation was canceled.
sweep / (4, 2048, off) / multiturn_tp4_users2048_offloadoff tp=4 users=2048 offload=off
The run was canceled by @cquil11.
sweep / (4, 2048, off) / multiturn_tp4_users2048_offloadoff tp=4 users=2048 offload=off
The operation was canceled.
sweep / (8, 16, on) / multiturn_tp8_users16_offloadon tp=8 users=16 offload=on
The run was canceled by @cquil11.
sweep / (8, 16, on) / multiturn_tp8_users16_offloadon tp=8 users=16 offload=on
The operation was canceled.
sweep / (1, 1024, off) / multiturn_tp1_users1024_offloadoff tp=1 users=1024 offload=off
The run was canceled by @cquil11.
sweep / (1, 1024, off) / multiturn_tp1_users1024_offloadoff tp=1 users=1024 offload=off
The operation was canceled.
sweep / (8, 8, off) / multiturn_tp8_users8_offloadoff tp=8 users=8 offload=off
The run was canceled by @cquil11.
sweep / (8, 8, off) / multiturn_tp8_users8_offloadoff tp=8 users=8 offload=off
The operation was canceled.
sweep / (1, 512, off) / multiturn_tp1_users512_offloadoff tp=1 users=512 offload=off
The run was canceled by @cquil11.
sweep / (1, 512, off) / multiturn_tp1_users512_offloadoff tp=1 users=512 offload=off
The operation was canceled.
sweep / (2, 1024, on) / multiturn_tp2_users1024_offloadon tp=2 users=1024 offload=on
The run was canceled by @cquil11.
sweep / (2, 1024, on) / multiturn_tp2_users1024_offloadon tp=2 users=1024 offload=on
The operation was canceled.
sweep / (2, 64, off) / multiturn_tp2_users64_offloadoff tp=2 users=64 offload=off
The run was canceled by @cquil11.
sweep / (2, 64, off) / multiturn_tp2_users64_offloadoff tp=2 users=64 offload=off
The operation was canceled.
sweep / (4, 512, off) / multiturn_tp4_users512_offloadoff tp=4 users=512 offload=off
The run was canceled by @cquil11.
sweep / (4, 512, off) / multiturn_tp4_users512_offloadoff tp=4 users=512 offload=off
The operation was canceled.
sweep / (8, 16, off) / multiturn_tp8_users16_offloadoff tp=8 users=16 offload=off
The run was canceled by @cquil11.
sweep / (8, 16, off) / multiturn_tp8_users16_offloadoff tp=8 users=16 offload=off
The operation was canceled.
sweep / (8, 256, on) / multiturn_tp8_users256_offloadon tp=8 users=256 offload=on
The run was canceled by @cquil11.
sweep / (8, 256, on) / multiturn_tp8_users256_offloadon tp=8 users=256 offload=on
The operation was canceled.
sweep / (2, 64, on) / multiturn_tp2_users64_offloadon tp=2 users=64 offload=on
The run was canceled by @cquil11.
sweep / (2, 64, on) / multiturn_tp2_users64_offloadon tp=2 users=64 offload=on
The operation was canceled.
sweep / (8, 512, on) / multiturn_tp8_users512_offloadon tp=8 users=512 offload=on
The run was canceled by @cquil11.
sweep / (8, 512, on) / multiturn_tp8_users512_offloadon tp=8 users=512 offload=on
The operation was canceled.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.

Artifacts

Produced during runtime
Name Size Digest
multiturn_aggregated
21.2 MB
sha256:d04122e7cdb60ca1f99ed2671ef20dfef8de0daccf4fc82372314ed61a69ce42
multiturn_tp1_users16_offloadoff
645 KB
sha256:58220b80d881ae43a9689ba9dfcb884a67d5c02aa9cb28af713b1c491d1f49e6
multiturn_tp1_users512_offloadoff
750 Bytes
sha256:52bd6f2fb1d33cf5badd9493702306cb1638c11d5c8f74b0822085391ae834ac
multiturn_tp1_users8_offloadon
725 KB
sha256:4b04698f83d3178ca18b085fe92e91579c60dc39e01eba9b3c4b81e1a8e4bca6
multiturn_tp2_users1024_offloadon
2.03 KB
sha256:479ef3ea7fd125b3b2913ea32f87f2019fe32f8a6aa3755c2cb8c236a206ad08
multiturn_tp2_users128_offloadon
767 KB
sha256:95f41f8befc6ee7f3d86b9a1ca0302faba936f85a0a0131d0525b06b19280f80
multiturn_tp2_users2048_offloadoff
673 KB
sha256:c2fd5af4c351ef70aa6ed72ae71a900ecc0bd1d61d4cd383c8afdaea688bfa53
multiturn_tp2_users256_offloadoff
730 KB
sha256:60a789f589a8d510acd539b326603af75a2587203471a72d233a331b2e106abf
multiturn_tp2_users64_offloadoff
2.82 KB
sha256:c3ca5a913d962e8fa2074c448749d330ea8a50f4ace70d0111a7bd98d724d938
multiturn_tp2_users64_offloadon
4.89 KB
sha256:8aeb3c8b9164c77ae2ba9a0fc4611c1d00b2de2f750cc3dddc63339ea178d2ac
multiturn_tp4_users1024_offloadon
9.02 MB
sha256:93073cd2aa8ecc76418d0087f1b39531fa1ff2d0fc4dad6f3f572b71a6e25950
multiturn_tp4_users16_offloadon
893 KB
sha256:411601567966e362565558912b21735b35c3af1a4b441f26dc1dc866d7291f11
multiturn_tp4_users512_offloadoff
7.87 KB
sha256:549aac34ef6c69c4e394c75e33add13469b97469ee19a114e67f7a5fd299bca9
multiturn_tp8_users1024_offloadoff
922 KB
sha256:52113159a5b7d2a6cca0a0e26d47fffaa5a7590b0293f531ee1d349c64b2ecd3
multiturn_tp8_users128_offloadoff
1.02 MB
sha256:802c12c5c8587f85b605de289b6e031541c19e935d242d70a93902c9c7b6a0ab
multiturn_tp8_users16_offloadoff
2.01 KB
sha256:2a9e8877f5bed8bb8ff69b209700b7b9eb35c855d389983767c3f27dd7e5b7c3
multiturn_tp8_users256_offloadon
3.6 MB
sha256:6238572864852d036a3372fe544b26d5765908d362cc714465f3be7fdead9196
multiturn_tp8_users32_offloadon
1.34 MB
sha256:1a311682673411069fbda11eada722761f04d653c17cc3157a2077958dfcf18d
multiturn_tp8_users512_offloadoff
922 KB
sha256:8dbb8009cd418ddbb4b6b7092071b38ef3a46ff01003fa9c9e40b46303c64f9b
multiturn_tp8_users512_offloadon
7.35 KB
sha256:53049a94ae073602283f64be314e46d9c4a78e5c2f9af215b333443551c7f740
multiturn_tp8_users8_offloadoff
7.95 KB
sha256:f147e02c7276b2374b62a1326504e541bd3190a6f48ec9a712157af2b921f7e3
server_logs_tp1_users16_offloadoff
8.24 KB
sha256:64a1c69ae6614ecf8e9e02c558483c86f0e63dd65f5a2d725de6ba049bd0005c
server_logs_tp1_users512_offloadoff
136 Bytes
sha256:0925e89bbf4603022511cdadd8b7cfb8151c8e56c281c455f2da32edec3c27a4
server_logs_tp1_users8_offloadon
9.31 KB
sha256:cec22830e200045abc7ed8feace33acec47b93ec9843f042bf4fd1e54b01650e
server_logs_tp2_users1024_offloadon
1.45 KB
sha256:29f8933e6a7b2f70d988b37ed9ca2b624744e23b9db92caee98742f0cc1d6e76
server_logs_tp2_users128_offloadon
27.1 KB
sha256:2ddb6b30e0ddcb7938ac97ffe74e687901281ce43f0c84a19add365bca98b790
server_logs_tp2_users2048_offloadoff
23.3 KB
sha256:2124c20dad81d96498e7bf100dc4c807cde313a2bce5c81418f77787eda02eec
server_logs_tp2_users256_offloadoff
16.3 KB
sha256:63b1b0a1e935875f3b1eed7d259da44af33f94af511f857ea3bd89acdbf9fbd0
server_logs_tp2_users64_offloadoff
3.88 KB
sha256:711cb05492046d9022b9edfab1715db4e3d84c91cdeb274286c7299a50301ec4
server_logs_tp2_users64_offloadon
4.25 KB
sha256:d436f896873f9d1a826e37b1b1669a7043a574dc25253c963f72a32288ac3eec
server_logs_tp4_users1024_offloadon
8.25 MB
sha256:8b27fb2452f79cdcdd214bc220dd253435ec1843b25b3fd1d1b45a553dceca01
server_logs_tp4_users16_offloadon
17.5 KB
sha256:aa7b781569cc1b798ab1f568a559c461f40d41779dce4718477fa539a4fa5804
server_logs_tp4_users512_offloadoff
7.41 KB
sha256:e615f9d050608390a850ff1f17f83bfc67f82fefd1e8b05fc046796b620a178e
server_logs_tp8_users1024_offloadoff
30.9 KB
sha256:73f71b4dadd4c87ad93f395054b45a8dca822a3f369f83520e3eb052eef2c946
server_logs_tp8_users128_offloadoff
31 KB
sha256:67fb87ea6cf618197ade1b7e7c2cd96328160e6764cb8e923a77e9d906fbc7a7
server_logs_tp8_users16_offloadoff
1.41 KB
sha256:e536341b1b286a2ea3eacb23767f66787087b8f8be48640ad0ccb8b487679640
server_logs_tp8_users256_offloadon
2.61 MB
sha256:d1cdfc11382bf1e077bc588b9336e0e7314dc481e86d2b6d59e3a4b6b828a0bd
server_logs_tp8_users32_offloadon
356 KB
sha256:26f20a55feb0f8a0a2b2d612d2583fcd6a1efee1592467e496d94b9df9317c0f
server_logs_tp8_users512_offloadoff
30.9 KB
sha256:73f71b4dadd4c87ad93f395054b45a8dca822a3f369f83520e3eb052eef2c946
server_logs_tp8_users512_offloadon
6.71 KB
sha256:afe5ec473672002e532f50651fc8e0e82c525c80345c806182c3f6a56ecaf43e
server_logs_tp8_users8_offloadoff
7.47 KB
sha256:7edcf1932c8440dcb47597939e596f52253e5f0ac93a7a9cf503d4db05cc9156