Skip to content
Multi-Turn Benchmark Sweep

Multi-Turn Sweep - tp=[1, 2, 4, 8] users=[8, 16, 32, 64, 128, 256, 512, 1024, 2048] offload=["on", "off"] #21

Sign in to view logs

Multi-Turn Sweep - tp=[1, 2, 4, 8] users=[8, 16, 32, 64, 128, 256, 512, 1024, 2048] offload=["on", "off"]

Multi-Turn Sweep - tp=[1, 2, 4, 8] users=[8, 16, 32, 64, 128, 256, 512, 1024, 2048] offload=["on", "off"] #21

Manually triggered March 9, 2026 19:24
@cquil11cquil11
⁠ b66a79f
experimental/multi-turn-benchmark
Status Cancelled
Total duration 47m 59s
Artifacts 73

multiturn-sweep.yml

on: workflow_dispatch
Matrix: sweep /
Collect results
43s
Collect results
Fit to window
Zoom out
Zoom in

Annotations

86 errors
sweep / (1, 128, off) / multiturn_tp1_users128_offloadoff tp=1 users=128 offload=off
The run was canceled by @cquil11.
sweep / (1, 2048, on) / multiturn_tp1_users2048_offloadon tp=1 users=2048 offload=on
The run was canceled by @cquil11.
sweep / (1, 8, on) / multiturn_tp1_users8_offloadon tp=1 users=8 offload=on
The run was canceled by @cquil11.
sweep / (1, 32, on) / multiturn_tp1_users32_offloadon tp=1 users=32 offload=on
The run was canceled by @cquil11.
sweep / (1, 256, on) / multiturn_tp1_users256_offloadon tp=1 users=256 offload=on
The run was canceled by @cquil11.
sweep / (1, 1024, off) / multiturn_tp1_users1024_offloadoff tp=1 users=1024 offload=off
The run was canceled by @cquil11.
sweep / (2, 32, on) / multiturn_tp2_users32_offloadon tp=2 users=32 offload=on
The run was canceled by @cquil11.
sweep / (2, 128, off) / multiturn_tp2_users128_offloadoff tp=2 users=128 offload=off
The run was canceled by @cquil11.
sweep / (2, 32, off) / multiturn_tp2_users32_offloadoff tp=2 users=32 offload=off
The run was canceled by @cquil11.
sweep / (2, 8, off) / multiturn_tp2_users8_offloadoff tp=2 users=8 offload=off
The run was canceled by @cquil11.
sweep / (2, 256, on) / multiturn_tp2_users256_offloadon tp=2 users=256 offload=on
The run was canceled by @cquil11.
sweep / (2, 16, on) / multiturn_tp2_users16_offloadon tp=2 users=16 offload=on
The run was canceled by @cquil11.
sweep / (2, 64, off) / multiturn_tp2_users64_offloadoff tp=2 users=64 offload=off
The run was canceled by @cquil11.
sweep / (4, 128, off) / multiturn_tp4_users128_offloadoff tp=4 users=128 offload=off
The run was canceled by @cquil11.
sweep / (4, 16, on) / multiturn_tp4_users16_offloadon tp=4 users=16 offload=on
The run was canceled by @cquil11.
sweep / (4, 8, off) / multiturn_tp4_users8_offloadoff tp=4 users=8 offload=off
The run was canceled by @cquil11.
sweep / (2, 64, on) / multiturn_tp2_users64_offloadon tp=2 users=64 offload=on
The run was canceled by @cquil11.
sweep / (2, 2048, off) / multiturn_tp2_users2048_offloadoff tp=2 users=2048 offload=off
The run was canceled by @cquil11.
sweep / (4, 32, off) / multiturn_tp4_users32_offloadoff tp=4 users=32 offload=off
The run was canceled by @cquil11.
sweep / (4, 32, on) / multiturn_tp4_users32_offloadon tp=4 users=32 offload=on
The run was canceled by @cquil11.
sweep / (4, 256, off) / multiturn_tp4_users256_offloadoff tp=4 users=256 offload=off
The run was canceled by @cquil11.
sweep / (8, 16, on) / multiturn_tp8_users16_offloadon tp=8 users=16 offload=on
The run was canceled by @cquil11.
sweep / (4, 512, off) / multiturn_tp4_users512_offloadoff tp=4 users=512 offload=off
The run was canceled by @cquil11.
sweep / (4, 16, off) / multiturn_tp4_users16_offloadoff tp=4 users=16 offload=off
The run was canceled by @cquil11.
sweep / (4, 512, on) / multiturn_tp4_users512_offloadon tp=4 users=512 offload=on
The run was canceled by @cquil11.
sweep / (8, 32, off) / multiturn_tp8_users32_offloadoff tp=8 users=32 offload=off
The run was canceled by @cquil11.
sweep / (8, 8, off) / multiturn_tp8_users8_offloadoff tp=8 users=8 offload=off
The run was canceled by @cquil11.
sweep / (8, 256, off) / multiturn_tp8_users256_offloadoff tp=8 users=256 offload=off
The run was canceled by @cquil11.
sweep / (8, 64, off) / multiturn_tp8_users64_offloadoff tp=8 users=64 offload=off
The run was canceled by @cquil11.
sweep / (8, 512, off) / multiturn_tp8_users512_offloadoff tp=8 users=512 offload=off
The run was canceled by @cquil11.
sweep / (8, 128, on) / multiturn_tp8_users128_offloadon tp=8 users=128 offload=on
The run was canceled by @cquil11.
sweep / (8, 256, on) / multiturn_tp8_users256_offloadon tp=8 users=256 offload=on
The run was canceled by @cquil11.
sweep / (8, 2048, off) / multiturn_tp8_users2048_offloadoff tp=8 users=2048 offload=off
The run was canceled by @cquil11.
sweep / (8, 1024, on) / multiturn_tp8_users1024_offloadon tp=8 users=1024 offload=on
The run was canceled by @cquil11.
sweep / (8, 2048, on) / multiturn_tp8_users2048_offloadon tp=8 users=2048 offload=on
The run was canceled by @cquil11.
sweep / (1, 8, off) / multiturn_tp1_users8_offloadoff tp=1 users=8 offload=off
The run was canceled by @cquil11.
sweep / (1, 8, off) / multiturn_tp1_users8_offloadoff tp=1 users=8 offload=off
The operation was canceled.
sweep / (1, 256, off) / multiturn_tp1_users256_offloadoff tp=1 users=256 offload=off
The run was canceled by @cquil11.
sweep / (1, 256, off) / multiturn_tp1_users256_offloadoff tp=1 users=256 offload=off
The operation was canceled.
sweep / (1, 64, on) / multiturn_tp1_users64_offloadon tp=1 users=64 offload=on
The run was canceled by @cquil11.
sweep / (1, 64, on) / multiturn_tp1_users64_offloadon tp=1 users=64 offload=on
The operation was canceled.
sweep / (4, 256, on) / multiturn_tp4_users256_offloadon tp=4 users=256 offload=on
The run was canceled by @cquil11.
sweep / (4, 256, on) / multiturn_tp4_users256_offloadon tp=4 users=256 offload=on
The operation was canceled.
sweep / (1, 16, on) / multiturn_tp1_users16_offloadon tp=1 users=16 offload=on
The run was canceled by @cquil11.
sweep / (1, 16, on) / multiturn_tp1_users16_offloadon tp=1 users=16 offload=on
The operation was canceled.
sweep / (2, 8, on) / multiturn_tp2_users8_offloadon tp=2 users=8 offload=on
The run was canceled by @cquil11.
sweep / (2, 8, on) / multiturn_tp2_users8_offloadon tp=2 users=8 offload=on
The operation was canceled.
sweep / (2, 16, off) / multiturn_tp2_users16_offloadoff tp=2 users=16 offload=off
The run was canceled by @cquil11.
sweep / (2, 16, off) / multiturn_tp2_users16_offloadoff tp=2 users=16 offload=off
The operation was canceled.
sweep / (8, 128, off) / multiturn_tp8_users128_offloadoff tp=8 users=128 offload=off
The run was canceled by @cquil11.
sweep / (8, 128, off) / multiturn_tp8_users128_offloadoff tp=8 users=128 offload=off
The operation was canceled.
sweep / (2, 1024, on) / multiturn_tp2_users1024_offloadon tp=2 users=1024 offload=on
The run was canceled by @cquil11.
sweep / (2, 1024, on) / multiturn_tp2_users1024_offloadon tp=2 users=1024 offload=on
The operation was canceled.
sweep / (8, 512, on) / multiturn_tp8_users512_offloadon tp=8 users=512 offload=on
The run was canceled by @cquil11.
sweep / (8, 512, on) / multiturn_tp8_users512_offloadon tp=8 users=512 offload=on
The operation was canceled.
sweep / (8, 8, on) / multiturn_tp8_users8_offloadon tp=8 users=8 offload=on
The run was canceled by @cquil11.
sweep / (8, 8, on) / multiturn_tp8_users8_offloadon tp=8 users=8 offload=on
The operation was canceled.
sweep / (2, 512, on) / multiturn_tp2_users512_offloadon tp=2 users=512 offload=on
The run was canceled by @cquil11.
sweep / (2, 512, on) / multiturn_tp2_users512_offloadon tp=2 users=512 offload=on
The operation was canceled.
sweep / (2, 2048, on) / multiturn_tp2_users2048_offloadon tp=2 users=2048 offload=on
The run was canceled by @cquil11.
sweep / (2, 2048, on) / multiturn_tp2_users2048_offloadon tp=2 users=2048 offload=on
The operation was canceled.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.
Multi-Turn Benchmark Sweep
The run was canceled by @cquil11.

Artifacts

Produced during runtime
Name Size Digest
multiturn_aggregated
53.8 MB
sha256:cc693c2a625e545ae4781d3877007694aafe5f29091dc2ff659a83249a938b16
multiturn_tp1_users1024_offloadon
3.32 MB
sha256:4ba17b60801b2675a0c687d2b74931bc795767e8add86fda3619cef72d405c91
multiturn_tp1_users128_offloadon
1.03 MB
sha256:65f853afa32711b52bb24a4897c53d13ea118f1e309c119c335fc47a4c55384a
multiturn_tp1_users16_offloadoff
862 KB
sha256:1a344275d62ec5caa041370a150e7deff5a53b6e005e403e16e985bfd28bf56d
multiturn_tp1_users16_offloadon
10.5 KB
sha256:6c7bedcd3653a5885a0df28f523a8ae95126e10ad50ab0ef967e3f5f97a2c087
multiturn_tp1_users2048_offloadoff
908 KB
sha256:8cc7f4743b364d8832f148af8ab05869034b1e779f0736c7538033bb4f63abac
multiturn_tp1_users256_offloadoff
13.5 KB
sha256:5edf42c68a7cc51d1f076c5a8ad480c6d52424792d000c07f3728020b2a1a884
multiturn_tp1_users32_offloadoff
816 KB
sha256:751937ace03764814913a18b2b6a928569e5ef3dd40de0b52024ec75e53b5a6b
multiturn_tp1_users512_offloadoff
723 KB
sha256:57477c7ab3c17c0c2e85d6996df90dc95f36afcbab34213127b2bb0bdb867420
multiturn_tp1_users512_offloadon
1.43 MB
sha256:47221de6cf9110a475d0d10bc3941fbbcb75e8c5f7c4dba17469281e9b44daf8
multiturn_tp1_users64_offloadoff
870 KB
sha256:0e31d295243b3284b67b1a79ce16b68d444e0bf02de3d9df0d3d53cea7bf6966
multiturn_tp1_users64_offloadon
12.2 KB
sha256:dc383b4e97d8bf98d3a21ee236273b18f09748d48ccd437b5d0c1ea5e919d0f1
multiturn_tp2_users1024_offloadoff
861 KB
sha256:62f870b0dcf65289fa24a0bacb307eb06c42f2daa4aa4de3362fd2c698e45e63
multiturn_tp2_users1024_offloadon
664 KB
sha256:8bab4ab5e429c6fc6b7467908c4481c64f065f1c91e96d1793fdd377796a71b9
multiturn_tp2_users128_offloadon
985 KB
sha256:2efef2ecc2467e44076b5e0902f1adb82ac1b251a1be8d810fe9ab54af4fd720
multiturn_tp2_users16_offloadoff
13.9 KB
sha256:56fc64df475de21228c4e0c516f64912525381a5b368865310d52c958a80bccf
multiturn_tp2_users2048_offloadon
531 KB
sha256:84ea4f0bb4add212052b7f390edd55281f638ce2ddb0a0d6e315184d1faf7b5b
multiturn_tp2_users256_offloadoff
1.03 MB
sha256:7e2091d997a3915eb71dd73a0c8d61486d6d426cf271638f9a421046232c2b37
multiturn_tp2_users512_offloadoff
1.25 MB
sha256:44574e8b1b259b3e61d1a2d5e68a106c6ab10d5c0984170098d9cceed1bd03f7
multiturn_tp2_users512_offloadon
115 KB
sha256:9271c299354ce9bfa068d9ce504a91f440276569bd31bb130452bad1d1cfca22
multiturn_tp2_users8_offloadon
13.6 KB
sha256:a6cfb69bde8eff794d9fa932ffae39c03ca01740dd33e2539e62fcc89abe87fa
multiturn_tp4_users1024_offloadoff
1.68 MB
sha256:5d2ac0d233fc172a99bca32c1d7b5c93f90296f8b0b58a679f5add3f84c2e6b9
multiturn_tp4_users1024_offloadon
5.27 MB
sha256:5f7c92f30d403481a4ca5ae636feba74084d35793c65b1ddc463ffbd6b49a16b
multiturn_tp4_users128_offloadon
2.15 MB
sha256:faf1f185e0305bd25d562011ca8478cc5c8151f1bb250d9903544fd8321167ed
multiturn_tp4_users2048_offloadoff
973 KB
sha256:eea1144afa7d07ab7696d76b51e54fe2ee70f8314a820a056b7ae06279381977
multiturn_tp4_users2048_offloadon
4.82 MB
sha256:d00f99180cae0418d5352848f66f7b6f98997d6c3f37d21ee67f587e9afbc24d
multiturn_tp4_users256_offloadon
30.1 KB
sha256:1651f2718e7a7d03ce9e79eb4714f945dea119a7da1066331e1edf8f451d7b28
multiturn_tp4_users64_offloadoff
1.61 MB
sha256:67e65f77b91d16b4492121ae44e3f24bd9c6ccd9570e349894eb106fc73548be
multiturn_tp4_users64_offloadon
1.94 MB
sha256:4a5c47c058c6f0006d425d726ac900382fb2d1b8a51ac020532fe7ffec617846
multiturn_tp4_users8_offloadon
928 KB
sha256:e8b6118766c3082e544e7c231e06680d5a04d2b90cac9072c991873f97eee136
multiturn_tp8_users1024_offloadoff
3.26 MB
sha256:09f46c2e3c8cd821cc9322596162eecb7ec48766fe3fc68960051e5231311233
multiturn_tp8_users128_offloadoff
27.4 KB
sha256:146aff052da40ae098219f6f3201c59178e3534a08f2c062f1616d7a4b70eb50
multiturn_tp8_users16_offloadoff
1.06 MB
sha256:f77b7cc807a41a2f35f23538434d93af7db5a60e00c87be20f89d44e1240922e
multiturn_tp8_users32_offloadon
1.28 MB
sha256:ca0647c54cf91113c48307400e90905f34b075f78ef85a1ffdf2ab3ed2f49978
multiturn_tp8_users512_offloadon
6.96 MB
sha256:f9a39553b230e5a86603af419eb978e9543f65d50a2e32425a65eabc85d0894c
multiturn_tp8_users64_offloadon
3.46 MB
sha256:b42171b251288965a1bd27a279075570f34bcf71d77393a46acb184aebd64d3b
multiturn_tp8_users8_offloadon
2.85 KB
sha256:2cbe1982e4ad142e613e271490f12a88a065387486f052c1270c049749d70456
server_logs_tp1_users1024_offloadon
2.51 MB
sha256:6c8cbf3066cf4c3ebff3c5453fb7eb3b9d7b9e5792d5045cf28e4e8e2ce8f512
server_logs_tp1_users128_offloadon
12.4 KB
sha256:e7cf644e6f02a56bf50d4b524b324f35cd841a7b86275db470342bcf25db7100
server_logs_tp1_users16_offloadoff
8.2 KB
sha256:d682ef3b47ef15090e8f06dc1df9e93f13fce0ca45ca6e24d6e4c6e1463f2d7e
server_logs_tp1_users16_offloadon
7.08 KB
sha256:2b1cb0dee07de53cd87fd82fe17cdf04b25107221c70975b6ab1d8c312b8d5c8
server_logs_tp1_users2048_offloadoff
18.8 KB
sha256:2898701f007ce3827b42abeff1d0f51ebcf12f0cb8fed1c14d45d47eb81e5085
server_logs_tp1_users256_offloadoff
9.05 KB
sha256:7b34da289a6c68f12e820c298b3020a262d88118314b7e376c052cb4eaf023a3
server_logs_tp1_users32_offloadoff
8.54 KB
sha256:c3eb136232657d60dc160c8cdfc9e1bd3d969636f649b4472faae08c7c88d2ff
server_logs_tp1_users512_offloadoff
12.4 KB
sha256:c5371b1c8cd1c2506969c12f559468cf7b392e0ede100d0597f3039aa9d781ae
server_logs_tp1_users512_offloadon
710 KB
sha256:760b748857cd02027e8d0c2b8665a7c1ab0fd3ab032acad3b4796d6bf1501344
server_logs_tp1_users64_offloadoff
8.89 KB
sha256:6be1ef7fea1912afc3e0cc350e1635d780b0abe2703687427891d8cc3ac092c7
server_logs_tp1_users64_offloadon
8.4 KB
sha256:ff2a29a82db730bceb0d662e8e9c040ea67b2210e5b41bd009dfb2feecb6d130
server_logs_tp2_users1024_offloadoff
20.7 KB
sha256:63131f994418ab052fc8101338958572805837879b011df121a754581670616f
server_logs_tp2_users1024_offloadon
674 KB
sha256:65fb91dd09ec2c3973680e35b01fb53a4f7bc6c9e5ead67022b4f8daa35b0b98
server_logs_tp2_users128_offloadon
16.3 KB
sha256:ab85eb120aa88dee19234f058ce8b9d2f7098fae196e35e627a95187f382eedc
server_logs_tp2_users16_offloadoff
10 KB
sha256:9a5b4efc2aec3c742c66b5605edbb5b5e93f704045a782f8834632bb3b5bb6cd
server_logs_tp2_users2048_offloadon
619 KB
sha256:eb02752cf712e236b7c4780c3360ae7db3a1714c4b89bb097153d5dba5d3605c
server_logs_tp2_users256_offloadoff
13.5 KB
sha256:864ebe61550a11cd3119e48fb5461208827e25ced77d44c6bf1a8ee46744719d
server_logs_tp2_users512_offloadoff
19.2 KB
sha256:7c3bf5fe1b8e248192e61094d7f9c03b9f060983733c5ce6e193fd94fa3bc820
server_logs_tp2_users512_offloadon
110 KB
sha256:4b4e90b55922cb882ea9f8a05bb914fe9cb7c8ed443c4fe2dff9852f4207f36a
server_logs_tp2_users8_offloadon
10 KB
sha256:3134eca50ea361b737c06e4c26bcbfa58fc10a8da7d8eb8a9d2d3c01b5117292
server_logs_tp4_users1024_offloadoff
25.9 KB
sha256:511db433b8912418128b3a0bcbbb9ec06b271b8721390222acd74c894da19c37
server_logs_tp4_users1024_offloadon
4.36 MB
sha256:0ad4904674166b04c54b7af15d026bdcf1d98257910780e3d135ca7f8e7db0cc
server_logs_tp4_users128_offloadon
163 KB
sha256:3cbd696fb8b4374735237d7843b5757ebbe878670eb51e0da91ff34eaecfee0f
server_logs_tp4_users2048_offloadoff
27.3 KB
sha256:3c196e2e557eeaff2e97d09b105a413fd8de6304ad96563aa5a2c3983d200670
server_logs_tp4_users2048_offloadon
3.93 MB
sha256:ae605892aa5ca7392f9d7814ec740d0235682f03345c228d2ac3f60b4fa0a663
server_logs_tp4_users256_offloadon
26.5 KB
sha256:f919f90a77df5c49616988dca450b26c5018f26efc9a567b55346b9d65846ce5
server_logs_tp4_users64_offloadoff
19.6 KB
sha256:2597c4b79deec6c3cacf79f0ad8079277654ab8e5d00e391dd687de2d9b2b209
server_logs_tp4_users64_offloadon
18.1 KB
sha256:3bb3d6254f2e04fe46eb7e15c6202f74bee0587019c37b90e18ecab570b154c7
server_logs_tp4_users8_offloadon
15.6 KB
sha256:25c7dc9e917e4450f01c6e55890d897ba90b73f25eb92319825b89781cb11c00
server_logs_tp8_users1024_offloadoff
27.2 KB
sha256:8dab092da76be8391ef2f19c043e3029a05c214022978113a5b92e5548df4519
server_logs_tp8_users128_offloadoff
21.3 KB
sha256:0493d19b79963937adee28575d5ee4e0e2cf5fcaf961b4f2887794112ef83a42
server_logs_tp8_users16_offloadoff
21.5 KB
sha256:f83d4ec1f301c10472823ee2df0f3c0bc2c36595d8a53f8b0481661aa12c71d6
server_logs_tp8_users32_offloadon
40.6 KB
sha256:84a68e2fb3d7a3aa3ad1b3f1fa08d9971751810a3cfb553755fbabf4cfb7625b
server_logs_tp8_users512_offloadon
7.03 MB
sha256:3881687356ede2e159faf087c78832b0b82925fe17871e782bbb89299e5ecb95
server_logs_tp8_users64_offloadon
308 KB
sha256:3c80b3300418ea6f66f5aeab7e58fe458132724b71c0282a2d1addd1f4efa872
server_logs_tp8_users8_offloadon
2.21 KB
sha256:1493f65ff615c5606348e934ddc821966032d20699f44d1452824f7d27a48e66