Skip to content

Commit e32f844

Browse files
committed
fix: increase Iceberg retry to 5 attempts with 3s delay, remove from refresh
Iceberg tables use directory-based R2 list() discovery which has eventual consistency in miniflare. Increase retries from 3×2s to 5×3s (15s total wait). Remove Iceberg from /refresh loop since refresh endpoint only supports single-file formats (Lance/Parquet).
1 parent 32f3b72 commit e32f844

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed

scripts/bench.ts

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -168,7 +168,7 @@ async function main(): Promise<void> {
168168
"simple.parquet", "simple_plain.parquet", "simple_snappy.parquet",
169169
"benchmark_100k.parquet", "benchmark_100k_uncompressed.parquet",
170170
"bench_100k_3col.parquet", "bench_100k_numeric.parquet", "bench_1m_numeric.parquet",
171-
"bench_iceberg_100k",
171+
// Iceberg tables use directory-based discovery (handled separately below)
172172
];
173173

174174
console.log("Refreshing tables...");
@@ -191,12 +191,13 @@ async function main(): Promise<void> {
191191
}
192192
await new Promise(r => setTimeout(r, 500));
193193

194-
// Pre-register Iceberg tables by triggering lazy-load via a query (retry for R2 consistency)
194+
// Pre-register Iceberg tables by triggering lazy-load via a query.
195+
// R2 list() in miniflare has eventual consistency — retry with longer delays.
195196
const icebergTables = ["bench_iceberg_100k"];
196197
for (const tbl of icebergTables) {
197198
let ok = false;
198-
for (let attempt = 0; attempt < 3 && !ok; attempt++) {
199-
if (attempt > 0) await new Promise(r => setTimeout(r, 2000));
199+
for (let attempt = 0; attempt < 5 && !ok; attempt++) {
200+
if (attempt > 0) await new Promise(r => setTimeout(r, 3000));
200201
try {
201202
const resp = await fetch(`${BASE_URL}/query`, {
202203
method: "POST",

0 commit comments

Comments
 (0)