Commit f5d6dc3
authored
feat(parquet): add sparse-column writer benchmarks (#9654)
# Which issue does this PR close?
- None, but relates to #9652
# Rationale for this change
Measure sparse and all-null cases in benchmarks.
# What changes are included in this PR?
Add three new benchmark cases to the arrow_writer benchmark suite for
evaluating write performance on sparse and all-null data:
- `primitive_sparse_99pct_null`: a flat primitive column with 99% nulls,
exercising long RLE runs in definition levels.
- `list_primitive_sparse_99pct_null`: a list-of-primitive column with
99% nulls, exercising null batching in the list level builder.
- `primitive_all_null`: a flat primitive column with 100% nulls,
exercising the uniform_levels fast path for entirely-null columns.
# Are these changes tested?
N/A
# Are there any user-facing changes?
None.
Signed-off-by: Hippolyte Barraud <hippolyte.barraud@datadoghq.com>1 parent c6ea0a5 commit f5d6dc3
1 file changed
+9
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
391 | 391 | | |
392 | 392 | | |
393 | 393 | | |
| 394 | + | |
| 395 | + | |
| 396 | + | |
| 397 | + | |
| 398 | + | |
| 399 | + | |
| 400 | + | |
| 401 | + | |
| 402 | + | |
394 | 403 | | |
395 | 404 | | |
396 | 405 | | |
| |||
0 commit comments