unordered row converter WIP TEST by rluvaton · Pull Request #9164 · apache/arrow-rs

rluvaton · 2026-01-13T17:14:30Z

No LLM wrote code (except for copilot as autocomplete but even that not a lot)

just checking perf

You can see the results of the optimizations that was done here:

unordered row converter WIP TEST #9164 (comment)

Closed as this is a POC and will be split into multiple PRs:

explaining in thorough of the steps and the optimizations I made here:

New row format that does not guarantee ordering of columns #9083 (comment)

…sing single byte for nulls and value

# Conflicts: # README.md # arrow/benches/row_format.rs

rluvaton · 2026-01-13T17:14:44Z

run benchmark row_format

alamb-ghbot · 2026-01-13T17:14:51Z

🤖 ./gh_compare_arrow.sh gh_compare_arrow.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing unordered-row-convertor (15e694c) to f122d77 diff
BENCH_NAME=row_format
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental --bench row_format
BENCH_FILTER=
BENCH_BRANCH_NAME=unordered-row-convertor
Results will be posted here when complete

alamb-ghbot · 2026-01-13T17:59:37Z

🤖: Benchmark completed

Details

group                                                                                                                         main                                   unordered-row-convertor
-----                                                                                                                         ----                                   -----------------------
append_rows 10 large_list(0) of u64(0)                                                                                        1.00    631.8±8.25ns        ? ?/sec    1.34    847.0±3.03ns        ? ?/sec
append_rows 10 list(0) of u64(0)                                                                                              1.00    679.2±3.81ns        ? ?/sec    1.32   894.3±10.33ns        ? ?/sec
append_rows 4096 4096 string_dictionary(20, 0.5), string_dictionary(30, 0), string_dictionary(100, 0), i64(0)                 1.26    369.7±4.15µs        ? ?/sec    1.00    293.6±4.03µs        ? ?/sec
append_rows 4096 53 columns                                                                                                   1.44  1745.0±15.70µs        ? ?/sec    1.00  1210.9±14.19µs        ? ?/sec
append_rows 4096 bool(0, 0.5)                                                                                                 1.09     12.1±0.03µs        ? ?/sec    1.00     11.1±0.25µs        ? ?/sec
append_rows 4096 bool(0.3, 0.5)                                                                                               1.20     14.8±0.11µs        ? ?/sec    1.00     12.3±0.07µs        ? ?/sec
append_rows 4096 i64(0)                                                                                                       1.00      7.8±0.16µs        ? ?/sec    1.09      8.5±0.05µs        ? ?/sec
append_rows 4096 i64(0.3)                                                                                                     1.00     15.2±0.11µs        ? ?/sec    1.23     18.8±0.14µs        ? ?/sec
append_rows 4096 large_list(0) of u64(0)                                                                                      1.35    168.0±1.14µs        ? ?/sec    1.00    124.4±1.88µs        ? ?/sec
append_rows 4096 large_list(0) sliced to 10 of u64(0)                                                                         1.00    910.4±7.93ns        ? ?/sec    1.17  1062.9±36.12ns        ? ?/sec
append_rows 4096 list(0) of u64(0)                                                                                            1.22    164.8±1.37µs        ? ?/sec    1.00    134.9±1.43µs        ? ?/sec
append_rows 4096 list(0) sliced to 10 of u64(0)                                                                               1.00   997.5±17.05ns        ? ?/sec    1.16  1157.8±34.73ns        ? ?/sec
append_rows 4096 string view(1..100, 0)                                                                                       1.55    103.6±1.40µs        ? ?/sec    1.00     66.9±0.66µs        ? ?/sec
append_rows 4096 string view(1..100, 0.5)                                                                                     1.25    100.8±0.84µs        ? ?/sec    1.00     80.7±1.42µs        ? ?/sec
append_rows 4096 string view(10, 0)                                                                                           1.32     49.2±0.30µs        ? ?/sec    1.00     37.4±0.70µs        ? ?/sec
append_rows 4096 string view(100, 0)                                                                                          1.49     74.8±1.34µs        ? ?/sec    1.00     50.3±0.39µs        ? ?/sec
append_rows 4096 string view(100, 0.5)                                                                                        1.18     85.4±0.36µs        ? ?/sec    1.00     72.4±0.36µs        ? ?/sec
append_rows 4096 string view(30, 0)                                                                                           1.34     52.7±0.42µs        ? ?/sec    1.00     39.5±0.28µs        ? ?/sec
append_rows 4096 string(10, 0)                                                                                                1.52     47.5±1.84µs        ? ?/sec    1.00     31.4±0.05µs        ? ?/sec
append_rows 4096 string(100, 0)                                                                                               1.63     71.1±0.98µs        ? ?/sec    1.00     43.5±0.56µs        ? ?/sec
append_rows 4096 string(100, 0.5)                                                                                             1.09     82.6±0.59µs        ? ?/sec    1.00     75.9±1.29µs        ? ?/sec
append_rows 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0)                                                       1.36    227.4±2.55µs        ? ?/sec    1.00    167.0±1.12µs        ? ?/sec
append_rows 4096 string(30, 0)                                                                                                1.52     49.5±1.04µs        ? ?/sec    1.00     32.5±0.43µs        ? ?/sec
append_rows 4096 string_dictionary(10, 0)                                                                                     1.31     74.5±1.28µs        ? ?/sec    1.00     57.0±0.18µs        ? ?/sec
append_rows 4096 string_dictionary(100, 0)                                                                                    1.54    144.7±2.60µs        ? ?/sec    1.00     93.8±0.89µs        ? ?/sec
append_rows 4096 string_dictionary(100, 0.5)                                                                                  1.14    106.9±0.86µs        ? ?/sec    1.00     93.7±1.65µs        ? ?/sec
append_rows 4096 string_dictionary(30, 0)                                                                                     1.33     77.5±1.62µs        ? ?/sec    1.00     58.3±0.25µs        ? ?/sec
append_rows 4096 string_dictionary_low_cardinality(10, 0)                                                                     1.06     27.4±0.98µs        ? ?/sec    1.00     25.7±0.25µs        ? ?/sec
append_rows 4096 string_dictionary_low_cardinality(100, 0)                                                                    1.28     46.4±1.46µs        ? ?/sec    1.00     36.2±0.70µs        ? ?/sec
append_rows 4096 string_dictionary_low_cardinality(30, 0)                                                                     1.05     27.6±1.03µs        ? ?/sec    1.00     26.2±0.19µs        ? ?/sec
append_rows 4096 u64(0)                                                                                                       1.05      7.6±0.12µs        ? ?/sec    1.00      7.2±0.04µs        ? ?/sec
append_rows 4096 u64(0.3)                                                                                                     1.00     13.8±0.42µs        ? ?/sec    1.37     18.9±0.42µs        ? ?/sec
append_rows 8192 53 columns                                                                                                   1.37      3.8±0.06ms        ? ?/sec    1.00      2.7±0.03ms        ? ?/sec
convert_columns 10 large_list(0) of u64(0)                                                                                    1.00   896.3±12.29ns        ? ?/sec    1.55   1387.9±9.53ns        ? ?/sec
convert_columns 10 list(0) of u64(0)                                                                                          1.00    936.7±7.72ns        ? ?/sec    1.52  1425.1±13.63ns        ? ?/sec
convert_columns 4096 4096 string_dictionary(20, 0.5), string_dictionary(30, 0), string_dictionary(100, 0), i64(0)             1.27    378.6±3.33µs        ? ?/sec    1.00    298.5±4.82µs        ? ?/sec
convert_columns 4096 53 columns                                                                                               1.43  1744.0±15.94µs        ? ?/sec    1.00   1220.2±7.71µs        ? ?/sec
convert_columns 4096 bool(0, 0.5)                                                                                             1.09     12.5±0.08µs        ? ?/sec    1.00     11.4±0.03µs        ? ?/sec
convert_columns 4096 bool(0.3, 0.5)                                                                                           1.19     15.1±0.55µs        ? ?/sec    1.00     12.7±0.24µs        ? ?/sec
convert_columns 4096 i64(0)                                                                                                   1.17      8.0±0.13µs        ? ?/sec    1.00      6.8±0.03µs        ? ?/sec
convert_columns 4096 i64(0.3)                                                                                                 1.00     15.5±0.14µs        ? ?/sec    1.24     19.3±0.41µs        ? ?/sec
convert_columns 4096 large_list(0) of u64(0)                                                                                  1.35    169.0±1.23µs        ? ?/sec    1.00    125.1±0.93µs        ? ?/sec
convert_columns 4096 large_list(0) sliced to 10 of u64(0)                                                                     1.00  1171.3±14.47ns        ? ?/sec    1.36  1594.0±18.14ns        ? ?/sec
convert_columns 4096 list(0) of u64(0)                                                                                        1.22    165.3±1.51µs        ? ?/sec    1.00    135.5±0.74µs        ? ?/sec
convert_columns 4096 list(0) sliced to 10 of u64(0)                                                                           1.00  1267.3±14.21ns        ? ?/sec    1.31  1664.1±21.32ns        ? ?/sec
convert_columns 4096 string view(1..100, 0)                                                                                   1.55    103.8±1.05µs        ? ?/sec    1.00     66.9±0.35µs        ? ?/sec
convert_columns 4096 string view(1..100, 0.5)                                                                                 1.25    101.0±0.42µs        ? ?/sec    1.00     81.0±0.90µs        ? ?/sec
convert_columns 4096 string view(10, 0)                                                                                       1.30     50.2±2.04µs        ? ?/sec    1.00     38.7±1.26µs        ? ?/sec
convert_columns 4096 string view(100, 0)                                                                                      1.47     73.8±0.89µs        ? ?/sec    1.00     50.2±0.41µs        ? ?/sec
convert_columns 4096 string view(100, 0.5)                                                                                    1.16     86.0±1.46µs        ? ?/sec    1.00     74.0±6.50µs        ? ?/sec
convert_columns 4096 string view(30, 0)                                                                                       1.33     52.9±0.33µs        ? ?/sec    1.00     39.9±0.32µs        ? ?/sec
convert_columns 4096 string(10, 0)                                                                                            1.49     47.6±0.29µs        ? ?/sec    1.00     31.9±0.22µs        ? ?/sec
convert_columns 4096 string(100, 0)                                                                                           1.66     72.3±0.70µs        ? ?/sec    1.00     43.5±1.59µs        ? ?/sec
convert_columns 4096 string(100, 0.5)                                                                                         1.09     83.0±0.90µs        ? ?/sec    1.00     76.2±0.54µs        ? ?/sec
convert_columns 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0)                                                   1.38    229.0±1.94µs        ? ?/sec    1.00    166.4±3.47µs        ? ?/sec
convert_columns 4096 string(30, 0)                                                                                            1.51     49.9±0.63µs        ? ?/sec    1.00     32.9±0.18µs        ? ?/sec
convert_columns 4096 string_dictionary(10, 0)                                                                                 1.28     75.4±0.49µs        ? ?/sec    1.00     59.1±0.60µs        ? ?/sec
convert_columns 4096 string_dictionary(100, 0)                                                                                1.47    144.8±1.74µs        ? ?/sec    1.00     98.2±1.47µs        ? ?/sec
convert_columns 4096 string_dictionary(100, 0.5)                                                                              1.13    109.2±0.63µs        ? ?/sec    1.00     96.5±1.98µs        ? ?/sec
convert_columns 4096 string_dictionary(30, 0)                                                                                 1.28     78.0±0.46µs        ? ?/sec    1.00     61.0±1.12µs        ? ?/sec
convert_columns 4096 string_dictionary_low_cardinality(10, 0)                                                                 1.00     27.9±0.30µs        ? ?/sec    1.00     27.8±0.10µs        ? ?/sec
convert_columns 4096 string_dictionary_low_cardinality(100, 0)                                                                1.23     46.5±1.37µs        ? ?/sec    1.00     37.8±0.40µs        ? ?/sec
convert_columns 4096 string_dictionary_low_cardinality(30, 0)                                                                 1.01     28.1±0.14µs        ? ?/sec    1.00     27.7±0.22µs        ? ?/sec
convert_columns 4096 u64(0)                                                                                                   1.00      7.8±0.15µs        ? ?/sec    1.23      9.6±0.33µs        ? ?/sec
convert_columns 4096 u64(0.3)                                                                                                 1.00     14.1±0.51µs        ? ?/sec    1.36     19.2±0.18µs        ? ?/sec
convert_columns 8192 53 columns                                                                                               1.38      3.8±0.13ms        ? ?/sec    1.00      2.8±0.04ms        ? ?/sec
convert_columns_prepared 10 large_list(0) of u64(0)                                                                           1.00    691.4±8.50ns        ? ?/sec    1.34   923.4±10.64ns        ? ?/sec
convert_columns_prepared 10 list(0) of u64(0)                                                                                 1.00   735.3±13.33ns        ? ?/sec    1.32   968.6±28.38ns        ? ?/sec
convert_columns_prepared 4096 4096 string_dictionary(20, 0.5), string_dictionary(30, 0), string_dictionary(100, 0), i64(0)    1.26    371.2±7.13µs        ? ?/sec    1.00   295.1±11.35µs        ? ?/sec
convert_columns_prepared 4096 53 columns                                                                                      1.45  1744.5±33.36µs        ? ?/sec    1.00  1205.7±19.54µs        ? ?/sec
convert_columns_prepared 4096 bool(0, 0.5)                                                                                    1.08     12.2±0.08µs        ? ?/sec    1.00     11.3±0.45µs        ? ?/sec
convert_columns_prepared 4096 bool(0.3, 0.5)                                                                                  1.20     14.9±0.41µs        ? ?/sec    1.00     12.4±0.06µs        ? ?/sec
convert_columns_prepared 4096 i64(0)                                                                                          1.00      7.9±0.13µs        ? ?/sec    1.10      8.7±0.08µs        ? ?/sec
convert_columns_prepared 4096 i64(0.3)                                                                                        1.00     15.4±0.17µs        ? ?/sec    1.24     19.0±0.20µs        ? ?/sec
convert_columns_prepared 4096 large_list(0) of u64(0)                                                                         1.35    168.5±1.48µs        ? ?/sec    1.00    124.6±1.19µs        ? ?/sec
convert_columns_prepared 4096 large_list(0) sliced to 10 of u64(0)                                                            1.00   984.0±11.84ns        ? ?/sec    1.18  1160.1±17.67ns        ? ?/sec
convert_columns_prepared 4096 list(0) of u64(0)                                                                               1.22    165.1±1.05µs        ? ?/sec    1.00    134.8±0.97µs        ? ?/sec
convert_columns_prepared 4096 list(0) sliced to 10 of u64(0)                                                                  1.00  1084.2±12.00ns        ? ?/sec    1.11  1203.4±14.14ns        ? ?/sec
convert_columns_prepared 4096 string view(1..100, 0)                                                                          1.56    103.6±0.37µs        ? ?/sec    1.00     66.6±0.56µs        ? ?/sec
convert_columns_prepared 4096 string view(1..100, 0.5)                                                                        1.25    101.1±2.68µs        ? ?/sec    1.00     80.9±0.86µs        ? ?/sec
convert_columns_prepared 4096 string view(10, 0)                                                                              1.33     50.4±0.67µs        ? ?/sec    1.00     38.0±0.92µs        ? ?/sec
convert_columns_prepared 4096 string view(100, 0)                                                                             1.51     74.8±0.85µs        ? ?/sec    1.00     49.6±0.36µs        ? ?/sec
convert_columns_prepared 4096 string view(100, 0.5)                                                                           1.18     85.4±0.68µs        ? ?/sec    1.00     72.5±1.32µs        ? ?/sec
convert_columns_prepared 4096 string view(30, 0)                                                                              1.32     52.7±0.44µs        ? ?/sec    1.00     39.9±0.71µs        ? ?/sec
convert_columns_prepared 4096 string(10, 0)                                                                                   1.51     47.6±1.05µs        ? ?/sec    1.00     31.5±0.11µs        ? ?/sec
convert_columns_prepared 4096 string(100, 0)                                                                                  1.65     72.5±0.75µs        ? ?/sec    1.00     44.0±1.05µs        ? ?/sec
convert_columns_prepared 4096 string(100, 0.5)                                                                                1.09     82.9±0.84µs        ? ?/sec    1.00     76.1±0.86µs        ? ?/sec
convert_columns_prepared 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0)                                          1.36    227.7±2.14µs        ? ?/sec    1.00    167.3±2.05µs        ? ?/sec
convert_columns_prepared 4096 string(30, 0)                                                                                   1.52     49.7±0.41µs        ? ?/sec    1.00     32.8±0.34µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary(10, 0)                                                                        1.30     74.9±0.33µs        ? ?/sec    1.00     57.8±0.57µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary(100, 0)                                                                       1.50    144.8±1.25µs        ? ?/sec    1.00     96.4±0.97µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary(100, 0.5)                                                                     1.16    108.6±5.79µs        ? ?/sec    1.00     93.6±0.64µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary(30, 0)                                                                        1.31     77.7±0.44µs        ? ?/sec    1.00     59.4±0.62µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary_low_cardinality(10, 0)                                                        1.04     27.1±0.10µs        ? ?/sec    1.00     26.1±0.15µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary_low_cardinality(100, 0)                                                       1.25     45.7±0.22µs        ? ?/sec    1.00     36.5±0.20µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary_low_cardinality(30, 0)                                                        1.03     27.3±0.41µs        ? ?/sec    1.00     26.4±0.37µs        ? ?/sec
convert_columns_prepared 4096 u64(0)                                                                                          1.06      7.8±0.13µs        ? ?/sec    1.00      7.3±0.10µs        ? ?/sec
convert_columns_prepared 4096 u64(0.3)                                                                                        1.00     14.0±0.13µs        ? ?/sec    1.35     18.9±0.13µs        ? ?/sec
convert_columns_prepared 8192 53 columns                                                                                      1.36      3.7±0.06ms        ? ?/sec    1.00      2.7±0.07ms        ? ?/sec
convert_rows 10 large_list(0) of u64(0)                                                                                       1.13  1568.9±16.94ns        ? ?/sec    1.00  1383.8±31.05ns        ? ?/sec
convert_rows 10 list(0) of u64(0)                                                                                             1.22  1729.7±12.28ns        ? ?/sec    1.00  1415.4±17.40ns        ? ?/sec
convert_rows 4096 4096 string_dictionary(20, 0.5), string_dictionary(30, 0), string_dictionary(100, 0), i64(0)                1.64   292.4±11.05µs        ? ?/sec    1.00    178.7±2.41µs        ? ?/sec
convert_rows 4096 53 columns                                                                                                  1.78      2.9±0.02ms        ? ?/sec    1.00  1633.4±20.31µs        ? ?/sec
convert_rows 4096 bool(0, 0.5)                                                                                                1.07     16.2±0.38µs        ? ?/sec    1.00     15.1±0.70µs        ? ?/sec
convert_rows 4096 bool(0.3, 0.5)                                                                                              1.08     16.2±0.07µs        ? ?/sec    1.00     15.0±0.06µs        ? ?/sec
convert_rows 4096 i64(0)                                                                                                      2.23     33.7±0.14µs        ? ?/sec    1.00     15.1±1.16µs        ? ?/sec
convert_rows 4096 i64(0.3)                                                                                                    1.28     33.7±0.22µs        ? ?/sec    1.00     26.3±1.11µs        ? ?/sec
convert_rows 4096 large_list(0) of u64(0)                                                                                     1.36    270.0±1.32µs        ? ?/sec    1.00    198.6±2.39µs        ? ?/sec
convert_rows 4096 large_list(0) sliced to 10 of u64(0)                                                                        1.21      2.0±0.02µs        ? ?/sec    1.00  1675.1±23.75ns        ? ?/sec
convert_rows 4096 list(0) of u64(0)                                                                                           1.32    268.4±2.33µs        ? ?/sec    1.00    202.6±1.85µs        ? ?/sec
convert_rows 4096 list(0) sliced to 10 of u64(0)                                                                              1.23      2.2±0.02µs        ? ?/sec    1.00  1773.5±24.50ns        ? ?/sec
convert_rows 4096 string view(1..100, 0)                                                                                      2.05    168.2±0.96µs        ? ?/sec    1.00     81.9±0.36µs        ? ?/sec
convert_rows 4096 string view(1..100, 0.5)                                                                                    1.28    133.9±1.43µs        ? ?/sec    1.00    104.8±1.23µs        ? ?/sec
convert_rows 4096 string view(10, 0)                                                                                          1.42     78.9±0.68µs        ? ?/sec    1.00     55.5±0.52µs        ? ?/sec
convert_rows 4096 string view(100, 0)                                                                                         2.24    123.4±0.87µs        ? ?/sec    1.00     55.1±1.00µs        ? ?/sec
convert_rows 4096 string view(100, 0.5)                                                                                       1.22    113.4±1.06µs        ? ?/sec    1.00     92.7±0.69µs        ? ?/sec
convert_rows 4096 string view(30, 0)                                                                                          1.81     88.2±3.36µs        ? ?/sec    1.00     48.6±0.32µs        ? ?/sec
convert_rows 4096 string(10, 0)                                                                                               1.43     56.2±0.24µs        ? ?/sec    1.00     39.3±0.27µs        ? ?/sec
convert_rows 4096 string(100, 0)                                                                                              2.23    105.7±1.11µs        ? ?/sec    1.00     47.3±0.30µs        ? ?/sec
convert_rows 4096 string(100, 0.5)                                                                                            1.27    101.2±0.35µs        ? ?/sec    1.00     79.8±0.73µs        ? ?/sec
convert_rows 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0)                                                      1.65    291.1±7.86µs        ? ?/sec    1.00    176.9±1.28µs        ? ?/sec
convert_rows 4096 string(30, 0)                                                                                               1.71     67.3±1.98µs        ? ?/sec    1.00     39.3±0.56µs        ? ?/sec
convert_rows 4096 string_dictionary(10, 0)                                                                                    1.42     56.2±0.29µs        ? ?/sec    1.00     39.6±0.38µs        ? ?/sec
convert_rows 4096 string_dictionary(100, 0)                                                                                   2.21    107.5±6.64µs        ? ?/sec    1.00     48.7±0.89µs        ? ?/sec
convert_rows 4096 string_dictionary(100, 0.5)                                                                                 1.26    101.7±0.80µs        ? ?/sec    1.00     80.7±1.25µs        ? ?/sec
convert_rows 4096 string_dictionary(30, 0)                                                                                    1.70     67.4±1.70µs        ? ?/sec    1.00     39.7±0.34µs        ? ?/sec
convert_rows 4096 string_dictionary_low_cardinality(10, 0)                                                                    1.42     56.3±0.43µs        ? ?/sec    1.00     39.7±0.31µs        ? ?/sec
convert_rows 4096 string_dictionary_low_cardinality(100, 0)                                                                   2.24    107.0±0.96µs        ? ?/sec    1.00     47.7±0.37µs        ? ?/sec
convert_rows 4096 string_dictionary_low_cardinality(30, 0)                                                                    1.70     67.3±0.75µs        ? ?/sec    1.00     39.6±0.12µs        ? ?/sec
convert_rows 4096 u64(0)                                                                                                      2.12     31.2±1.05µs        ? ?/sec    1.00     14.7±0.85µs        ? ?/sec
convert_rows 4096 u64(0.3)                                                                                                    1.20     31.2±0.14µs        ? ?/sec    1.00     26.0±0.88µs        ? ?/sec
convert_rows 8192 53 columns                                                                                                  1.89      7.2±0.10ms        ? ?/sec    1.00      3.8±0.09ms        ? ?/sec
iterate rows                                                                                                                  1.00      3.3±0.01µs        ? ?/sec    1.00      3.3±0.03µs        ? ?/sec

rluvaton · 2026-01-14T10:11:33Z

run benchmark row_format

rluvaton · 2026-01-14T10:18:20Z

show benchmark queue

rluvaton · 2026-01-14T10:47:34Z

@alamb is there a problem with the benchmarks?

Dandandan · 2026-01-14T12:52:36Z

Probably it crashed on something and didn't start up again.

rluvaton · 2026-01-14T22:28:33Z

show benchmark queue

alamb-ghbot · 2026-01-14T22:56:04Z

🤖 Hi @rluvaton, you asked to view the benchmark queue (#9164 (comment)).

No pending jobs in jobs/.

alamb · 2026-01-14T23:01:52Z

Probably it crashed on something and didn't start up again.

Yes, exactly so -- I restarted it here

#9079 (comment)

rluvaton · 2026-01-15T05:01:46Z

run benchmark row_format

alamb-ghbot · 2026-01-15T05:01:56Z

🤖 ./gh_compare_arrow.sh gh_compare_arrow.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing unordered-row-convertor (527efa1) to f122d77 diff
BENCH_NAME=row_format
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental --bench row_format
BENCH_FILTER=
BENCH_BRANCH_NAME=unordered-row-convertor
Results will be posted here when complete

alamb-ghbot · 2026-01-15T05:46:43Z

🤖: Benchmark completed

Details

group                                                                                                                         main                                   unordered-row-convertor
-----                                                                                                                         ----                                   -----------------------
append_rows 10 large_list(0) of u64(0)                                                                                        1.00   624.3±10.33ns        ? ?/sec    1.36    852.2±4.53ns        ? ?/sec
append_rows 10 list(0) of u64(0)                                                                                              1.00   674.7±13.46ns        ? ?/sec    1.30    876.4±3.78ns        ? ?/sec
append_rows 4096 4096 string_dictionary(20, 0.5), string_dictionary(30, 0), string_dictionary(100, 0), i64(0)                 1.26    368.5±2.23µs        ? ?/sec    1.00    292.4±2.31µs        ? ?/sec
append_rows 4096 53 columns                                                                                                   1.46  1744.4±58.93µs        ? ?/sec    1.00  1197.5±23.86µs        ? ?/sec
append_rows 4096 bool(0, 0.5)                                                                                                 1.10     12.2±0.96µs        ? ?/sec    1.00     11.1±0.16µs        ? ?/sec
append_rows 4096 bool(0.3, 0.5)                                                                                               1.19     14.6±0.12µs        ? ?/sec    1.00     12.3±0.06µs        ? ?/sec
append_rows 4096 i64(0)                                                                                                       1.00      8.0±0.78µs        ? ?/sec    1.14      9.1±0.06µs        ? ?/sec
append_rows 4096 i64(0.3)                                                                                                     1.00     14.9±0.14µs        ? ?/sec    1.05     15.6±0.18µs        ? ?/sec
append_rows 4096 large_list(0) of u64(0)                                                                                      1.34    151.5±1.24µs        ? ?/sec    1.00    113.0±0.33µs        ? ?/sec
append_rows 4096 large_list(0) sliced to 10 of u64(0)                                                                         1.00   890.2±12.09ns        ? ?/sec    1.20   1065.9±5.68ns        ? ?/sec
append_rows 4096 list(0) of u64(0)                                                                                            1.37    152.2±0.58µs        ? ?/sec    1.00    111.5±0.94µs        ? ?/sec
append_rows 4096 list(0) sliced to 10 of u64(0)                                                                               1.00   985.1±31.71ns        ? ?/sec    1.10   1079.3±6.77ns        ? ?/sec
append_rows 4096 string view(1..100, 0)                                                                                       1.57    109.7±1.03µs        ? ?/sec    1.00     69.7±0.26µs        ? ?/sec
append_rows 4096 string view(1..100, 0.5)                                                                                     1.20    100.2±1.19µs        ? ?/sec    1.00     83.2±1.67µs        ? ?/sec
append_rows 4096 string view(10, 0)                                                                                           1.33     49.5±0.92µs        ? ?/sec    1.00     37.3±0.64µs        ? ?/sec
append_rows 4096 string view(100, 0)                                                                                          1.55     77.3±0.35µs        ? ?/sec    1.00     50.0±0.14µs        ? ?/sec
append_rows 4096 string view(100, 0.5)                                                                                        1.14     88.4±0.68µs        ? ?/sec    1.00     77.9±0.79µs        ? ?/sec
append_rows 4096 string view(30, 0)                                                                                           1.32     52.6±0.57µs        ? ?/sec    1.00     40.0±0.29µs        ? ?/sec
append_rows 4096 string(10, 0)                                                                                                1.54     45.1±0.37µs        ? ?/sec    1.00     29.3±0.19µs        ? ?/sec
append_rows 4096 string(100, 0)                                                                                               1.71     73.3±0.46µs        ? ?/sec    1.00     42.9±0.58µs        ? ?/sec
append_rows 4096 string(100, 0.5)                                                                                             1.18     84.9±0.89µs        ? ?/sec    1.00     71.8±1.10µs        ? ?/sec
append_rows 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0)                                                       1.35    225.9±1.72µs        ? ?/sec    1.00    167.7±1.56µs        ? ?/sec
append_rows 4096 string(30, 0)                                                                                                1.57     47.4±1.22µs        ? ?/sec    1.00     30.1±1.34µs        ? ?/sec
append_rows 4096 string_dictionary(10, 0)                                                                                     1.31     73.1±0.53µs        ? ?/sec    1.00     55.9±0.61µs        ? ?/sec
append_rows 4096 string_dictionary(100, 0)                                                                                    1.49    143.4±1.82µs        ? ?/sec    1.00     96.0±1.15µs        ? ?/sec
append_rows 4096 string_dictionary(100, 0.5)                                                                                  1.16    111.6±1.80µs        ? ?/sec    1.00     96.2±0.65µs        ? ?/sec
append_rows 4096 string_dictionary(30, 0)                                                                                     1.30     75.3±0.36µs        ? ?/sec    1.00     58.0±0.24µs        ? ?/sec
append_rows 4096 string_dictionary_low_cardinality(10, 0)                                                                     1.05     28.3±1.58µs        ? ?/sec    1.00     27.0±0.80µs        ? ?/sec
append_rows 4096 string_dictionary_low_cardinality(100, 0)                                                                    1.26     46.9±0.15µs        ? ?/sec    1.00     37.2±1.06µs        ? ?/sec
append_rows 4096 string_dictionary_low_cardinality(30, 0)                                                                     1.03     28.2±1.25µs        ? ?/sec    1.00     27.3±0.31µs        ? ?/sec
append_rows 4096 u64(0)                                                                                                       1.00      7.5±0.07µs        ? ?/sec    1.20      9.1±0.12µs        ? ?/sec
append_rows 4096 u64(0.3)                                                                                                     1.00     14.6±0.08µs        ? ?/sec    1.07     15.6±0.10µs        ? ?/sec
append_rows 8192 53 columns                                                                                                   1.38      3.7±0.04ms        ? ?/sec    1.00      2.7±0.02ms        ? ?/sec
convert_columns 10 large_list(0) of u64(0)                                                                                    1.00    888.9±9.00ns        ? ?/sec    1.55  1378.9±26.43ns        ? ?/sec
convert_columns 10 list(0) of u64(0)                                                                                          1.00   956.6±17.88ns        ? ?/sec    1.49   1423.5±9.17ns        ? ?/sec
convert_columns 4096 4096 string_dictionary(20, 0.5), string_dictionary(30, 0), string_dictionary(100, 0), i64(0)             1.26    376.8±2.73µs        ? ?/sec    1.00    299.8±2.79µs        ? ?/sec
convert_columns 4096 53 columns                                                                                               1.47  1742.6±17.60µs        ? ?/sec    1.00   1186.1±7.13µs        ? ?/sec
convert_columns 4096 bool(0, 0.5)                                                                                             1.09     12.4±0.04µs        ? ?/sec    1.00     11.4±0.13µs        ? ?/sec
convert_columns 4096 bool(0.3, 0.5)                                                                                           1.18     14.9±0.17µs        ? ?/sec    1.00     12.7±0.17µs        ? ?/sec
convert_columns 4096 i64(0)                                                                                                   1.04      8.0±0.15µs        ? ?/sec    1.00      7.7±0.07µs        ? ?/sec
convert_columns 4096 i64(0.3)                                                                                                 1.00     15.2±0.49µs        ? ?/sec    1.05     16.0±0.11µs        ? ?/sec
convert_columns 4096 large_list(0) of u64(0)                                                                                  1.34    152.9±8.42µs        ? ?/sec    1.00    113.8±0.93µs        ? ?/sec
convert_columns 4096 large_list(0) sliced to 10 of u64(0)                                                                     1.00  1140.5±14.30ns        ? ?/sec    1.39   1588.5±5.11ns        ? ?/sec
convert_columns 4096 list(0) of u64(0)                                                                                        1.36    153.0±3.78µs        ? ?/sec    1.00    112.3±0.77µs        ? ?/sec
convert_columns 4096 list(0) sliced to 10 of u64(0)                                                                           1.00  1270.4±39.76ns        ? ?/sec    1.27  1615.8±40.37ns        ? ?/sec
convert_columns 4096 string view(1..100, 0)                                                                                   1.56    109.7±0.47µs        ? ?/sec    1.00     70.4±0.58µs        ? ?/sec
convert_columns 4096 string view(1..100, 0.5)                                                                                 1.20    100.7±0.51µs        ? ?/sec    1.00     83.8±0.62µs        ? ?/sec
convert_columns 4096 string view(10, 0)                                                                                       1.32     49.9±1.87µs        ? ?/sec    1.00     37.8±0.67µs        ? ?/sec
convert_columns 4096 string view(100, 0)                                                                                      1.50     77.9±0.69µs        ? ?/sec    1.00     51.8±0.49µs        ? ?/sec
convert_columns 4096 string view(100, 0.5)                                                                                    1.13     88.6±0.26µs        ? ?/sec    1.00     78.3±0.35µs        ? ?/sec
convert_columns 4096 string view(30, 0)                                                                                       1.31     52.9±0.41µs        ? ?/sec    1.00     40.5±1.00µs        ? ?/sec
convert_columns 4096 string(10, 0)                                                                                            1.54     45.5±0.61µs        ? ?/sec    1.00     29.6±0.40µs        ? ?/sec
convert_columns 4096 string(100, 0)                                                                                           1.63     73.4±2.54µs        ? ?/sec    1.00     45.0±3.67µs        ? ?/sec
convert_columns 4096 string(100, 0.5)                                                                                         1.18     85.1±0.42µs        ? ?/sec    1.00     72.0±0.57µs        ? ?/sec
convert_columns 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0)                                                   1.33    228.2±1.91µs        ? ?/sec    1.00    171.2±4.02µs        ? ?/sec
convert_columns 4096 string(30, 0)                                                                                            1.57     47.6±0.69µs        ? ?/sec    1.00     30.3±0.31µs        ? ?/sec
convert_columns 4096 string_dictionary(10, 0)                                                                                 1.28     74.3±1.64µs        ? ?/sec    1.00     58.1±1.13µs        ? ?/sec
convert_columns 4096 string_dictionary(100, 0)                                                                                1.51    147.4±1.14µs        ? ?/sec    1.00     97.9±1.34µs        ? ?/sec
convert_columns 4096 string_dictionary(100, 0.5)                                                                              1.16    113.6±2.62µs        ? ?/sec    1.00     98.0±0.61µs        ? ?/sec
convert_columns 4096 string_dictionary(30, 0)                                                                                 1.29     76.8±0.95µs        ? ?/sec    1.00     59.7±0.51µs        ? ?/sec
convert_columns 4096 string_dictionary_low_cardinality(10, 0)                                                                 1.02     28.9±0.25µs        ? ?/sec    1.00     28.4±0.07µs        ? ?/sec
convert_columns 4096 string_dictionary_low_cardinality(100, 0)                                                                1.24     49.0±0.76µs        ? ?/sec    1.00     39.5±1.19µs        ? ?/sec
convert_columns 4096 string_dictionary_low_cardinality(30, 0)                                                                 1.00     29.0±0.90µs        ? ?/sec    1.00     29.0±0.40µs        ? ?/sec
convert_columns 4096 u64(0)                                                                                                   1.00      7.9±0.20µs        ? ?/sec    1.19      9.4±0.04µs        ? ?/sec
convert_columns 4096 u64(0.3)                                                                                                 1.00     14.8±0.16µs        ? ?/sec    1.08     15.9±0.21µs        ? ?/sec
convert_columns 8192 53 columns                                                                                               1.35      3.7±0.08ms        ? ?/sec    1.00      2.7±0.05ms        ? ?/sec
convert_columns_prepared 10 large_list(0) of u64(0)                                                                           1.00   692.9±12.78ns        ? ?/sec    1.36   939.7±11.18ns        ? ?/sec
convert_columns_prepared 10 list(0) of u64(0)                                                                                 1.00   740.7±13.29ns        ? ?/sec    1.32   975.3±34.74ns        ? ?/sec
convert_columns_prepared 4096 4096 string_dictionary(20, 0.5), string_dictionary(30, 0), string_dictionary(100, 0), i64(0)    1.26    371.5±2.69µs        ? ?/sec    1.00    294.7±4.13µs        ? ?/sec
convert_columns_prepared 4096 53 columns                                                                                      1.46   1725.9±7.16µs        ? ?/sec    1.00  1183.6±22.50µs        ? ?/sec
convert_columns_prepared 4096 bool(0, 0.5)                                                                                    1.09     12.3±0.38µs        ? ?/sec    1.00     11.3±0.28µs        ? ?/sec
convert_columns_prepared 4096 bool(0.3, 0.5)                                                                                  1.19     14.8±0.10µs        ? ?/sec    1.00     12.4±0.04µs        ? ?/sec
convert_columns_prepared 4096 i64(0)                                                                                          1.00      7.9±0.14µs        ? ?/sec    1.17      9.3±0.48µs        ? ?/sec
convert_columns_prepared 4096 i64(0.3)                                                                                        1.00     15.0±0.19µs        ? ?/sec    1.05     15.8±0.11µs        ? ?/sec
convert_columns_prepared 4096 large_list(0) of u64(0)                                                                         1.32    151.3±1.26µs        ? ?/sec    1.00    114.3±1.20µs        ? ?/sec
convert_columns_prepared 4096 large_list(0) sliced to 10 of u64(0)                                                            1.00   951.4±11.64ns        ? ?/sec    1.20  1140.0±13.62ns        ? ?/sec
convert_columns_prepared 4096 list(0) of u64(0)                                                                               1.36    153.5±4.10µs        ? ?/sec    1.00    112.5±0.79µs        ? ?/sec
convert_columns_prepared 4096 list(0) sliced to 10 of u64(0)                                                                  1.00   1045.7±4.60ns        ? ?/sec    1.12  1172.7±19.48ns        ? ?/sec
convert_columns_prepared 4096 string view(1..100, 0)                                                                          1.57    109.9±0.78µs        ? ?/sec    1.00     70.0±0.38µs        ? ?/sec
convert_columns_prepared 4096 string view(1..100, 0.5)                                                                        1.21    100.5±0.71µs        ? ?/sec    1.00     83.4±0.55µs        ? ?/sec
convert_columns_prepared 4096 string view(10, 0)                                                                              1.32     49.6±0.77µs        ? ?/sec    1.00     37.6±0.50µs        ? ?/sec
convert_columns_prepared 4096 string view(100, 0)                                                                             1.54     77.4±0.82µs        ? ?/sec    1.00     50.3±0.73µs        ? ?/sec
convert_columns_prepared 4096 string view(100, 0.5)                                                                           1.13     88.6±0.40µs        ? ?/sec    1.00     78.2±0.69µs        ? ?/sec
convert_columns_prepared 4096 string view(30, 0)                                                                              1.31     52.8±0.68µs        ? ?/sec    1.00     40.3±0.89µs        ? ?/sec
convert_columns_prepared 4096 string(10, 0)                                                                                   1.54     45.3±0.79µs        ? ?/sec    1.00     29.4±0.25µs        ? ?/sec
convert_columns_prepared 4096 string(100, 0)                                                                                  1.69     73.0±0.27µs        ? ?/sec    1.00     43.1±0.43µs        ? ?/sec
convert_columns_prepared 4096 string(100, 0.5)                                                                                1.18     85.0±0.73µs        ? ?/sec    1.00     71.9±1.61µs        ? ?/sec
convert_columns_prepared 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0)                                          1.34    227.9±1.06µs        ? ?/sec    1.00    169.8±1.80µs        ? ?/sec
convert_columns_prepared 4096 string(30, 0)                                                                                   1.57     47.4±0.14µs        ? ?/sec    1.00     30.2±0.49µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary(10, 0)                                                                        1.30     73.1±0.36µs        ? ?/sec    1.00     56.1±0.61µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary(100, 0)                                                                       1.54    147.6±8.75µs        ? ?/sec    1.00     95.9±1.42µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary(100, 0.5)                                                                     1.15    111.8±0.43µs        ? ?/sec    1.00     97.0±1.26µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary(30, 0)                                                                        1.31     76.5±1.08µs        ? ?/sec    1.00     58.3±0.45µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary_low_cardinality(10, 0)                                                        1.04     28.3±0.32µs        ? ?/sec    1.00     27.1±0.17µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary_low_cardinality(100, 0)                                                       1.31     49.0±3.85µs        ? ?/sec    1.00     37.3±0.69µs        ? ?/sec
convert_columns_prepared 4096 string_dictionary_low_cardinality(30, 0)                                                        1.03     28.2±0.30µs        ? ?/sec    1.00     27.5±0.36µs        ? ?/sec
convert_columns_prepared 4096 u64(0)                                                                                          1.00      7.8±0.08µs        ? ?/sec    1.17      9.1±0.03µs        ? ?/sec
convert_columns_prepared 4096 u64(0.3)                                                                                        1.00     14.6±0.15µs        ? ?/sec    1.07     15.7±0.20µs        ? ?/sec
convert_columns_prepared 8192 53 columns                                                                                      1.37      3.7±0.09ms        ? ?/sec    1.00      2.7±0.03ms        ? ?/sec
convert_rows 10 large_list(0) of u64(0)                                                                                       1.03  1520.6±20.21ns        ? ?/sec    1.00  1478.4±10.98ns        ? ?/sec
convert_rows 10 list(0) of u64(0)                                                                                             1.11  1715.4±56.82ns        ? ?/sec    1.00  1550.5±11.31ns        ? ?/sec
convert_rows 4096 4096 string_dictionary(20, 0.5), string_dictionary(30, 0), string_dictionary(100, 0), i64(0)                1.59    301.9±1.96µs        ? ?/sec    1.00    190.1±3.05µs        ? ?/sec
convert_rows 4096 53 columns                                                                                                  1.78      2.9±0.03ms        ? ?/sec    1.00  1653.8±20.08µs        ? ?/sec
convert_rows 4096 bool(0, 0.5)                                                                                                1.08     16.3±0.57µs        ? ?/sec    1.00     15.1±0.13µs        ? ?/sec
convert_rows 4096 bool(0.3, 0.5)                                                                                              1.08     16.3±0.27µs        ? ?/sec    1.00     15.1±0.21µs        ? ?/sec
convert_rows 4096 i64(0)                                                                                                      2.18     32.2±0.35µs        ? ?/sec    1.00     14.8±0.86µs        ? ?/sec
convert_rows 4096 i64(0.3)                                                                                                    1.23     32.1±0.11µs        ? ?/sec    1.00     26.0±1.00µs        ? ?/sec
convert_rows 4096 large_list(0) of u64(0)                                                                                     1.94    268.7±2.63µs        ? ?/sec    1.00    138.5±2.26µs        ? ?/sec
convert_rows 4096 large_list(0) sliced to 10 of u64(0)                                                                        1.19  1972.8±22.57ns        ? ?/sec    1.00  1657.6±34.09ns        ? ?/sec
convert_rows 4096 list(0) of u64(0)                                                                                           1.96    271.2±8.59µs        ? ?/sec    1.00    138.2±3.07µs        ? ?/sec
convert_rows 4096 list(0) sliced to 10 of u64(0)                                                                              1.26      2.2±0.02µs        ? ?/sec    1.00  1714.4±10.14ns        ? ?/sec
convert_rows 4096 string view(1..100, 0)                                                                                      2.01    172.5±0.73µs        ? ?/sec    1.00     85.8±0.96µs        ? ?/sec
convert_rows 4096 string view(1..100, 0.5)                                                                                    1.26    137.2±0.54µs        ? ?/sec    1.00    108.6±2.55µs        ? ?/sec
convert_rows 4096 string view(10, 0)                                                                                          1.32     79.6±1.67µs        ? ?/sec    1.00     60.2±1.22µs        ? ?/sec
convert_rows 4096 string view(100, 0)                                                                                         2.03    124.8±1.17µs        ? ?/sec    1.00     61.4±0.60µs        ? ?/sec
convert_rows 4096 string view(100, 0.5)                                                                                       1.15    115.3±0.35µs        ? ?/sec    1.00    100.4±0.61µs        ? ?/sec
convert_rows 4096 string view(30, 0)                                                                                          1.61     90.5±0.71µs        ? ?/sec    1.00     56.2±2.15µs        ? ?/sec
convert_rows 4096 string(10, 0)                                                                                               1.40     60.3±0.69µs        ? ?/sec    1.00     43.1±0.63µs        ? ?/sec
convert_rows 4096 string(100, 0)                                                                                              2.18    110.3±0.95µs        ? ?/sec    1.00     50.7±0.64µs        ? ?/sec
convert_rows 4096 string(100, 0.5)                                                                                            1.21    104.2±0.72µs        ? ?/sec    1.00     86.2±0.91µs        ? ?/sec
convert_rows 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0)                                                      1.61    300.8±1.69µs        ? ?/sec    1.00    186.8±1.20µs        ? ?/sec
convert_rows 4096 string(30, 0)                                                                                               1.68     72.8±1.01µs        ? ?/sec    1.00     43.2±0.68µs        ? ?/sec
convert_rows 4096 string_dictionary(10, 0)                                                                                    1.40     60.3±0.13µs        ? ?/sec    1.00     43.2±0.15µs        ? ?/sec
convert_rows 4096 string_dictionary(100, 0)                                                                                   2.19    110.9±2.38µs        ? ?/sec    1.00     50.6±0.25µs        ? ?/sec
convert_rows 4096 string_dictionary(100, 0.5)                                                                                 1.21    104.4±0.35µs        ? ?/sec    1.00     86.3±0.87µs        ? ?/sec
convert_rows 4096 string_dictionary(30, 0)                                                                                    1.67     72.8±2.13µs        ? ?/sec    1.00     43.7±1.28µs        ? ?/sec
convert_rows 4096 string_dictionary_low_cardinality(10, 0)                                                                    1.40     60.5±0.88µs        ? ?/sec    1.00     43.3±0.46µs        ? ?/sec
convert_rows 4096 string_dictionary_low_cardinality(100, 0)                                                                   2.20    111.9±2.92µs        ? ?/sec    1.00     50.8±0.50µs        ? ?/sec
convert_rows 4096 string_dictionary_low_cardinality(30, 0)                                                                    1.68     72.6±1.38µs        ? ?/sec    1.00     43.4±0.53µs        ? ?/sec
convert_rows 4096 u64(0)                                                                                                      2.08     31.1±0.12µs        ? ?/sec    1.00     14.9±0.94µs        ? ?/sec
convert_rows 4096 u64(0.3)                                                                                                    1.20     31.3±1.05µs        ? ?/sec    1.00     26.1±1.20µs        ? ?/sec
convert_rows 8192 53 columns                                                                                                  1.92      7.2±0.15ms        ? ?/sec    1.00      3.8±0.05ms        ? ?/sec
iterate rows                                                                                                                  1.29      3.3±0.06µs        ? ?/sec    1.00      2.5±0.02µs        ? ?/sec

rluvaton · 2026-01-15T18:23:47Z

Closed as this is a POC and will be split into multiple PRs:

explaining in thorough of the steps and the optimizations I made here:

New row format that does not guarantee ordering of columns #9083 (comment)

rluvaton added 24 commits January 4, 2026 19:21

copy all unordered row code and update tests

4cb1014

fix one test and set the other to ignore

50700ba

added more tests with nullability

9e5ea8b

fix variable length parsing

7fa72b8

improve variable encoding by avoiding blocks and improve boolean by u…

931ee03

…sing single byte for nulls and value

change do bench to compare both impl

7cf64c9

add bench large and move small strings before empty strings

d356454

tried special impl for 4 of the same type

7fad286

slower

15adf69

make some faster and broke others

00a92e1

over complicated to see something

f0b6568

add null encoding

79f0f7f

fix some

3f3349e

fix some more

e3367c1

fix encoding

266edcf

fix and add test

b19d02f

for single column encode nulls as before

49edf84

wip

de6e6e6

Merge branch 'main' into unordered-row-convertor

25c9bfc

# Conflicts: # README.md # arrow/benches/row_format.rs

add encode with null and fix

9575090

fix nulls

a166272

Merge branch 'main' into unordered-row-convertor

6568cba

revert row format benchmark

d22b872

change row format benchmark to use the unordered row converter

15e694c

github-actions bot added the arrow Changes to the arrow crate label Jan 13, 2026

rluvaton closed this Jan 13, 2026

improve list encoding

ca7d701

cleanup and comment

527efa1

rluvaton reopened this Jan 14, 2026

rluvaton mentioned this pull request Jan 15, 2026

New row format that does not guarantee ordering of columns #9083

Open

rluvaton closed this Jan 15, 2026

Conversation

rluvaton commented Jan 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

rluvaton commented Jan 13, 2026

Uh oh!

alamb-ghbot commented Jan 13, 2026

Uh oh!

alamb-ghbot commented Jan 13, 2026

Uh oh!

rluvaton commented Jan 14, 2026

Uh oh!

rluvaton commented Jan 14, 2026

Uh oh!

rluvaton commented Jan 14, 2026

Uh oh!

Dandandan commented Jan 14, 2026

Uh oh!

rluvaton commented Jan 14, 2026

Uh oh!

alamb-ghbot commented Jan 14, 2026

Uh oh!

alamb commented Jan 14, 2026

Uh oh!

rluvaton commented Jan 15, 2026

Uh oh!

alamb-ghbot commented Jan 15, 2026

Uh oh!

alamb-ghbot commented Jan 15, 2026

Uh oh!

rluvaton commented Jan 15, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

rluvaton commented Jan 13, 2026 •

edited

Loading

rluvaton commented Jan 15, 2026 •

edited

Loading