Skip to content

Conversation

@johnedquinn
Copy link
Member

Generate data:

./partiql-eval-vectorized/scripts/generate_all_data.sh

Run comparison:

cargo run --release --bin partiql-comparison \
        "SELECT a, b FROM ~input~ WHERE a % 1000000 = 0" \
        --data-source-old ion --data-path-old test_data/data_b1024_n10000.10n \
        --data-source-new ion --data-path-new test_data/data_b1024_n10000.10n;

Results:

Query (Legacy):       SELECT a, b FROM data() WHERE a % 1000000 = 0
Query (Vectorized):   SELECT a, b FROM data WHERE a % 1000000 = 0
Data Source (Old):    ion
Data Path (Old):      test_data/data_b1024_n10000.10n
Data Source (New):    ion
Data Path (New):      test_data/data_b1024_n10000.10n
Reader Config (Old):  total_rows=10,240,000 (from file)
Reader Config (New):  total_rows=10,240,000 (from file)

============================================================
EXECUTION COMPARISON: Non-Vectorized vs Vectorized
============================================================

=== NON-VECTORIZED EXECUTION ===
Execution completed successfully
Execution time: 6823.012ms
Rows processed: 11

=== VECTORIZED EXECUTION ===
Execution time: 1686.931ms
Batches processed: 10000
Rows processed: 11

============================================================
TIMING SUMMARY
============================================================

Non-Vectorized Planning Phase:
  Parse:                5.120ms
  Lower:                0.589ms
  Compile:              0.270ms

Vectorized Planning Phase:
  Parse:                0.017ms
  Lower:                0.025ms
  Compile:              1658.917μs

Execution Phase:
  Non-Vectorized:       6823.012ms
  Vectorized:           1686.931ms
  Speedup:              4.04x

Description of changes:

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@johnedquinn johnedquinn merged commit 8270d25 into poc-vectorized Jan 6, 2026
3 of 16 checks passed
@johnedquinn johnedquinn deleted the poc-vectorized-streaming branch January 6, 2026 21:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant