Skip to content

Instantly share code, notes, and snippets.

@Mytherin
Created August 19, 2021 20:49
Show Gist options
  • Save Mytherin/16d8b2c3b2177d17c140fbe5b4820ffd to your computer and use it in GitHub Desktop.
Save Mytherin/16d8b2c3b2177d17c140fbe5b4820ffd to your computer and use it in GitHub Desktop.
Benchmark DataFusion vs DuckDB
TPC-H
| Query | DuckDB | DataFusion |
|-------|--------|------------------|
| Q01 | 0.05s | 0.07 |
| Q02 | 0.02s | Unsupported |
| Q03 | 0.03s | 0.06s |
| Q04 | 0.05s | Unsupported |
| Q05 | 0.03s | 0.11s |
| Q06 | 0.01s | 0.01s |
| Q07 | 0.07s | 0.37s |
| Q08 | 0.03s | Panic |
| Q09 | 0.31s | 19.2s |
| Q10 | 0.05s | 0.12s |
| Q11 | 0.01s | Unsupported |
| Q12 | 0.05s | 0.03s |
| Q13 | 0.12s | 0.20s |
| Q14 | 0.02s | Panic |
| Q15 | 0.04s | Unsupported |
| Q16 | 0.05s | Unsupported |
| Q17 | 0.08s | Unsupported |
| Q18 | 0.10s | Unsupported |
| Q19 | 0.05s | Timeout (>5 min) |
| Q20 | 0.05s | Unsupported |
| Q21 | 0.20s | Unsupported |
| Q22 | 0.02s | Unsupported |
NYC Taxi (2015 only, concatenated into one single Parquet file because DataFusion does not support reading multiple Parquet files)
| Query | DuckDB | DataFusion |
|-------|--------|------------|
| Q1 | 0.5s | 2.4s |
| Q2 | 0.45s | 2.6s |
| Q3 | 0.55s | 2.9s |
| Q4 | 1.7s | 3.8s |
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment