Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf(select): Use byte records instead of string records #892

Merged
merged 1 commit into from
Dec 16, 2024

Conversation

nwagner84
Copy link
Member

@nwagner84 nwagner84 commented Dec 16, 2024

 Benchmark 1: ./pica-v0.25 select -s -H 'ppn,gnd_id,label' '[email protected],041A/*{ (9, a) | 9? && 7 =~ "^T[bfgpsu][1z]$" }' DUMP.dat --where '[email protected] =^ "O" && 041A/*.9?' -o out.csv
  Time (mean ± σ):     261.160 s ±  2.054 s    [User: 240.933 s, System: 18.878 s]
  Range (min … max):   259.707 s … 262.612 s    2 runs

Benchmark 2: ./pica-main select -s -H 'ppn,gnd_id,label' '[email protected],041A/*{ (9, a) | 9? && 7 =~ "^T[bfgpsu][1z]$" }' DUMP.dat --where '[email protected] =^ "O" && 041A/*.9?' -o out.csv
  Time (mean ± σ):     243.547 s ±  1.746 s    [User: 223.634 s, System: 18.478 s]
  Range (min … max):   242.312 s … 244.782 s    2 runs

Summary
  './pica-main select -s -H 'ppn,gnd_id,label' '[email protected],041A/*{ (9, a) | 9? && 7 =~ "^T[bfgpsu][1z]$" }' DUMP.dat --where '[email protected] =^ "O" && 041A/*.9?' -o out.csv' ran
    1.07 ± 0.01 times faster than './pica-v0.25 select -s -H 'ppn,gnd_id,label' '[email protected],041A/*{ (9, a) | 9? && 7 =~ "^T[bfgpsu][1z]$" }' DUMP.dat --where '[email protected] =^ "O" && 041A/*.9?' -o out.csv'

@nwagner84 nwagner84 added A-select Area: The select command C-optimization Category: optimization labels Dec 16, 2024
@nwagner84 nwagner84 self-assigned this Dec 16, 2024
@nwagner84 nwagner84 merged commit 86260d5 into main Dec 16, 2024
20 checks passed
@nwagner84 nwagner84 deleted the select-byte-record branch December 16, 2024 10:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-select Area: The select command C-optimization Category: optimization
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant