Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TpchBenchmark is broken #6834

Closed
majetideepak opened this issue Sep 29, 2023 · 9 comments
Closed

TpchBenchmark is broken #6834

majetideepak opened this issue Sep 29, 2023 · 9 comments
Labels
bug Something isn't working triage Newly created issue that needs attention.

Comments

@majetideepak
Copy link
Collaborator

Bug description

It currently segfaults on cmake-build-debug/velox/benchmarks/tpch/velox_tpch_benchmark --data_path data/hive_data/tpch --run_query_verbose 6
Specifying the cache_gb option throws the following message
MemoryAllocator capacity 10737418240 must be the same as MemoryManager capacity 9223372036854775807.

The following patch is needed to prevent the segfault.

--- a/velox/benchmarks/tpch/TpchBenchmark.cpp
+++ b/velox/benchmarks/tpch/TpchBenchmark.cpp
@@ -263,7 +263,9 @@ class TpchBenchmark {
   }
 
   void shutdown() {
-    cache_->shutdown();
+    if (cache_) {
+      cache_->shutdown();
+    }
   }
 
   std::pair<std::unique_ptr<TaskCursor>, std::vector<RowVectorPtr>> run(

System information

Velox System Info v0.0.2
Commit: ebf797a
CMake Version: 3.26.4
System: Darwin-22.6.0
Arch: arm64
C++ Compiler: /Library/Developer/CommandLineTools/usr/bin/c++
C++ Compiler Version: 15.0.0.15000040
C Compiler: /Library/Developer/CommandLineTools/usr/bin/cc
C Compiler Version: 15.0.0.15000040
CMake Prefix Path: /Library/Developer/CommandLineTools/SDKs/MacOSX14.0.sdk/usr;/opt/homebrew;/usr/local;/usr;/;/opt/homebrew/Cellar/cmake/3.26.4;/usr/local;/usr/X11R6;/usr/pkg;/opt;/sw;/opt/local

Relevant logs

No response

@majetideepak majetideepak added bug Something isn't working triage Newly created issue that needs attention. labels Sep 29, 2023
@XinShuoWang
Copy link

Same issue. Why is this fix not merged into the main branch?

@majetideepak
Copy link
Collaborator Author

@XinShuoWang Along with the fix, we need to add this benchmark to CI to prevent this from breaking again.

@bdice
Copy link
Contributor

bdice commented Nov 14, 2024

It seems like PR #7345 went stale. Could this fix be revived and merged as-is? We have confirmed that it fixes a bug on our side.

@majetideepak
Copy link
Collaborator Author

@majetideepak
Copy link
Collaborator Author

@bdice can you share a reproducer?

@bdice
Copy link
Contributor

bdice commented Nov 14, 2024

Ah - I just saw this issue was still open. I have a reproducer but it may be because I may need to pull in the latest Velox upstream (my branch is out of date). I'll double check on the upstream soon, but I'm fine with closing this issue if you think it has been resolved.

cc: @karthikeyann

@bdice
Copy link
Contributor

bdice commented Nov 25, 2024

I verified that the fix linked above worked. I think this issue should be safe to close now.

@karthikeyann
Copy link
Contributor

It's broken again after new parquet reader
This PR #11833 fixes the issue.

@majetideepak
Copy link
Collaborator Author

Currently fixed!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working triage Newly created issue that needs attention.
Projects
None yet
Development

No branches or pull requests

4 participants