Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Integrate with datafusion to support projection pushdown from SQL #206

Open
xushiyan opened this issue Nov 30, 2024 · 2 comments
Open

Integrate with datafusion to support projection pushdown from SQL #206

xushiyan opened this issue Nov 30, 2024 · 2 comments
Labels
feature
Milestone
release-0.4.0

Comments

@xushiyan
Copy link
Member

Similar to #160 , support projection pushdown
@xushiyan xushiyan added this to the release-0.3.0 milestone Nov 30, 2024
@jonathanc-n jonathanc-n mentioned this issue Dec 1, 2024
Closed
@jonathanc-n
Copy link
Contributor

@xushiyan What will this one entail? Projections in hudi are a little different due to being group partitioned versus file partitioning. Should we do a schema projection here?

@xushiyan xushiyan removed the p0 label Jan 22, 2025
@xushiyan xushiyan modified the milestones: release-0.3.0, release-0.4.0 Jan 22, 2025
@xushiyan
Copy link
Member Author

xushiyan commented Feb 1, 2025 •
edited
Loading

@jonathanc-n so there is FileGroupReader for reading file slices. this is about passing projection to file group reader such that it only extract needed columns.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature
Projects
hudi-rs roadmap
Status: Todo
Milestone
release-0.4.0
Development

No branches or pull requests
2 participants
@xushiyan @jonathanc-n