Delta Sharing Python 1.3.1

We’d like to announce the release of Delta Sharing Python 1.3.1, which fixes an issue with the previous 1.3.0 release where the rust wrapper failed to install on some systems (such as Linux with glibc 2.34+ and Windows).

Credits: Patrick Jin

Delta Sharing Python 1.3.0

We are excited to announce the release of Delta Sharing Python 1.3 which includes support for CDF queries on shared tables with deletion vectors (DV) enabled on the source table. (#613)

Limitations:

• If DV is enabled, use_delta_format=True must be specified when calling load_table_changes_to_pandas.
  • Note that unlike load_as_pandas, load_table_changes_to_pandas will NOT auto-resolve to delta format if advanced features (like DV) are enabled.
• CDF queries with use_delta_format=True will fail if the schema changed during the queried version range.

Credits: Patrick Jin, Lin Zhou

Delta Sharing 1.2.2

We’d like to announce the release of Delta Sharing 1.2.12 which introduce the following improvements:

• Sync back the change of #603 and #604 to branch-1.2 to make 1.2 work with Spark 4.0 (#605)

Credits: Jungtaek Lim

Delta Sharing 1.2.1

We’d like to announce the release of Delta Sharing 1.2.1, which introduce the following improvements:

• Fix constructor of DeltaSharingRestClient (#601)
• Backport includeEndStreamAction in DeltasharingService to branch-1.2 (#599)
• Make delta-sharing-client compatible with Spark 4.0 (#583)

Credits: Charlene Lyu, Lin Zhou

Delta Sharing 1.1.3

We’d like to announce the release of Delta Sharing 0.7.10, which introduce the following improvements

• Backport includeEndStreamAction in DeltasharingService to branch-1.1 (#593)
• Add additional logging in DeltaSharingClient and DeltaSharingSource Branch 1.1 (#587)
• Log additional queryId and table id and table name (#576)
• add more debugging info (#575)

Credits: Lin Zhou

Delta Sharing 0.7.10

We’d like to announce the release of Delta Sharing 0.7.10, which introduce the following improvements

• Backport includeEndStreamAction in DeltasharingService. (#595)

Credits: Lin Zhou

Delta Sharing Python 1.2.0

We are excited to announce the release of Delta Sharing Python 1.2 which includes oauth_client_credentials support in the Python DeltaSharing Client. (#563)

Credits: Moe Derakhshani

Delta Sharing 1.1.2

• Allow for conditional downgrading https requests for storage access in DeltaSharingClient when a proxy is provided. (#559)

Credits: Taiga Matsumoto

Delta Sharing 1.2.0

We’d like to announce the release of Delta Sharing 1.2.0, which introduce the following improvements

• Allow for conditional downgrading https requests for storage access in DeltaSharingClient when a proxy is provided. (#559)
• Added support for oauth client credentials grant in DeltaSharingClient (#553)
• Added support for Deletion Vector in Server. (#518)
• Pre-signed URLs no longer show up in error messages upon access failure
• Enable JsonPredicateV2 by default (#496)
• Server side push down JSON Predicate Hints (#525)

Credits: Taiga Matsumoto, Moe Derakhshani , Pranav Sukumar

Delta Sharing Spark 0.4.1

We’d like to announce the release of Delta Sharing Spark 0.4.1, which introduce the following improvements

• Add spark_release script to 0.4 (#565)
• Add a Custom Http Header Provider (#561)
  Credits: Tom Zhu