This notebook is used to update metadata of an existing table in Delta Lake using the table's equivalent Pydantic data model. This is especially useful if you have data from an application that flows into Delta and happens to already have dataclasses or datamodels that define the schema of raw data.
Note that updating Delta table metadata is highly dependent on the Pydantic models already being pre-defined with
tagsanddescriptionperField
The Delta Lake Table metadata updater is a helpful tool with below use cases:
-
Metadata Enrichment: Enhance the quality of your data by adding descriptions and tags to your table columns.
-
Automated Documentation: Save time and effort by automatically generating metadata based on your Pydantic data models.
-
Consistency and Quality: Ensure consistent metadata across your Delta Lake tables.
See more details in the notebook (ipynb)