Switch from using the deprecated SourceAsset to AssetSpec

[bendnorman]

Switch from using the deprecated SourceAsset to AssetSpec.

The FERC Form 1 and Form 714 raw data are extracted into SQLite files before the main ETL begins. To bring the raw SQLite tables into dagster, we create SourceAssets for all the tables. To create a SourceAsset you just need to initialize it with a table name and an io manager key.

Dagster is removing SourceAssets in 2.0.0 so we need to start using AssetSpecs! This is what the SourceAsset docs say:

Use AssetSpec instead. If using the SourceAsset io_manager_key property, use AssetSpec(...).with_io_manager_key(...)..

Here is an example of how to make this change:

pudl/src/pudl/extract/ferc1.py

Lines 360 to 366 in 9dd1ab9

	raw_ferc1_dbf_assets = [
	SourceAsset(
	key=AssetKey(f"raw_ferc1_dbf__{table_name}"),
	io_manager_key="ferc1_dbf_sqlite_io_manager",
	)
	for table_name in dbf_table_names
	]

to

raw_ferc1_dbf_assets = [
    AssetSpec(
        key=AssetKey(f"raw_ferc1_dbf__{table_name}"),
    ).with_io_manager_key(""ferc1_dbf_sqlite_io_manager")
    for table_name in dbf_table_names
]

Tasks

Preview Give feedback

1. Replace SourceAsset with AssetSpec for FERC 714 and extraction
2. Incorporate AssetSpec into get_asset_keys()

[zaneselvans]

I made a brief attempt at this a couple of weeks ago and ran into some issues. It didn't seem quite as straightforward as they made it sound. See the deprecate-source-assets branch for where I left it.

[bendnorman]

Hey @ggurjar333! Are you still interested in taking this on?

[ggurjar333]

Yes I have created a branch on this I'll push it today. But I'm still facing some issues on AssetSpec configuration

#3983