-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
3 changed files
with
19 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,4 +1,7 @@ | ||
# Advanced Topics in Chunking | ||
|
||
In this second series of notebooks, we will go over more advanced topics associated with chunking. | ||
The key concepts you should understand have after this series include: | ||
|
||
```{tableofcontents} | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,15 @@ | ||
# Additional Resources | ||
|
||
As we can't cover all possible material on chunking in one series of notebooks, | ||
listed below are some links to additional resources on chunking that can be referred to for additional information. | ||
|
||
- [Zarr docs on chunk optimization](https://zarr.readthedocs.io/en/stable/tutorial.html#chunk-optimizations) | ||
- [Dask docs on chunk selection](https://docs.dask.org/en/stable/array-chunks.html) | ||
- [Rechunker docs](https://rechunker.readthedocs.io/en/latest/index.html) | ||
- [Kerchunk docs](https://fsspec.github.io/kerchunk/index.html) | ||
- [VirtualiZarr docs](https://virtualizarr.readthedocs.io/en/stable/index.html) | ||
- [Tutorial notebook on adding CRS to Zarr](https://code.usgs.gov/wma/nhgf/geo-data-portal/gdp_data_processing/-/blob/main/workflows/opendap/CIDA/crs_notebooks/tutorial.ipynb) | ||
- [UCAR Blog on Difference between NetCDF and Zarr](https://www.unidata.ucar.edu/blogs/news/entry/netcdf-vs-zarr-an-incomplete) | ||
- [UCAR Blog on Why Chunk Data](https://www.unidata.ucar.edu/blogs/developer/en/entry/chunking_data_why_it_matters) | ||
- [UCAR Blog on Choosing Chunk Shapes](https://www.unidata.ucar.edu/blogs/developer/en/entry/chunking_data_choosing_shapes) | ||
- [Project Pythia Cookbook on Kerchunk with Dask](https://projectpythia.org/kerchunk-cookbook/README.html) |