diff --git a/201/index.md b/201/index.md index bf86c8a..bca6e11 100644 --- a/201/index.md +++ b/201/index.md @@ -1,4 +1,7 @@ # Advanced Topics in Chunking +In this second series of notebooks, we will go over more advanced topics associated with chunking. +The key concepts you should understand have after this series include: + ```{tableofcontents} ``` diff --git a/_toc.yml b/_toc.yml index cddd888..0b173bc 100755 --- a/_toc.yml +++ b/_toc.yml @@ -24,4 +24,4 @@ chapters: # - file: AWS # - file: StartNebariCluster - file: back/Glossary - # - file: back/AdditionalResources + - file: back/AdditionalResources diff --git a/back/AdditionalResources.md b/back/AdditionalResources.md new file mode 100644 index 0000000..4e94dad --- /dev/null +++ b/back/AdditionalResources.md @@ -0,0 +1,15 @@ +# Additional Resources + +As we can't cover all possible material on chunking in one series of notebooks, +listed below are some links to additional resources on chunking that can be referred to for additional information. + +- [Zarr docs on chunk optimization](https://zarr.readthedocs.io/en/stable/tutorial.html#chunk-optimizations) +- [Dask docs on chunk selection](https://docs.dask.org/en/stable/array-chunks.html) +- [Rechunker docs](https://rechunker.readthedocs.io/en/latest/index.html) +- [Kerchunk docs](https://fsspec.github.io/kerchunk/index.html) +- [VirtualiZarr docs](https://virtualizarr.readthedocs.io/en/stable/index.html) +- [Tutorial notebook on adding CRS to Zarr](https://code.usgs.gov/wma/nhgf/geo-data-portal/gdp_data_processing/-/blob/main/workflows/opendap/CIDA/crs_notebooks/tutorial.ipynb) +- [UCAR Blog on Difference between NetCDF and Zarr](https://www.unidata.ucar.edu/blogs/news/entry/netcdf-vs-zarr-an-incomplete) +- [UCAR Blog on Why Chunk Data](https://www.unidata.ucar.edu/blogs/developer/en/entry/chunking_data_why_it_matters) +- [UCAR Blog on Choosing Chunk Shapes](https://www.unidata.ucar.edu/blogs/developer/en/entry/chunking_data_choosing_shapes) +- [Project Pythia Cookbook on Kerchunk with Dask](https://projectpythia.org/kerchunk-cookbook/README.html) \ No newline at end of file