Skip to content

Commit

Permalink
Additional resources page
Browse files Browse the repository at this point in the history
  • Loading branch information
kjdoore committed Jan 6, 2025
1 parent 54bbc70 commit c1c6af0
Show file tree
Hide file tree
Showing 3 changed files with 19 additions and 1 deletion.
3 changes: 3 additions & 0 deletions 201/index.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,7 @@
# Advanced Topics in Chunking

In this second series of notebooks, we will go over more advanced topics associated with chunking.
The key concepts you should understand have after this series include:

```{tableofcontents}
```
2 changes: 1 addition & 1 deletion _toc.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,4 +24,4 @@ chapters:
# - file: AWS
# - file: StartNebariCluster
- file: back/Glossary
# - file: back/AdditionalResources
- file: back/AdditionalResources
15 changes: 15 additions & 0 deletions back/AdditionalResources.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
# Additional Resources

As we can't cover all possible material on chunking in one series of notebooks,
listed below are some links to additional resources on chunking that can be referred to for additional information.

- [Zarr docs on chunk optimization](https://zarr.readthedocs.io/en/stable/tutorial.html#chunk-optimizations)
- [Dask docs on chunk selection](https://docs.dask.org/en/stable/array-chunks.html)
- [Rechunker docs](https://rechunker.readthedocs.io/en/latest/index.html)
- [Kerchunk docs](https://fsspec.github.io/kerchunk/index.html)
- [VirtualiZarr docs](https://virtualizarr.readthedocs.io/en/stable/index.html)
- [Tutorial notebook on adding CRS to Zarr](https://code.usgs.gov/wma/nhgf/geo-data-portal/gdp_data_processing/-/blob/main/workflows/opendap/CIDA/crs_notebooks/tutorial.ipynb)
- [UCAR Blog on Difference between NetCDF and Zarr](https://www.unidata.ucar.edu/blogs/news/entry/netcdf-vs-zarr-an-incomplete)
- [UCAR Blog on Why Chunk Data](https://www.unidata.ucar.edu/blogs/developer/en/entry/chunking_data_why_it_matters)
- [UCAR Blog on Choosing Chunk Shapes](https://www.unidata.ucar.edu/blogs/developer/en/entry/chunking_data_choosing_shapes)
- [Project Pythia Cookbook on Kerchunk with Dask](https://projectpythia.org/kerchunk-cookbook/README.html)

0 comments on commit c1c6af0

Please sign in to comment.