If you have found your way here, then you are probably interested in learning more about data chunking. In this tutorial, we will go over all levels of information on data chunking, from the basic introductions on the topic to complex methods of selecting optimal chunk sizes and rechunking on the cloud. Much of what is covered in this tutorial replicates concepts covered in a variety of materials that we cite as we go. However, that material has been adapted to use data that looks like data you might encounter in a HyTEST workflow.
The content is split into two primary section:
In Introduction to Chunking, we discuss all of the basic introductory topics associated with chunking. As for Advanced Topics in Chunking, we dive into some more advanced topics related to chunking, which require a firm understanding of introductory topics.
Feel free to read this tutorial in order (which has been set up for those new to chunking) or jump directly to the topic that interests you:
If you find any issues or errors in this tutorial or have any ideas for material that should be included, please open an issue using GitHub icon in the upper right.