Module 2 References

Parallelization

Workflow

Start Small, Scale Up

Tools

Choosing Tools

Multiprocessing

• Multiprocessing
• Multiprocessing Docs

Dask

• Dask
• Dask Dataframes
• Dask Arrays
• Dask Delayed
• Parallelizing Xarray with Dask

Other Parallelization Frameworks in Python

• Polars
• Ray

Parallel Computing

• MapReduce
• Parallel Computing for Data Science (Towards Data Science)
• Dask Tutorial
• Dask Examples
• CMIP6 Dask Example
• CMIP6 Dask Example 2

Time Complexity

• Article 1
• Article 2
• Article 3
• Article 4

Functional Programming

• Article 1
• Article 2

Data Cleaning

• Tidy Data
• Missingno (for Python)