Earth System Data Science in the Cloud

Session Overview

  • Welcome
  • Interim Check-In
  • Data Driven Science
  • What is Data Science?
  • Where We Are/Context
  • Course Goals and Objectives
  • Module Goals and Objectives
  • Course Logistics

Welcome To Module 4!

Interim Check-In


How did you apply Module 3 to your work?


What did you explore?

Where are you in your team environment?

This Module

Data Product Development

Data Driven Science

Schleder et al. 2019 DOI: 10.1088/2515-7639/ab084b

Data Science

Course Goals & Objectives

  1. Make the Impossible Possible
  2. 10x Performance

Course Goals & Objectives

  • Conversant and practiced in developing cloud based earth system data science workflows.

  • Comfortable developing data science products.

  • Comfortable and practiced in working effectively on interdisciplinary teams.

  • Able to rapidly pick up new skills, tools, and techniques.

Principles & Practices

Module Goals & Objectives

By the end of this module, you will be familiar with and conversant in the following areas:

  • The fundamentals of Deep Learning
  • Your personal ethical framework for decision making
  • Scaling ML training on the Cloud

Module Goals & Objectives

Specifically by the end of the course, you will have accomplished the following:

  • Run custom and off-the-shelf deep learning algorithms on GPUs in the Cloud.
  • Automated large amounts of ML training.
  • Monitored and troubleshooted ML development at scale.
  • Leveraged multiple workers to process large amounts of data.
  • Connected results from ML approaches to scientific insights.

Module Outline

Days:

  1. Managing Multiple Models & Intro to Deep Learning
  2. Ethics & More Deep Learning
  3. Deep Learning
  4. Insight & Team Work
  5. Team Presentations and Next Steps

Team Project Outline

Days:

1-3. ML & Project Development

  1. Presentation Practice
  2. Presentations

Team Project Deliverables

Presentation

  • 10 minutes (no more, can be less)
  • Team Name
  • Results from ML approach
  • Beginning of Scientific Insight
  • Next Steps

Session Overview

  • Welcome
  • What is Data Science?
  • What is Earth System Data Science in the Cloud?
  • Course Goals and Objectives
  • Module Goals and Objectives
  • Course Logistics

Course Logistics

Strategies for Success

This is a lot of information.

  • You would not be here if you could not handle it.
  • Be present.
  • You will not understand everything the first time. That is OK!
  • Keep a Journal of topics to return to and explore more
  • You will see each topic/idea at least 3 times on separate days
  • Ask questions
  • Invest the time now…

Penultimate Note

Reflection, Integration, and Scientific Insight

Final Note

We made this course for you! We want your feedback!

Please reach out anytime on Slack or at dwillett@cicsnc.org & ggraham@cicsnc.org.

Team Pre-Project Assessment

Production Assessment