Pangeo Forge Documentation

Pangeo Forge is an open source framework for Extraction, Transformation, and Loading (ETL) of scientific data.

First Steps

New to Pangeo Forge? You are in the right spot!

How the documentation is organized

There are a number of resources available when working with Pangeo Forge:

  • Introduction Tutorial: Introduction Tutorial - Walks you through creating, running, and staging your first Recipe.

  • User Guides explain core Pangeo Forge concepts in detail. They provide background information to aid in gaining a depth of understanding:

  • Advanced Examples walk through examples of using Pangeo Forge Recipes:

    • Recipe Tutorials - Are in-depth demonstrations of using Pangeo Forge Recipes with real world datasets. They are a good next step after the Introduction Tutorial.

  • References are the complete technical documentation of Pangeo Forge features. They are useful when you want to review a particular functionality in depth, but assume you already have a working knowledge of the framework:

Connecting with the Community

Pangeo Forge is a community run effort with a variety of roles:

  • Recipe contributors — contributors who write recipes to define the data conversions. This can be anyone with a desire to create analysis ready cloud-optimized (ARCO) data. To get involved, see Recipe Contribution.

  • Bakery operators — individuals or instituations who deploy bakeries on cloud infrastructure to process and host the transformed data. This is typically an organization with a grant to fund the infrastructure. For more information, see the Bakeries section of Core Concepts.

  • Pangeo Forge developers - scientists and software developers who maintain and enhance the open-source code base which makes Pangeo Forge run. See Development.

If you are new to Pangeo Forge and looking to get involved, we suggest starting with Recipe Contribution.