Complex NetCDF to Zarr Recipe: TerraClimate

About the Dataset

From http://www.climatologylab.org/terraclimate.html:

TerraClimate is a dataset of monthly climate and climatic water balance for global terrestrial surfaces from 1958-2019. These data provide important inputs for ecological and hydrological studies at global scales that require high spatial resolution and time-varying data. All data have monthly temporal resolution and a ~4-km (1/24th degree) spatial resolution. The data cover the period from 1958-2019. We plan to update these data periodically (annually).

What makes it tricky

This is an advanced example that illustrates the following concepts

  • Multiple variables in different files: There is one file per year for a dozen different variables.

  • Complex Preprocessing: We want to apply different preprocessing depending on the variable. This example shows how.

  • Inconsistent size of data in input files: This means we have to scan each input file and cache its metadata before we can start writing the target.

This recipe requires a new storage target, a metadata_cache. In this example, this is just another directory. You could hypothetically use a database or other key/value store for this.

from pangeo_forge_recipes.recipes import XarrayZarrRecipe
from pangeo_forge_recipes.patterns import FilePattern, ConcatDim, MergeDim
import xarray as xr

Define Filename Pattern

To keep this example smaller, we just use two years instead of the whole record.

target_chunks = {"lat": 1024, "lon": 1024, "time": 12}
# only do two years to keep the example small; it's still big!
years = list(range(1958, 1960))
variables = [
    "aet",
    "def",
    "pet",
    "ppt",
    "q",
    "soil",
    "srad",
    "swe",
    "tmax",
    "tmin",
    "vap",
    "ws",
    "vpd",
    "PDSI",
]

def make_filename(variable, time):
    return f"http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_{variable}_{time}.nc"

pattern = FilePattern(
    make_filename,
    ConcatDim(name="time", keys=years),
    MergeDim(name="variable", keys=variables)
)
pattern
<FilePattern {'time': 2, 'variable': 14}>

Check out the pattern:

for key, filename in pattern.items():
    break
key, filename
((DimIndex(name='time', index=0, sequence_len=2, operation=<CombineOp.CONCAT: 2>),
  DimIndex(name='variable', index=0, sequence_len=14, operation=<CombineOp.MERGE: 1>)),
 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1958.nc')

Define Preprocessing Functions

These functions apply masks for each variable to remove invalid data.

rename_vars = {'PDSI': 'pdsi'}

mask_opts = {
    "PDSI": ("lt", 10),
    "aet": ("lt", 32767),
    "def": ("lt", 32767),
    "pet": ("lt", 32767),
    "ppt": ("lt", 32767),
    "ppt_station_influence": None,
    "q": ("lt", 2147483647),
    "soil": ("lt", 32767),
    "srad": ("lt", 32767),
    "swe": ("lt", 10000),
    "tmax": ("lt", 200),
    "tmax_station_influence": None,
    "tmin": ("lt", 200),
    "tmin_station_influence": None,
    "vap": ("lt", 300),
    "vap_station_influence": None,
    "vpd": ("lt", 300),
    "ws": ("lt", 200),
}

def apply_mask(key, da):
    """helper function to mask DataArrays based on a threshold value"""
    if mask_opts.get(key, None):
        op, val = mask_opts[key]
        if op == "lt":
            da = da.where(da < val)
        elif op == "neq":
            da = da.where(da != val)
    return da


def preproc(ds):
    """custom preprocessing function for terraclimate data"""
    
    rename = {}

    station_influence = ds.get("station_influence", None)

    if station_influence is not None:
        ds = ds.drop_vars("station_influence")

    var = list(ds.data_vars)[0]

    if var in rename_vars:
        rename[var] = rename_vars[var]

    if "day" in ds.coords:
        rename["day"] = "time"

    if station_influence is not None:
        ds[f"{var}_station_influence"] = station_influence

    with xr.set_options(keep_attrs=True):
        ds[var] = apply_mask(var, ds[var])

    if rename:
        ds = ds.rename(rename)
                
    return ds

Define Recipe

We are now ready to define the recipe. We also specify the desired chunks of the target dataset.

A key property of this recipe is nitems_per_input=None, which triggers caching of input metadata.

chunks = {"lat": 1024, "lon": 1024, "time": 12}

recipe = XarrayZarrRecipe(
    file_pattern=pattern,
    target_chunks=target_chunks,
    process_chunk=preproc
)
recipe
XarrayZarrRecipe(file_pattern=<FilePattern {'time': 2, 'variable': 14}>, inputs_per_chunk=1, target_chunks={'lat': 1024, 'lon': 1024, 'time': 12}, target=None, input_cache=None, metadata_cache=None, cache_inputs=True, copy_input_to_local_file=False, consolidate_zarr=True, xarray_open_kwargs={}, xarray_concat_kwargs={}, delete_input_encoding=True, process_input=None, process_chunk=<function preproc at 0x7fc048a84670>, lock_timeout=None, subset_inputs={})

Define Storage Targets

Since we did not specify nitems_per_file in our ConcatDim, the recipe needs to cache input metadata. So we need to suply a metadata_cache target.

import tempfile
from fsspec.implementations.local import LocalFileSystem
from pangeo_forge_recipes.storage import FSSpecTarget, CacheFSSpecTarget, MetadataTarget

fs_local = LocalFileSystem()

target_dir = tempfile.TemporaryDirectory()
target = FSSpecTarget(fs_local, target_dir.name)

cache_dir = tempfile.TemporaryDirectory()
cache_target = CacheFSSpecTarget(fs_local, cache_dir.name)

meta_dir = tempfile.TemporaryDirectory()
meta_store = MetadataTarget(fs_local, meta_dir.name)

recipe.target = target
recipe.input_cache = cache_target
recipe.metadata_cache = meta_store
recipe
XarrayZarrRecipe(file_pattern=<FilePattern {'time': 2, 'variable': 14}>, inputs_per_chunk=1, target_chunks={'lat': 1024, 'lon': 1024, 'time': 12}, target=FSSpecTarget(fs=<fsspec.implementations.local.LocalFileSystem object at 0x7fc048a8ef40>, root_path='/var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo'), input_cache=CacheFSSpecTarget(fs=<fsspec.implementations.local.LocalFileSystem object at 0x7fc048a8ef40>, root_path='/var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpf4qd_07g'), metadata_cache=MetadataTarget(fs=<fsspec.implementations.local.LocalFileSystem object at 0x7fc048a8ef40>, root_path='/var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmployas62r'), cache_inputs=True, copy_input_to_local_file=False, consolidate_zarr=True, xarray_open_kwargs={}, xarray_concat_kwargs={}, delete_input_encoding=True, process_input=None, process_chunk=<function preproc at 0x7fc048a84670>, lock_timeout=None, subset_inputs={})

Execute with Prefect

This produces A LOT of output because we turn on logging.

# logging will display some interesting information about our recipe during execution
import logging
import sys

logging.basicConfig(
    format='%(asctime)s [%(levelname)s] %(name)s - %(message)s',
    level=logging.INFO,
    datefmt='%Y-%m-%d %H:%M:%S',
    stream=sys.stdout,
)
logger = logging.getLogger("pangeo_forge_recipes")
logger.setLevel(logging.INFO)
flow = recipe.to_prefect()
flow.run()
[2021-07-19 16:47:05+0200] INFO - prefect.FlowRunner | Beginning Flow run for 'pangeo-forge-recipe'
2021-07-19 16:47:05 [INFO] prefect.FlowRunner - Beginning Flow run for 'pangeo-forge-recipe'
[2021-07-19 16:47:05+0200] INFO - prefect.TaskRunner | Task 'cache_input': Starting task run...
2021-07-19 16:47:05 [INFO] prefect.TaskRunner - Task 'cache_input': Starting task run...
[2021-07-19 16:47:05+0200] INFO - prefect.TaskRunner | Task 'cache_input': Finished task run for task with final state: 'Mapped'
2021-07-19 16:47:05 [INFO] prefect.TaskRunner - Task 'cache_input': Finished task run for task with final state: 'Mapped'
[2021-07-19 16:47:05+0200] INFO - prefect.TaskRunner | Task 'cache_input[0]': Starting task run...
2021-07-19 16:47:05 [INFO] prefect.TaskRunner - Task 'cache_input[0]': Starting task run...
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-0'
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1958.nc'
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.storage - File 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1958.nc' is already cached
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-0'
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-0: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1958.nc'
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1958.nc' from cache
[2021-07-19 16:47:05+0200] INFO - prefect.TaskRunner | Task 'cache_input[0]': Finished task run for task with final state: 'Success'
2021-07-19 16:47:05 [INFO] prefect.TaskRunner - Task 'cache_input[0]': Finished task run for task with final state: 'Success'
[2021-07-19 16:47:05+0200] INFO - prefect.TaskRunner | Task 'cache_input[1]': Starting task run...
2021-07-19 16:47:05 [INFO] prefect.TaskRunner - Task 'cache_input[1]': Starting task run...
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-1'
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1958.nc'
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.storage - File 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1958.nc' is already cached
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-1'
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-1: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1958.nc'
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1958.nc' from cache
[2021-07-19 16:47:05+0200] INFO - prefect.TaskRunner | Task 'cache_input[1]': Finished task run for task with final state: 'Success'
2021-07-19 16:47:05 [INFO] prefect.TaskRunner - Task 'cache_input[1]': Finished task run for task with final state: 'Success'
[2021-07-19 16:47:05+0200] INFO - prefect.TaskRunner | Task 'cache_input[2]': Starting task run...
2021-07-19 16:47:05 [INFO] prefect.TaskRunner - Task 'cache_input[2]': Starting task run...
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-2'
2021-07-19 16:47:05 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1958.nc'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.storage - File 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1958.nc' is already cached
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-2'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-2: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1958.nc'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1958.nc' from cache
[2021-07-19 16:47:06+0200] INFO - prefect.TaskRunner | Task 'cache_input[2]': Finished task run for task with final state: 'Success'
2021-07-19 16:47:06 [INFO] prefect.TaskRunner - Task 'cache_input[2]': Finished task run for task with final state: 'Success'
[2021-07-19 16:47:06+0200] INFO - prefect.TaskRunner | Task 'cache_input[3]': Starting task run...
2021-07-19 16:47:06 [INFO] prefect.TaskRunner - Task 'cache_input[3]': Starting task run...
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-3'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1958.nc'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.storage - File 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1958.nc' is already cached
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-3'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-3: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1958.nc'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1958.nc' from cache
[2021-07-19 16:47:06+0200] INFO - prefect.TaskRunner | Task 'cache_input[3]': Finished task run for task with final state: 'Success'
2021-07-19 16:47:06 [INFO] prefect.TaskRunner - Task 'cache_input[3]': Finished task run for task with final state: 'Success'
[2021-07-19 16:47:06+0200] INFO - prefect.TaskRunner | Task 'cache_input[4]': Starting task run...
2021-07-19 16:47:06 [INFO] prefect.TaskRunner - Task 'cache_input[4]': Starting task run...
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-4'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1958.nc'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.storage - File 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1958.nc' is already cached
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-4'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-4: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1958.nc'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1958.nc' from cache
[2021-07-19 16:47:06+0200] INFO - prefect.TaskRunner | Task 'cache_input[4]': Finished task run for task with final state: 'Success'
2021-07-19 16:47:06 [INFO] prefect.TaskRunner - Task 'cache_input[4]': Finished task run for task with final state: 'Success'
[2021-07-19 16:47:06+0200] INFO - prefect.TaskRunner | Task 'cache_input[5]': Starting task run...
2021-07-19 16:47:06 [INFO] prefect.TaskRunner - Task 'cache_input[5]': Starting task run...
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-5'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1958.nc'
2021-07-19 16:47:06 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1958.nc' to cache
2021-07-19 16:47:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-5'
2021-07-19 16:47:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-5: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1958.nc'
2021-07-19 16:47:36 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1958.nc' from cache
[2021-07-19 16:47:36+0200] INFO - prefect.TaskRunner | Task 'cache_input[5]': Finished task run for task with final state: 'Success'
2021-07-19 16:47:36 [INFO] prefect.TaskRunner - Task 'cache_input[5]': Finished task run for task with final state: 'Success'
[2021-07-19 16:47:36+0200] INFO - prefect.TaskRunner | Task 'cache_input[6]': Starting task run...
2021-07-19 16:47:36 [INFO] prefect.TaskRunner - Task 'cache_input[6]': Starting task run...
2021-07-19 16:47:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-6'
2021-07-19 16:47:36 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1958.nc'
2021-07-19 16:47:36 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1958.nc' to cache
2021-07-19 16:48:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-6'
2021-07-19 16:48:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-6: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1958.nc'
2021-07-19 16:48:17 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1958.nc' from cache
[2021-07-19 16:48:17+0200] INFO - prefect.TaskRunner | Task 'cache_input[6]': Finished task run for task with final state: 'Success'
2021-07-19 16:48:17 [INFO] prefect.TaskRunner - Task 'cache_input[6]': Finished task run for task with final state: 'Success'
[2021-07-19 16:48:17+0200] INFO - prefect.TaskRunner | Task 'cache_input[7]': Starting task run...
2021-07-19 16:48:17 [INFO] prefect.TaskRunner - Task 'cache_input[7]': Starting task run...
2021-07-19 16:48:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-7'
2021-07-19 16:48:17 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1958.nc'
2021-07-19 16:48:17 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1958.nc' to cache
2021-07-19 16:48:42 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-7'
2021-07-19 16:48:42 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-7: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1958.nc'
2021-07-19 16:48:42 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1958.nc' from cache
[2021-07-19 16:48:42+0200] INFO - prefect.TaskRunner | Task 'cache_input[7]': Finished task run for task with final state: 'Success'
2021-07-19 16:48:42 [INFO] prefect.TaskRunner - Task 'cache_input[7]': Finished task run for task with final state: 'Success'
[2021-07-19 16:48:42+0200] INFO - prefect.TaskRunner | Task 'cache_input[8]': Starting task run...
2021-07-19 16:48:42 [INFO] prefect.TaskRunner - Task 'cache_input[8]': Starting task run...
2021-07-19 16:48:42 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-8'
2021-07-19 16:48:42 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1958.nc'
2021-07-19 16:48:42 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1958.nc' to cache
2021-07-19 16:49:21 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-8'
2021-07-19 16:49:21 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-8: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1958.nc'
2021-07-19 16:49:21 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1958.nc' from cache
[2021-07-19 16:49:21+0200] INFO - prefect.TaskRunner | Task 'cache_input[8]': Finished task run for task with final state: 'Success'
2021-07-19 16:49:21 [INFO] prefect.TaskRunner - Task 'cache_input[8]': Finished task run for task with final state: 'Success'
[2021-07-19 16:49:21+0200] INFO - prefect.TaskRunner | Task 'cache_input[9]': Starting task run...
2021-07-19 16:49:21 [INFO] prefect.TaskRunner - Task 'cache_input[9]': Starting task run...
2021-07-19 16:49:21 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-9'
2021-07-19 16:49:21 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1958.nc'
2021-07-19 16:49:21 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1958.nc' to cache
2021-07-19 16:50:00 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-9'
2021-07-19 16:50:00 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-9: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1958.nc'
2021-07-19 16:50:00 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1958.nc' from cache
[2021-07-19 16:50:00+0200] INFO - prefect.TaskRunner | Task 'cache_input[9]': Finished task run for task with final state: 'Success'
2021-07-19 16:50:00 [INFO] prefect.TaskRunner - Task 'cache_input[9]': Finished task run for task with final state: 'Success'
[2021-07-19 16:50:00+0200] INFO - prefect.TaskRunner | Task 'cache_input[10]': Starting task run...
2021-07-19 16:50:00 [INFO] prefect.TaskRunner - Task 'cache_input[10]': Starting task run...
2021-07-19 16:50:00 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-10'
2021-07-19 16:50:00 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1958.nc'
2021-07-19 16:50:00 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1958.nc' to cache
2021-07-19 16:50:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-10'
2021-07-19 16:50:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-10: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1958.nc'
2021-07-19 16:50:26 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1958.nc' from cache
[2021-07-19 16:50:26+0200] INFO - prefect.TaskRunner | Task 'cache_input[10]': Finished task run for task with final state: 'Success'
2021-07-19 16:50:26 [INFO] prefect.TaskRunner - Task 'cache_input[10]': Finished task run for task with final state: 'Success'
[2021-07-19 16:50:26+0200] INFO - prefect.TaskRunner | Task 'cache_input[11]': Starting task run...
2021-07-19 16:50:26 [INFO] prefect.TaskRunner - Task 'cache_input[11]': Starting task run...
2021-07-19 16:50:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-11'
2021-07-19 16:50:26 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1958.nc'
2021-07-19 16:50:26 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1958.nc' to cache
2021-07-19 16:50:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-11'
2021-07-19 16:50:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-11: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1958.nc'
2021-07-19 16:50:51 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1958.nc' from cache
[2021-07-19 16:50:51+0200] INFO - prefect.TaskRunner | Task 'cache_input[11]': Finished task run for task with final state: 'Success'
2021-07-19 16:50:51 [INFO] prefect.TaskRunner - Task 'cache_input[11]': Finished task run for task with final state: 'Success'
[2021-07-19 16:50:51+0200] INFO - prefect.TaskRunner | Task 'cache_input[12]': Starting task run...
2021-07-19 16:50:51 [INFO] prefect.TaskRunner - Task 'cache_input[12]': Starting task run...
2021-07-19 16:50:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-12'
2021-07-19 16:50:51 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1958.nc'
2021-07-19 16:50:51 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1958.nc' to cache
2021-07-19 16:51:04 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-12'
2021-07-19 16:51:04 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-12: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1958.nc'
2021-07-19 16:51:04 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1958.nc' from cache
[2021-07-19 16:51:04+0200] INFO - prefect.TaskRunner | Task 'cache_input[12]': Finished task run for task with final state: 'Success'
2021-07-19 16:51:04 [INFO] prefect.TaskRunner - Task 'cache_input[12]': Finished task run for task with final state: 'Success'
[2021-07-19 16:51:05+0200] INFO - prefect.TaskRunner | Task 'cache_input[13]': Starting task run...
2021-07-19 16:51:05 [INFO] prefect.TaskRunner - Task 'cache_input[13]': Starting task run...
2021-07-19 16:51:05 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-0,variable-13'
2021-07-19 16:51:05 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1958.nc'
2021-07-19 16:51:05 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1958.nc' to cache
2021-07-19 16:51:33 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0,variable-13'
2021-07-19 16:51:33 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-13: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1958.nc'
2021-07-19 16:51:33 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1958.nc' from cache
[2021-07-19 16:51:33+0200] INFO - prefect.TaskRunner | Task 'cache_input[13]': Finished task run for task with final state: 'Success'
2021-07-19 16:51:33 [INFO] prefect.TaskRunner - Task 'cache_input[13]': Finished task run for task with final state: 'Success'
[2021-07-19 16:51:33+0200] INFO - prefect.TaskRunner | Task 'cache_input[14]': Starting task run...
2021-07-19 16:51:33 [INFO] prefect.TaskRunner - Task 'cache_input[14]': Starting task run...
2021-07-19 16:51:33 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-0'
2021-07-19 16:51:33 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1959.nc'
2021-07-19 16:51:33 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1959.nc' to cache
2021-07-19 16:51:56 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-0'
2021-07-19 16:51:56 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-0: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1959.nc'
2021-07-19 16:51:56 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1959.nc' from cache
[2021-07-19 16:51:56+0200] INFO - prefect.TaskRunner | Task 'cache_input[14]': Finished task run for task with final state: 'Success'
2021-07-19 16:51:56 [INFO] prefect.TaskRunner - Task 'cache_input[14]': Finished task run for task with final state: 'Success'
[2021-07-19 16:51:56+0200] INFO - prefect.TaskRunner | Task 'cache_input[15]': Starting task run...
2021-07-19 16:51:56 [INFO] prefect.TaskRunner - Task 'cache_input[15]': Starting task run...
2021-07-19 16:51:56 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-1'
2021-07-19 16:51:56 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1959.nc'
2021-07-19 16:51:56 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1959.nc' to cache
2021-07-19 16:52:13 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-1'
2021-07-19 16:52:13 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-1: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1959.nc'
2021-07-19 16:52:13 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1959.nc' from cache
[2021-07-19 16:52:13+0200] INFO - prefect.TaskRunner | Task 'cache_input[15]': Finished task run for task with final state: 'Success'
2021-07-19 16:52:13 [INFO] prefect.TaskRunner - Task 'cache_input[15]': Finished task run for task with final state: 'Success'
[2021-07-19 16:52:13+0200] INFO - prefect.TaskRunner | Task 'cache_input[16]': Starting task run...
2021-07-19 16:52:13 [INFO] prefect.TaskRunner - Task 'cache_input[16]': Starting task run...
2021-07-19 16:52:13 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-2'
2021-07-19 16:52:13 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1959.nc'
2021-07-19 16:52:13 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1959.nc' to cache
2021-07-19 16:52:37 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-2'
2021-07-19 16:52:37 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-2: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1959.nc'
2021-07-19 16:52:37 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1959.nc' from cache
[2021-07-19 16:52:37+0200] INFO - prefect.TaskRunner | Task 'cache_input[16]': Finished task run for task with final state: 'Success'
2021-07-19 16:52:37 [INFO] prefect.TaskRunner - Task 'cache_input[16]': Finished task run for task with final state: 'Success'
[2021-07-19 16:52:37+0200] INFO - prefect.TaskRunner | Task 'cache_input[17]': Starting task run...
2021-07-19 16:52:37 [INFO] prefect.TaskRunner - Task 'cache_input[17]': Starting task run...
2021-07-19 16:52:37 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-3'
2021-07-19 16:52:37 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1959.nc'
2021-07-19 16:52:37 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1959.nc' to cache
2021-07-19 16:53:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-3'
2021-07-19 16:53:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-3: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1959.nc'
2021-07-19 16:53:02 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1959.nc' from cache
[2021-07-19 16:53:02+0200] INFO - prefect.TaskRunner | Task 'cache_input[17]': Finished task run for task with final state: 'Success'
2021-07-19 16:53:02 [INFO] prefect.TaskRunner - Task 'cache_input[17]': Finished task run for task with final state: 'Success'
[2021-07-19 16:53:02+0200] INFO - prefect.TaskRunner | Task 'cache_input[18]': Starting task run...
2021-07-19 16:53:02 [INFO] prefect.TaskRunner - Task 'cache_input[18]': Starting task run...
2021-07-19 16:53:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-4'
2021-07-19 16:53:02 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1959.nc'
2021-07-19 16:53:02 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1959.nc' to cache
2021-07-19 16:53:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-4'
2021-07-19 16:53:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-4: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1959.nc'
2021-07-19 16:53:14 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1959.nc' from cache
[2021-07-19 16:53:14+0200] INFO - prefect.TaskRunner | Task 'cache_input[18]': Finished task run for task with final state: 'Success'
2021-07-19 16:53:14 [INFO] prefect.TaskRunner - Task 'cache_input[18]': Finished task run for task with final state: 'Success'
[2021-07-19 16:53:14+0200] INFO - prefect.TaskRunner | Task 'cache_input[19]': Starting task run...
2021-07-19 16:53:14 [INFO] prefect.TaskRunner - Task 'cache_input[19]': Starting task run...
2021-07-19 16:53:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-5'
2021-07-19 16:53:14 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1959.nc'
2021-07-19 16:53:14 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1959.nc' to cache
2021-07-19 16:53:39 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-5'
2021-07-19 16:53:39 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-5: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1959.nc'
2021-07-19 16:53:39 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1959.nc' from cache
[2021-07-19 16:53:39+0200] INFO - prefect.TaskRunner | Task 'cache_input[19]': Finished task run for task with final state: 'Success'
2021-07-19 16:53:39 [INFO] prefect.TaskRunner - Task 'cache_input[19]': Finished task run for task with final state: 'Success'
[2021-07-19 16:53:39+0200] INFO - prefect.TaskRunner | Task 'cache_input[20]': Starting task run...
2021-07-19 16:53:39 [INFO] prefect.TaskRunner - Task 'cache_input[20]': Starting task run...
2021-07-19 16:53:39 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-6'
2021-07-19 16:53:39 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1959.nc'
2021-07-19 16:53:39 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1959.nc' to cache
2021-07-19 16:54:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-6'
2021-07-19 16:54:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-6: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1959.nc'
2021-07-19 16:54:12 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1959.nc' from cache
[2021-07-19 16:54:12+0200] INFO - prefect.TaskRunner | Task 'cache_input[20]': Finished task run for task with final state: 'Success'
2021-07-19 16:54:12 [INFO] prefect.TaskRunner - Task 'cache_input[20]': Finished task run for task with final state: 'Success'
[2021-07-19 16:54:12+0200] INFO - prefect.TaskRunner | Task 'cache_input[21]': Starting task run...
2021-07-19 16:54:12 [INFO] prefect.TaskRunner - Task 'cache_input[21]': Starting task run...
2021-07-19 16:54:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-7'
2021-07-19 16:54:12 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1959.nc'
2021-07-19 16:54:12 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1959.nc' to cache
2021-07-19 16:54:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-7'
2021-07-19 16:54:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-7: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1959.nc'
2021-07-19 16:54:36 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1959.nc' from cache
[2021-07-19 16:54:36+0200] INFO - prefect.TaskRunner | Task 'cache_input[21]': Finished task run for task with final state: 'Success'
2021-07-19 16:54:36 [INFO] prefect.TaskRunner - Task 'cache_input[21]': Finished task run for task with final state: 'Success'
[2021-07-19 16:54:36+0200] INFO - prefect.TaskRunner | Task 'cache_input[22]': Starting task run...
2021-07-19 16:54:36 [INFO] prefect.TaskRunner - Task 'cache_input[22]': Starting task run...
2021-07-19 16:54:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-8'
2021-07-19 16:54:36 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1959.nc'
2021-07-19 16:54:36 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1959.nc' to cache
2021-07-19 16:55:35 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-8'
2021-07-19 16:55:35 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-8: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1959.nc'
2021-07-19 16:55:35 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1959.nc' from cache
[2021-07-19 16:55:35+0200] INFO - prefect.TaskRunner | Task 'cache_input[22]': Finished task run for task with final state: 'Success'
2021-07-19 16:55:35 [INFO] prefect.TaskRunner - Task 'cache_input[22]': Finished task run for task with final state: 'Success'
[2021-07-19 16:55:35+0200] INFO - prefect.TaskRunner | Task 'cache_input[23]': Starting task run...
2021-07-19 16:55:35 [INFO] prefect.TaskRunner - Task 'cache_input[23]': Starting task run...
2021-07-19 16:55:35 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-9'
2021-07-19 16:55:35 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1959.nc'
2021-07-19 16:55:35 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1959.nc' to cache
2021-07-19 16:56:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-9'
2021-07-19 16:56:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-9: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1959.nc'
2021-07-19 16:56:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1959.nc' from cache
[2021-07-19 16:56:18+0200] INFO - prefect.TaskRunner | Task 'cache_input[23]': Finished task run for task with final state: 'Success'
2021-07-19 16:56:18 [INFO] prefect.TaskRunner - Task 'cache_input[23]': Finished task run for task with final state: 'Success'
[2021-07-19 16:56:18+0200] INFO - prefect.TaskRunner | Task 'cache_input[24]': Starting task run...
2021-07-19 16:56:18 [INFO] prefect.TaskRunner - Task 'cache_input[24]': Starting task run...
2021-07-19 16:56:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-10'
2021-07-19 16:56:18 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1959.nc'
2021-07-19 16:56:18 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1959.nc' to cache
2021-07-19 16:56:54 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-10'
2021-07-19 16:56:54 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-10: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1959.nc'
2021-07-19 16:56:54 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1959.nc' from cache
[2021-07-19 16:56:54+0200] INFO - prefect.TaskRunner | Task 'cache_input[24]': Finished task run for task with final state: 'Success'
2021-07-19 16:56:54 [INFO] prefect.TaskRunner - Task 'cache_input[24]': Finished task run for task with final state: 'Success'
[2021-07-19 16:56:54+0200] INFO - prefect.TaskRunner | Task 'cache_input[25]': Starting task run...
2021-07-19 16:56:54 [INFO] prefect.TaskRunner - Task 'cache_input[25]': Starting task run...
2021-07-19 16:56:54 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-11'
2021-07-19 16:56:54 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1959.nc'
2021-07-19 16:56:54 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1959.nc' to cache
2021-07-19 16:57:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-11'
2021-07-19 16:57:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-11: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1959.nc'
2021-07-19 16:57:32 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1959.nc' from cache
[2021-07-19 16:57:32+0200] INFO - prefect.TaskRunner | Task 'cache_input[25]': Finished task run for task with final state: 'Success'
2021-07-19 16:57:32 [INFO] prefect.TaskRunner - Task 'cache_input[25]': Finished task run for task with final state: 'Success'
[2021-07-19 16:57:32+0200] INFO - prefect.TaskRunner | Task 'cache_input[26]': Starting task run...
2021-07-19 16:57:32 [INFO] prefect.TaskRunner - Task 'cache_input[26]': Starting task run...
2021-07-19 16:57:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-12'
2021-07-19 16:57:32 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1959.nc'
2021-07-19 16:57:32 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1959.nc' to cache
2021-07-19 16:57:46 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-12'
2021-07-19 16:57:46 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-12: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1959.nc'
2021-07-19 16:57:46 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1959.nc' from cache
[2021-07-19 16:57:46+0200] INFO - prefect.TaskRunner | Task 'cache_input[26]': Finished task run for task with final state: 'Success'
2021-07-19 16:57:46 [INFO] prefect.TaskRunner - Task 'cache_input[26]': Finished task run for task with final state: 'Success'
[2021-07-19 16:57:46+0200] INFO - prefect.TaskRunner | Task 'cache_input[27]': Starting task run...
2021-07-19 16:57:46 [INFO] prefect.TaskRunner - Task 'cache_input[27]': Starting task run...
2021-07-19 16:57:46 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching input 'time-1,variable-13'
2021-07-19 16:57:46 [INFO] pangeo_forge_recipes.storage - Caching file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1959.nc'
2021-07-19 16:57:46 [INFO] pangeo_forge_recipes.storage - Coping remote file 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1959.nc' to cache
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-1,variable-13'
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-13: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1959.nc'
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1959.nc' from cache
[2021-07-19 16:58:17+0200] INFO - prefect.TaskRunner | Task 'cache_input[27]': Finished task run for task with final state: 'Success'
2021-07-19 16:58:17 [INFO] prefect.TaskRunner - Task 'cache_input[27]': Finished task run for task with final state: 'Success'
[2021-07-19 16:58:17+0200] INFO - prefect.TaskRunner | Task 'prepare_target': Starting task run...
2021-07-19 16:58:17 [INFO] prefect.TaskRunner - Task 'prepare_target': Starting task run...
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Creating a new dataset in target
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-0
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-0: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1958.nc'
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1958.nc' from cache
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-0'
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-1
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-1: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1958.nc'
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1958.nc' from cache
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-1'
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-2
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-2: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1958.nc'
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1958.nc' from cache
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-2'
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-3
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-3: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1958.nc'
2021-07-19 16:58:17 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-3'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-4
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-4: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1958.nc'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-4'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-5
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-5: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1958.nc'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-5'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-6
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-6: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1958.nc'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-6'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-7
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-7: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1958.nc'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-7'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-8
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-8: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1958.nc'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-8'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-9
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-9: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1958.nc'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-9'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-10
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-10: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1958.nc'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-10'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-11
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-11: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1958.nc'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-11'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-12
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-12: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1958.nc'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-12'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-13
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-13: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1958.nc'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1958.nc' from cache
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-13'
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpbo124muo
2021-07-19 16:58:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Expanding target concat dim 'time' to size 24
[2021-07-19 16:58:18+0200] INFO - prefect.TaskRunner | Task 'prepare_target': Finished task run for task with final state: 'Success'
2021-07-19 16:58:18 [INFO] prefect.TaskRunner - Task 'prepare_target': Finished task run for task with final state: 'Success'
[2021-07-19 16:58:19+0200] INFO - prefect.TaskRunner | Task 'store_chunk': Starting task run...
2021-07-19 16:58:19 [INFO] prefect.TaskRunner - Task 'store_chunk': Starting task run...
[2021-07-19 16:58:19+0200] INFO - prefect.TaskRunner | Task 'store_chunk': Finished task run for task with final state: 'Mapped'
2021-07-19 16:58:19 [INFO] prefect.TaskRunner - Task 'store_chunk': Finished task run for task with final state: 'Mapped'
[2021-07-19 16:58:19+0200] INFO - prefect.TaskRunner | Task 'store_chunk[0]': Starting task run...
2021-07-19 16:58:19 [INFO] prefect.TaskRunner - Task 'store_chunk[0]': Starting task run...
2021-07-19 16:58:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-0
2021-07-19 16:58:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-0: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1958.nc'
2021-07-19 16:58:19 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1958.nc' from cache
2021-07-19 16:58:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-0'
2021-07-19 16:58:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-0 to Zarr region (slice(0, 12, None),)
2021-07-19 16:58:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable aet chunk time-0,variable-0 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 16:58:27+0200] INFO - prefect.TaskRunner | Task 'store_chunk[0]': Finished task run for task with final state: 'Success'
2021-07-19 16:58:27 [INFO] prefect.TaskRunner - Task 'store_chunk[0]': Finished task run for task with final state: 'Success'
[2021-07-19 16:58:27+0200] INFO - prefect.TaskRunner | Task 'store_chunk[1]': Starting task run...
2021-07-19 16:58:27 [INFO] prefect.TaskRunner - Task 'store_chunk[1]': Starting task run...
2021-07-19 16:58:27 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-1
2021-07-19 16:58:27 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-1: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1958.nc'
2021-07-19 16:58:27 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1958.nc' from cache
2021-07-19 16:58:27 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-1'
2021-07-19 16:58:27 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-1 to Zarr region (slice(0, 12, None),)
2021-07-19 16:58:35 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable def chunk time-0,variable-1 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 16:58:36+0200] INFO - prefect.TaskRunner | Task 'store_chunk[1]': Finished task run for task with final state: 'Success'
2021-07-19 16:58:36 [INFO] prefect.TaskRunner - Task 'store_chunk[1]': Finished task run for task with final state: 'Success'
[2021-07-19 16:58:36+0200] INFO - prefect.TaskRunner | Task 'store_chunk[2]': Starting task run...
2021-07-19 16:58:36 [INFO] prefect.TaskRunner - Task 'store_chunk[2]': Starting task run...
2021-07-19 16:58:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-2
2021-07-19 16:58:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-2: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1958.nc'
2021-07-19 16:58:36 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1958.nc' from cache
2021-07-19 16:58:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-2'
2021-07-19 16:58:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-2 to Zarr region (slice(0, 12, None),)
2021-07-19 16:58:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable pet chunk time-0,variable-2 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 16:58:45+0200] INFO - prefect.TaskRunner | Task 'store_chunk[2]': Finished task run for task with final state: 'Success'
2021-07-19 16:58:45 [INFO] prefect.TaskRunner - Task 'store_chunk[2]': Finished task run for task with final state: 'Success'
[2021-07-19 16:58:45+0200] INFO - prefect.TaskRunner | Task 'store_chunk[3]': Starting task run...
2021-07-19 16:58:45 [INFO] prefect.TaskRunner - Task 'store_chunk[3]': Starting task run...
2021-07-19 16:58:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-3
2021-07-19 16:58:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-3: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1958.nc'
2021-07-19 16:58:45 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1958.nc' from cache
2021-07-19 16:58:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-3'
2021-07-19 16:58:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-3 to Zarr region (slice(0, 12, None),)
2021-07-19 16:58:59 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable ppt chunk time-0,variable-3 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 16:59:01+0200] INFO - prefect.TaskRunner | Task 'store_chunk[3]': Finished task run for task with final state: 'Success'
2021-07-19 16:59:01 [INFO] prefect.TaskRunner - Task 'store_chunk[3]': Finished task run for task with final state: 'Success'
[2021-07-19 16:59:01+0200] INFO - prefect.TaskRunner | Task 'store_chunk[4]': Starting task run...
2021-07-19 16:59:01 [INFO] prefect.TaskRunner - Task 'store_chunk[4]': Starting task run...
2021-07-19 16:59:01 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-4
2021-07-19 16:59:01 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-4: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1958.nc'
2021-07-19 16:59:01 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1958.nc' from cache
2021-07-19 16:59:01 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-4'
2021-07-19 16:59:01 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-4 to Zarr region (slice(0, 12, None),)
2021-07-19 16:59:15 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable q chunk time-0,variable-4 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 16:59:17+0200] INFO - prefect.TaskRunner | Task 'store_chunk[4]': Finished task run for task with final state: 'Success'
2021-07-19 16:59:17 [INFO] prefect.TaskRunner - Task 'store_chunk[4]': Finished task run for task with final state: 'Success'
[2021-07-19 16:59:17+0200] INFO - prefect.TaskRunner | Task 'store_chunk[5]': Starting task run...
2021-07-19 16:59:17 [INFO] prefect.TaskRunner - Task 'store_chunk[5]': Starting task run...
2021-07-19 16:59:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-5
2021-07-19 16:59:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-5: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1958.nc'
2021-07-19 16:59:17 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1958.nc' from cache
2021-07-19 16:59:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-5'
2021-07-19 16:59:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-5 to Zarr region (slice(0, 12, None),)
2021-07-19 16:59:25 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable soil chunk time-0,variable-5 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 16:59:26+0200] INFO - prefect.TaskRunner | Task 'store_chunk[5]': Finished task run for task with final state: 'Success'
2021-07-19 16:59:26 [INFO] prefect.TaskRunner - Task 'store_chunk[5]': Finished task run for task with final state: 'Success'
[2021-07-19 16:59:26+0200] INFO - prefect.TaskRunner | Task 'store_chunk[6]': Starting task run...
2021-07-19 16:59:26 [INFO] prefect.TaskRunner - Task 'store_chunk[6]': Starting task run...
2021-07-19 16:59:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-6
2021-07-19 16:59:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-6: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1958.nc'
2021-07-19 16:59:26 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1958.nc' from cache
2021-07-19 16:59:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-6'
2021-07-19 16:59:27 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-6 to Zarr region (slice(0, 12, None),)
2021-07-19 16:59:35 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable srad chunk time-0,variable-6 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 16:59:36+0200] INFO - prefect.TaskRunner | Task 'store_chunk[6]': Finished task run for task with final state: 'Success'
2021-07-19 16:59:36 [INFO] prefect.TaskRunner - Task 'store_chunk[6]': Finished task run for task with final state: 'Success'
[2021-07-19 16:59:36+0200] INFO - prefect.TaskRunner | Task 'store_chunk[7]': Starting task run...
2021-07-19 16:59:36 [INFO] prefect.TaskRunner - Task 'store_chunk[7]': Starting task run...
2021-07-19 16:59:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-7
2021-07-19 16:59:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-7: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1958.nc'
2021-07-19 16:59:36 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1958.nc' from cache
2021-07-19 16:59:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-7'
2021-07-19 16:59:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-7 to Zarr region (slice(0, 12, None),)
2021-07-19 16:59:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable swe chunk time-0,variable-7 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 16:59:53+0200] INFO - prefect.TaskRunner | Task 'store_chunk[7]': Finished task run for task with final state: 'Success'
2021-07-19 16:59:53 [INFO] prefect.TaskRunner - Task 'store_chunk[7]': Finished task run for task with final state: 'Success'
[2021-07-19 16:59:53+0200] INFO - prefect.TaskRunner | Task 'store_chunk[8]': Starting task run...
2021-07-19 16:59:53 [INFO] prefect.TaskRunner - Task 'store_chunk[8]': Starting task run...
2021-07-19 16:59:53 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-8
2021-07-19 16:59:53 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-8: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1958.nc'
2021-07-19 16:59:53 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1958.nc' from cache
2021-07-19 16:59:53 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-8'
2021-07-19 16:59:53 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-8 to Zarr region (slice(0, 12, None),)
2021-07-19 17:00:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable tmax chunk time-0,variable-8 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:00:03+0200] INFO - prefect.TaskRunner | Task 'store_chunk[8]': Finished task run for task with final state: 'Success'
2021-07-19 17:00:03 [INFO] prefect.TaskRunner - Task 'store_chunk[8]': Finished task run for task with final state: 'Success'
[2021-07-19 17:00:03+0200] INFO - prefect.TaskRunner | Task 'store_chunk[9]': Starting task run...
2021-07-19 17:00:03 [INFO] prefect.TaskRunner - Task 'store_chunk[9]': Starting task run...
2021-07-19 17:00:03 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-9
2021-07-19 17:00:03 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-9: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1958.nc'
2021-07-19 17:00:03 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1958.nc' from cache
2021-07-19 17:00:03 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-9'
2021-07-19 17:00:03 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-9 to Zarr region (slice(0, 12, None),)
2021-07-19 17:00:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable tmin chunk time-0,variable-9 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:00:13+0200] INFO - prefect.TaskRunner | Task 'store_chunk[9]': Finished task run for task with final state: 'Success'
2021-07-19 17:00:13 [INFO] prefect.TaskRunner - Task 'store_chunk[9]': Finished task run for task with final state: 'Success'
[2021-07-19 17:00:14+0200] INFO - prefect.TaskRunner | Task 'store_chunk[10]': Starting task run...
2021-07-19 17:00:14 [INFO] prefect.TaskRunner - Task 'store_chunk[10]': Starting task run...
2021-07-19 17:00:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-10
2021-07-19 17:00:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-10: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1958.nc'
2021-07-19 17:00:14 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1958.nc' from cache
2021-07-19 17:00:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-10'
2021-07-19 17:00:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-10 to Zarr region (slice(0, 12, None),)
2021-07-19 17:00:22 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable vap chunk time-0,variable-10 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:00:23+0200] INFO - prefect.TaskRunner | Task 'store_chunk[10]': Finished task run for task with final state: 'Success'
2021-07-19 17:00:23 [INFO] prefect.TaskRunner - Task 'store_chunk[10]': Finished task run for task with final state: 'Success'
[2021-07-19 17:00:23+0200] INFO - prefect.TaskRunner | Task 'store_chunk[11]': Starting task run...
2021-07-19 17:00:23 [INFO] prefect.TaskRunner - Task 'store_chunk[11]': Starting task run...
2021-07-19 17:00:23 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-11
2021-07-19 17:00:23 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-11: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1958.nc'
2021-07-19 17:00:23 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1958.nc' from cache
2021-07-19 17:00:23 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-11'
2021-07-19 17:00:23 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-11 to Zarr region (slice(0, 12, None),)
2021-07-19 17:00:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable ws chunk time-0,variable-11 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:00:33+0200] INFO - prefect.TaskRunner | Task 'store_chunk[11]': Finished task run for task with final state: 'Success'
2021-07-19 17:00:33 [INFO] prefect.TaskRunner - Task 'store_chunk[11]': Finished task run for task with final state: 'Success'
[2021-07-19 17:00:33+0200] INFO - prefect.TaskRunner | Task 'store_chunk[12]': Starting task run...
2021-07-19 17:00:33 [INFO] prefect.TaskRunner - Task 'store_chunk[12]': Starting task run...
2021-07-19 17:00:33 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-12
2021-07-19 17:00:33 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-12: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1958.nc'
2021-07-19 17:00:33 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1958.nc' from cache
2021-07-19 17:00:33 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-12'
2021-07-19 17:00:33 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-12 to Zarr region (slice(0, 12, None),)
2021-07-19 17:00:41 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable vpd chunk time-0,variable-12 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:00:42+0200] INFO - prefect.TaskRunner | Task 'store_chunk[12]': Finished task run for task with final state: 'Success'
2021-07-19 17:00:42 [INFO] prefect.TaskRunner - Task 'store_chunk[12]': Finished task run for task with final state: 'Success'
[2021-07-19 17:00:42+0200] INFO - prefect.TaskRunner | Task 'store_chunk[13]': Starting task run...
2021-07-19 17:00:42 [INFO] prefect.TaskRunner - Task 'store_chunk[13]': Starting task run...
2021-07-19 17:00:42 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,variable-13
2021-07-19 17:00:42 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0,variable-13: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1958.nc'
2021-07-19 17:00:42 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1958.nc' from cache
2021-07-19 17:00:42 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,variable-13'
2021-07-19 17:00:42 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,variable-13 to Zarr region (slice(0, 12, None),)
2021-07-19 17:00:50 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable pdsi chunk time-0,variable-13 to Zarr region (slice(0, 12, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:00:52+0200] INFO - prefect.TaskRunner | Task 'store_chunk[13]': Finished task run for task with final state: 'Success'
2021-07-19 17:00:52 [INFO] prefect.TaskRunner - Task 'store_chunk[13]': Finished task run for task with final state: 'Success'
[2021-07-19 17:00:52+0200] INFO - prefect.TaskRunner | Task 'store_chunk[14]': Starting task run...
2021-07-19 17:00:52 [INFO] prefect.TaskRunner - Task 'store_chunk[14]': Starting task run...
2021-07-19 17:00:52 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-0
2021-07-19 17:00:52 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-0: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1959.nc'
2021-07-19 17:00:52 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_aet_1959.nc' from cache
2021-07-19 17:00:52 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-0'
2021-07-19 17:00:52 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-0 to Zarr region (slice(12, 24, None),)
2021-07-19 17:01:00 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable aet chunk time-1,variable-0 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:01:01+0200] INFO - prefect.TaskRunner | Task 'store_chunk[14]': Finished task run for task with final state: 'Success'
2021-07-19 17:01:01 [INFO] prefect.TaskRunner - Task 'store_chunk[14]': Finished task run for task with final state: 'Success'
[2021-07-19 17:01:01+0200] INFO - prefect.TaskRunner | Task 'store_chunk[15]': Starting task run...
2021-07-19 17:01:01 [INFO] prefect.TaskRunner - Task 'store_chunk[15]': Starting task run...
2021-07-19 17:01:01 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-1
2021-07-19 17:01:01 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-1: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1959.nc'
2021-07-19 17:01:01 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_def_1959.nc' from cache
2021-07-19 17:01:01 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-1'
2021-07-19 17:01:01 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-1 to Zarr region (slice(12, 24, None),)
2021-07-19 17:01:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable def chunk time-1,variable-1 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:01:10+0200] INFO - prefect.TaskRunner | Task 'store_chunk[15]': Finished task run for task with final state: 'Success'
2021-07-19 17:01:10 [INFO] prefect.TaskRunner - Task 'store_chunk[15]': Finished task run for task with final state: 'Success'
[2021-07-19 17:01:10+0200] INFO - prefect.TaskRunner | Task 'store_chunk[16]': Starting task run...
2021-07-19 17:01:10 [INFO] prefect.TaskRunner - Task 'store_chunk[16]': Starting task run...
2021-07-19 17:01:10 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-2
2021-07-19 17:01:10 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-2: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1959.nc'
2021-07-19 17:01:10 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_pet_1959.nc' from cache
2021-07-19 17:01:10 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-2'
2021-07-19 17:01:10 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-2 to Zarr region (slice(12, 24, None),)
2021-07-19 17:01:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable pet chunk time-1,variable-2 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:01:19+0200] INFO - prefect.TaskRunner | Task 'store_chunk[16]': Finished task run for task with final state: 'Success'
2021-07-19 17:01:19 [INFO] prefect.TaskRunner - Task 'store_chunk[16]': Finished task run for task with final state: 'Success'
[2021-07-19 17:01:19+0200] INFO - prefect.TaskRunner | Task 'store_chunk[17]': Starting task run...
2021-07-19 17:01:19 [INFO] prefect.TaskRunner - Task 'store_chunk[17]': Starting task run...
2021-07-19 17:01:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-3
2021-07-19 17:01:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-3: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1959.nc'
2021-07-19 17:01:19 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ppt_1959.nc' from cache
2021-07-19 17:01:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-3'
2021-07-19 17:01:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-3 to Zarr region (slice(12, 24, None),)
2021-07-19 17:01:34 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable ppt chunk time-1,variable-3 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:01:36+0200] INFO - prefect.TaskRunner | Task 'store_chunk[17]': Finished task run for task with final state: 'Success'
2021-07-19 17:01:36 [INFO] prefect.TaskRunner - Task 'store_chunk[17]': Finished task run for task with final state: 'Success'
[2021-07-19 17:01:36+0200] INFO - prefect.TaskRunner | Task 'store_chunk[18]': Starting task run...
2021-07-19 17:01:36 [INFO] prefect.TaskRunner - Task 'store_chunk[18]': Starting task run...
2021-07-19 17:01:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-4
2021-07-19 17:01:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-4: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1959.nc'
2021-07-19 17:01:36 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_q_1959.nc' from cache
2021-07-19 17:01:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-4'
2021-07-19 17:01:36 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-4 to Zarr region (slice(12, 24, None),)
2021-07-19 17:01:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable q chunk time-1,variable-4 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:01:53+0200] INFO - prefect.TaskRunner | Task 'store_chunk[18]': Finished task run for task with final state: 'Success'
2021-07-19 17:01:53 [INFO] prefect.TaskRunner - Task 'store_chunk[18]': Finished task run for task with final state: 'Success'
[2021-07-19 17:01:53+0200] INFO - prefect.TaskRunner | Task 'store_chunk[19]': Starting task run...
2021-07-19 17:01:53 [INFO] prefect.TaskRunner - Task 'store_chunk[19]': Starting task run...
2021-07-19 17:01:53 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-5
2021-07-19 17:01:53 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-5: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1959.nc'
2021-07-19 17:01:53 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_soil_1959.nc' from cache
2021-07-19 17:01:53 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-5'
2021-07-19 17:01:53 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-5 to Zarr region (slice(12, 24, None),)
2021-07-19 17:02:01 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable soil chunk time-1,variable-5 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:02:02+0200] INFO - prefect.TaskRunner | Task 'store_chunk[19]': Finished task run for task with final state: 'Success'
2021-07-19 17:02:02 [INFO] prefect.TaskRunner - Task 'store_chunk[19]': Finished task run for task with final state: 'Success'
[2021-07-19 17:02:02+0200] INFO - prefect.TaskRunner | Task 'store_chunk[20]': Starting task run...
2021-07-19 17:02:02 [INFO] prefect.TaskRunner - Task 'store_chunk[20]': Starting task run...
2021-07-19 17:02:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-6
2021-07-19 17:02:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-6: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1959.nc'
2021-07-19 17:02:02 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_srad_1959.nc' from cache
2021-07-19 17:02:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-6'
2021-07-19 17:02:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-6 to Zarr region (slice(12, 24, None),)
2021-07-19 17:02:11 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable srad chunk time-1,variable-6 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:02:12+0200] INFO - prefect.TaskRunner | Task 'store_chunk[20]': Finished task run for task with final state: 'Success'
2021-07-19 17:02:12 [INFO] prefect.TaskRunner - Task 'store_chunk[20]': Finished task run for task with final state: 'Success'
[2021-07-19 17:02:12+0200] INFO - prefect.TaskRunner | Task 'store_chunk[21]': Starting task run...
2021-07-19 17:02:12 [INFO] prefect.TaskRunner - Task 'store_chunk[21]': Starting task run...
2021-07-19 17:02:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-7
2021-07-19 17:02:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-7: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1959.nc'
2021-07-19 17:02:12 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_swe_1959.nc' from cache
2021-07-19 17:02:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-7'
2021-07-19 17:02:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-7 to Zarr region (slice(12, 24, None),)
2021-07-19 17:02:27 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable swe chunk time-1,variable-7 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:02:29+0200] INFO - prefect.TaskRunner | Task 'store_chunk[21]': Finished task run for task with final state: 'Success'
2021-07-19 17:02:29 [INFO] prefect.TaskRunner - Task 'store_chunk[21]': Finished task run for task with final state: 'Success'
[2021-07-19 17:02:29+0200] INFO - prefect.TaskRunner | Task 'store_chunk[22]': Starting task run...
2021-07-19 17:02:29 [INFO] prefect.TaskRunner - Task 'store_chunk[22]': Starting task run...
2021-07-19 17:02:29 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-8
2021-07-19 17:02:29 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-8: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1959.nc'
2021-07-19 17:02:29 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmax_1959.nc' from cache
2021-07-19 17:02:29 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-8'
2021-07-19 17:02:29 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-8 to Zarr region (slice(12, 24, None),)
2021-07-19 17:02:38 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable tmax chunk time-1,variable-8 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:02:39+0200] INFO - prefect.TaskRunner | Task 'store_chunk[22]': Finished task run for task with final state: 'Success'
2021-07-19 17:02:39 [INFO] prefect.TaskRunner - Task 'store_chunk[22]': Finished task run for task with final state: 'Success'
[2021-07-19 17:02:39+0200] INFO - prefect.TaskRunner | Task 'store_chunk[23]': Starting task run...
2021-07-19 17:02:39 [INFO] prefect.TaskRunner - Task 'store_chunk[23]': Starting task run...
2021-07-19 17:02:39 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-9
2021-07-19 17:02:39 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-9: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1959.nc'
2021-07-19 17:02:39 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_tmin_1959.nc' from cache
2021-07-19 17:02:39 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-9'
2021-07-19 17:02:39 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-9 to Zarr region (slice(12, 24, None),)
2021-07-19 17:02:48 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable tmin chunk time-1,variable-9 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:02:49+0200] INFO - prefect.TaskRunner | Task 'store_chunk[23]': Finished task run for task with final state: 'Success'
2021-07-19 17:02:49 [INFO] prefect.TaskRunner - Task 'store_chunk[23]': Finished task run for task with final state: 'Success'
[2021-07-19 17:02:49+0200] INFO - prefect.TaskRunner | Task 'store_chunk[24]': Starting task run...
2021-07-19 17:02:49 [INFO] prefect.TaskRunner - Task 'store_chunk[24]': Starting task run...
2021-07-19 17:02:49 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-10
2021-07-19 17:02:49 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-10: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1959.nc'
2021-07-19 17:02:49 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vap_1959.nc' from cache
2021-07-19 17:02:49 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-10'
2021-07-19 17:02:49 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-10 to Zarr region (slice(12, 24, None),)
2021-07-19 17:02:57 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable vap chunk time-1,variable-10 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:02:58+0200] INFO - prefect.TaskRunner | Task 'store_chunk[24]': Finished task run for task with final state: 'Success'
2021-07-19 17:02:58 [INFO] prefect.TaskRunner - Task 'store_chunk[24]': Finished task run for task with final state: 'Success'
[2021-07-19 17:02:58+0200] INFO - prefect.TaskRunner | Task 'store_chunk[25]': Starting task run...
2021-07-19 17:02:58 [INFO] prefect.TaskRunner - Task 'store_chunk[25]': Starting task run...
2021-07-19 17:02:58 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-11
2021-07-19 17:02:58 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-11: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1959.nc'
2021-07-19 17:02:58 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_ws_1959.nc' from cache
2021-07-19 17:02:58 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-11'
2021-07-19 17:02:58 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-11 to Zarr region (slice(12, 24, None),)
2021-07-19 17:03:06 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable ws chunk time-1,variable-11 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:03:07+0200] INFO - prefect.TaskRunner | Task 'store_chunk[25]': Finished task run for task with final state: 'Success'
2021-07-19 17:03:07 [INFO] prefect.TaskRunner - Task 'store_chunk[25]': Finished task run for task with final state: 'Success'
[2021-07-19 17:03:07+0200] INFO - prefect.TaskRunner | Task 'store_chunk[26]': Starting task run...
2021-07-19 17:03:07 [INFO] prefect.TaskRunner - Task 'store_chunk[26]': Starting task run...
2021-07-19 17:03:07 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-12
2021-07-19 17:03:07 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-12: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1959.nc'
2021-07-19 17:03:07 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_vpd_1959.nc' from cache
2021-07-19 17:03:07 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-12'
2021-07-19 17:03:07 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-12 to Zarr region (slice(12, 24, None),)
2021-07-19 17:03:15 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable vpd chunk time-1,variable-12 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:03:16+0200] INFO - prefect.TaskRunner | Task 'store_chunk[26]': Finished task run for task with final state: 'Success'
2021-07-19 17:03:16 [INFO] prefect.TaskRunner - Task 'store_chunk[26]': Finished task run for task with final state: 'Success'
[2021-07-19 17:03:16+0200] INFO - prefect.TaskRunner | Task 'store_chunk[27]': Starting task run...
2021-07-19 17:03:16 [INFO] prefect.TaskRunner - Task 'store_chunk[27]': Starting task run...
2021-07-19 17:03:16 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-1,variable-13
2021-07-19 17:03:16 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-1,variable-13: 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1959.nc'
2021-07-19 17:03:16 [INFO] pangeo_forge_recipes.storage - Opening 'http://thredds.northwestknowledge.net:8080/thredds/fileServer/TERRACLIMATE_ALL/data/TerraClimate_PDSI_1959.nc' from cache
2021-07-19 17:03:16 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-1,variable-13'
2021-07-19 17:03:16 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-1,variable-13 to Zarr region (slice(12, 24, None),)
2021-07-19 17:03:24 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable pdsi chunk time-1,variable-13 to Zarr region (slice(12, 24, None), slice(None, None, None), slice(None, None, None))
[2021-07-19 17:03:25+0200] INFO - prefect.TaskRunner | Task 'store_chunk[27]': Finished task run for task with final state: 'Success'
2021-07-19 17:03:25 [INFO] prefect.TaskRunner - Task 'store_chunk[27]': Finished task run for task with final state: 'Success'
[2021-07-19 17:03:25+0200] INFO - prefect.TaskRunner | Task 'finalize_target': Starting task run...
2021-07-19 17:03:25 [INFO] prefect.TaskRunner - Task 'finalize_target': Starting task run...
2021-07-19 17:03:25 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Consolidating Zarr metadata
[2021-07-19 17:03:25+0200] INFO - prefect.TaskRunner | Task 'finalize_target': Finished task run for task with final state: 'Success'
2021-07-19 17:03:25 [INFO] prefect.TaskRunner - Task 'finalize_target': Finished task run for task with final state: 'Success'
[2021-07-19 17:03:25+0200] INFO - prefect.FlowRunner | Flow run SUCCESS: all reference tasks succeeded
2021-07-19 17:03:25 [INFO] prefect.FlowRunner - Flow run SUCCESS: all reference tasks succeeded
<Success: "All reference tasks succeeded.">

Check and Plot Target

ds_target = xr.open_zarr(target.get_mapper(), consolidated=True)
ds_target
<xarray.Dataset>
Dimensions:  (crs: 1, lat: 4320, lon: 8640, time: 24)
Coordinates:
  * crs      (crs) int16 3
  * lat      (lat) float64 89.98 89.94 89.9 89.85 ... -89.85 -89.9 -89.94 -89.98
  * lon      (lon) float64 -180.0 -179.9 -179.9 -179.9 ... 179.9 179.9 180.0
  * time     (time) datetime64[ns] 1958-01-01 1958-02-01 ... 1959-12-01
Data variables: (12/14)
    aet      (time, lat, lon) float32 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    def      (time, lat, lon) float32 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    pdsi     (time, lat, lon) float32 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    pet      (time, lat, lon) float32 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    ppt      (time, lat, lon) float64 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    q        (time, lat, lon) float64 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    ...       ...
    swe      (time, lat, lon) float64 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    tmax     (time, lat, lon) float32 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    tmin     (time, lat, lon) float32 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    vap      (time, lat, lon) float32 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    vpd      (time, lat, lon) float32 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
    ws       (time, lat, lon) float32 dask.array<chunksize=(12, 1024, 1024), meta=np.ndarray>
Attributes: (12/49)
    Conventions:                     CF-1.6
    acknowledgment:                  Please cite the references included here...
    cdm_data_type:                   GRID
    contributor_email:               khegewisch@ucmerced.edu
    contributor_name:                Katherine Hegewisch
    contributor_role:                Postdoctoral Fellow
    ...                              ...
    time_coverage_duration:          P1Y
    time_coverage_end:               1958-12-01T00:0
    time_coverage_resolution:        P1M
    time_coverage_start:             1958-01-01T00:0
    title:                           TerraClimate: monthly climate and climat...
    version:                         v1.0

As an example calculation, we compute and plot the seasonal climatology of soil moisture.

with xr.set_options(keep_attrs=True):
    soil_clim = ds_target.soil.groupby('time.season').mean('time').coarsen(lon=12, lat=12).mean()
soil_clim
<xarray.DataArray 'soil' (season: 4, lat: 360, lon: 720)>
dask.array<mean_agg-aggregate, shape=(4, 360, 720), dtype=float32, chunksize=(1, 86, 86), chunktype=numpy.ndarray>
Coordinates:
  * lat      (lat) float64 89.75 89.25 88.75 88.25 ... -88.75 -89.25 -89.75
  * lon      (lon) float64 -179.8 -179.2 -178.8 -178.2 ... 178.8 179.2 179.8
  * season   (season) object 'DJF' 'JJA' 'MAM' 'SON'
Attributes:
    coordinate_system:  WGS84,EPSG:4326
    description:        Soil Moisture at End of Month
    dimensions:         lon lat time
    grid_mapping:       crs
    long_name:          soil_moisture_content
    standard_name:      soil_moisture_content
    units:              mm
soil_clim.plot(col='season', col_wrap=2, robust=True, figsize=(18, 8))
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/dask/array/numpy_compat.py:40: RuntimeWarning: invalid value encountered in true_divide
  x = np.divide(x1, x2, out)
<xarray.plot.facetgrid.FacetGrid at 0x7fc028fca340>
../../_images/terraclimate_19_2.png