NARR: Subsetting and OPeNDAP

About the Dataset

This tutorial uses data from NOAA’s North American Regional Reanalysis (NARR)

The North American Regional Reanalysis (NARR) is a model produced by the National Centers for Environmental Prediction (NCEP) that generates reanalyzed data for temperature, wind, moisture, soil, and dozens of other parameters. The NARR model assimilates a large amount of observational data from a variety of sources to produce a long-term picture of weather over North America.

For this recipe, we will access the data via OPeNDAP, a widely-used API for remote access of environmental data over HTTP. A key point is that, since we use using OPeNDAP, there are no input files to download / cache. We open the data directly from the remote server.

The data we will use are catalogged here (3D data on pressure levels): https://psl.noaa.gov/thredds/catalog/Datasets/NARR/pressure/catalog.html

Let’s peek at one file. Xarray should automatically do the right thing with the OPeNDAP url. But just to be safe, we can pass the option, engine='netcdf4', which is needed to open OPeNDAP links correctly. (We will need this again later when writing our recipe.)

import xarray as xr
url = "https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc"
ds = xr.open_dataset(url, engine='netcdf4')
ds
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
<xarray.Dataset>
Dimensions:            (level: 29, time: 248, x: 349, y: 277)
Coordinates:
  * time               (time) datetime64[ns] 1979-01-01 ... 1979-01-31T21:00:00
  * level              (level) float32 1e+03 975.0 950.0 ... 150.0 125.0 100.0
  * y                  (y) float32 0.0 3.246e+04 ... 8.927e+06 8.96e+06
  * x                  (x) float32 0.0 3.246e+04 ... 1.126e+07 1.13e+07
    lat                (y, x) float32 1.0 1.104 1.208 ... 46.93 46.64 46.35
    lon                (y, x) float32 -145.5 -145.3 -145.1 ... -2.644 -2.57
Data variables:
    Lambert_Conformal  int32 -2147483647
    air                (time, level, y, x) float32 ...
Attributes: (12/17)
    Conventions:                     CF-1.2
    centerlat:                       50.0
    centerlon:                       -107.0
    comments:                        
    institution:                     National Centers for Environmental Predi...
    latcorners:                      [ 1.000001  0.897945 46.3544   46.63433 ]
    ...                              ...
    history:                         created Fri Jan  8 02:35:07 MST 2016 by ...
    dataset_title:                   NCEP North American Regional Reanalysis ...
    references:                      https://www.esrl.noaa.gov/psd/data/gridd...
    source:                          http://www.emc.ncep.noaa.gov/mmb/rreanl/...
    References:                      
    DODS_EXTRA.Unlimited_Dimension:  time

This is just one file. But it’s a very big file (several GB)! We will want to use the subsetting capability of XarrayZarrRecipe. To figure out how to subset, let’s examine the _ChunkSizes attribute. This attribute part of the NetCDF4 files that the OPeNDAP server is serving. We want to make sure our subsetting is compatible with the internal chunking of the files.

ds.air._ChunkSizes
array([  1,   1, 277, 349], dtype=int32)

This tells us that we can subset in the time or level dimensions, but problably should avoid subsetting in the x and y dimensions.

Define File Pattern

We are now ready to define the FilePattern for the recipe. There is one file per month. So we start with a function like this:

def format_function(time):
    return f"https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.{time}.nc"

To keep things short and simple for this tutorial, we will just use one file, and subset it into many chunks. But we could easily add more months to build up the entire dataset. Since each file is monthly, and the number of days per months varies, we cannot set nitems_per_input in the ConcatDim.

from pangeo_forge_recipes.patterns import FilePattern, ConcatDim, MergeDim
time_dim = ConcatDim("time", ["197901"])
pattern = FilePattern(format_function, time_dim)
pattern
<FilePattern {'time': 1}>

Define the Recipe

This tutorial introduces a new option we have not seen before: subset_inpus={"time": 30}. This tells the XarrayZarrRecipe to break each input file into 30 distinct chunks along the time dimension.

Some other points to consider when defining this recipe.

  • Since the inputs are OPeNDAP, we want to use is_opendap=True.

  • Since we have not specified nitems_per_input in the FilePattern, we need to explicitly set the target chunks.

from pangeo_forge_recipes.recipes import XarrayZarrRecipe
recipe = XarrayZarrRecipe(
    pattern, 
    is_opendap=True
    subset_inputs={"time": 30},
    target_chunks={"time": 1},
)
recipe
XarrayZarrRecipe(file_pattern=<FilePattern {'time': 1}>, inputs_per_chunk=1, target_chunks={'time': 1}, target=None, input_cache=None, metadata_cache=None, cache_inputs=False, copy_input_to_local_file=False, consolidate_zarr=True, xarray_open_kwargs={'engine': 'netcdf4'}, xarray_concat_kwargs={}, delete_input_encoding=True, process_input=None, process_chunk=None, lock_timeout=None, subset_inputs={'time': 30}, is_opendap=True)

Assign Targets

Since we cannot cache the OPeNDAP inputs, we don’t need an input cache target.

import tempfile
from fsspec.implementations.local import LocalFileSystem
from pangeo_forge_recipes.storage import FSSpecTarget, CacheFSSpecTarget, MetadataTarget

fs_local = LocalFileSystem()

target_dir = tempfile.TemporaryDirectory()
target = FSSpecTarget(fs_local, target_dir.name)

meta_dir = tempfile.TemporaryDirectory()
meta_store = MetadataTarget(fs_local, meta_dir.name)

recipe.target = target
recipe.metadata_cache = meta_store
recipe
XarrayZarrRecipe(file_pattern=<FilePattern {'time': 1}>, inputs_per_chunk=1, target_chunks={'time': 1}, target=FSSpecTarget(fs=<fsspec.implementations.local.LocalFileSystem object at 0x7f9470d26e80>, root_path='/var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpt58fl_jv'), input_cache=None, metadata_cache=MetadataTarget(fs=<fsspec.implementations.local.LocalFileSystem object at 0x7f9470d26e80>, root_path='/var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpb9_y3bnl'), cache_inputs=False, copy_input_to_local_file=False, consolidate_zarr=True, xarray_open_kwargs={'engine': 'netcdf4'}, xarray_concat_kwargs={}, delete_input_encoding=True, process_input=None, process_chunk=None, lock_timeout=None, subset_inputs={'time': 30}, is_opendap=True)

Run the Recipe

# logging will display some interesting information about our recipe during execution
import logging
import sys

logging.basicConfig(
    format='%(asctime)s [%(levelname)s] %(name)s - %(message)s',
    level=logging.INFO,
    datefmt='%Y-%m-%d %H:%M:%S',
    stream=sys.stdout,
)
logger = logging.getLogger("pangeo_forge_recipes")
logger.setLevel(logging.INFO)

Here we just use the simple python function executor.

recipe.to_function()()
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Caching metadata for input 'time-0'
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Creating a new dataset in target
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-0
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-0
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-0'
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing dataset in /var/folders/n8/63q49ms55wxcj_gfbtykwp5r0000gn/T/tmpjgk2r0s4
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Expanding target concat dim 'time' to size 248
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-0
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-0
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-0'
2021-07-19 18:25:32 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-0 to Zarr region (slice(0, 8, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:25:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-0 to Zarr region (slice(0, 8, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:25:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-1
2021-07-19 18:25:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:25:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-1
2021-07-19 18:25:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-1'
2021-07-19 18:25:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-1 to Zarr region (slice(8, 16, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:26:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-1 to Zarr region (slice(8, 16, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:26:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-2
2021-07-19 18:26:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:26:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-2
2021-07-19 18:26:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-2'
2021-07-19 18:26:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-2 to Zarr region (slice(16, 24, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:26:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-2 to Zarr region (slice(16, 24, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:26:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-3
2021-07-19 18:26:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:26:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-3
2021-07-19 18:26:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-3'
2021-07-19 18:26:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-3 to Zarr region (slice(24, 32, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:26:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-3 to Zarr region (slice(24, 32, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:26:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-4
2021-07-19 18:26:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:26:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-4
2021-07-19 18:26:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-4'
2021-07-19 18:26:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-4 to Zarr region (slice(32, 40, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:27:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-4 to Zarr region (slice(32, 40, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:27:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-5
2021-07-19 18:27:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:27:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-5
2021-07-19 18:27:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-5'
2021-07-19 18:27:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-5 to Zarr region (slice(40, 48, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:27:30 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-5 to Zarr region (slice(40, 48, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:27:30 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-6
2021-07-19 18:27:30 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:27:30 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-6
2021-07-19 18:27:30 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-6'
2021-07-19 18:27:30 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-6 to Zarr region (slice(48, 56, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:27:48 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-6 to Zarr region (slice(48, 56, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:27:48 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-7
2021-07-19 18:27:48 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:27:48 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-7
2021-07-19 18:27:48 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-7'
2021-07-19 18:27:48 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-7 to Zarr region (slice(56, 64, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:28:03 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-7 to Zarr region (slice(56, 64, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:28:03 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-8
2021-07-19 18:28:03 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:28:03 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-8
2021-07-19 18:28:03 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-8'
2021-07-19 18:28:03 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-8 to Zarr region (slice(64, 72, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:28:22 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-8 to Zarr region (slice(64, 72, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:28:22 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-9
2021-07-19 18:28:22 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:28:22 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-9
2021-07-19 18:28:22 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-9'
2021-07-19 18:28:22 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-9 to Zarr region (slice(72, 80, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:28:40 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-9 to Zarr region (slice(72, 80, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:28:40 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-10
2021-07-19 18:28:40 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:28:40 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-10
2021-07-19 18:28:40 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-10'
2021-07-19 18:28:40 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-10 to Zarr region (slice(80, 88, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:28:57 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-10 to Zarr region (slice(80, 88, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:28:57 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-11
2021-07-19 18:28:57 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:28:57 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-11
2021-07-19 18:28:57 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-11'
2021-07-19 18:28:57 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-11 to Zarr region (slice(88, 96, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:29:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-11 to Zarr region (slice(88, 96, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:29:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-12
2021-07-19 18:29:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:29:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-12
2021-07-19 18:29:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-12'
2021-07-19 18:29:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-12 to Zarr region (slice(96, 104, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:29:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-12 to Zarr region (slice(96, 104, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:29:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-13
2021-07-19 18:29:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:29:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-13
2021-07-19 18:29:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-13'
2021-07-19 18:29:28 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-13 to Zarr region (slice(104, 112, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:29:49 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-13 to Zarr region (slice(104, 112, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:29:49 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-14
2021-07-19 18:29:49 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:29:49 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-14
2021-07-19 18:29:49 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-14'
2021-07-19 18:29:49 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-14 to Zarr region (slice(112, 120, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:30:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-14 to Zarr region (slice(112, 120, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:30:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-15
2021-07-19 18:30:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:30:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-15
2021-07-19 18:30:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-15'
2021-07-19 18:30:12 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-15 to Zarr region (slice(120, 128, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:30:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-15 to Zarr region (slice(120, 128, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:30:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-16
2021-07-19 18:30:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:30:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-16
2021-07-19 18:30:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-16'
2021-07-19 18:30:26 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-16 to Zarr region (slice(128, 136, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:30:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-16 to Zarr region (slice(128, 136, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:30:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-17
2021-07-19 18:30:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:30:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-17
2021-07-19 18:30:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-17'
2021-07-19 18:30:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-17 to Zarr region (slice(136, 144, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:31:07 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-17 to Zarr region (slice(136, 144, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:31:07 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-18
2021-07-19 18:31:07 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:31:07 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-18
2021-07-19 18:31:07 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-18'
2021-07-19 18:31:07 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-18 to Zarr region (slice(144, 152, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:31:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-18 to Zarr region (slice(144, 152, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:31:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-19
2021-07-19 18:31:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:31:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-19
2021-07-19 18:31:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-19'
2021-07-19 18:31:44 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-19 to Zarr region (slice(152, 160, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:32:00 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-19 to Zarr region (slice(152, 160, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:32:00 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-20
2021-07-19 18:32:00 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:32:00 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-20
2021-07-19 18:32:00 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-20'
2021-07-19 18:32:00 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-20 to Zarr region (slice(160, 168, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:32:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-20 to Zarr region (slice(160, 168, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:32:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-21
2021-07-19 18:32:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:32:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-21
2021-07-19 18:32:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-21'
2021-07-19 18:32:14 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-21 to Zarr region (slice(168, 176, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:32:31 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-21 to Zarr region (slice(168, 176, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:32:31 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-22
2021-07-19 18:32:31 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:32:31 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-22
2021-07-19 18:32:31 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-22'
2021-07-19 18:32:31 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-22 to Zarr region (slice(176, 184, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:32:50 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-22 to Zarr region (slice(176, 184, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:32:50 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-23
2021-07-19 18:32:50 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:32:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-23
2021-07-19 18:32:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-23'
2021-07-19 18:32:51 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-23 to Zarr region (slice(184, 192, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:33:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-23 to Zarr region (slice(184, 192, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:33:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-24
2021-07-19 18:33:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:33:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-24
2021-07-19 18:33:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-24'
2021-07-19 18:33:09 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-24 to Zarr region (slice(192, 200, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:33:29 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-24 to Zarr region (slice(192, 200, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:33:29 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-25
2021-07-19 18:33:29 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:33:29 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-25
2021-07-19 18:33:29 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-25'
2021-07-19 18:33:29 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-25 to Zarr region (slice(200, 208, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:33:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-25 to Zarr region (slice(200, 208, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:33:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-26
2021-07-19 18:33:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:33:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-26
2021-07-19 18:33:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-26'
2021-07-19 18:33:45 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-26 to Zarr region (slice(208, 216, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:34:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-26 to Zarr region (slice(208, 216, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:34:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-27
2021-07-19 18:34:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:34:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-27
2021-07-19 18:34:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-27'
2021-07-19 18:34:02 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-27 to Zarr region (slice(216, 224, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:34:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-27 to Zarr region (slice(216, 224, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:34:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-28
2021-07-19 18:34:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:34:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-28
2021-07-19 18:34:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-28'
2021-07-19 18:34:19 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-28 to Zarr region (slice(224, 232, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:34:37 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-28 to Zarr region (slice(224, 232, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:34:37 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening inputs for chunk time-0,time-29
2021-07-19 18:34:37 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Opening input with Xarray time-0: 'https://psl.noaa.gov/thredds/dodsC/Datasets/NARR/pressure/air.197901.nc'
2021-07-19 18:34:37 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Subsetting input according to time-29
2021-07-19 18:34:37 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Combining inputs for chunk 'time-0,time-29'
2021-07-19 18:34:37 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable time chunk time-0,time-29 to Zarr region (slice(232, 248, None),)
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/xarray/conventions.py:512: SerializationWarning: variable 'air' has multiple fill values {9.96921e+36, -9.96921e+36}, decoding all values to NaN.
  new_vars[k] = decode_cf_variable(
2021-07-19 18:35:17 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Storing variable air chunk time-0,time-29 to Zarr region (slice(232, 248, None), slice(None, None, None), slice(None, None, None), slice(None, None, None))
2021-07-19 18:35:18 [INFO] pangeo_forge_recipes.recipes.xarray_zarr - Consolidating Zarr metadata

Check The Outputs

ds_target =  xr.open_zarr(target.get_mapper())
ds_target
<xarray.Dataset>
Dimensions:            (level: 29, time: 248, x: 349, y: 277)
Coordinates:
    lat                (y, x) float32 dask.array<chunksize=(277, 349), meta=np.ndarray>
  * level              (level) float32 1e+03 975.0 950.0 ... 150.0 125.0 100.0
    lon                (y, x) float32 dask.array<chunksize=(277, 349), meta=np.ndarray>
  * time               (time) datetime64[ns] 1979-01-01 ... 1979-01-31T21:00:00
  * x                  (x) float32 0.0 3.246e+04 ... 1.126e+07 1.13e+07
  * y                  (y) float32 0.0 3.246e+04 ... 8.927e+06 8.96e+06
Data variables:
    Lambert_Conformal  int32 ...
    air                (time, level, y, x) float32 dask.array<chunksize=(1, 29, 277, 349), meta=np.ndarray>
Attributes: (12/17)
    Conventions:                     CF-1.2
    DODS_EXTRA.Unlimited_Dimension:  time
    References:                      
    centerlat:                       50.0
    centerlon:                       -107.0
    comments:                        
    ...                              ...
    platform:                        Model
    references:                      https://www.esrl.noaa.gov/psd/data/gridd...
    source:                          http://www.emc.ncep.noaa.gov/mmb/rreanl/...
    standardpar1:                    50.0
    standardpar2:                    50.000001
    title:                           8x Daily NARR
ds_target.air.isel(level=0).mean("time").plot()
/opt/miniconda3/envs/pangeo-forge/lib/python3.8/site-packages/dask/array/numpy_compat.py:40: RuntimeWarning: invalid value encountered in true_divide
  x = np.divide(x1, x2, out)
<matplotlib.collections.QuadMesh at 0x7fe5319d20a0>
../../_images/opendap_subset_recipe_18_2.png