!pip install pandas matplotlib zarr fsspec s3fs intake intake_xarray intake_parquet

Show code cell output Hide code cell output

Requirement already satisfied: pandas in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (2.2.2)
Requirement already satisfied: matplotlib in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (3.9.0)
Requirement already satisfied: zarr in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (2.18.2)
Requirement already satisfied: fsspec in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (2024.6.0)
Requirement already satisfied: s3fs in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (2024.6.0)
Requirement already satisfied: intake in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (2.0.5)
Requirement already satisfied: intake_xarray in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (0.7.0)
Requirement already satisfied: intake_parquet in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (0.3.0)
Requirement already satisfied: numpy>=1.23.2 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from pandas) (1.26.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from pandas) (2.9.0)
Requirement already satisfied: pytz>=2020.1 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from pandas) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from pandas) (2024.1)

Requirement already satisfied: contourpy>=1.0.1 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from matplotlib) (1.2.1)
Requirement already satisfied: cycler>=0.10 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from matplotlib) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from matplotlib) (4.53.0)
Requirement already satisfied: kiwisolver>=1.3.1 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from matplotlib) (1.4.5)
Requirement already satisfied: packaging>=20.0 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from matplotlib) (24.1)
Requirement already satisfied: pillow>=8 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from matplotlib) (10.3.0)
Requirement already satisfied: pyparsing>=2.3.1 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from matplotlib) (3.1.2)
Requirement already satisfied: asciitree in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from zarr) (0.3.3)
Requirement already satisfied: numcodecs>=0.10.0 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from zarr) (0.12.1)
Requirement already satisfied: fasteners in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from zarr) (0.19)
Requirement already satisfied: aiobotocore<3.0.0,>=2.5.4 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from s3fs) (2.13.0)
Requirement already satisfied: aiohttp!=4.0.0a0,!=4.0.0a1 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from s3fs) (3.9.5)
Requirement already satisfied: pyyaml in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from intake) (6.0.1)
Requirement already satisfied: appdirs in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from intake) (1.4.4)
Requirement already satisfied: xarray>=02022 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from intake_xarray) (2024.5.0)
Requirement already satisfied: dask>=2.2 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from intake_xarray) (2024.5.2)
Requirement already satisfied: netcdf4 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from intake_xarray) (1.6.5)
Requirement already satisfied: msgpack in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from intake_xarray) (1.0.8)
Requirement already satisfied: requests in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from intake_xarray) (2.32.3)
Requirement already satisfied: fastparquet in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from intake_parquet) (2024.5.0)
Requirement already satisfied: pyarrow in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from intake_parquet) (16.1.0)
Requirement already satisfied: botocore<1.34.107,>=1.34.70 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from aiobotocore<3.0.0,>=2.5.4->s3fs) (1.34.106)

Requirement already satisfied: wrapt<2.0.0,>=1.10.10 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from aiobotocore<3.0.0,>=2.5.4->s3fs) (1.16.0)
Requirement already satisfied: aioitertools<1.0.0,>=0.5.1 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from aiobotocore<3.0.0,>=2.5.4->s3fs) (0.11.0)
Requirement already satisfied: aiosignal>=1.1.2 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->s3fs) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->s3fs) (23.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->s3fs) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->s3fs) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->s3fs) (1.9.4)
Requirement already satisfied: click>=8.1 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from dask>=2.2->intake_xarray) (8.1.7)
Requirement already satisfied: cloudpickle>=1.5.0 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from dask>=2.2->intake_xarray) (3.0.0)
Requirement already satisfied: partd>=1.2.0 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from dask>=2.2->intake_xarray) (1.4.2)
Requirement already satisfied: toolz>=0.10.0 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from dask>=2.2->intake_xarray) (0.12.1)
Requirement already satisfied: importlib-metadata>=4.13.0 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from dask>=2.2->intake_xarray) (7.1.0)
Requirement already satisfied: six>=1.5 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from python-dateutil>=2.8.2->pandas) (1.16.0)

Requirement already satisfied: cramjam>=2.3 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from fastparquet->intake_parquet) (2.8.3)
Requirement already satisfied: cftime in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from netcdf4->intake_xarray) (1.6.4)
Requirement already satisfied: certifi in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from netcdf4->intake_xarray) (2024.6.2)
Requirement already satisfied: charset-normalizer<4,>=2 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from requests->intake_xarray) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from requests->intake_xarray) (3.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from requests->intake_xarray) (2.2.1)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from botocore<1.34.107,>=1.34.70->aiobotocore<3.0.0,>=2.5.4->s3fs) (1.0.1)

Requirement already satisfied: zipp>=0.5 in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from importlib-metadata>=4.13.0->dask>=2.2->intake_xarray) (3.19.2)
Requirement already satisfied: locket in /Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages (from partd>=1.2.0->dask>=2.2->intake_xarray) (1.0.0)

Tutorial: Accessing Data with Intake & S3

This notebooks demonstrates how to remotely load data from the archive, stored in a s3 bucket, using intake.

import intake
import matplotlib.pyplot as plt
import pandas as pd
import yaml
import PIL
from IPython.display import Image

Accessing the Shot Index

Before we can load data from the archive, we find the url where the data is located.

To do this we will use a intake catalog. intake catalogs are a way of abstracting how data is loaded from the user. intake is means that you don’t need to know the details of where the data is stored or how to read it.

To open the catalog we can use intake.open_catalog and give it the path to where our catalog is hosted.

The outpt shows that the catalog contains two sources: index and shots

• index is a source that reads metadata about different objects in the archive. It provides an index of different data objects stored in the archive.

• level1 is a source that reads from about level1 sources, which contain data directly from the tokamak. In the future, derived sources will be added at other product levels.

catalog  = intake.open_catalog('https://mastapp.site/intake/catalog.yml')
list(catalog)

['index', 'level1']

Let’s look at the index. The index also contains different product levels. For now, we are only interested in level1 products.

list(catalog.index)

['level1']

Lets use the index source to read in metadata about all the different shots.

Below we read the shot metadata (stored as JSON) directly into a pandas dataframe. The output is a table of metadata including urls for each shot in the archive.

df = pd.DataFrame(catalog.index.level1.shots.read())
df = df[['shot_id', 'campaign', 'url']]
df

	shot_id	campaign	url
0	11695	M5	s3://mast/level1/shots/11695.zarr
1	11696	M5	s3://mast/level1/shots/11696.zarr
2	11697	M5	s3://mast/level1/shots/11697.zarr
3	11698	M5	s3://mast/level1/shots/11698.zarr
4	11699	M5	s3://mast/level1/shots/11699.zarr
...	...	...	...
15548	30467	M9	s3://mast/level1/shots/30467.zarr
15549	30468	M9	s3://mast/level1/shots/30468.zarr
15550	30469	M9	s3://mast/level1/shots/30469.zarr
15551	30470	M9	s3://mast/level1/shots/30470.zarr
15552	30471	M9	s3://mast/level1/shots/30471.zarr

15553 rows × 3 columns

Using the urls of the shots we can load data from the archive.

In the next cell we use the url of the first shot to remotely open data from the amc diagnostic.

intake returns a xr.Dataset object containing all the data for this diagnostic.

shot = df.loc[df.shot_id == 30420].iloc[0]
dataset = catalog.level1.shots(url=shot.url, group='amc').to_dask()
dataset

/Users/rt2549/miniconda3/envs/mast-book/lib/python3.11/site-packages/intake_xarray/base.py:21: FutureWarning: The return type of `Dataset.dims` will be changed to return a set of dimension names in future, in order to be more consistent with `DataArray.dims`. To access a mapping from dimension names to lengths, please use `Dataset.sizes`.
  'dims': dict(self._ds.dims),

<xarray.Dataset> Size: 5MB
Dimensions:            (time: 30000)
Coordinates:
  * time               (time) float32 120kB -2.0 -2.0 -2.0 ... 3.999 4.0 4.0
Data variables: (12/46)
    efps_current       (time) float32 120kB dask.array<chunksize=(30000,), meta=np.ndarray>
    error_field_02     (time) float32 120kB dask.array<chunksize=(30000,), meta=np.ndarray>
    error_field_05     (time) float32 120kB dask.array<chunksize=(30000,), meta=np.ndarray>
    p2il_coil_current  (time) float32 120kB dask.array<chunksize=(30000,), meta=np.ndarray>
    p2il_feed_current  (time) float32 120kB dask.array<chunksize=(30000,), meta=np.ndarray>
    p2iu_coil_current  (time) float32 120kB dask.array<chunksize=(30000,), meta=np.ndarray>
    ...                 ...
    p6u_current        (time) float32 120kB dask.array<chunksize=(30000,), meta=np.ndarray>
    plasma_current     (time) float32 120kB dask.array<chunksize=(30000,), meta=np.ndarray>
    sol_current        (time) float32 120kB dask.array<chunksize=(30000,), meta=np.ndarray>
    status             float32 4B ...
    tf_current         (time) float32 120kB dask.array<chunksize=(30000,), meta=np.ndarray>
    version            float32 4B ...
Attributes:
    description:  Plasma Current and PF/TF Coil Currents
    file_name:    amc0304.20
    format:       IDA3
    mds_name:     None
    name:         amc
    quality:      Not Checked
    shot_id:      30420
    signal_type:  Analysed
    source:       amc
    uda_name:     AMC
    uuid:         01aad0c4-2a84-59e2-8b1b-168b4bd66aa3
    version:      0

xarray.Dataset

• Dimensions:
  • time: 30000
• Coordinates: (1)
  • time
    (time)
    float32
    -2.0 -2.0 -2.0 ... 3.999 4.0 4.0

    units :

    s

    array([-2.      , -1.9998  , -1.9996  , ...,  3.999399,  3.9996  ,  3.999799],
          dtype=float32)

• Data variables: (46)
  • efps_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    EFPS current measured at input to P2 link board

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    EFPS Current

    mds_name :

    \TOP.ANALYSED.AMC:EFPS_CURRENT

    name :

    amc/efps_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_EFPS CURRENT

    units :

    kA

    uuid :

    184cb059-3b20-5ff2-87fb-959ce07c42d0

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • error_field_02
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    Error Field/02

    mds_name :

    \TOP.ANALYSED.AMC.ERROR_FIELD:02

    name :

    amc/error_field_02

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_ERROR FIELD/02

    units :

    kA * turn

    uuid :

    a48b22d3-dc5b-57cc-805b-e2875e4b4783

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • error_field_05
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    Error Field/05

    mds_name :

    \TOP.ANALYSED.AMC.ERROR_FIELD:05

    name :

    amc/error_field_05

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_ERROR FIELD/05

    units :

    kA * turn

    uuid :

    a2a22abc-b6dd-5115-87b9-a3106ff30110

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2il_coil_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P2 inner lower current (pseudo coil current signal used by EFIT)

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2IL Coil Current

    mds_name :

    \TOP.ANALYSED.AMC.P2IL_COIL:CURRENT

    name :

    amc/p2il_coil_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2IL COIL CURRENT

    units :

    kA * turn

    uuid :

    63691830-c58d-5f03-a811-5601bca0e0b9

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2il_feed_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P2L inner winding current - measured at P2 link board

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2il Feed Current

    mds_name :

    \TOP.ANALYSED.AMC.P2IL_FEED:CURRENT

    name :

    amc/p2il_feed_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2IL FEED CURRENT

    units :

    kA

    uuid :

    af5c935e-ce9a-5b8f-b7be-2e97726f314a

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2iu_coil_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P2 inner upper feed current (pseudo coil current signal used by EFIT)

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2IU Coil Current

    mds_name :

    \TOP.ANALYSED.AMC.P2IU_COIL:CURRENT

    name :

    amc/p2iu_coil_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2IU COIL CURRENT

    units :

    kA * turn

    uuid :

    26141f74-c0b6-5718-b28f-b40765ca326e

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2iu_feed_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P2U inner winding current - measured at P2 link board

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2iu Feed Current

    mds_name :

    \TOP.ANALYSED.AMC.P2IU_FEED:CURRENT

    name :

    amc/p2iu_feed_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2IU FEED CURRENT

    units :

    kA

    uuid :

    6f129101-1a1b-5d41-afa3-01b38587dafb

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2l_case_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P2 lower case current (pseudo coil current signal used by EFIT)

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2L Case Current

    mds_name :

    \TOP.ANALYSED.AMC.P2L_CASE:CURRENT

    name :

    amc/p2l_case_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2L CASE CURRENT

    units :

    kA

    uuid :

    99aad5b5-f691-53fb-9b50-cfca47478c1e

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2l_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Internal P2L current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2L Current

    mds_name :

    \TOP.ANALYSED.AMC:P2L_CURRENT

    name :

    amc/p2l_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2L CURRENT

    units :

    kA * turn

    uuid :

    48b41de3-eac6-54a2-896c-c5a3e78c176d

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2ol_coil_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P2 outer lower current (pseudo coil current signal used by EFIT)

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2OL Coil Current

    mds_name :

    \TOP.ANALYSED.AMC.P2OL_COIL:CURRENT

    name :

    amc/p2ol_coil_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2OL COIL CURRENT

    units :

    kA * turn

    uuid :

    22c92239-552f-5da4-aed1-4595f9998392

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2ol_feed_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P2L outer winding current - measured at P2 link board

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2ol Feed Current

    mds_name :

    \TOP.ANALYSED.AMC.P2OL_FEED:CURRENT

    name :

    amc/p2ol_feed_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2OL FEED CURRENT

    units :

    kA

    uuid :

    c8485623-2746-5b7c-9a53-b0f085ff54f9

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2ou_coil_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P2 outer upper feed current (pseudo coil current signal used by EFIT)

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2OU Coil Current

    mds_name :

    \TOP.ANALYSED.AMC.P2OU_COIL:CURRENT

    name :

    amc/p2ou_coil_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2OU COIL CURRENT

    units :

    kA * turn

    uuid :

    f4963f6c-a084-574a-ad4e-58ab7c977b29

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2ou_feed_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P2U outer winding current - measured at P2 link board

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2ou Feed Current

    mds_name :

    \TOP.ANALYSED.AMC.P2OU_FEED:CURRENT

    name :

    amc/p2ou_feed_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2OU FEED CURRENT

    units :

    kA

    uuid :

    14f2d15f-7449-5d82-9269-3543d772d2b3

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2u_case_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P2 upper case current (pseudo coil current signal used by EFIT)

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2U Case Current

    mds_name :

    \TOP.ANALYSED.AMC.P2U_CASE:CURRENT

    name :

    amc/p2u_case_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2U CASE CURRENT

    units :

    kA

    uuid :

    dc9cf0aa-73df-5b8a-ae76-28784eda0ffd

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p2u_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Internal P2U current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P2U Current

    mds_name :

    \TOP.ANALYSED.AMC:P2U_CURRENT

    name :

    amc/p2u_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P2U CURRENT

    units :

    kA * turn

    uuid :

    1f335921-0caa-5a97-9c20-66979363b26f

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p3l_case_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P3L Case Current

    mds_name :

    \TOP.ANALYSED.AMC.P3L_CASE:CURRENT

    name :

    amc/p3l_case_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P3L CASE CURRENT

    units :

    kA

    uuid :

    23c0924c-2ee4-5cc6-8e2d-03ac857efeef

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p3l_coil_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P3L Coil Current

    mds_name :

    \TOP.ANALYSED.AMC.P3L_COIL:CURRENT

    name :

    amc/p3l_coil_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P3L COIL CURRENT

    units :

    kA * turn

    uuid :

    d5f3c8aa-7335-5260-92cd-0392ea4bc035

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p3l_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Internal P3L current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P3L Current

    mds_name :

    \TOP.ANALYSED.AMC:P3L_CURRENT

    name :

    amc/p3l_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P3L CURRENT

    units :

    kA * turn

    uuid :

    9a9fb709-4ca7-5ccb-8697-bffe44d9583f

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p3l_feed_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P3l Feed Current

    mds_name :

    \TOP.ANALYSED.AMC.P3L_FEED:CURRENT

    name :

    amc/p3l_feed_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P3L FEED CURRENT

    units :

    kA

    uuid :

    2378bca5-a554-56b0-838e-b29f99803b2c

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p3u_case_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P3U Case Current

    mds_name :

    \TOP.ANALYSED.AMC.P3U_CASE:CURRENT

    name :

    amc/p3u_case_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P3U CASE CURRENT

    units :

    kA

    uuid :

    ba240fad-6013-5da0-8e24-f416ed793b94

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p3u_coil_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P3U Coil Current

    mds_name :

    \TOP.ANALYSED.AMC.P3U_COIL:CURRENT

    name :

    amc/p3u_coil_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P3U COIL CURRENT

    units :

    kA * turn

    uuid :

    3b4af51c-ed63-5349-9eed-d913f4ba2afa

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p3u_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Internal P3U current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P3U Current

    mds_name :

    \TOP.ANALYSED.AMC:P3U_CURRENT

    name :

    amc/p3u_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P3U CURRENT

    units :

    kA * turn

    uuid :

    4cf1388c-8f2e-5c30-93c6-d2b7d40da40b

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p3u_feed_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P3U winding current - measured at P3/4/5 link board

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P3u Feed Current

    mds_name :

    \TOP.ANALYSED.AMC.P3U_FEED:CURRENT

    name :

    amc/p3u_feed_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P3U FEED CURRENT

    units :

    kA

    uuid :

    88fe288b-25c1-59f8-949a-a54e2cb360d7

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p4l_case_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P4L Case Current

    mds_name :

    \TOP.ANALYSED.AMC.P4L_CASE:CURRENT

    name :

    amc/p4l_case_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P4L CASE CURRENT

    units :

    kA

    uuid :

    a28f9810-827c-56d9-8622-7ca19671d44d

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p4l_coil_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P4L Coil Current

    mds_name :

    \TOP.ANALYSED.AMC.P4L_COIL:CURRENT

    name :

    amc/p4l_coil_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P4L COIL CURRENT

    units :

    kA * turn

    uuid :

    7ddc00ba-98cc-518e-93d9-50ba85196fc9

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p4l_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Internal P4L current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P4L Current

    mds_name :

    \TOP.ANALYSED.AMC:P4L_CURRENT

    name :

    amc/p4l_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P4L CURRENT

    units :

    kA * turn

    uuid :

    12619bbb-9d72-5784-82d3-041b1a0678cc

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p4l_feed_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P4L winding current - measured at P3/4/5 link board

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P4l Feed Current

    mds_name :

    \TOP.ANALYSED.AMC.P4L_FEED:CURRENT

    name :

    amc/p4l_feed_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P4L FEED CURRENT

    units :

    kA

    uuid :

    8cd586d7-3ee9-5eb8-b00f-e1f4431d4f27

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p4u_case_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P4U Case Current

    mds_name :

    \TOP.ANALYSED.AMC.P4U_CASE:CURRENT

    name :

    amc/p4u_case_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P4U CASE CURRENT

    units :

    kA

    uuid :

    bab05664-c0cf-5bbd-a0ee-2bcc19899f4a

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p4u_coil_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P4U Coil Current

    mds_name :

    \TOP.ANALYSED.AMC.P4U_COIL:CURRENT

    name :

    amc/p4u_coil_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P4U COIL CURRENT

    units :

    kA * turn

    uuid :

    83df05ea-5dd2-5d55-af2c-f6f62880f5b9

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p4u_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Internal P4U current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P4U Current

    mds_name :

    \TOP.ANALYSED.AMC:P4U_CURRENT

    name :

    amc/p4u_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P4U CURRENT

    units :

    kA * turn

    uuid :

    c8019ebe-400c-5846-8233-80b1d08a9e03

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p4u_feed_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P4U winding current - measured at P3/4/5 link board

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P4u Feed Current

    mds_name :

    \TOP.ANALYSED.AMC.P4U_FEED:CURRENT

    name :

    amc/p4u_feed_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P4U FEED CURRENT

    units :

    kA

    uuid :

    fbfe5693-2fa1-577b-8567-76261174b0c4

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p5l_case_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P5L Case Current

    mds_name :

    \TOP.ANALYSED.AMC.P5L_CASE:CURRENT

    name :

    amc/p5l_case_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P5L CASE CURRENT

    units :

    kA

    uuid :

    94e8a842-4c13-56c3-b581-1279db9762a0

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p5l_coil_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P5L Coil Current

    mds_name :

    \TOP.ANALYSED.AMC.P5L_COIL:CURRENT

    name :

    amc/p5l_coil_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P5L COIL CURRENT

    units :

    kA * turn

    uuid :

    1f786b53-7971-54ae-a013-f07405e398ca

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p5l_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Internal P5L current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P5L Current

    mds_name :

    \TOP.ANALYSED.AMC:P5L_CURRENT

    name :

    amc/p5l_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P5L CURRENT

    units :

    kA * turn

    uuid :

    7f0ab6cd-61cd-502e-af7e-646dc4e7cf12

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p5l_feed_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P5L winding current - measured at P3/4/5 link board

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P5l Feed Current

    mds_name :

    \TOP.ANALYSED.AMC.P5L_FEED:CURRENT

    name :

    amc/p5l_feed_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P5L FEED CURRENT

    units :

    kA

    uuid :

    0d4b200c-35e6-52d0-b759-297842b2dcd3

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p5u_case_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P5U Case Current

    mds_name :

    \TOP.ANALYSED.AMC.P5U_CASE:CURRENT

    name :

    amc/p5u_case_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P5U CASE CURRENT

    units :

    kA

    uuid :

    2b648bdd-e3a8-53b7-9b10-47cd1208bd4a

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p5u_coil_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P5U Coil Current

    mds_name :

    \TOP.ANALYSED.AMC.P5U_COIL:CURRENT

    name :

    amc/p5u_coil_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P5U COIL CURRENT

    units :

    kA * turn

    uuid :

    346777d8-9808-5b84-883a-5ed522a96f42

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p5u_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Internal P5U current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P5U Current

    mds_name :

    \TOP.ANALYSED.AMC:P5U_CURRENT

    name :

    amc/p5u_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P5U CURRENT

    units :

    kA * turn

    uuid :

    ffb66909-326a-5dd9-915c-3257b0afe32f

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p5u_feed_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P5U winding current - measured at P3/4/5 link board

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P5u Feed Current

    mds_name :

    \TOP.ANALYSED.AMC.P5U_FEED:CURRENT

    name :

    amc/p5u_feed_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P5U FEED CURRENT

    units :

    kA

    uuid :

    919e1597-f986-5556-b427-df2dc2d6d075

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p6l_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Internal P6L current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P6L Current

    mds_name :

    \TOP.ANALYSED.AMC:P6L_CURRENT

    name :

    amc/p6l_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P6L CURRENT

    units :

    kA * turn

    uuid :

    f2032ccb-441e-5241-9a9e-ba1d37c5f437

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • p6u_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Internal P6U current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    P6U Current

    mds_name :

    \TOP.ANALYSED.AMC:P6U_CURRENT

    name :

    amc/p6u_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_P6U CURRENT

    units :

    kA * turn

    uuid :

    e48ade2b-11e4-5793-9ad0-0a754c0aa488

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • plasma_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    Plasma Current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    Plasma Current

    mds_name :

    \TOP.ANALYSED.AMC.PLASMA:CURRENT

    name :

    amc/plasma_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_PLASMA CURRENT

    units :

    kA

    uuid :

    6327e756-e587-5c74-8aed-4e595d3546cf

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • sol_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    P1PS - Solenoid Feed Current

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    Sol Current

    mds_name :

    \TOP.ANALYSED.AMC:SOL_CURRENT

    name :

    amc/sol_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_SOL CURRENT

    units :

    kA

    uuid :

    b2b6c10b-15cf-5a15-82e8-2a53e5be144d

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • status
    ()
    float32
    ...

    description :

    dims :

    []

    file_name :

    None

    format :

    None

    label :

    mds_name :

    \TOP.ANALYSED.AMC:STATUS

    name :

    amc/status

    quality :

    Not Checked

    rank :

    1

    shape :

    [1]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_STATUS

    units :

    uuid :

    19528798-cd4d-5799-90e5-528d5b275b0c

    version :

    0

    [1 values with dtype=float32]

  • tf_current
    (time)
    float32
    dask.array<chunksize=(30000,), meta=np.ndarray>

    description :

    TF feed current measured in north duct

    dims :

    ['time']

    file_name :

    None

    format :

    None

    label :

    TF Current

    mds_name :

    \TOP.ANALYSED.AMC:TF_CURRENT

    name :

    amc/tf_current

    quality :

    Not Checked

    rank :

    1

    shape :

    [30000]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_TF CURRENT

    units :

    kA

    uuid :

    50cd98f3-8f4d-543d-be7a-bf06e87c477e

    version :

    0

    Array Chunk Bytes 117.19 kiB 117.19 kiB Shape (30000,) (30000,) Dask graph 1 chunks in 2 graph layers Data type float32 numpy.ndarray

  • version
    ()
    float32
    ...

    description :

    dims :

    []

    file_name :

    None

    format :

    None

    label :

    mds_name :

    \TOP.ANALYSED.AMC:VERSION

    name :

    amc/version

    quality :

    Not Checked

    rank :

    1

    shape :

    [1]

    shot_id :

    30420

    signal_type :

    Analysed

    source :

    amc

    time_index :

    0

    uda_name :

    AMC_VERSION

    units :

    uuid :

    723bd0c7-5695-5576-8f7f-2203f6797ee4

    version :

    0

    [1 values with dtype=float32]

• Indexes: (1)
  • time
    PandasIndex

    PandasIndex(Index([ -2.000000238418579,  -1.999800205230713, -1.9996002912521362,
             -1.99940025806427, -1.9992002248764038, -1.9990001916885376,
            -1.998800277709961, -1.9986002445220947, -1.9984002113342285,
           -1.9982002973556519,
           ...
             3.997999429702759,   3.998199701309204,   3.998399496078491,
            3.9985997676849365,  3.9987995624542236,   3.998999834060669,
             3.999199628829956,   3.999399423599243,  3.9995996952056885,
            3.9997994899749756],
          dtype='float32', name='time', length=30000))

• Attributes: (12)

  description :

  Plasma Current and PF/TF Coil Currents

  file_name :

  amc0304.20

  format :

  IDA3

  mds_name :

  None

  name :

  amc

  quality :

  Not Checked

  shot_id :

  30420

  signal_type :

  Analysed

  source :

  amc

  uda_name :

  AMC

  uuid :

  01aad0c4-2a84-59e2-8b1b-168b4bd66aa3

  version :

  0

Data Analysis with Remote Data

We’re going to perform a simple plotting task. We will:

• Get the URLs for 10 shots in a given range

• Load the plasma current data as a xarray.Dataset

• Slice every shot between 0 seconds and .3 seconds.

df = df.loc[(df.shot_id <= 30420) & (df.shot_id >= 30410)]

plasma_shots = []
for index, row in df.iterrows():
    dataset = catalog.level1.shots(url=row['url'], group='amc')
    dataset = dataset.to_dask()
    dataset = dataset['plasma_current']
    dataset = dataset.sel(time=slice(0, .3))
    plasma_shots.append(dataset)

In the code above, we load each item as an xarray dataset, with the data, time, and error data all together.

plasma_shots[0]

<xarray.DataArray 'plasma_current' (time: 1500)> Size: 6kB
dask.array<getitem, shape=(1500,), dtype=float32, chunksize=(1500,), chunktype=numpy.ndarray>
Coordinates:
  * time     (time) float32 6kB 0.0001998 0.0003998 0.0005996 ... 0.2998 0.3
Attributes: (12/18)
    description:  Plasma Current
    dims:         ['time']
    file_name:    None
    format:       None
    label:        Plasma Current
    mds_name:     \TOP.ANALYSED.AMC.PLASMA:CURRENT
    ...           ...
    source:       amc
    time_index:   0
    uda_name:     AMC_PLASMA CURRENT
    units:        kA
    uuid:         04b71d20-1e39-538d-9626-a6ef7926a84e
    version:      0

xarray.DataArray

'plasma_current'

• time: 1500

• dask.array<chunksize=(1500,), meta=np.ndarray>

  Array Chunk Bytes 5.86 kiB 5.86 kiB Shape (1500,) (1500,) Dask graph 1 chunks in 3 graph layers Data type float32 numpy.ndarray

• Coordinates: (1)
  • time
    (time)
    float32
    0.0001998 0.0003998 ... 0.2998 0.3

    units :

    s

    array([1.997948e-04, 3.998280e-04, 5.996227e-04, ..., 2.995996e-01,
           2.997997e-01, 2.999997e-01], dtype=float32)

• Indexes: (1)
  • time
    PandasIndex

    PandasIndex(Index([0.00019979476928710938,  0.0003998279571533203,  0.0005996227264404297,
            0.0007996559143066406,  0.0009996891021728516,  0.0011997222900390625,
            0.0013997554779052734,  0.0015997886657714844,  0.0017998218536376953,
            0.0019996166229248047,
           ...
               0.2981996536254883,     0.2983996868133545,     0.2985997200012207,
               0.2987997531890869,     0.2989997863769531,    0.29919981956481934,
              0.29939961433410645,    0.29959964752197266,    0.29979968070983887,
               0.2999997138977051],
          dtype='float32', name='time', length=1500))

• Attributes: (18)

  description :

  Plasma Current

  dims :

  ['time']

  file_name :

  None

  format :

  None

  label :

  Plasma Current

  mds_name :

  \TOP.ANALYSED.AMC.PLASMA:CURRENT

  name :

  amc/plasma_current

  quality :

  Not Checked

  rank :

  1

  shape :

  [30000]

  shot_id :

  30410

  signal_type :

  Analysed

  source :

  amc

  time_index :

  0

  uda_name :

  AMC_PLASMA CURRENT

  units :

  kA

  uuid :

  04b71d20-1e39-538d-9626-a6ef7926a84e

  version :

  0

Finally, we can plot the 10 shots we loaded and cropped.

for current in plasma_shots:
    plt.plot(current.time, current.data, label=current.attrs['shot_id'])
    plt.xlabel('time')
    plt.ylabel(f"current ({current.attrs['units']})")

plt.legend()

<matplotlib.legend.Legend at 0x35bc46110>

Larger Data - Loading RBB Image Data

In this example we show how to load Image data remotely. Image data are just grouped by source, such as the rbb data. In this example we load all the image data from an rbb group and create a GIF of the contents.

dataset = catalog.level1.shots(url=shot.url, group='rbb')
dataset = dataset.read()
dataset

<xarray.Dataset> Size: 82MB
Dimensions:  (time: 286, height: 448, width: 640)
Coordinates:
  * time     (time) float64 2kB 1.6e-05 0.002016 0.004016 ... 0.308 0.309 0.31
Dimensions without coordinates: height, width
Data variables:
    data     (time, height, width) uint8 82MB 0 0 2 0 0 0 1 2 ... 2 2 0 4 0 2 0
Attributes: (12/48)
    CLASS:           IMAGE
    IMAGE_SUBCLASS:  IMAGE_INDEXED
    IMAGE_VERSION:   1.2
    board_temp:      0.0
    bottom:          680
    camera:          
    ...              ...
    units:           pixels
    uuid:            10ed506a-3ac4-5e62-8a6b-25a7abfc3171
    vbin:            0
    version:         -1
    view:            photron HM10 + Dalpha filter
    width:           640

xarray.Dataset

• Dimensions:
  • time: 286
  • height: 448
  • width: 640
• Coordinates: (1)
  • time
    (time)
    float64
    1.6e-05 0.002016 ... 0.309 0.31

    units :

    s

    array([1.60000e-05, 2.01600e-03, 4.01600e-03, ..., 3.08016e-01, 3.09016e-01,
           3.10016e-01])

• Data variables: (1)
  • data
    (time, height, width)
    uint8
    0 0 2 0 0 0 1 2 ... 2 2 2 0 4 0 2 0

    array([[[ 0,  0,  2, ...,  0,  2,  2],
            [ 1,  1,  0, ...,  6,  8,  6],
            [ 0,  2,  0, ...,  0,  0,  0],
            ...,
            [ 2,  4,  0, ...,  0,  2,  0],
            [ 0,  0,  4, ...,  4,  2,  2],
            [ 6,  0,  4, ...,  0,  6,  4]],
    
           [[ 0,  0,  4, ...,  0,  0,  0],
            [ 3,  0,  1, ...,  6,  2,  2],
            [ 1,  4,  1, ...,  0,  2,  0],
            ...,
            [ 0,  0,  0, ...,  0,  4,  0],
            [ 2,  0,  2, ...,  4,  4,  0],
            [ 0,  0,  0, ...,  0,  2,  2]],
    
           [[ 0,  0,  0, ...,  0,  0,  0],
            [ 1,  3,  1, ...,  8,  4,  2],
            [ 1,  6,  0, ...,  0,  0,  4],
            ...,
    ...
            ...,
            [ 4,  2,  2, ...,  0,  6,  4],
            [ 2,  0,  4, ...,  8,  8, 11],
            [ 2,  0,  0, ...,  2,  6,  4]],
    
           [[ 0,  0,  0, ...,  2,  2,  4],
            [ 1,  0,  0, ...,  4,  6,  2],
            [ 3,  4,  5, ...,  2,  0,  4],
            ...,
            [ 4,  4,  0, ...,  0,  6,  2],
            [ 0,  0,  6, ...,  4,  2,  2],
            [ 0,  2,  0, ...,  0,  2,  0]],
    
           [[ 0,  0,  0, ...,  0,  0,  0],
            [ 1,  0,  1, ...,  2,  2,  2],
            [ 1,  0,  3, ...,  2,  2,  2],
            ...,
            [ 0,  2,  0, ...,  0,  6,  2],
            [ 0,  0,  2, ...,  6,  6,  8],
            [ 0,  2,  4, ...,  0,  2,  0]]], dtype=uint8)

• Indexes: (1)
  • time
    PandasIndex

    PandasIndex(Index([             1.6e-05,             0.002016,             0.004016,
                       0.006016, 0.008015999999999999, 0.010015999999999999,
           0.012015999999999999, 0.014015999999999999,             0.016016,
                       0.018016,
           ...
                       0.301016,             0.302016,             0.303016,
                       0.304016,             0.305016,             0.306016,
                       0.307016,             0.308016,             0.309016,
            0.31001599999999996],
          dtype='float64', name='time', length=286))

• Attributes: (48)

  CLASS :

  IMAGE

  IMAGE_SUBCLASS :

  IMAGE_INDEXED

  IMAGE_VERSION :

  1.2

  board_temp :

  0.0

  bottom :

  680

  camera :

  ccd_temp :

  0.0

  codex :

  JP2

  date_time :

  2013-09-25T12:50:53Z

  depth :

  8

  description :

  Photron bullet camera B

  dims :

  ['time', 'height', 'width']

  exposure :

  10.0

  file_format :

  IPX-1

  file_name :

  rbb030420.ipx

  filter :

  format :

  IPX

  gain :

  [4.0, 0.0]

  hbin :

  0

  height :

  448

  is_color :

  0

  left :

  193

  lens :

  mds_name :

  None

  n_frames :

  286

  name :

  rbb

  offset :

  [0.0, 0.0]

  orientation :

  0

  pre_exp :

  0.0

  quality :

  Not Checked

  rank :

  3

  right :

  832

  shape :

  [286, 448, 640]

  shot :

  30420

  shot_id :

  30420

  signal_type :

  Image

  source :

  rbb

  strobe :

  0

  taps :

  0

  top :

  233

  trigger :

  -0.10000000149011612

  uda_name :

  RBB

  units :

  pixels

  uuid :

  10ed506a-3ac4-5e62-8a6b-25a7abfc3171

  vbin :

  0

  version :

  -1

  view :

  photron HM10 + Dalpha filter

  width :

  640

imgs = [PIL.Image.fromarray(img) for img in dataset.data.values]
imgs[0].save("array.gif", save_all=True, append_images=imgs[1:], duration=50, loop=0)
Image(open('array.gif','rb').read())