!pip install aiohttp matplotlib pandas pyarrow requests "xarray[io]"
import pandas as pd
URL = 'https://mastapp.site'
Quickstart#
This notebook shows some very simple example of getting started.
List All Shots#
shots_df = pd.read_parquet(f'{URL}/parquet/level2/shots')
shots_df
| shot_id | uuid | equi_max_li3 | ohmnic_max_heating | generic_max_energy_time | generic_min_q95_time | endpoint_url | generic_max_geo_major_radius_time | timestamp | shot_postshot_comment | ... | nbi_power_max_ss | nbi_energy_ss_max_power | nbi_max_ss_power_time | nbi_power_ss_max_current | nbi_power_truby_ss | scenario | rad_o2ratio | radii_c2ratio | shot_scenario | shot_flat_top_duration | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 11766 | 7da2590b-6b7c-5a4e-8125-8b0c38a7c8bf | 1.520526 | 1.038769 | 0.037496 | 0.270 | https://s3.echo.stfc.ac.uk | 0.080 | 2005-01-13 12:02:00 | GOOD PLASMA, RAN FINE. SL JOINT ALARMS RATHER ... | ... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | None | NaN |
| 1 | 11767 | 594cabe7-8b0a-54a2-9e1e-8b250a858acd | 1.217211 | 1.105280 | 0.019210 | 0.245 | https://s3.echo.stfc.ac.uk | 0.080 | 2005-01-13 12:17:00 | OK BUT LOST VERTICAL CONTROL - FA2 JUST DIED A... | ... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | None | NaN |
| 2 | 11768 | 23a8941d-e073-5073-8f5e-e53230f55b43 | 1.262946 | 0.849237 | 0.036312 | 0.150 | https://s3.echo.stfc.ac.uk | 0.080 | 2005-01-13 13:30:00 | OK. GOT FA4 BUT NOT FA3 | ... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | None | NaN |
| 3 | 11769 | e12564d4-f0af-5c8d-b15c-ab59f11144b3 | 1.519628 | 2.149353 | 0.057099 | 0.290 | https://s3.echo.stfc.ac.uk | 0.290 | 2005-01-13 13:44:00 | SLIDING JOINT ALARMS A BIT LOWER. PLASMA OK. | ... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | None | NaN |
| 4 | 11771 | 1562346b-2097-5d27-8649-07eeb48dc5f7 | 1.788729 | 0.824824 | 0.052359 | 0.285 | https://s3.echo.stfc.ac.uk | 0.260 | 2005-01-13 14:33:00 | GOOD PLASMA F/B CONTROL. SLIDING JOINT ALARMS ... | ... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | None | NaN |
| ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
| 11568 | 30467 | db7bc878-869c-59c6-bcc6-cb28cba69cf9 | 6.694992 | NaN | -1.000000 | 0.030 | https://s3.echo.stfc.ac.uk | 0.165 | 2013-09-27 14:03:00 | 'Two times lower DD neutron rate than referenc... | ... | 2.080261 | 70.840835 | 0.12160 | 2.180491 | NaN | 3.0 | NaN | NaN | S6 | NaN |
| 11569 | 30468 | 696b1a86-1986-59a4-8cd8-f968dba4ece4 | 8.221705 | NaN | -1.000000 | 0.030 | https://s3.echo.stfc.ac.uk | 0.155 | 2013-09-27 14:21:00 | 'Good beam.Good repeat.' | ... | 2.083544 | 70.921546 | 0.13065 | 1.985447 | NaN | 2.0 | NaN | NaN | S8 | NaN |
| 11570 | 30469 | dcc5091c-ba43-599e-9c63-f8cb41494a60 | 2.542882 | NaN | -1.000000 | 0.195 | https://s3.echo.stfc.ac.uk | 0.170 | 2013-09-27 14:39:00 | 'Good shot. Modes present.' | ... | 2.163367 | 75.050461 | 0.19560 | 2.288206 | NaN | 3.0 | NaN | NaN | S6 | NaN |
| 11571 | 30470 | 63ccd361-c339-5403-abf3-dec0ad9d4811 | 11.771064 | 10.391692 | 0.008542 | 0.035 | https://s3.echo.stfc.ac.uk | 0.170 | 2013-09-27 15:03:00 | 'No HF gas.' | ... | 2.204641 | 75.045603 | 0.18445 | 2.107413 | NaN | 2.0 | NaN | NaN | S8 | NaN |
| 11572 | 30471 | 0916ffb1-fece-5d3d-81a9-b0504f49929f | 59.918600 | 73.787904 | 0.021805 | 0.035 | https://s3.echo.stfc.ac.uk | 0.125 | 2013-09-27 15:20:00 | 'Good shot.' | ... | 2.062899 | 71.177179 | 0.12170 | NaN | NaN | 2.0 | NaN | NaN | S8 | NaN |
11573 rows × 189 columns
List All Sources#
sources_df = pd.read_parquet(f"{URL}/parquet/level2/sources")
sources_df
| shot_id | quality | context_ | title | name | endpoint_url | imas | description | type_ | uuid | url | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 11766 | Not Checked | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | Source Dataset | equilibrium | https://s3.echo.stfc.ac.uk | equilibrium | dcat:Dataset | 0f3fbb3a-8915-593b-8a5e-bb2801bd5b6d | s3://mast/level2/shots/11766.zarr | |
| 1 | 11766 | Not Checked | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | Source Dataset | gas_injection | https://s3.echo.stfc.ac.uk | gas_injection | dcat:Dataset | 21df071f-d08f-540c-8f39-a799dc34535c | s3://mast/level2/shots/11766.zarr | |
| 2 | 11766 | Not Checked | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | Source Dataset | magnetics | https://s3.echo.stfc.ac.uk | magnetics | dcat:Dataset | c97c0e5c-c26c-52af-9b37-f6660d08726d | s3://mast/level2/shots/11766.zarr | |
| 3 | 11766 | Not Checked | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | Source Dataset | pf_active | https://s3.echo.stfc.ac.uk | pf_active | dcat:Dataset | ba47b2a2-a6da-5d8e-b6c2-e093fbfc3553 | s3://mast/level2/shots/11766.zarr | |
| 4 | 11766 | Not Checked | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | Source Dataset | pulse_schedule | https://s3.echo.stfc.ac.uk | pulse_schedule | dcat:Dataset | 46662499-0e12-5e7a-a8b8-ec44cdfca24d | s3://mast/level2/shots/11766.zarr | |
| ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
| 105993 | 30471 | Not Checked | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | Source Dataset | gas_injection | https://s3.echo.stfc.ac.uk | gas_injection | dcat:Dataset | 9d2c7bbd-8592-5e3b-a358-921879f34bd4 | s3://mast/level2/shots/30471.zarr | |
| 105994 | 30471 | Not Checked | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | Source Dataset | magnetics | https://s3.echo.stfc.ac.uk | magnetics | dcat:Dataset | 7118a52b-91bc-5575-ae9d-388552642b72 | s3://mast/level2/shots/30471.zarr | |
| 105995 | 30471 | Not Checked | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | Source Dataset | pf_active | https://s3.echo.stfc.ac.uk | pf_active | dcat:Dataset | 8a94267d-3c38-516b-83ee-27ba71348716 | s3://mast/level2/shots/30471.zarr | |
| 105996 | 30471 | Not Checked | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | Source Dataset | spectrometer_visible | https://s3.echo.stfc.ac.uk | None | dcat:Dataset | 7d455235-58fb-5918-9d04-0653d4972b89 | s3://mast/level2/shots/30471.zarr | |
| 105997 | 30471 | Not Checked | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | Source Dataset | summary | https://s3.echo.stfc.ac.uk | summary | dcat:Dataset | 5da1f1a6-c70f-5ad6-97c4-8e3b1f91da04 | s3://mast/level2/shots/30471.zarr |
105998 rows × 11 columns
List all signals Given a Shot Number#
signals_df = pd.read_parquet(f"{URL}/parquet/level2/signals?shot_id=30421")
signals_df
| shot_id | shape | uuid | imas | context_ | name | version | description | rank | dimensions | url | quality | endpoint_url | type_ | source | title | units | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 30421 | [73, 160] | 75756c34-c5b1-5e75-a53e-82bd90635d75 | charge_exchange | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | t_i | 0 | 2 | [time, major_radius] | s3://mast/level2/shots/30421.zarr | Not Checked | https://s3.echo.stfc.ac.uk | dcat:Dataset | charge_exchange | Signal Dataset | eV | |
| 1 | 30421 | [73, 160] | dcb14130-bf6a-5cc3-90ff-3985dad388a7 | charge_exchange | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | v_i | 0 | 2 | [time, major_radius] | s3://mast/level2/shots/30421.zarr | Not Checked | https://s3.echo.stfc.ac.uk | dcat:Dataset | charge_exchange | Signal Dataset | eV | |
| 2 | 30421 | [146] | eb848f08-2f4e-54a6-8bd5-98a98823aa2e | equilibrium | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | beta_normal | 0 | 1 | [time] | s3://mast/level2/shots/30421.zarr | Not Checked | https://s3.echo.stfc.ac.uk | dcat:Dataset | equilibrium | Signal Dataset | ||
| 3 | 30421 | [146] | cb95202b-279e-524a-b6af-899729ca9298 | equilibrium | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | beta_pol | 0 | 1 | [time] | s3://mast/level2/shots/30421.zarr | Not Checked | https://s3.echo.stfc.ac.uk | dcat:Dataset | equilibrium | Signal Dataset | ||
| 4 | 30421 | [146] | fd1ec81b-5eb9-5a59-b507-8b2df648e0ad | equilibrium | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | beta_tor | 0 | 1 | [time] | s3://mast/level2/shots/30421.zarr | Not Checked | https://s3.echo.stfc.ac.uk | dcat:Dataset | equilibrium | Signal Dataset | ||
| ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
| 68 | 30421 | [146, 120] | f0b586cd-11ea-5208-927b-4e4f057a6c44 | thomson_scattering | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | n_e | 0 | 2 | [time, major_radius] | s3://mast/level2/shots/30421.zarr | Not Checked | https://s3.echo.stfc.ac.uk | dcat:Dataset | thomson_scattering | Signal Dataset | eV | |
| 69 | 30421 | [146] | 097cfe72-4d53-5a04-a7dc-97b1898e6e98 | thomson_scattering | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | n_e_core | 0 | 1 | [time] | s3://mast/level2/shots/30421.zarr | Not Checked | https://s3.echo.stfc.ac.uk | dcat:Dataset | thomson_scattering | Signal Dataset | eV | |
| 70 | 30421 | [146, 120] | 23c0ad57-6ff8-5222-9a7a-c897b661b9ad | thomson_scattering | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | p_e | 0 | 2 | [time, major_radius] | s3://mast/level2/shots/30421.zarr | Not Checked | https://s3.echo.stfc.ac.uk | dcat:Dataset | thomson_scattering | Signal Dataset | eV | |
| 71 | 30421 | [146, 120] | 6e2f4faf-7eb6-5f9e-a8a3-f0869af4abbf | thomson_scattering | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | t_e | 0 | 2 | [time, major_radius] | s3://mast/level2/shots/30421.zarr | Not Checked | https://s3.echo.stfc.ac.uk | dcat:Dataset | thomson_scattering | Signal Dataset | eV | |
| 72 | 30421 | [146] | c83667d9-fd83-5808-90b9-bb6750e98b77 | thomson_scattering | {'dct': 'http://purl.org/dc/terms/', 'dqv': 'h... | t_e_core | 0 | 1 | [time] | s3://mast/level2/shots/30421.zarr | Not Checked | https://s3.echo.stfc.ac.uk | dcat:Dataset | thomson_scattering | Signal Dataset | eV |
73 rows × 17 columns
Open and plot shot data.#
Here we are visualising some plasma current data.
import xarray as xr
import matplotlib.pyplot as plt
dataset = xr.open_zarr(
"https://s3.echo.stfc.ac.uk/mast/level2/shots/30421.zarr",
group='summary'
)
dataset['ip'].plot()
plt.show()
