How to use Harmonised Data Access (HDA)
The Harmonised Data Access provides a single-entry point for accessing the Destination Earth Data lake data. HDA exposes a set of RESTful APIs for programmatic access to data, along with a STAC 1.0.0-compliant interface.
Here we list some of the tools that can be configured with the HDA endpoint (see STAC API endpoint) and with which one can gain access to the vast amount of diverse data exposed by Destination Earth - Data Lake.
- PyStac
Python library for working with SpatioTemporal Asset Catalogs (STACs). In general, the STAC interface allows integration with STAC-compatible tools, such as the STAC BROWSER, QGIS with STAC extension.
- Any REST client pointing to the HDA STAC API endpoint
REST clients are available in various programming languages and also provided by tools like Postman, Swagger UI, SoapUI, Talend API tester and others.
- cURL
Command line tool.
Jupyter Notebook examples at Destination Earth on Github will help to dive into the HDA. These are the links to the appropriate folders in that repository:
- REST
How to use the HDA APIs by sending a few HTTP requests, using Python code.
Includes authentication using DESP accounts, discovery search access and visualization of data.
- PySTAC
How to use HDA with pystac-client.
Includes iterating through Collections and Items as well as how to perform simple spatio-temporal searches.
- DestinE Digital Twins
How to access and visualize DestinE Digital Twins data through HDA.
- EUM_data
How to access and visualize EUMETSAT data.
- CDS_data
How to access and visualize Climate Data Store data.
STACK Service provided by Destination Earth Data Lake, can also be used in conjunction with the HDA component to facilitate access and processing of data. The hosted service JupyterLab Environment will allow users to execute their own Python code. Jupyter Notebook examples found at Destination Earth on Github are pre-loaded in the DEDL JupyterLab environment and can be executed using the dedicated ‘DEDL Python’ kernel.
Code examples demonstrating how to perform common operations using HDA
To run the examples below, you can either use the DestinE Platform provided Insula service or the DEDL provided STACK Service. Insula service is an integrated code environment based on JupyterHub, available through the DestinE Platform. The ‘datalake-lab’ folder in Insula’s navigation panel offers useful HDA tutorials.
Open API documentation
The HDA STAC API documentation is available here: OpenAPI documentation