Hook Service

Overview - Provided Hooks

The Destination Earth Data Lake (DEDL) ‘Hook service’ provides ready-to-use high level serverless workflows and functions preconfigured to efficiently access and manipulate Destination Earth Data Lake (DEDL) data. A growing number of workflows and functions will provide on-demand capabilities for the diverse data analysis needs.

Overview - Custom Hooks

Users of Destination Earth Data Lake (DEDL) can also create their own ‘Custom Hooks’, for more details click on the ‘Custom Hooks’ link below.

Technology

The Hook Service is based on Argo Workflows which itself runs on top of kubernetes. ‘Provided’ and ‘Custom’ Hooks run as containers and are triggered through a dedicated API provided by Destination Earth Data Lake.

OnDemand Data Processing API

Note

Interaction with the Hook Service is based on the OnDemand Data Processing API. As an Edge Service you will have to have the necessary rights to use this API (See Access DestinE Edge Services)

Contents:

• Provided Hooks
  • Overview
  • Getting Started
  • Hook Descriptions
• Custom Hooks
  • Overview
  • Getting Started
  • Installation of your own Argo Workflows instance
  • Build and Push your Custom Hook to a Private Container Registry
  • Run your Custom Hook on your own Argo Workflows Instance

The collection of Jupyter Notebooks examples on how to use the DestinE Data Lake services can be found at Destination Earth on Github.