Component Overview of AQIS Engine - Dask

The AQIS Engine - Dask can be broken down into a few basic components (classes). The instances of these classes offer the data structures and methods necessary for workflows:

• instances of the AQIS class will have methods to execute data analytics tasks or start an API server;
• the AQIS object will use an Execution Mode and Connection objects to data systems and dask clusters to this purpose;
• the operations will be executed on AQIS Dataframes, with standard operations encapsulated in Data System Adaptors;
• the AQIS Infisical functionality (InfisicalObj class) allows for easy connection to multiple data backends from an AQIS analytics workflow, using a single access token. It connects to an instance of the Infisical open-source secret store, which is used as catalogue of running data backends (Database Catalogue), keeping the secrets necessary for access. It automatises filling of a Connection object.

An overview of all this is given in the figure below: