Cache Support

The AQIS Cache Support submodule will be published soon and includes:

• guidance for setting up data backends with an intrinsic storage-tiering capability (based on iRODS, similar to a hierarchical storage management), where the topmost/highest-performance tier can be considered a cache layer, and
• a caching library facilitating a simple setup of a local cache for remote data on the file system of a data-processing machine (e.g. supercomputing cluster).

The submodule thus facilitates fast data access in typical situations where the bulk of the data has to be moved to a slower data system (e.g. tape or object store for cold data) for cost-efficiency reasons. A smaller, faster data system then constitutes the cache used to minimise I/O times.