Object Storage Configuration

Multiple S3 compatible Cloud and Object Storage providers are supported :

Public cloud providers :

  • Amazon AWS S3 Storage

  • Google Cloud Storage

  • Microsoft Azure Blob Storage

  • Wasabi Hot Cloud Storage

Private Cloud Providers :

  • Cloudian HyperStore

  • Dell EMC ECS

  • OpenStack Swift

  • Quantum ActiveScale

  • Scality Ring

Generic

  • Generic S3

If you don't find your S3 storage in this list, there is also a "Generic" S3 connector which is available.

S3 Storage

Configuration

Navigate to

Settings -> Hardware -> Storage -> Cloud

Parameters

Definition

Name

Complete the name of the storage

Provider

Choose a provider

Region

Complete the region*

URL

Complete the url

Backend

Select the backend : Rclone or S3FS

Mount Options

Access Key ID

Complete*

Secret access key

Complete*

*Information required, if your provider doesn't enforce the usage of region, define a value representative for you.

The name of a cloud storage is unique. You can't have several cloud storage with the same Name.

Once, the connector is defined, the buckets will automatically appear.

Swift Storage

OpenStack Swift Configuration

System -> Hardware -> Storages -> Cloud

- Name: complete the name you define in the toml (ansible playbook)

Mandatory to have the same name as the name writing in the toml (parent_name)

- Provider: choose OpenStack Swift (+++ Mandatory)

How to Visualize your buckets ?

Go to

storage services -> Cloud

At this stage, This panel display the complete overview of all Cloud Bucket.

You directly see if the bucket is Online or Offline.

S3 As a Primary Storage

Primary Storage need to be mount before launching a task.

To mount the storage, click on the button to connect the storage.

If you change the Backend for a primary storage bucket, it's required to reconnect the Storage (in the Storage Services cloud), for doing this operation, alt click on the button:

It's required to reconnect the Storage (in the Storage Services cloud), for doing this operation, alt click on the button:

S3 As a Secondary Storage

Secondary storage are automatically mounted by the workflow manager.

If you change the Backend for a Secondary storage bucket, it's required to restart the service Core Manager (in settings menu).

Last updated