Task Management

Task management capabilities allow users to control and monitor data movement workflows.

Unlimited number of tasks can be defined simultaneously, this to move, archive and protect data between different storage tiers.

In addition, a centralized dashboard allows users to monitor task progress and get real-time updates on the status of their data.

A list of (non exhaustive) options is available for each defined task:

  • Task Name

  • Type of workflow (Offline Archive, Active Archive)

  • Action (Copy, Move)

  • Source (Pool of Storage)

Allow the selection of the overall storage or get the option to browse the storage and include specific contents.

  • Destination (Pool of Storage, Specify Specific Folder destination and conflict resolution)

  • Filtering with inclusion / exclusion of files

  • Incremental or full type selection depending on the content of the storage pool selected at destination

  • Priority setting

  • Schedule (Manually, Periodically, Automatically)

Task Creation

Behind the task creation mechanism, different type of workflows can defined.

Data Protection / Offline Archive

Definition

Data Protection or Offline Archiving task secures selected data on a dedicated storage tier. Data accessibility is managed by the administrator behind the workflow. It allows only the data to be read or retrieved online.

Depending on the medium chosen, data can be physically moved off-site. This requires human intervention to retrieve the data online.

Users have the option of running an offline workflow that will copy or move the data to a secondary storage pool.

Why to use this workflow?

  1. Protect stored content that is online (online means "modifiable" by users or applications). Workflow allows these data to be copied according to defined criteria.

  2. Archive data on a disconnected media, with the possibility of get it online - offsite.

Traceability

A complete traceability is kept.

User/administrator have an overview of their data mobility even if the data has been secure offline.

In case of tape library, data can even be move out of the library (off site). All contents are stored in open format, under common standards.

Available Criteria

SourceDestinationType of action Mover

Primary Storage :

  • Nas

  • Object Storage

Secondary Storage :

  • Tape Pools

  • Cloud Pools

  • Nas Pools

Copy / Move

Container

Secondary Storage :

  • Tape Pools

  • Cloud Pools

  • Nas Pools

Copy / Move

Restore Source

Destination

Type of action Mover

Tape Pools

  • Container (cache)

  • Primary Storage (NAS or Object Storage)

Copy / Move

Cloud Pools

  • Container (cache)

  • Primary Storage (NAS or Object Storage)

  • Cloud Pool

Copy / Move

Nas Pools

  • Container (cache)

  • Primary Storage (NAS or Object Storage)

  • Nas Pool

Copy / Move

Task

  • Container (cache)

  • Primary Storage (NAS or Object Storage)

Copy / Move

From Reference File

  • Container (cache)

  • Primary Storage (NAS or Object Storage)

Copy / Move

Data Archiving / Active Archive

Before to use this workflow, make sure to configure the container and cache. Learn more to Container configuration section

Definition

This makes it possible to archive a collection of data that can be moved from an expensive primary storage tier to a secondary storage tier. The data may or may not be removed from primary storage and must remain accessible from time to time. Data archiving allows data to be stored that does not require intensive reading and writing, but can be modified or read from time to time.

Why to use this workflow?

Data is stored on less expensive storage media, such as object storage, tape storage or even low-cost disks. An active archive includes functionality to seamlessly move data between different storage tiers (disk - tape - cloud) so that applications or users can access it directly.

Scan an LTFS Media

This workflow makes it possible to re-import tapes that have already been written.

To import LTFS Tapes into Nodeum, follow these steps :

Add the LTFS TAPE 000001L6 in the tape library connected to Nodeum

Define a workflow to scan the LTFS TAPE and then execute it

  • Select Scan an LTFS Media

  • Select as the source the tape need to scan "Tape “000001L6"

  • Launch the task

Get the result after the task execution

  • Data are indexed and recognized by Nodeum without reading the complete tape

  • Metadata are injected in the catalog

  • End user can see and retrieve easily the contents (files, images, video)

  • End user accesses contents straight away; no need to make new set of tapes

Task Monitoring

To aid in monitoring task execution, the Console offers a comprehensive monitoring feature. This feature provides a global overview of all task activities.

Three different sections are available :

Upcoming task

This section shows the task(s) scheduled. For each task, you can see detailed information including the date - time when the task will be executed.

It is possible to skip an execution in clicking in the right cross icon.

If a task hasn't been executed properly, then you will an information saying that "task execution missed for one or multiple occurence".

Running task

This section provides the list of the task(s) which are currently running.

For each of these tasks, you can

  1. See the detail and the status.

  2. Pause the task execution.

  3. Resume a paused task .

  4. Stop the task execution

History

In this section you can find all the tasks that have been completed.

Task Report

For each task running or finished, you can open to see the global view about the task.

To see the full informations click on the arrow beside the task:

And have a look on the task information:

Definitions of task informations :

InformationsDefinition

Timing

  1. Task starts the x date and at x hours

  2. Elapsed time for the task

  3. Estimated remaining time to process the task

Type

  1. Offline Archive

  2. Active Archive

  3. Data Exchange

Move or Copy to a destination:

Processed size

size of data processed

Processed items

Number of items of data processed

To see the good process click on the tab processed items*

Logs

Details of task's log

Each task report contains all files processed during the task, a downloaded copy can be exported.

Last updated