> For the complete documentation index, see [llms.txt](https://docs.nodeum.io/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.nodeum.io/data-archiving/console/data-mover-management/filtering-basic-or-advanced.md). # Filtering (Basic or Advanced) Allows users to easily manage and organize their data movement workflows by filtering files based on specific criteria. Handle different time - date threshold in the filter module such as : creation date, last access date, ... Two different types of filtering are available: * basic mode * Advanced mode: it provides an embedded scripting editor. #### Based on File Name The file name and path can be used in the filtering module.

#### Based on File Extension

#### Based on File Size

#### Based on Boolean Operators Boolean operators are available. Default operator is inclusive OR, different operators can be set.

### **Basic Mode** This mode includes the capability to define expressions directly in the Console based on the following types:

Type of Filter	Operator	Description
Creation Date	Older Than Earlier Than Before After	Filter the selection on when the file has been created. It allows to select only files that have been created before or after a specific date.
File Name	Matches Doesn't Match	It allows to filter the selection based on the name of the file. Examples : '.' for any type of character '' from 0 to infinite Regex expressions are also supported.*
File extension	Equal Doesn't Match	It allows to filter your selection based on the file extension. File extension name has to be defined. Example: pdf
File Path	Matches Doesn't Match	It allows to filter your selection based on the folder(s) path. Regex expressions are also supported.
Last access date	Older Than Earlier Than Before After	Same but with a trigger on when the file has been accessed for the last time.
Last modification date	Older Than Earlier Than Before After	Filter the selection on when the file has been modified for the last time. It allows to select only files that have been modified before or after a specific date.
Size	More than Less than	Filter the file selection based on the files size

### **Advanced Mode** This mode allows the usage of an online scripting editor to define advances filter which cannot be defined in using the simple graphical mode. The scripting Language is "LUA" , which a known language , with online documentation available. The scripting language supports : * Logical Operator such as 'and' , 'or' * Defined Functions #### **Example of a LUA script** ```bash --[[ This function is auto-generated. By editing it, you might lose your filter configuration when going back to "Basic" mode --]] function test ( file ) return filter_size(file, ">", 2344000) or filter_name(file, "\\b(\\w*archive\\w*)\\b") or filter_path(file, "\\b(\\w*archive\\w*)\\b") or filter_relative_date(file, "C", ">", 20, "D") or filter_relative_date(file, "M", ">", 20, "D") or filter_relative_date(file, "A", "<", 20, "D") end ``` #### Standard filtering methods are available : **Filtering by the size of the file** **Example of LUA code** ```bash ... filter_size(file, ">", 2344000) .. ```

Result	The workflow will only process files with a size which is bigger than 234000KB
file	Match the process file
">"	Comparison symbol
234000	File size

**Filtering by the name of the file** **Example of LUA code** ```bash ... filter_path(file, "\\b(\\w*archive\\w*)\\b") .. ``` | **Results** | **The workflow will only process files which are located in folder with a name which contains "archive"** | | ------------------------------- | --------------------------------------------------------------------------------------------------------- | | file | Match the process file | | "\\\b(\\\w\*archive\\\w\*)\\\b" | Regex expression | **Filtering by the creation date** **Example of LUA code** ```bash ... filter_relative_date(file, "C", ">", 20, "D") ... ``` | **Result** | **The workflow will only process files with a creation date older or earlier than** | | ---------- | --------------------------------------------------------------------------------------- | | file | Match the process file | | "C" | Relative to the Creation Date | | ">" | ">", "<" are available for (older than, earlier than) | | 20 | Number of Year, Month, Day, Hour, Minute, Second | | "D" | "Y", "M", "D", "H", "M", "S" are available for (Year, Month, Day, Hour, Minute, Second) | **Filtering by the modification date** **Example of LUA code** ```bash ... filter_relative_date(file, "C", ">", 20, "M") ... ``` | **Result** | **The workflow will only process files with an access date older or earlier than** | | ---------- | --------------------------------------------------------------------------------------- | | file | Match the process file | | "C" | Relative to the Last Access Date | | ">" | ">", "<" are available for (older than, earlier than) | | 20 | Number of Year, Month, Day, Hour, Minute, Second | | "D" | "Y", "M", "D", "H", "M", "S" are available for (Year, Month, Day, Hour, Minute, Second) | Some addition information which can be helpful for using the feature : * LUA WebSite : * LUA Online Script validation * REGEX Online validation : --- # Agent Instructions This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com. ## Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.nodeum.io/data-archiving/console/data-mover-management/filtering-basic-or-advanced.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.