Directory
List files and folders of a specified directory from a data ingress/egress connection.
Input and Output
The Directory gem does not accept any inputs.
The Directory gem produces one output. The output schema includes the following columns:
name: The name of the file.path: The full path to the file.size_in_bytes: The size of the file. Folders will be listed as0bytes.creation_time: The time that the file was created.modification_time: The time that the file was last modified.parent_directory: The parent directory of the file or folder.file_type: Whether the record listed is a file or a folder.
If a certain connection does not provide a certain field (for example, Databricks does not provide creation time), then the columns will be populated with zeroes or null values.
Parameters
Configure the Directory gem using the following parameters.
| Parameter | Description |
|---|---|
| Connection type | Data provider that you will connect to. See Supported connection types. |
| Select or create connection | New or existing connection to the provider you selected. |
| Path | Path to directory that you want to see the contents of. |
| Enable to include files/directories inside subfolders | Recursively traverse and include all files and directories within subdirectories of the specified path. |
| File pattern (Optional) | Narrow the results to only files or folders that match the regex pattern provided here. |
Supported connection types
You can use the Directory gem to list files and folders from the following connection types: