CSV
Read or write a CSV file from an external connection.
info
You can also use the upload file feature to use CSV files. These will be stored in the SQL warehouse configured in your fabric.
Supported connections
Parameters
| Parameter | Tab | Description |
|---|---|---|
| Connection type | Type | Location you want to connect from. |
| Format type | Source location | Format of the gem. In this case, csv. |
| Select or create connection | Source location | Whether to select an existing connection, or to create a new one. |
| Filepath | Source location | File path where you want to read and write files according to the connection type. |
| Properties | Properties | Optional table properties to apply. Source and target properties are outlined below. |
| Schema | Properties | Schema definition of the table (custom or inferred). |
Source properties
| Property | Description | Default |
|---|---|---|
| Description | Description of the table. | None |
| Separator | Character used to separate values in the CSV file. | , |
| Header | Whether the first row is the column header. | True |
| Null Value | String that represents a null or missing value in the CSV. | None |
| Comment Character | Character used to denote lines in the file that should be treated as comments. | None |
| Inference Data Sampling Limit | Maximum number of rows to sample for inferring the schema. | 0 |
Target properties
| Property | Description | Default |
|---|---|---|
| Description | Description of the table. | None |
| Separator | Character used to separate values in the CSV file. | , |
| Header | Whether to make the first row the column header. | True |
| Null Value | String that represents a null or missing value in the CSV. | None |
| Use CRLF as line separator | If enabled, lines in the CSV will end with \r\n (Windows-style newlines). | None |