Transform

The following list constitutes the set of gems that help with transforming data.

Aggregate

Group data and apply aggregation methods or pivot operations

Change the data type of multiple columns at once

Rename multiple columns in your dataset in a systematic way

Parse XML or JSON inside a table

Standardize data formats and address missing or null values in the data

Ensure your data adhere to predefined constraints

Remove rows with duplicate values of specified columns

Dynamically generate values depending on certain conditions

Dynamically filter columns of your dataset based on a set of conditions

Filter your data based on a custom filter condition

Flatten nested data

Identify non-identical duplicates in your data

Limit the number of rows

Sort your data based on one or more columns

Select one or more columns or values using expressions and functions

Sample records by choosing a specific number or percentage of records

Add, Edit, Rename or Drop Columns

Union, Intersect and Difference

Use the Unpivot gem to transform your data from a wide format to a long format

Aggregate and transform Windowed data