45 docs tagged with "gems"

Group data and apply aggregation methods or pivot operations

Avro

BigQuery

Compare columns between two dataframes

CosmosDB

CSV

DB2

Remove rows with duplicate values of specified columns

Delta

Delta Table

Filter your data based on a custom filter condition

Fixed Format

Flatten nested data

Transforming your data

Gems are data seeds, sources, transformations, and targets

Read from or write to Tables managed by a Hive metastore

Iceberg

JDBC

Join one or more DataFrames on conditions

JSON

Reading and writing data from Apache Kafka in batch mode

Limit the number of rows

Lookup

MongoDB

Oracle

ORC

Sort your data based on one or more Columns

Parquet

Redshift

Select one or more columns or values using expressions and functions.

Repartition or coalesce a DataFrame

Enrich DataFrame with content from rest API response based on configuration

Create multiple DataFrames based on filter conditions

Salesforce

Add, Edit, Rename or Drop Columns

Union, Intersect and Difference

Snowflake

Prophecy Streaming Gems

Create DataFrames based on custom SQL queries

Data transformation steps in SQL

Teradata

Text

Aggregate and transform Windowed data

Explore the basics of working with XLSX (Excel) files with Prophecy

XLSX (Excel)