Skip to main content

Script

Provides a SparkSession and allows you to run custom code

Parameters

ParameterMeaningRequired
Input DataFrame(s)Input DataFrame(s)False
Output DataFrame(s)Output DataFrame(s)False
CodeCustom code to be executedTrue
info

To remove input/output DataFrame(s), simply click icon on the left sidebar

Script - Remove inputs

Examples


Script Gem with Input and Output: Un-pivoting a DataFrame

We'll perform the unpivot operation using our custom code

Script - Unpivot


Script Gem with only Output: Generating a DataFrame

We'll use the provided SparkSession to create and return a DataFrame

note

Since we removed the input port, we don't see input DataFrame in the method signature

Script - Unpivot