OrderBy gem

ProphecySparkBasicsPython 0.0.1+ProphecySparkBasicsScala 0.0.1+UC Dedicated Cluster 14.3+UC Standard Cluster 14.3+Livy 3.0.1+

Sorts a DataFrame on one or more columns in ascending or descending order.

Parameters

Parameter	Description	Required
DataFrame	Input DataFrame to be sorted	True
Order columns	Columns to sort DataFrame by	True
Sort	Order of sorting - ascending or descending	True

Example

Spark Code

Python

def Sort(spark: SparkSession, in0: DataFrame) -> DataFrame:
    return in0.orderBy(col("name").asc(), col("updated_at").desc())

Scala

object Sort {
  def apply(spark: SparkSession, in: DataFrame): DataFrame =
    in.orderBy(col("updated_at").desc, col("name").asc)
}