Release notes 2023

December 2023

• 3.2.7.* (December 26, 2023)
  • Features
• 3.2.6.* (December 18, 2023)
  • Features
    • Gem Dependencies
    • Build Template configurable by Admin
    • Minor Improvements

November 2023

• 3.2.5.* (November 28, 2023)
  • Features
    • Low Code Airflow Enhancements
    • Release enhancements
    • Data Explorer for Spark

October 2023

• 3.2.3.* (October 31, 2023)
  • Features
    • Export and Execute Pipeline Code in Databricks Notebooks
    • Config Variable Value Updates in Scala
• 3.2.1.* (October 10, 2023)
  • Features
    • Advance Settings for Releases and Deployments

September 2023

• 3.2.0.* (September 14, 2023)
  • Features
    • Introducing Package Hub
    • Knowledge Graph - Connectors
    • Copilot 2.0
    • DataProc fabric
    • DLT Support in SQL
    • Guided private deployment
  • Minor Improvements

August 2023

• 3.1.4.* (August 11, 2023)
  • Features
    • Synapse Fabric
    • EMR support for Low code Orchestration
• 3.1.3.* (August 3, 2023)
  • Features
    • EMR Fabric
  • Minor Improvements
    • Low code SQL Improvements
    • Low code Spark Improvements
    • Other Minor Improvements

July 2023

• 3.1.2.* (July 26, 2023)
  • Features
    • Livy Fabric Users can now enable Execution Metrics
    • Users can now select all-purpose Databricks clusters for testing their Jobs
  • Minor Improvements
    • Low code Airflow Enhancements
    • Low code SQL Enhancements
    • Low code Spark Enhancements
• 3.1.1.* (July 6, 2023)
  • Features
    • Conditional Execution In Spark Pipelines
    • Revamped Prophecy Fabrics UI
    • New Features in Low Code Airflow
  • Minor Improvements
    • Ability to Attach Cluster to multiple Pipelines for Interactive Run
    • Alert and warning diagnostics for Users passing plain-text Username password in gems
    • Improved Entity Discovery on Info Pages

June 2023

• 3.1.0.* (June 22, 2023)
  • Features
    • Data Copilot
    • Generative-AI
    • General Availability Announcement: Low Code Airflow
    • Data Explorer For SQL
    • DLT Jobs Support
  • Minor Improvements
    • PingID and AAD
    • Config Package Name support in pipelines
    • Other Minor Improvements
• 3.0.2.* (June 02, 2023)
  • Minor Improvements
    • EMR Support (Beta)
    • Databricks support enhancements

May 2023

• 3.0.1.* (May 17, 2023)
  • Minor Improvements
    • Job filter support in PBT
    • Gem updates
    • Group select gems to batch changes like phase
    • Ability to add comments on gems in UI
    • UX update on Merge conflict resolution screens
    • Added warning before deleting branch from local and remote
    • Support for Unit tests with Lookups through PBT

April 2023

• 3.0.0.* (Apr 26, 2023)
  • Features
    • Low-Code SQL
    • Expression Builder
    • Airflow (Beta)
  • Improvements
    • Support for Databricks ACL
    • New UI for Source/Target gems
    • New Data Observability Page
    • Attach a cluster and run from the gem

March 2023

• 2.10.0.* (Mar 31, 2023)
  • Improvements
    • Search box on available clusters
    • Performance Improvements for Projects with large Number of Entities
    • Datasets improvements
    • Warning when deleting Teams
• 2.9.0.* (Mar 24, 2023)
  • Features
    • Sharable Subgraphs and UDFs
    • Ability to commit and Release from the pipeline page
  • Improvements
    • Ability to rename a cluster while attaching
    • Checkout remote branches
    • Open Project lineage view
    • Cluster auto-attach behavior
    • Control Data Sampling behavior for Configured Pipelines

February 2023

• 2.8.0.* (February 28, 2023)
  • Features
    • A team is not required during sign-up
    • Added support for Identity provider initiated SSO
    • Sorting columns on Metadata tables
    • Cluster consistency
    • Link to Databricks Workflow in Released Prophecy Jobs
    • Create Pipelines and Jobs directly from Project Browser
    • Alert user on Databricks Token Expiry
  • Improvements
    • Allow Run on main branch
    • Cluster restart after setting dependencies
• 2.7.0.* (February 16, 2023)
  • Behavior Changes
    • Spark and Scala Versions are now Required in Livy Fabrics
  • New Features
    • Kafka and Watermarking support (Beta)
    • Data Fabric ACL
    • Ticketing Support
  • UX Improvements
    • Auto Connect gems and Auto suggest on Drag and drop
    • Zoom-in And Zoom-out
    • Gem Sorting
    • Dangling interims
  • Improvements
    • Project creation on protected main branches
    • Disconnection Error handling
    • Copy pasting gems in pipeline editor
• 2.6.0.* (February 3 2023)
  • New Features
    • GCP Support
    • Interims for Unity Catalog Workspaces
    • Team-level execution metrics
    • Seamless Git Integration with stored credentials
    • Streaming Pipeline Support (Beta)
  • Updates
    • Union By Name
  • Improvements
    • Python code generation taking long time
    • Blocked log4j dependency