Release notes 2023
December 2023
November 2023
October 2023
September 2023
August 2023
July 2023
- 3.1.2.* (July 26, 2023)
- Features
- Livy Fabric Users can now enable Execution Metrics
- Users can now select all-purpose Databricks clusters for testing their Jobs
- Minor Improvements
- Low code Airflow Enhancements
- Low code SQL Enhancements
- Low code Spark Enhancements
- 3.1.1.* (July 6, 2023)
- Features
- Conditional Execution In Spark Pipelines
- Revamped Prophecy Fabrics UI
- New Features in Low Code Airflow
- Minor Improvements
- Ability to Attach Cluster to multiple Pipelines for Interactive Run
- Alert and warning diagnostics for Users passing plain-text Username password in Gems
- Improved Entity Discovery on Info Pages
June 2023
- 3.1.0.* (June 22, 2023)
- Features
- Data Copilot
- Generative-AI
- General Availability Announcement: Low Code Airflow
- Data Explorer For SQL
- DLT Jobs Support
- Minor Improvements
- PingID and AAD
- Config Package Name support in Pipelines
- Other Minor Improvements
- 3.0.2.* (June 02, 2023)
- Minor Improvements
- EMR Support (Beta)
- Databricks support enhancements
May 2023
- 3.0.1.* (May 17, 2023)
- Minor Improvements
- Job filter support in PBT
- Gem updates
- Group select gems to batch changes like phase
- Ability to add comments on Gems in UI
- UX update on Merge conflict resolution screens
- Added warning before deleting branch from local and remote
- Support for Unit tests with Lookups through PBT
April 2023
March 2023
- 2.10.0.* (Mar 31, 2023)
- Improvements
- Search box on available clusters
- Performance Improvements for Projects with large Number of Entities
- Datasets improvements
- Warning when deleting Teams
- 2.9.0.* (Mar 24, 2023)
- Features
- Sharable Subgraphs and UDFs
- Ability to commit and Release from the Pipeline page
- Improvements
- Ability to rename a cluster while attaching
- Checkout remote branches
- Open Project lineage view
- Cluster auto-attach behavior
- Control Data Sampling behavior for Configured Pipelines
February 2023
- 2.8.0.* (February 28, 2023)
- Features
- A team is not required during sign-up
- Added support for Identity provider initiated SSO
- Sorting columns on Metadata tables
- Cluster consistency
- Link to Databricks Workflow in Released Prophecy Jobs
- Create Pipelines and Jobs directly from Project Browser
- Alert user on Databricks Token Expiry
- Improvements
- Allow Run on main branch
- Cluster restart after setting dependencies
- 2.7.0.* (February 16, 2023)
- Behavior Changes
- Spark and Scala Versions are now Required in Livy Fabrics
- New Features
- Kafka and Watermarking support (<em>Beta</em>)
- Data Fabric ACL
- Ticketing Support
- UX Improvements
- Auto Connect Gems and Auto suggest on Drag and drop
- Zoom-in And Zoom-out
- Gem Sorting
- Dangling interims
- Improvements
- Project creation on protected main branches
- Disconnection Error handling
- Copy pasting Gem in Pipeline editor
- 2.6.0.* (February 3 2023)
- New Features
- GCP Support
- Interims for Unity Catalog Workspaces
- Team-level execution metrics
- Seamless Git Integration with stored credentials
- Streaming Pipeline Support (<em>Beta</em>)
- Updates
- Union By Name
- Improvements
- Python code generation taking long time
- Blocked log4j dependency