21 docs tagged with "spark"

Control how a pipeline behaves during execution

Use Copilot to develop and explain your Spark pipelines

Get started with Prophecy via Databricks Partner Connect

How to create Databricks Spark connection in Prophecy Managed Airflow fabric

How to enable Pipeline Monitoring for Spark

Event-based Source and Target Gems for Streaming Data Applications

Execution Metrics

Expression Builder

File-based Source and Target gems for Streaming Data Applications

Prophecy Spark Gems

Using Spark with Prophecy's Data Transformation Copilot

About Pipeline Monitoring for Spark

Control how your pipeline runs

Getting started with Spark on Databricks

Create a Spark pipeline with Prophecy's visual interface

Store secrets in pipeline config

Spark Streaming with Prophecy's easy-to-use interface

Implementing unit tests in Prophecy

Learn how to upload files to your Spark pipeline

How to use Pipeline Monitoring for Spark

Warehouse-based Source gem for Streaming Data Applications