23 docs tagged with "spark"

Control how a pipeline behaves during execution

Using Spark with Prophecy's Data Transformation Copilot

How to create Databricks Spark connection in Prophecy Managed Airflow fabric

How to enable Pipeline Monitoring for Spark

Event-based Source and Target Gems for Streaming Data Applications

Execution Metrics

Execution on Databricks clusters

Execution on Livy

Expression Builder

File-based Source and Target gems for Streaming Data Applications

Run a pipeline interactively in the pipeline canvas

About Pipeline Monitoring for Spark

Control how your pipeline runs

Secret Management for Spark Fabrics

Prophecy Spark Gems

Follow along in the product to make your first Spark pipeline

Getting started with Spark on Databricks

Spark Streaming with Prophecy's easy-to-use interface

Implementing unit tests in Prophecy

Upload files to your Spark pipeline

Databricks secrets for username and passwords

How to use Pipeline Monitoring for Spark

Warehouse-based Source gem for Streaming Data Applications