Set up Spark fabrics
A fabric is a logical execution environment. Teams can organize their data engineering into multiple environments such as development, staging, and production.
When you connect to a fabric, Prophecy has the same level of access as the user authenticated for that fabric. Therefore, if you need to do something like create a cluster in Prophecy, you will first need the permission to create clusters in your respective execution environment.
📄️ Prophecy-managed
Configuring Prophecy Managed Databricks Fabric
🗃️ Databricks
1 items
📄️ Livy
Configuring Livy fabrics
📄️ Amazon EMR
This page outlines how to use Amazon EMR via Livy as your Spark execution engine in Prophecy.
📄️ Azure Synapse Analytics
Configuring Synapse Fabric
🗃️ Google Cloud Dataproc
1 items
📄️ Diagnostics
Troubleshooting fabrics using diagnostics
📄️ Set up Spark fabrics
Connect Prophecy to an external execution engine