Prophecy fabrics
Prophecy fabrics provide a unified environment for executing SQL pipelines. They combine a primary SQL warehouse with Prophecy’s runtime orchestration to simplify pipeline execution and data movement.
Fabric architecture
Prophecy fabrics consist of two main components:
-
Primary SQL Warehouse
Your main SQL environment, which includes data storage and compute capacity to execute SQL queries generated by your pipeline. A primary warehouse connection is required for every Prophecy fabric. You can connect to secondary warehouses for data ingress and egress, but you won't be able to use those warehouses' compute.
-
Prophecy Automate
Prophecy’s orchestration layer. Handles pipeline execution triggering, scheduling, and movement of data between external systems and the SQL warehouse. External systems include Salesforce, Tableau, SFTP, S3, Oracle, and more. For the full list, visit Connections.
Fabric provisioning
Prophecy fabrics are provisioned differently depending on your Prophecy edition:
| Edition | Description |
|---|---|
| Free & Professional Editions | Each user automatically receives a personal fabric that is linked to their team. These fabrics run on Prophecy In Memory, and all execution is fully managed by Prophecy. Usage is billed in credits. |
| Express Edition | Users create fabrics manually and connect them to their own Databricks SQL warehouse. Prophecy Automate is included, while Databricks costs are managed separately by the user. |
| Enterprise Edition | Users create fabrics manually and can connect to any external SQL engine supported by Prophecy, including Databricks SQL warehouse and BigQuery. Prophecy Automate is included, and warehouse costs are managed separately by the user. |
Supported primary SQL warehouses
Prophecy fabrics can be connected to one of several primary SQL warehouses. The warehouse you choose provides the compute and determines the SQL dialect for all pipelines in the fabric.
-
Prophecy In Memory
Exclusive to Free and Professional Editions. This warehouse is fully managed by Prophecy and powered by DuckDB. All pipeline transformations execute using the DuckDB SQL dialect.
-
Databricks SQL
Supported in Express and Enterprise Editions. Connect your own Databricks SQL warehouse to run pipeline transformations.
-
Google BigQuery
Supported in Enterprise Edition. Connect to your BigQuery environment to run pipeline transformations.
What's next
To learn how to create a new fabric, visit Create a Prophecy fabric.
Free and Professional Editions do not support creating new fabrics.