Concepts

There are a few core concepts you need to be familiar with to get started with Prophecy.

Term	Description
Fabric	Connection to an execution environment for building and running pipelines.
Project	Collection of components like Pipelines, Models, and Datasets stored in a Git repository.
Pipeline	Sequence of steps using Spark-native code for data transformations. They can be viewed in a visual or code format.
Model	Sequence of steps to perform SQL-based transformations. They can be viewed in a visual or code format.
Dataset	Structured collection of data, defined by type, location, and properties.
Gem	Reusable component in a Pipeline that performs a specific data operation.
Job	Scheduled task or execution of a Pipeline, Model, or script.