Build Shareable Datasets

Users can share a Dataset across their Pipelines, but use caution when sharing across Projects.

Across Pipelines

Once a User adds a new Dataset as a Source or Target in their Pipeline, that Dataset is immediately available to be used in all Pipelines of that project. A User can use that Dataset as a Source or Target in other pipelines. Once a Dataset is modified in one Pipeline, it gets modified in all the Pipelines using it (in that Project) automatically.

For example:

Across Projects

Datasets in Prophecy are pointers to actual data in your data storage solution. Prophecy doesn’t store any data, and we recommend not to treat Datasets in Packages as “data products.” That is, we recommend not to configure Datasets in a Package. Instead, leave Datasets configurable in the project where they are used. Importantly, access to the actual data remains dependent upon the user’s personal access token or username/password credential. To access the data in a new project, the user must select a Fabric with access permissions for that data.