Skip to main content

Build Shareable Subgraphs

Users can share published Subgraphs across their Pipelines and Projects. This allows central Data Platform teams to build reusable code to cover a wide variety of business needs, such as Encryption/Decryption or Identity Masking, and have their "consumers" (the Data Practitioners) take a dependency on that reusable code.

Configurable Subgraphs

User can add configuration variables to reusable Subgraphs and use these in the Gems of the Subgraph.

info

Please note only Subgraph Configs can be used inside a Subgraph. Pipeline config variables cannot be used in Gems inside a Subgraph. Similarly, Subgraph configs are not available to other outside gems of the Pipeline. These Subgraph configs can only be edited from inside the Subgraph.

Also, Subgraph configurations will be shown as part of Pipeline configs.

Please see this video for an example

Sharing Subgraphs Across Pipelines

Once a subgraph is published, the user can simply add it to any other Pipeline of the same Project. Please see this video for an example

Sharing Subgraphs Across Projects

Once a Project (let's call it BaseProject) is Released and added as a Dependency to another Project(let's call it AppProject), all Subgraphs from BaseProject are available in all Pipelines of AppProject.

Please see this video for an example