gcp-pipeline-resource-provisioning
Automates declarative resource creation and provisioning for data pipelines, supporting BigQuery, Dataform, Dataproc, BigQuery Data Transfer Service (DTS), and other resources. It manages environment-specific configurations (dev, staging, prod) through a deployment.yaml file.
Use when:
- Modifying or creating deployment.yaml for deployment settings.
- Resolving environment-specific variables (e.g., Project IDs, Regions) for deployment.
- Provisioning supported infrastructure like BigQuery datasets/tables, Dataform resources, or DTS resources via deployment.yaml.
Do not use when:
- Resources already exist.
- Managing resources not supported by gcloud beta orchestration-pipelines resource-types list.
- Managing general cloud infrastructure (VMs, networks, Kubernetes, IAM policies), which are better suited for Terraform.
- Infrastructure spans multiple cloud providers (AWS, Azure, etc.).
- Already uses Terraform for the target resources.
- Version
- v1
- License
- Apache-2.0
Pinned to revision db28b191f5db, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/gcp-pipeline-resource-provisioning/SKILL.md
- skills/gcp-pipeline-resource-provisioning/references/gcp_pipeline_resource_provisioning_spec.md
Every link opens the file at its source, pinned to the revision this page describes.