You want to automate execution of a multi-step data pipeline running on Google Cloud. The pipeline includes Cloud Dataproc and Cloud Dataflow jobs that have multiple dependencies on each other. You want to use managed services where possible, and the pipeline will run every day. Which tool should you use?
A. cron
B. Cloud Composer Most Voted
C. Cloud Scheduler
D. Workflow Templates on Cloud Dataproc
You want to automate execution of a multi-step data pipeline running on Google Cloud. The pipeline includes Cloud Datapr
-
answerhappygod
- Site Admin
- Posts: 899604
- Joined: Mon Aug 02, 2021 8:13 am
You want to automate execution of a multi-step data pipeline running on Google Cloud. The pipeline includes Cloud Datapr
Join a community of subject matter experts. Register for FREE to view solutions, replies, and use search function. Request answer by replying!