You want to automate execution of a multi-step data pipeline running on Google Cloud. The pipeline includes Cloud Datapr
Posted: Mon Aug 01, 2022 9:51 am
You want to automate execution of a multi-step data pipeline running on Google Cloud. The pipeline includes Cloud Dataproc and Cloud Dataflow jobs that have multiple dependencies on each other. You want to use managed services where possible, and the pipeline will run every day. Which tool should you use?
A. cron
B. Cloud Composer Most Voted
C. Cloud Scheduler
D. Workflow Templates on Cloud Dataproc
A. cron
B. Cloud Composer Most Voted
C. Cloud Scheduler
D. Workflow Templates on Cloud Dataproc