Build and operate the data processing systems behind analytics and ML on Google Cloud, including BigQuery, Dataflow, and Pub/Sub, and track your readiness for the Professional Data Engineer exam.
Advanced
Prepare and test your skills
Advanced
Prepare and test your skills
Google Cloud service
Workflows
Topic in 11 exam domains
- Workflows · Service · Google Cloud service
- workflows · Feature · Gemini Enterprise web app
- workflows · Concept · Gemini Enterprise
Also called: Cloud Workflow, Enable workflows, Google Cloud Workflows, Workflows API, Workflows service
An orchestration service that allows defining workflows to connect Google Cloud products and external APIs.
Where this appears on the exam
6 objectives in 3 of 5 domains
Related topics
FoundationsThis topicWorks alongsideApplication Default CredentialsFeatureVPC Service ControlsServiceIdentity and Access ManagementServicePub/SubServiceCloud Run functionsServiceSecret ManagerServiceCloud StorageServiceCloud MonitoringServiceBigQueryService
WorkflowsService
Cloud KMSServiceDataflowServiceCloud RunServiceCloud SchedulerServiceManaged Service for Apache AirflowServiceCloud SQLServiceEventarcServiceIdentity-Aware ProxyServiceGKEServicePoints to what builds on itWorks with or alternative toHover or tap a line to see what connects the two
- Eventarc works with Workflows From the official documentation: “Route Eventarc events to Workflows”
- Application Default Credentials works with Workflows From the official documentation: “To authenticate to Workflows, set up Application Default Credentials.”
- Cloud Run works with Workflows From the official documentation: “Route Workflows events to Cloud Run”
- Cloud Scheduler works with Workflows From the official documentation: “Manage Workflows with optional Cloud Scheduler or Eventarc triggers”
- Cloud Run functions works with Workflows From the official documentation: “Use Workflows with Cloud Run and Cloud Run functions tutorial”
- Pub/Sub works with Workflows From the official documentation: “Route Cloud Pub/Sub events to Workflows”
- Secret Manager works with Workflows From the official documentation: “You can use a Workflows connector to access Secret Manager within a workflow.”
- BigQuery works with Workflows From the official documentation: “To learn more about using Workflows with BigQuery, see [Run multiple BigQuery jobs in parallel](/workflows/docs/tutorials/bigquery-parallel-jobs).”
- Cloud KMS works with Workflows From the official documentation: “You might encounter errors when using Cloud KMS with Workflows.”
- Identity and Access Management secures Workflows From the official documentation: “This page describes the Identity and Access Management (IAM) roles and permissions available to control access to Workflows resources.”
- Identity-Aware Proxy works with Workflows From the official documentation: “You can use Workflows to invoke an endpoint for which Identity-Aware Proxy (IAP) has been enabled.”
- VPC Service Controls works with Workflows From the official documentation: “You can use VPC Service Controls with Workflows to help protect your services.”
- Workflows depends on Application Default Credentials From the official documentation: “To authenticate to Workflows, set up Application Default Credentials.”
- Application Default Credentials secures Workflows From the official documentation: “To authenticate to Workflows, set up Application Default Credentials.”
- Cloud Monitoring works with Workflows From the official documentation: “Use [Monitoring](/monitoring/docs) to get visibility into the performance, uptime, and overall health of your workflows.”
- Cloud Storage works with Workflows From the official documentation: “Route Cloud Storage events to Workflows”
- Dataflow works with Workflows From the official documentation: “Route Dataflow events to Workflows”
- GKE works with Workflows From the official documentation: “Route Workflows events to GKE”
- Identity and Access Management works with Workflows From the official documentation: “Workflows manages access and authentication using Identity and Access Management (IAM) roles and permissions.”
- Managed Service for Apache Airflow is an alternative to Workflows From the official documentation: “Both [Workflows](/workflows/docs/overview) and [Managed Service for Apache Airflow](/composer/docs/concepts/overview) can be used for service orchestration to combine services to implement application functionality or perform data processing.”
- Workflows depends on Identity and Access Management From the official documentation: “Workflows uses [IAM](/iam/docs/overview) for access control.”
- Application Default Credentials works with Cloud Storage From the official documentation: “To authenticate to Cloud Storage, set up Application Default Credentials.”
- Application Default Credentials secures BigQuery From the official documentation: “To authenticate to BigQuery, set up Application Default Credentials.”
- BigQuery depends on Application Default Credentials From the official documentation: “To authenticate to BigQuery, set up Application Default Credentials.”
- Dataflow depends on Application Default Credentials From the official documentation: “To authenticate to Dataflow, set up Application Default Credentials.”
- Application Default Credentials works with Pub/Sub From the official documentation: “To authenticate to Pub/Sub, set up Application Default Credentials.”
- BigQuery is an alternative to Cloud Storage From the official documentation: “The `import_result_sink` must be a Cloud Storage path or a BigQuery table.”
- BigQuery works with Cloud Storage From the official documentation: “External BigQuery data source backed by Cloud Storage”
- Application Default Credentials works with BigQuery From the official documentation: “Create a BigQuery client using application default credentials.”
- Application Default Credentials secures Pub/Sub From the official documentation: “To authenticate to Pub/Sub, set up Application Default Credentials.”
- Pub/Sub depends on Application Default Credentials From the official documentation: “To authenticate to Pub/Sub, set up Application Default Credentials.”
- Application Default Credentials works with Secret Manager From the official documentation: “To authenticate to Secret Manager, set up Application Default Credentials.”
- BigQuery works with Dataflow From the official documentation: “Read from BigQuery to Dataflow”
- BigQuery works with Cloud SQL From the official documentation: “Add credentials to connect BigQuery to Cloud SQL.”
- Cloud Run works with Cloud SQL From the official documentation: “Learn how to connect to Cloud SQL from Cloud Run”
- Application Default Credentials works with Dataflow From the official documentation: “To authenticate to Dataflow, set up Application Default Credentials.”
- VPC Service Controls secures BigQuery From the official documentation: “BigQuery data is protected with VPC Service Controls”
- Application Default Credentials secures Cloud Storage From the official documentation: “To authenticate to Cloud Storage, set up Application Default Credentials.”
- Cloud Storage depends on Application Default Credentials From the official documentation: “To authenticate to Cloud Storage, set up Application Default Credentials.”
- Cloud SQL works with Cloud Storage From the official documentation: “When ingesting data from Cloud SQL, data is first staged to a Cloud Storage bucket.”
- BigQuery works with Cloud Monitoring From the official documentation: “You can use Monitoring to export your metrics to BigQuery.”
- Cloud Run works with Cloud Scheduler From the official documentation: “Create a Cloud Scheduler job that triggers the Cloud Run service daily.”
- Cloud Run works with Pub/Sub From the official documentation: “Route Cloud Pub/Sub events to Cloud Run”
- Cloud Run works with Eventarc From the official documentation: “Route Eventarc events to Cloud Run”
- Dataflow works with Pub/Sub From the official documentation: “Pub/Sub notifies Dataflow about the upload.”
- Application Default Credentials works with Cloud KMS From the official documentation: “To authenticate to Cloud KMS, set up Application Default Credentials.”
- Cloud Run works with Cloud Storage From the official documentation: “Route Cloud Storage events to Cloud Run”
- Cloud Run works with Secret Manager From the official documentation: “You can integrate Secret Manager with other Google Cloud products such as Cloud Run.”
- Managed Service for Apache Airflow works with Secret Manager From the official documentation: “You can [configure Secret Manager](/composer/docs/composer-3/configure-secret-manager) as your Airflow secrets backend.”
- Application Default Credentials works with Cloud Run functions From the official documentation: “To authenticate to Cloud Run functions, set up Application Default Credentials.”
- Cloud Run functions depends on Application Default Credentials From the official documentation: “To authenticate to Cloud Run functions, set up Application Default Credentials.”
- Pub/Sub works with Secret Manager From the official documentation: “Receive notifications via Pub/Sub when Secret Manager resources change.”
- BigQuery is an alternative to Pub/Sub From the official documentation: “To keep audit logs for a longer period of time or to use more powerful search capabilities, you can route copies of your audit logs to Cloud Storage, BigQuery, or Pub/Sub.”
- Cloud KMS depends on Application Default Credentials From the official documentation: “To authenticate to Cloud KMS, set up Application Default Credentials.”
- Cloud Run functions works with Cloud Scheduler From the official documentation: “Create a Cloud Scheduler job to trigger the Cloud Run function on a regular schedule.”
- Cloud Run functions works with Cloud Storage From the official documentation: “Set up functions in response to events in Cloud Storage:”
- Secret Manager depends on Application Default Credentials From the official documentation: “To authenticate to Secret Manager, set up Application Default Credentials.”
- BigQuery works with Cloud Run functions From the official documentation: “BigQuery supports external function calls through Cloud Run functions.”
- Cloud Monitoring depends on Application Default Credentials From the official documentation: “To authenticate to Monitoring, set up Application Default Credentials.”
- Cloud Monitoring works with Cloud SQL From the official documentation: “You can also get more details by viewing the Cloud Monitoring logs for your Cloud SQL destination instance.”
How learners score on this topic
Last updated