Triggers

Related topics

• Managed Service for Apache Airflow is an alternative to Triggers From the official documentation: “Cloud Data Fusion recommends using Managed Airflow to orchestrate pipelines. If you require a simpler way to manage orchestration, use triggers.”
• Triggers is part of Application Integration From the official documentation: “Understand triggers and learn about the different triggers available in Application Integration.”
• Triggers is part of Cloud Data Fusion From the official documentation: “Cloud Data Fusion triggers let you automatically execute a downstream pipeline upon the completion (success, failure, or any specified condition) of one or more upstream pipelines.”
• Cloud Data Fusion works with Managed Service for Apache Spark From the official documentation: “Deployed Cloud Data Fusion pipelines run on Managed Service for Apache Spark clusters by default.”
• Managed Service for Apache Airflow works with Secret Manager From the official documentation: “You can [configure Secret Manager](/composer/docs/composer-3/configure-secret-manager) as your Airflow secrets backend.”
• Cloud Logging works with Cloud Monitoring From the official documentation: “You can store and view query-response activity logs in Cloud Logging and set up logs-based monitoring by using Cloud Monitoring.”
• VPC Service Controls secures Managed Service for Apache Airflow From the official documentation: “Managed Airflow can be selected as a secured service inside a VPC Service Controls perimeter.”
• Cloud Data Fusion works with Cloud Logging From the official documentation: “To use Cloud Logging with your Cloud Data Fusion pipeline, create a Cloud Data Fusion instance with Cloud Logging enabled:”
• Cloud Data Fusion works with Managed Service for Apache Airflow From the official documentation: “Recommended: You can also use Composer to orchestrate pipelines in Cloud Data Fusion.”
• Cloud Monitoring works with Managed Service for Apache Airflow From the official documentation: “To learn about Cloud Logging and Cloud Monitoring for your Managed Airflow environment, see [Monitor environments](/composer/docs/composer-2/monitor-environments).”
• Identity and Access Management secures Secret Manager From the official documentation: “Secret Manager uses Identity and Access Management (IAM) for authorization.”
• Identity and Access Management works with VPC Service Controls From the official documentation: “VPC Service Controls perimeters and Identity and Access Management (IAM) roles work together.”
• Managed Service for Apache Airflow works with Managed Service for Apache Spark From the official documentation: “This tutorial shows how to use Managed Service for Apache Airflow to create an [Apache Airflow](http://airflow.apache.org) DAG (Directed Acyclic Graph) that runs an Apache Hadoop wordcount job on a Managed Service for Apache Spark cluster.”
• Application Integration works with Cloud Logging From the official documentation: “To store integration execution logs in Cloud Logging, you must first enable Cloud Logging for your integration.”
• Application Integration works with Cloud Monitoring From the official documentation: “Application Integration is synchronously [integrated](/monitoring/agent/integrations) with Cloud Monitoring.”
• Application Integration works with Secret Manager From the official documentation: “Yes, running an integration in Application Integration incurs charges for other Google Cloud resources used in the integration, such as Integration Connectors, Secret Manager, and Cloud Key Management Service.”
• Cloud Data Fusion works with Cloud Monitoring From the official documentation: “Filter and aggregate Cloud Data Fusion pipeline and instance metrics in Monitoring using [*metric* and *monitored-resource* labels](/monitoring/api/v3/metric-model#generic-label-info).”
• Cloud Data Fusion depends on Managed Service for Apache Spark From the official documentation: “Cloud Data Fusion uses Managed Service for Apache Spark as the execution environment for pipelines.”
• Cloud Data Fusion works with VPC Service Controls From the official documentation: “Using VPC Service Controls with Cloud Data Fusion”
• Cloud Logging is an alternative to Cloud Monitoring From the official documentation: “To see the status of your invalidation request or find a definitive list of recently submitted requests, you can use Cloud Logging or Cloud Monitoring.”
• Cloud Logging works with Managed Service for Apache Airflow From the official documentation: “To learn about Cloud Logging and Cloud Monitoring for your Managed Airflow environment, see [Monitor environments](/composer/docs/composer-2/monitor-environments).”
• Cloud Logging works with Managed Service for Apache Spark From the official documentation: “Enables (`true`) or disables (`false`) Managed Service for Apache Spark job driver logs in [Cloud Logging](/logging/docs).”
• Cloud Logging works with VPC Service Controls From the official documentation: “This page describes how you can find VPC Service Controls errors using Cloud Logging.”
• Cloud Monitoring works with Managed Service for Apache Spark From the official documentation: “Monitoring uses workload metadata and metrics to provide insights into the health and performance of Managed Service for Apache Spark workloads.”
• Cloud Monitoring works with VPC Service Controls From the official documentation: “Cloud Monitoring performs the VPC perimeter check when a project is *added* to a metrics scope:”
• Identity and Access Management secures Application Integration From the official documentation: “Application Integration uses Identity and Access Management (IAM) for authorization.”
• Identity and Access Management secures Cloud Data Fusion From the official documentation: “Cloud Data Fusion uses Identity and Access Management (IAM) for authorization.”
• Identity and Access Management secures Managed Service for Apache Airflow From the official documentation: “For access control, use Identity and Access Management and Managed Airflow [roles and permissions](/composer/docs/composer-2/access-control#user-account).”
• Managed Service for Apache Airflow works with VPC Service Controls From the official documentation: “By configuring your environment with VPC Service Controls, you can keep sensitive data private while taking advantage of the fully-managed workflow orchestration capabilities of Managed Airflow.”
• Managed Service for Apache Spark depends on Cloud Logging From the official documentation: “Managed Service for Apache Spark clusters require network connectivity to Google Cloud APIs and services, such as the Dataproc API, Cloud Storage, and Cloud Logging, and to user resources, such as data sources in other VPC networks or on-premises environments.”
• Managed Service for Apache Spark works with VPC Service Controls From the official documentation: “Consider the following strategies when you use VPC-SC networks with Managed Service for Apache Spark:”
• VPC Service Controls secures Application Integration From the official documentation: “VPC Service Controls lets you define a security perimeter around the Application Integration Google Cloud service.”
• VPC Service Controls secures Cloud Monitoring From the official documentation: “VPC Service Controls provides additional security for Cloud Monitoring to help mitigate the risk of data exfiltration.”
• VPC Service Controls secures Managed Service for Apache Spark From the official documentation: “In this example, a Managed Service for Apache Spark cluster is running in a project protected by VPC Service Controls.”
• VPC Service Controls secures Secret Manager From the official documentation: “In addition to IAM controls, you can limit access to the Secret Manager API with network-based controls by setting up a [VPC Service Controls perimeter](/vpc-service-controls/docs/overview) for your organization.”