Apache Airflow

Related topics

• Managed Airflow depends on Apache Airflow From the official documentation: “Managed Airflow is built on the popular [Apache Airflow](https://airflow.apache.org) open source project and operates using the Python programming language.”
• Apache Airflow works with Cloud Composer From the official documentation: “Cloud Composer is a managed Apache Airflow service that helps you create, schedule, monitor and manage workflows.”
• Apache Airflow works with Managed Airflow From the official documentation: “Managed Airflow is built on the popular [Apache Airflow](https://airflow.apache.org) open source project and operates using the Python programming language.”
• Apache Airflow works with Managed Service for Apache Airflow From the official documentation: “It shows how to use Managed Airflow to create an [Apache Airflow](http://airflow.apache.org) DAG.”
• Dataflow works with Managed Service for Apache Airflow From the official documentation: “Launch Dataflow pipelines with Cloud Composer”
• Managed Service for Apache Airflow works with Secret Manager From the official documentation: “You can [configure Secret Manager](/composer/docs/composer-3/configure-secret-manager) as your Airflow secrets backend.”
• Cloud Monitoring depends on Application Default Credentials From the official documentation: “To authenticate to Monitoring, set up Application Default Credentials.”
• Application Default Credentials secures Dataflow From the official documentation: “To authenticate to Dataflow, set up Application Default Credentials.”
• Application Default Credentials works with Dataflow From the official documentation: “To authenticate to Dataflow, set up Application Default Credentials.”
• Application Default Credentials works with Secret Manager From the official documentation: “To authenticate to Secret Manager, set up Application Default Credentials.”
• Dataflow depends on Application Default Credentials From the official documentation: “To authenticate to Dataflow, set up Application Default Credentials.”
• VPC Service Controls secures Managed Service for Apache Airflow From the official documentation: “Managed Airflow can be selected as a secured service inside a VPC Service Controls perimeter.”
• Application Default Credentials secures Cloud Monitoring From the official documentation: “To authenticate to Monitoring, set up Application Default Credentials.”
• Application Default Credentials works with Cloud SQL From the official documentation: “Application Default Credentials are part of the client libraries you can use to access Cloud SQL.”
• Cloud Composer works with Secret Manager From the official documentation: “Once you configure Secret Manager for your Composer environment, you can store an SMTP password in Secret Manager:”
• Cloud Monitoring works with Cloud SQL From the official documentation: “You can also get more details by viewing the Cloud Monitoring logs for your Cloud SQL destination instance.”
• Cloud Monitoring works with Dataflow From the official documentation: “Dataflow is fully integrated with Cloud Monitoring.”
• Cloud Monitoring works with Managed Service for Apache Airflow From the official documentation: “To learn about Cloud Logging and Cloud Monitoring for your Managed Airflow environment, see [Monitor environments](/composer/docs/composer-2/monitor-environments).”
• Cloud SQL works with Secret Manager From the official documentation: “This page describes four use cases for using Secret Manager to manage secrets with Cloud SQL:”
• Managed Service for Apache Airflow depends on Cloud SQL From the official documentation: “Managed Airflow uses Cloud SQL to run Airflow database.”
• Secret Manager depends on Application Default Credentials From the official documentation: “To authenticate to Secret Manager, set up Application Default Credentials.”
• Secret Manager secures Cloud SQL From the official documentation: “Secret Manager provides centralized and secure storage of sensitive data such as Cloud SQL configuration.”
• Application Default Credentials secures Cloud Composer From the official documentation: “To authenticate to Managed Airflow, set up Application Default Credentials.”
• Application Default Credentials secures Managed Airflow From the official documentation: “To authenticate to Managed Airflow, set up Application Default Credentials. For more information, see [Set up authentication for a local development environment](/docs/authentication/set-up-adc-local-dev-environment).”
• Application Default Credentials secures Secret Manager From the official documentation: “To authenticate to Secret Manager, set up Application Default Credentials.”
• Cloud Composer depends on Application Default Credentials From the official documentation: “To authenticate to Managed Airflow, set up Application Default Credentials.”
• Cloud Composer depends on Cloud Monitoring From the official documentation: “Managed Airflow uses global endpoints for Cloud Monitoring (`monitoring.googleapis.com`) because some Monitoring APIs don't fully support regional endpoints.”
• Cloud Composer works with Cloud Monitoring From the official documentation: “You can use [Cloud Monitoring](/monitoring/docs) and [Cloud Logging](/logging/docs) with Managed Service for Apache Airflow.”
• Cloud Composer depends on Cloud SQL From the official documentation: “This parameter determines the machine type for the [Cloud SQL instance](/composer/pricing#db-machine-types) that runs the Airflow database. The default Cloud SQL machine type is `db-n1-standard-2`.”
• Cloud Composer works with VPC Service Controls From the official documentation: “- **VPC SC**: To deploy Managed Airflow environments inside a security perimeter, see [Configuring VPC SC](/composer/docs/composer-1/configure-vpc-sc). When used with Managed Airflow, VPC Service Controls have several [known…”
• Cloud Monitoring works with VPC Service Controls From the official documentation: “Cloud Monitoring performs the VPC perimeter check when a project is *added* to a metrics scope:”
• Cloud SQL works with Dataflow From the official documentation: “Use Datastream to replicate changes from your MySQL instance to either BigQuery or Cloud Storage, and then use Dataflow or Managed Service for Apache Spark to bring the data into your Cloud SQL instance.”
• Cloud SQL works with Managed Service for Apache Airflow From the official documentation: “For Private IP environments, Managed Airflow assigns only private IP ([RFC 1918](https://www.ietf.org/rfc/rfc1918.txt)) addresses to the managed Google Kubernetes Engine and Cloud SQL VMs in your environment.”
• Cloud SQL works with VPC Service Controls From the official documentation: “Make sure that you configure VPC Service Controls so that the project that hosts the CA Service CA pool and CA<br>and the project that hosts Cloud SQL belong to the same service perimeter.”
• Dataflow works with Managed Airflow From the official documentation: “The data ingestion process uses Managed Airflow and Dataflow to orchestrate the movement and transformation of data within the data domain.”
• Dataflow works with VPC Service Controls From the official documentation: “To customize DNS resolution when using Dataflow with VPC Service Controls, use Cloud DNS [private zones](/dns/docs/overview#dns-private-zones) instead of using custom BIND servers.”
• Managed Airflow depends on Application Default Credentials From the official documentation: “To authenticate to Managed Airflow, set up Application Default Credentials.”
• Managed Service for Apache Airflow works with VPC Service Controls From the official documentation: “By configuring your environment with VPC Service Controls, you can keep sensitive data private while taking advantage of the fully-managed workflow orchestration capabilities of Managed Airflow.”
• VPC Service Controls secures Cloud Composer From the official documentation: “If you want to protect your environment with VPC Service Controls, then make sure that both host and service projects are located in the same service perimeter For more information, see [Perimeters for environments with Shared VPC and…”
• VPC Service Controls secures Cloud Monitoring From the official documentation: “VPC Service Controls provides additional security for Cloud Monitoring to help mitigate the risk of data exfiltration.”
• VPC Service Controls configures Cloud SQL From the official documentation: “This page describes how to enable VPC Service Controls on a Cloud SQL project.”
• VPC Service Controls secures Dataflow From the official documentation: “Dataflow VPC Service Controls help protect against accidental or targeted action by external entities or by insider entities, which helps to minimize unwarranted data exfiltration risks.”
• VPC Service Controls secures Secret Manager From the official documentation: “In addition to IAM controls, you can limit access to the Secret Manager API with network-based controls by setting up a [VPC Service Controls perimeter](/vpc-service-controls/docs/overview) for your organization.”