Build and operate the data processing systems behind analytics and ML on Google Cloud, including BigQuery, Dataflow, and Pub/Sub, and track your readiness for the Professional Data Engineer exam.
Advanced
Prepare and test your skills
Advanced
Prepare and test your skills
Google Cloud service
Amazon S3
Topic in 1 exam domain
Also called: Amazon Simple Storage Service, AWS S3 bucket, S3
An object storage service or compatible bucket storage location used to store database backups.
Where this appears on the exam
1 objective in 1 of 5 domains
~15% of exam
Related topics
This topicWorks alongsideAppliedIdentity and Access ManagementService
Amazon S3Service
VPC Service ControlsServiceCloud LoggingServiceGoogle Cloud StorageServiceLookerServiceCloud MonitoringServiceGoogle SecOpsServiceBigQuery Data Transfer ServiceServiceSensitive Data ProtectionServicePub/SubServiceStorage Transfer ServiceServiceBigQuery OmniFeatureAzure Blob StorageServiceBindplane agentServiceBigQueryServiceCloud SQLServiceCloud StorageServicePoints to what builds on itWorks with or alternative toHover or tap a line to see what connects the two
- Amazon S3 works with Google SecOps From the official documentation: “Configure AWS S3 bucket and IAM for Google SecOps”
- Amazon S3 is an alternative to Cloud Storage From the official documentation: “Data must be stored in either a Cloud Storage or Amazon S3 bucket.”
- Amazon S3 works with Storage Transfer Service From the official documentation: “Storage Transfer Service provides multiple options for how to transfer your S3 data to Cloud Storage.”
- Amazon S3 works with BigQuery Data Transfer Service From the official documentation: “The BigQuery Data Transfer Service uses load jobs to load Amazon S3 data into BigQuery.”
- Amazon S3 works with BigQuery Omni From the official documentation: “To create an Amazon S3 connection with BigQuery Omni, see [Connect to Amazon S3](/bigquery/docs/omni-aws-create-connection).”
- Amazon S3 is an alternative to Bindplane agent From the official documentation: “This document explains how to ingest Broadcom Carbon Black EDR logs to Google Security Operations using the Bindplane agent or Amazon S3.”
- Amazon S3 is an alternative to Azure Blob Storage From the official documentation: “If your query result is larger than 20 GiB, consider exporting the results to [Amazon S3](/bigquery/docs/omni-aws-export-results-to-s3) or [Blob Storage](/bigquery/docs/omni-azure-export-results-to-azure-storage).”
- Amazon S3 works with BigQuery From the official documentation: “Schedule recurring load jobs from Amazon S3 into BigQuery.”
- Amazon S3 works with Cloud Storage From the official documentation: “This section demonstrates how to synchronize data from Amazon S3 to a Cloud Storage bucket.”
- Amazon S3 is an alternative to Google Cloud Storage From the official documentation: “This document explains how to ingest Google Cloud Looker audit logs to Google Security Operations using Google Cloud Storage or Amazon S3.”
- Amazon S3 works with Looker From the official documentation: “Amazon S3 buckets are a common way to store large amounts of data. You or your company will need to have created an S3 bucket with Amazon before Looker can use it.”
- Amazon S3 works with Sensitive Data Protection From the official documentation: “This page describes how to configure Sensitive Data Protection discovery for Amazon S3.”
- Bindplane agent works with Google SecOps From the official documentation: “Configure Bindplane Agent to ingest Syslog and send to Google SecOps”
- BigQuery works with Sensitive Data Protection From the official documentation: “Uses the Data Loss Prevention API to analyze BigQuery data.”
- BigQuery is an alternative to Cloud Storage From the official documentation: “The `import_result_sink` must be a Cloud Storage path or a BigQuery table.”
- BigQuery works with Cloud Logging From the official documentation: “BigQuery utilizes Cloud Logging for some of your log data.”
- BigQuery works with Cloud Storage From the official documentation: “External BigQuery data source backed by Cloud Storage”
- Cloud Storage works with Google SecOps From the official documentation: “Configure a feed in Google SecOps to ingest from Google Cloud Storage”
- BigQuery works with BigQuery Data Transfer Service From the official documentation: “The BigQuery Data Transfer Service uses load jobs to load Amazon S3 data into BigQuery.”
- BigQuery works with Cloud SQL From the official documentation: “Add credentials to connect BigQuery to Cloud SQL.”
- VPC Service Controls secures BigQuery From the official documentation: “BigQuery data is protected with VPC Service Controls”
- BigQuery works with Looker From the official documentation: “Connect Looker to the BigQuery project.”
- Cloud SQL works with Cloud Storage From the official documentation: “When ingesting data from Cloud SQL, data is first staged to a Cloud Storage bucket.”
- BigQuery works with Cloud Monitoring From the official documentation: “You can use Monitoring to export your metrics to BigQuery.”
- Cloud Storage works with Storage Transfer Service From the official documentation: “Transfer data between Cloud Storage services such as AWS S3 and Cloud Storage.”
- Google Cloud Storage works with Google SecOps From the official documentation: “Google SecOps uses a unique service account to read data from your GCS bucket.”
- Pub/Sub works with Sensitive Data Protection From the official documentation: “Watch the Pub/Sub topic until the DLP job finishes”
- BigQuery is an alternative to Google Cloud Storage From the official documentation: “The training data can be either a CSV file in Cloud Storage or a table in BigQuery.”
- BigQuery is an alternative to Pub/Sub From the official documentation: “To keep audit logs for a longer period of time or to use more powerful search capabilities, you can route copies of your audit logs to Cloud Storage, BigQuery, or Pub/Sub.”
- BigQuery works with Google Cloud Storage From the official documentation: “Load Cloud Storage data into BigQuery”
- Cloud Monitoring works with Cloud SQL From the official documentation: “You can also get more details by viewing the Cloud Monitoring logs for your Cloud SQL destination instance.”
- Cloud SQL works with Identity and Access Management From the official documentation: “This page describes how Cloud SQL is integrated with IAM .”
- Cloud Storage works with Sensitive Data Protection From the official documentation: “Uses the Data Loss Prevention API to analyze a file on GCS.”
- BigQuery works with Pub/Sub From the official documentation: “createBigQuerySubscription creates a Pub/Sub subscription that exports messages to BigQuery.”
- Cloud Logging works with Cloud SQL From the official documentation: “Cloud SQL uses Cloud Logging.”
- Cloud Storage works with Identity and Access Management From the official documentation: “To learn how to use IAM with Cloud Storage, see [Using IAM Permissions](/storage/docs/access-control/using-iam-permissions).”
- Cloud Storage works with Pub/Sub From the official documentation: “| **Google Cloud** | Cloud Storage | Pub/Sub |”
- Cloud Storage is an alternative to Pub/Sub From the official documentation: “To keep audit logs for a longer period of time or to use more powerful search capabilities, you can route copies of your audit logs to Cloud Storage, BigQuery, or Pub/Sub.”
- VPC Service Controls secures Cloud Storage From the official documentation: “Storage Transfer Service supports transfers to Cloud Storage buckets protected by VPC Service Controls.”
- Cloud Logging works with Cloud Storage From the official documentation: “Cloud Storage writes various log entries to Cloud Logging in the Google Cloud console.”
- Cloud Logging works with Pub/Sub From the official documentation: “Pub/Sub writes various log entries to Cloud Logging in the Google Cloud console.”
- Cloud Logging works with Storage Transfer Service From the official documentation: “Enable Cloud Logging for agentless transfers, or transfers from S3-compatible sources, with `--log-actions` and `--log-action-states`.”
- Cloud SQL works with Looker From the official documentation: “To get started, see [Use Looker with Cloud SQL](/sql/docs/sqlserver/looker).”
- Cloud SQL works with Sensitive Data Protection From the official documentation: “Sensitive Data Protection starts identifying your Cloud SQL instances and creating a default connection for each instance.”
- Identity and Access Management secures BigQuery From the official documentation: “Access to BigQuery data from AlloyDB is managed through IAM.”
- Identity and Access Management secures Cloud Storage From the official documentation: “Cloud Storage uses Identity and Access Management (IAM) for authorization.”
- Azure Blob Storage works with Google SecOps From the official documentation: “Google SecOps can use Azure Blob Storage to store Event Hub checkpoints, which track which events have been processed.”
- BigQuery depends on Cloud Logging From the official documentation: “BigQuery utilizes Cloud Logging for some of your log data.”
- BigQuery works with Google SecOps From the official documentation: “Google SecOps exports the following categories of data to your BigQuery project:”
- BigQuery works with Identity and Access Management From the official documentation: “BigQuery uses Identity and Access Management (IAM) for authorization.”
- BigQuery Data Transfer Service works with Pub/Sub From the official documentation: “If you are using the Google Cloud console, you can schedule recurring copies, and configure an email or Pub/Sub notifications with the BigQuery Data Transfer Service.”
- Bindplane agent works with Cloud Monitoring From the official documentation: “How often the heartbeat metric is sent to Monitoring through Bindplane.”
- Cloud Monitoring works with Pub/Sub From the official documentation: “Use Cloud Monitoring and Pub/Sub to set up custom monitoring and alerting policies for exported logs.”
- Cloud SQL works with Google Cloud Storage From the official documentation: “Imports data into a Cloud SQL instance from a SQL dump or CSV file in Cloud Storage.”
- Google Cloud Storage works with Storage Transfer Service From the official documentation: “We use Storage Transfer Service to transfer data from the appliance to your Cloud Storage bucket.”
- Storage Transfer Service works with VPC Service Controls From the official documentation: “The Storage Transfer Service integration with VPC Service Controls has no known limitations.”
- VPC Service Controls secures Cloud SQL From the official documentation: “VPC Service Controls perimeters protect the Cloud SQL Admin API.”
- Azure Blob Storage works with BigQuery Omni From the official documentation: “BigQuery Omni writes to the specified Blob Storage location regardless of any existing content.”
- BigQuery Data Transfer Service works with Cloud Storage From the official documentation: “Retrieving events from the provided Pub/Sub subscription for Cloud Storage event-driven transfer”
- Bindplane agent works with Cloud Logging From the official documentation: “You can use the BindPlane service to send logs to Logging.”
How learners score on this topic
Last updated