A data engineer is building a data pipeline. A large data file is uploaded to an Amazon S3 bucket once each day at unpredictable times. An AWS Glue…

The most critical requirement is to process the file "as quickly as possible" after it arrives at an unpredictable time. An event-driven architecture is the most efficient solution for this scenario. Option B describes a robust event-driven pattern where an Amazon S3 PutObject event is captured and sent to Amazon EventBridge. An EventBridge rule then filters for this specific event and invokes the event-based AWS Glue trigger, starting the workflow almost instantaneously. This approach avoids the latency inherent in polling mechanisms and directly addresses the requirement for immediate processing.

1. AWS Glue Developer Guide: The guide details how to use event-based triggers. "You can use Amazon EventBridge to start a workflow run when certain events occur. For example

you can create a rule that starts a workflow run when a file is uploaded to an Amazon S3 bucket."

Source: AWS Glue Developer Guide

"Starting an AWS Glue workflow with an Amazon EventBridge event".

2. Amazon EventBridge User Guide: This guide explains how S3 events can be used as a source to trigger targets like AWS Glue. "Amazon S3 notifies EventBridge when certain events happen in your S3 buckets... you can use these events in EventBridge to trigger targets."

Source: Amazon EventBridge User Guide

"Events from AWS services"

section on Amazon S3 events.

3. Amazon S3 User Guide: This document explains how to enable and configure event notifications

including sending them to Amazon EventBridge. "You can use Amazon S3 Event Notifications to receive notifications when certain events happen in your S3 bucket. To enable notifications

you first add a notification configuration that identifies the events that you want Amazon S3 to publish and the destinations where you want Amazon S3 to send the notifications."

Source: Amazon S3 User Guide

"Amazon S3 Event Notifications".

4. AWS Database Migration Service (AWS DMS) User Guide: The documentation clarifies the purpose of DMS

which is data migration

not workflow triggering. "AWS Database Migration Service (AWS DMS) is a web service that you can use to migrate data from a source data store to a target data store." Its targets are data stores like Amazon Redshift or RDS

not compute services like AWS Glue.

Source: AWS DMS User Guide

"What is AWS Database Migration Service?".