A company is running a custom-built application that processes records. All the components run on Amazon EC2 instances that run in an Auto Scaling…

Use AWS Step Functions to Orchestrate Processing:

AWS Step Functions allow you to build distributed applications by combining AWS Lambda functions

or other AWS services into workflows.

Decoupling the processing into Step Functions tasks enables you to retry individual steps without

reprocessing the entire record.

Architectural Steps:

Create a web application to pass records to AWS Step Functions:

The web application can be a simple frontend that receives input and triggers the Step Functions

workflow.

Define a Step Functions state machine:

Each step in the state machine represents a processing stage. If a step fails, Step Functions can retry

the step based on defined conditions.

Use AWS Lambda functions:

Lambda functions can be used to handle each processing step. These functions can be stateless and

handle specific tasks, reducing the complexity of error handling and reprocessing logic.

Operational Efficiency:

Using Step Functions and Lambda improves operational efficiency by providing built-in error

handling, retries, and state management.

This architecture scales automatically and isolates failures to individual steps, ensuring only failed

steps are retried.

Reference:

AWS Step Functions

Building Workflows with Step Functions