Orchestrating Complex Workflows
Build sophisticated serverless workflows that involve conditional logic, parallel execution, and error handling using Step Functions.
Orchestrating Complex Workflows is a free Serverless Backend with AWS Lambda & API Gateway lesson on CoddyKit — lesson 3 of 4. You can read the complete lesson below for free — then practise it hands-on in the browser with a built-in code editor and a 24/7 AI tutor. It is part of the Serverless Backend with AWS Lambda & API Gateway learning path, one of 4 lessons in the course, and your progress syncs across the web and the CoddyKit app.
Orchestrating Complex Workflows
Welcome! In this lesson, we'll dive into building sophisticated serverless workflows with AWS Step Functions.
We'll explore how to add decision-making, run tasks concurrently, and make your workflows resilient to errors.
Decision Making with Choice
The Choice state is your workflow's "if/else" statement. It allows your state machine to make decisions based on the input it receives.
- Each choice rule has a condition (e.g., input value equals "X").
- If a condition is met, the workflow transitions to a specified state.
- A default state handles cases where no conditions match.
Choice State Example
Here's how a Choice state looks in your Step Functions definition. It checks an orderStatus field to decide the next step.
{ "StartAt": "CheckOrderStatus", "States": { "CheckOrderStatus": { "Type": "Choice", "Choices": [ { "Variable": "$.orderStatus", "StringEquals": "PENDING", "Next": "ProcessPendingOrder" }, { "Variable": "$.orderStatus", "StringEquals": "SHIPPED", "Next": "NotifyShipping" } ], "Default": "HandleUnknownStatus" }, "ProcessPendingOrder": { "Type": "Task", "Resource": "arn:aws:lambda:us-east-1:123456789012:function:processPending", "End": true }, "NotifyShipping": { "Type": "Task", "Resource": "arn:aws:lambda:us-east-1:123456789012:function:notifyShipping", "End": true }, "HandleUnknownStatus": { "Type": "Fail", "Cause": "Unknown order status", "Error": "InvalidOrderStatus" } }}Running Tasks in Parallel
The Parallel state allows you to execute multiple branches of your workflow concurrently. This is great for tasks that don't depend on each other and can run at the same time.
- Each branch runs independently.
- The Parallel state waits for all branches to complete.
- Outputs from all branches are combined into an array.
Parallel State Example
This Parallel state simultaneously processes an order and updates inventory, then combines their results.
{ "StartAt": "ProcessOrderAndInventory", "States": { "ProcessOrderAndInventory": { "Type": "Parallel", "Branches": [ { "StartAt": "ProcessOrder", "States": { "ProcessOrder": { "Type": "Task", "Resource": "arn:aws:lambda:us-east-1:123456789012:function:processOrder", "End": true } } }, { "StartAt": "UpdateInventory", "States": { "UpdateInventory": { "Type": "Task", "Resource": "arn:aws:lambda:us-east-1:123456789012:function:updateInventory", "End": true } } } ], "Next": "CombineResults" }, "CombineResults": { "Type": "Pass", "End": true } }}Handling Errors Gracefully
Things can go wrong! Step Functions provides robust error handling with the Catch field. You can specify what errors to catch and which state to transition to when an error occurs.
- Errors are identified by their type (e.g.,
States.TaskFailed). - You can catch specific errors or a generic
States.ALL. - The
ResultPathspecifies where the error output is placed.
Catch State Example
Here, if the ProcessPayment task fails, it's caught and the workflow moves to the RefundOrder state.
{ "StartAt": "ProcessPayment", "States": { "ProcessPayment": { "Type": "Task", "Resource": "arn:aws:lambda:us-east-1:123456789012:function:processPayment", "Catch": [ { "ErrorEquals": [ "States.TaskFailed", "PaymentFailure" ], "Next": "RefundOrder", "ResultPath": "$.errorInfo" } ], "Next": "CompleteOrder" }, "RefundOrder": { "Type": "Task", "Resource": "arn:aws:lambda:us-east-1:123456789012:function:refundOrder", "End": true }, "CompleteOrder": { "Type": "Pass", "End": true } }}Retrying Failed Tasks
For transient errors (like network timeouts), it's often better to retry the task a few times before failing. The Retry field lets you define retry policies.
- Specify which errors to retry.
- Configure
IntervalSeconds,MaxAttempts, andBackoffRate. - Exponential backoff (
BackoffRate > 1) is highly recommended.
Retry State Example
This task will retry up to 3 times with exponential backoff if a Timeout or NetworkError occurs.
{ "StartAt": "CallExternalService", "States": { "CallExternalService": { "Type": "Task", "Resource": "arn:aws:lambda:us-east-1:123456789012:function:callExternalService", "Retry": [ { "ErrorEquals": [ "States.Timeout", "NetworkError" ], "IntervalSeconds": 2, "MaxAttempts": 3, "BackoffRate": 1.5 } ], "End": true } }}Orchestrating It All
The real power of Step Functions comes from combining these states. You can build highly sophisticated workflows by nesting Parallel states within Choices, adding Retries to Tasks, and Catching errors at various levels.
This allows you to model almost any business process, making your serverless applications robust and adaptable.
Workflow Logic Check
Consider a workflow that needs to:
- Check if a user is premium.
- If premium, send a personalized email AND update their loyalty points simultaneously.
- If not premium, send a standard email.
- Handle any email sending failures by logging them without stopping the workflow.
Which Step Functions states would be essential to implement this logic?
Recap: Complex Workflows
You've mastered advanced Step Functions concepts!
- We used Choice states for conditional logic.
- We leveraged Parallel states for concurrent execution.
- We implemented robust error handling with Catch blocks.
- And we learned about Retry policies for transient failures.
These tools allow you to build incredibly powerful and resilient event-driven serverless applications!
Frequently asked questions
Is the “Orchestrating Complex Workflows” lesson free?
Yes — the full text of “Orchestrating Complex Workflows” is free to read here on the web, and the Serverless Backend with AWS Lambda & API Gateway course includes 4 lessons in total. To practise it interactively (a built-in code editor and a 24/7 AI tutor) and unlock the rest of the Serverless Backend with AWS Lambda & API Gateway course, upgrade to CoddyKit PRO.
What will I learn in “Orchestrating Complex Workflows”?
Build sophisticated serverless workflows that involve conditional logic, parallel execution, and error handling using Step Functions. You practise Serverless Backend with AWS Lambda & API Gateway with hands-on code you run directly in the browser, and a 24/7 AI tutor answers your questions as you work through the lesson.
Do I need any experience to start Serverless Backend with AWS Lambda & API Gateway?
No prior experience is required. Serverless Backend with AWS Lambda & API Gateway on CoddyKit is structured for beginners through advanced learners; this is — lesson 3 of 4, so you can start here or from the beginning and move at your own pace.
How long does the “Orchestrating Complex Workflows” lesson take?
Most CoddyKit lessons take about 5–10 minutes. Each one is bite-sized and interactive, so you make steady progress and pick up exactly where you left off across the web and the app.
Can I write and run code in this Serverless Backend with AWS Lambda & API Gateway lesson?
Yes. Every Serverless Backend with AWS Lambda & API Gateway lesson includes a built-in code editor, so you write and run real code right in your browser and get instant AI feedback — no local setup required.
All lessons in this course
- Introduction to AWS Step Functions
- Building State Machines
- Orchestrating Complex Workflows
- Error Handling and Retries in State Machines