Agenti di autocorrezione e riflessione
Impari a costruire agenti capaci di valutare criticamente i propri output e perfezionare iterativamente le proprie risposte o azioni.
Agenti di autocorrezione e riflessione è una lezione AI Agents with LangChain & Autonomous Workflows gratuita su CoddyKit. Questa è la lezione 3 di 6. Puoi leggere la lezione completa qui gratuitamente — poi esercitati direttamente nel browser con un editor di codice integrato e un tutor IA disponibile 24/7. Fa parte del percorso di apprendimento AI Agents with LangChain & Autonomous Workflows, e i tuoi progressi si sincronizzano tra il web e l'app CoddyKit. Il corso AI Agents with LangChain & Autonomous Workflows include 6 lezioni in totale.
Parti di questa lezione non sono ancora state tradotte e vengono mostrate in inglese.
Agents That Think Twice
Ever wished your AI agent could check its own work? That's exactly what self-correction and reflection agents do!
These agents are designed to not just generate an output, but also to critically evaluate it and make improvements. Think of it as an agent having an internal "editor" or "critic".
The Reflective Cycle
The core idea of reflection is an iterative process:
- Generate: The agent produces an initial response or action.
- Reflect: It then uses another prompt (or a different LLM) to analyze its own output against specific criteria.
- Refine: Based on the reflection, the agent adjusts its original output, aiming for better quality or accuracy.
This cycle can repeat multiple times until a satisfactory result is achieved.
Inside a Reflection Agent
A self-correcting agent typically involves a few key parts:
- Generator LLM: The primary Large Language Model that creates the initial output.
- Critic/Reflector LLM: Often the same LLM, but prompted to act as a critic, evaluating the generator's output.
- Reflection Prompt: A carefully designed prompt that guides the critic LLM on what to evaluate and how.
- Refinement Mechanism: The logic that takes the critic's feedback and uses it to improve the next generation.
The Generator Prompt
Just like any LLM interaction, a clear initial prompt for the "generator" is crucial. This prompt tells the agent what task to perform.
For example, if we want an agent to write a short story, the generator prompt would define the story's theme, characters, and length. The goal is a solid first draft.
prompt_template = "Write a 3-sentence story about a brave knight and a dragon."Crafting the Reflection Prompt
The reflection prompt is where the magic happens. It instructs the LLM to review the previous output and identify areas for improvement.
This prompt should include specific criteria. For our story example, it might ask: "Is the story engaging? Does it clearly mention a knight and a dragon? Is it exactly 3 sentences?"
reflection_prompt = "Critique the following story: '{story}'. Does it meet these criteria: 1. Engaging? 2. Knight and Dragon present? 3. Exactly 3 sentences? Provide specific feedback for improvement."Simple Reflection Example
Let's trace our story example conceptually:
- Generate: LLM writes an initial story draft.
- Reflect: LLM reads the story and the reflection prompt, then gives feedback (e.g., "It's 4 sentences, not 3.").
- Refine: The agent receives the feedback. It then tries to rewrite the story, incorporating the feedback (e.g., shortening it to 3 sentences).
This loop continues until the story meets all criteria or a limit is reached.
Building a Refinement Loop
In practice, the refinement process often involves a loop. The agent continues to generate and reflect until a set condition is met. This condition could be:
- A maximum number of iterations.
- The reflection feedback indicates no further improvements are needed.
- A specific quality metric is achieved.
This iterative process allows for continuous self-improvement, making agents more robust.
Code: A Simple Reflection Loop
Here's a simplified Python example demonstrating a basic self-correction loop. We'll use a placeholder LLM for clarity, focusing on the generate, reflect, and refine logic.
class MockLLM:
def __init__(self):
pass
def generate_initial_output(self, task_prompt):
# Simulate a generator LLM that sometimes gets it wrong
if "start with 'Hello'" in task_prompt:
return "Greetings! How are you?" # Incorrect initial attempt
return "Hello World!" # Correct initial attempt based on prompt
def reflect_and_suggest(self, original_task, generated_output):
# Simulate a critic LLM
reflection_prompt = (
f"Given the task: '{original_task}'. "
f"The generated output was: '{generated_output}'. "
"Critique this output: Does it start with 'Hello'? "
"If not, suggest a correction. Be concise."
)
# Simplified reflection logic for the mock LLM
if not generated_output.strip().startswith("Hello"):
return "Doesn't start with 'Hello'. Suggestion: Start with 'Hello'."
return "Output meets criteria."
# --- Main Logic ---
llm = MockLLM()
task = "Create a greeting sentence that starts with 'Hello'."
current_output = llm.generate_initial_output(task)
print(f"Initial Output: {current_output}")
for i in range(3): # Max 3 attempts (initial + 2 refinements)
reflection = llm.reflect_and_suggest(task, current_output)
print(f"Reflection {i+1}: {reflection}")
if "Output meets criteria" in reflection:
print("Agent self-corrected successfully!")
break
else:
# Simulate applying the suggestion
if "Start with 'Hello'" in reflection and not current_output.startswith("Hello"):
current_output = "Hello" + current_output[current_output.find(' '):] # Simple fix
print(f"Refined Output: {current_output}")
else:
print("No specific refinement strategy for this feedback. Stopping.")
break
print("\nFinal Output:", current_output)Benefits & Trade-offs
Reflection agents are powerful for tasks requiring high accuracy or complex reasoning, especially when a single pass might miss nuances.
- Improved Accuracy: Reduces errors and hallucinations.
- Robustness: Handles complex prompts better.
- Quality: Leads to higher-quality outputs.
However, they increase computational cost and latency due to multiple LLM calls. Use them where quality justifies the overhead.
Test Your Knowledge
Consider an agent designed to summarize a document and then self-correct. What is the primary purpose of the "reflection prompt" in this scenario?
Recap: Self-Correction
We've explored how self-correction and reflection agents work. These agents enhance AI capabilities by allowing them to critically evaluate and refine their own outputs.
- They follow a generate, reflect, refine cycle.
- Key components include a generator, a critic, and specific reflection prompts.
- While increasing cost and latency, they significantly boost output quality and accuracy for complex tasks.
This ability to "think twice" is a crucial step towards more robust and intelligent AI systems!
Domande Frequenti
La lezione «Agenti di autocorrezione e riflessione» è gratuita?
Sì — il testo completo di «Agenti di autocorrezione e riflessione» è gratuito qui sul web. Per esercitarvi in modo interattivo (un editor di codice integrato e un tutor IA 24/7) e sbloccare il resto del corso AI Agents with LangChain & Autonomous Workflows, passa a CoddyKit PRO. Il corso AI Agents with LangChain & Autonomous Workflows include 6 lezioni in totale.
Cosa imparerò in «Agenti di autocorrezione e riflessione»?
Impari a costruire agenti capaci di valutare criticamente i propri output e perfezionare iterativamente le proprie risposte o azioni. Eserciti AI Agents with LangChain & Autonomous Workflows con codice pratico che esegui direttamente nel browser, e un tutor IA 24/7 risponde alle tue domande mentre lavori sulla lezione.
Ho bisogno di esperienza per iniziare AI Agents with LangChain & Autonomous Workflows?
Non è richiesta alcuna esperienza precedente. AI Agents with LangChain & Autonomous Workflows su CoddyKit è strutturato per principianti e studenti avanzati, quindi puoi iniziare da qui o dall'inizio e procedere al tuo ritmo. Questa è la lezione 3 di 6.
Quanto tempo richiede la lezione «Agenti di autocorrezione e riflessione»?
La maggior parte delle lezioni CoddyKit richiede circa 5–10 minuti. Ogni lezione è breve e interattiva, quindi fai progressi costanti e riprendi esattamente da dove hai lasciato su web e app.
Posso scrivere ed eseguire codice in questa lezione AI Agents with LangChain & Autonomous Workflows?
Sì. Ogni lezione AI Agents with LangChain & Autonomous Workflows include un editor di codice integrato, quindi scrivi ed esegui codice reale direttamente nel tuo browser e ricevi feedback istantaneo dall'IA — nessuna configurazione locale necessaria.
Tutte le lezioni di questo corso
- Agenti ReAct e Plan-and-Execute
- Progettazione gerarchica degli agenti
- Agenti di autocorrezione e riflessione
- Architetture cognitive per gli agenti
- Pattern di collaborazione tra più agenti
- Sistemi di agenti ibridi