반복적 자기 수정 루프

자기 교정이 필요한 이유

The Loop

def code_until_pass(task, max_iters=10):
    write_initial_code(task)
    for i in range(max_iters):
        result = run_tests()
        if result.passed:
            return 'success'
        fix_prompt = f'Tests failed:\n{result.stderr}\nRead the code, identify the bug, and fix it with edit_file.'
        agent.run(fix_prompt)
    return 'gave up'

유용한 피드백 제공

fix_prompt = f'''
The tests failed with this output:

FAILED tests/test_utils.py::test_add
  AssertionError: expected 4, got 5
  at line 42

Fix the code by editing the file.
'''

다시 수정하기 전에 다시 읽기

fix_prompt = 'First, read_file the failing module. Then edit it.'

반복 실패 감지

if same_error_count >= 3:
    return 'stuck — replanning needed'

Replan When Stuck

replan_prompt = f'''
The current approach is not working. The repeated error is:
{error}

Describe ONE alternative approach to solving the task.
'''

더 강력한 모델로 전환

if iter > 3 and using_cheap_model:
    switch_to_big_model()
    # often unblocks 50% of stuck cases

각 편집 후 검증

컨텍스트에 test 출력 포함

messages.append({'role': 'tool', 'content': f'After your edit, tests now: {test_summary}'})

무한 "수정" 반복 피하기

if iter == MAX_ITERS - 1:
    notify_human(task, current_state, error_history)
    break

자기 교정 지표 추적

test 없이 자기 비평하기

critique_prompt = '''
Review your changes for:
- Off-by-one errors
- Missing error handling
- Breaking other tests
Return FIX LATER or DONE.
'''

자기 교정 입력

복습