Konsistensi Mandiri dan Pengetahuan yang Dihasilkan

Welcome to Lesson 2! In complex problem-solving, Large Language Models (LLMs) can sometimes struggle, leading to incorrect or inconsistent answers.

This lesson introduces two powerful techniques to boost their reliability: Self-Consistency and Generated Knowledge. These methods help LLMs 'think' more deeply and systematically.

LLMs are great at generating text, but they can sometimes make logical errors or 'hallucinate' (produce factually incorrect information), especially with multi-step reasoning.

Advanced prompting strategies like Self-Consistency and Generated Knowledge aim to:

• Improve accuracy for complex tasks.
• Reduce the likelihood of factual errors.
• Make LLM responses more robust and reliable.

Self-Consistency is a technique where you prompt an LLM to generate multiple distinct reasoning paths or answers for the same question.

Instead of relying on a single output, you then aggregate these different outputs and select the most consistent (e.g., the most frequent) answer. It's like asking several experts and taking the majority opinion.

Imagine asking an LLM: "If a train leaves station A at 8 AM traveling at 60 mph, and another leaves station B (300 miles away) at 9 AM traveling at 70 mph, when do they meet?"

A single prompt might give a wrong answer. With self-consistency, you'd ask this multiple times, perhaps with slightly varied phrasing, then compare the results to find the most common meeting time.

This Python example simulates calling an LLM multiple times for a math problem. It then picks the most frequent answer, enhancing reliability.

Generated Knowledge is a technique where the LLM first generates relevant facts, context, or intermediate thoughts, and then uses this self-generated information to answer the main query.

This is akin to doing research before writing an essay. The LLM essentially 'pre-computes' or 'recalls' relevant knowledge to build a stronger foundation for its final answer.

Consider a question like: "Describe the main differences between a black hole and a wormhole."

Instead of directly answering, you could first prompt the LLM to:

1. "List key characteristics of a black hole."
2. "List key characteristics of a wormhole."

Then, use these generated lists as context for the original question, leading to a more informed and accurate comparison.

This Python example demonstrates a two-step process: first, asking the LLM to generate knowledge, and then using that knowledge in a subsequent prompt to answer a complex question.

While powerful individually, Self-Consistency and Generated Knowledge can also be combined for even greater robustness.

For instance, you could first use Generated Knowledge to create a robust set of facts, and then apply Self-Consistency to the final answer generation phase, ensuring both factual grounding and reliable output.

In this lesson, you learned about two advanced prompting strategies:

• Self-Consistency: Generating multiple answers and selecting the most common one to improve reliability.
• Generated Knowledge: Having the LLM create relevant context first, then using that context to answer the main question.

These techniques empower LLMs to tackle complex problems with greater accuracy and less risk of errors. Continue experimenting with them to unlock more robust LLM applications!