AI Agents with LangChain & Autonomous Workflows · 课时

管理模型参数与成本

了解如何通过参数控制 LLM 的行为，以及优化 API 调用成本的策略

管理模型参数与成本 是 CoddyKit 上的免费 AI Agents with LangChain & Autonomous Workflows 课时。这是第 3 节课，共 4 节。你可以在下方免费阅读本课时的完整内容 — 然后在浏览器中使用内置代码编辑器和全天候 AI 导师进行实践。这是 AI Agents with LangChain & Autonomous Workflows 学习路径的一部分，你的进度在网页和 CoddyKit 应用中同步。 AI Agents with LangChain & Autonomous Workflows 课程共包含 4 节课。

本课时的部分内容尚未翻译，以英文显示。

Control Your LLMs with Parameters

When you interact with Large Language Models (LLMs), you're not just sending a prompt. You can fine-tune their behavior using various parameters.

These parameters act like 'dials' that control aspects like creativity, response length, and even the underlying model used.
Understanding them is key to getting the desired output and managing costs effectively.

Adjusting Creativity: Temperature

The temperature parameter controls the randomness of the LLM's output.

A higher temperature (e.g., 0.8-1.0) leads to more creative, diverse, and sometimes unexpected responses.
A lower temperature (e.g., 0.1-0.3) makes the output more deterministic, focused, and repeatable.
It typically ranges from 0 to 1, though some models allow higher.

Temperature in Action

Here's how you set temperature when initializing an LLM in LangChain. Run this to see how the parameter is applied, though the output will vary.

from langchain_openai import ChatOpenAI
from langchain_core.messages import HumanMessage

def main():
    # Initialize an LLM with a specific temperature
    # (API key usually set as environment variable: OPENAI_API_KEY)
    llm_creative = ChatOpenAI(temperature=0.8)
    llm_focused = ChatOpenAI(temperature=0.1)

    print("--- High Temperature (0.8) ---")
    response_creative = llm_creative.invoke([
        HumanMessage(content="Write a very short, imaginative sentence about a talking cat.")
    ])
    print(f"Response: {response_creative.content}")

    print("\n--- Low Temperature (0.1) ---")
    response_focused = llm_focused.invoke([
        HumanMessage(content="Write a very short, imaginative sentence about a talking cat.")
    ])
    print(f"Response: {response_focused.content}")

if __name__ == "__main__":
    main()

Focusing Choices: Top_p

Another parameter for controlling randomness is top_p, often called 'nucleus sampling'.

It tells the LLM to consider only tokens whose cumulative probability exceeds a certain threshold (e.g., top_p=0.9 means consider the smallest set of tokens whose sum of probabilities is 90%).
Like temperature, top_p influences creativity. Often, you'll use either temperature or top_p, but not both at high values, as they can conflict.

Controlling Response Length: Max Tokens

The max_tokens parameter directly sets the maximum number of tokens (words or pieces of words) the LLM will generate in its response.

This is crucial for keeping responses concise and preventing unnecessarily long outputs.
More importantly, max_tokens directly impacts your API costs, as you are charged per token generated.

Max Tokens Code Example

See how setting max_tokens limits the length of the LLM's output. This is a direct way to manage both response verbosity and cost.

from langchain_openai import ChatOpenAI
from langchain_core.messages import HumanMessage

def main():
    # Initialize an LLM to limit response length
    llm_short = ChatOpenAI(max_tokens=20) # Max 20 tokens
    llm_medium = ChatOpenAI(max_tokens=50) # Max 50 tokens

    question = "Explain the concept of photosynthesis in simple terms."

    print("--- Short Response (max_tokens=20) ---")
    response_short = llm_short.invoke([HumanMessage(content=question)])
    print(f"Response: {response_short.content}")

    print("\n--- Medium Response (max_tokens=50) ---")
    response_medium = llm_medium.invoke([HumanMessage(content=question)])
    print(f"Response: {response_medium.content}")

if __name__ == "__main__":
    main()

Why LLM API Costs Matter

Using powerful LLMs from providers like OpenAI, Anthropic, or Google isn't free. Each API call incurs a cost.

These costs accumulate quickly, especially in applications with frequent interactions or long responses.
Efficient management of LLM usage is essential for building sustainable and budget-friendly AI agents.

Token Counting for Cost Estimation

LLM providers typically charge based on the number of tokens processed (both input prompt and output response).

A token is a piece of a word, roughly 4 characters in English.
Understanding how to count tokens helps you estimate costs. LangChain often has utilities to help with this, or you can use provider-specific tokenizers.

Strategic Model Selection

One of the most impactful ways to manage costs is by choosing the right LLM model for the task.

More advanced models (e.g., GPT-4) offer superior performance but come at a significantly higher cost per token than simpler models (e.g., GPT-3.5-turbo).
For simpler tasks like summarization or basic classification, often a cheaper model is perfectly sufficient.

Caching LLM Responses for Savings

To avoid redundant API calls (and costs), you can implement caching.

If an identical prompt is sent multiple times, caching allows you to store the first response and return it directly, without re-querying the LLM.
LangChain provides built-in caching mechanisms that can be easily integrated to save both time and money.

Parameter & Cost Check

Test your understanding of LLM parameters and cost implications.

Recap: Master Your LLMs & Budget

Great job! You've learned how to take control of your LLMs:

We explored parameters like temperature and top_p to manage creativity.
You saw how max_tokens limits response length and directly impacts cost.
We also covered strategies for cost optimization, including token counting, strategic model selection, and caching.

These skills are vital for building efficient and cost-effective AI agents!

常见问题解答

「管理模型参数与成本」课时是免费的吗？

是的 — 「管理模型参数与成本」的完整文本可在网页上免费阅读。要进行交互式练习（内置代码编辑器和全天候 AI 导师）并解锁 AI Agents with LangChain & Autonomous Workflows 课程的其余内容，请升级到 CoddyKit PRO。 AI Agents with LangChain & Autonomous Workflows 课程共包含 4 节课。

「管理模型参数与成本」这节课中我会学到什么？

了解如何通过参数控制 LLM 的行为，以及优化 API 调用成本的策略你通过在浏览器中直接运行的动手代码来练习 AI Agents with LangChain & Autonomous Workflows，全天候 AI 导师会在你学习这节课的过程中回答你的问题。

学习 AI Agents with LangChain & Autonomous Workflows 需要有经验吗？

无需任何先前经验。CoddyKit 上的 AI Agents with LangChain & Autonomous Workflows 课程适合初学者到高级学习者，你可以从这里开始或从头开始，按照自己的节奏学习。这是第 3 节课，共 4 节。

「管理模型参数与成本」课时需要多长时间？

大多数 CoddyKit 课程大约需要 5–10 分钟。每节课都很精短且互动，所以你能稳步进步，并在网页和应用中从离开的地方继续。

我能在这节 AI Agents with LangChain & Autonomous Workflows 课中编写并运行代码吗？

能。每节 AI Agents with LangChain & Autonomous Workflows 课都包含内置代码编辑器，你可以在浏览器中直接编写并运行真实代码，并获得即时 AI 反馈 — 无需本地设置。

此课程中的所有课时

← 返回 AI Agents with LangChain & Autonomous Workflows