配置开发环境
配置 Python 开发环境，安装 Requests 和 BeautifulSoup 等网络抓取所需的库。
配置开发环境 是 CoddyKit 上的免费 Web Scraping & Bots 课时。 这是第 1 节课，共 4 节。 你可以在下方免费阅读本课时的完整内容 — 然后在浏览器中使用内置代码编辑器和全天候 AI 导师进行实践。 这是 Web Scraping & Bots 学习路径的一部分，你的进度在网页和 CoddyKit 应用中同步。 Web Scraping & Bots 课程共包含 4 节课。
本课时的部分内容尚未翻译，以英文显示。
Get Ready to Scrape!
Welcome! Before we dive into web scraping, we need to prepare our workspace. This lesson will guide you through setting up your Python environment and installing the essential libraries: Requests and BeautifulSoup.
These tools are crucial for fetching web pages and extracting data from them effectively.
Python & Pip: Your Core Tools
First things first, you need Python installed on your computer. CoddyKit assumes you have Python 3.x ready to go.
Alongside Python, you'll use pip. Pip is Python's standard package installer. It's how we'll add external libraries to our projects.
- Python: The programming language itself.
- pip: Manages Python libraries.
Introducing the Requests Library
The first library we'll install is Requests. This library simplifies making HTTP requests, which is how your program will "ask" websites for their content.
Think of Requests as your program's browser, but without the graphical interface. It handles all the complex network communication for you, making it easy to get HTML.
Install Requests with pip
Open your terminal or command prompt. To install Requests, simply type:
pip install requestsPress Enter. Pip will download and install the library and its dependencies.
Note: If you have multiple Python versions, you might need to use pip3 install requests.
Test Your Requests Install
Let's quickly check if Requests was installed correctly. Run this small Python script:
import requests
try:
response = requests.get("https://www.example.com")
print(f"Requests library imported and working!")
print(f"Status Code: {response.status_code}")
except Exception as e:
print(f"Error: Requests might not be installed or working. {e}")Next Up: BeautifulSoup
Once you have the web page content (thanks to Requests), you need a way to easily navigate and extract specific pieces of data from it. That's where BeautifulSoup comes in!
BeautifulSoup is a library designed for parsing HTML and XML documents. It creates a parse tree that you can search and traverse, making data extraction simple.
Install BeautifulSoup with pip
Similar to Requests, we use pip to install BeautifulSoup. The package name is beautifulsoup4.
pip install beautifulsoup4This will download and install BeautifulSoup, along with its dependencies like lxml or html5lib (which it uses as efficient parsers).
Test Your BeautifulSoup Install
Let's confirm BeautifulSoup is ready. Run this Python code:
from bs4 import BeautifulSoup
try:
# A simple HTML string to parse
html_doc = "<html><head><title>Test</title></head><body>Hello</body></html>"
soup = BeautifulSoup(html_doc, 'html.parser')
print(f"BeautifulSoup imported and working!")
print(f"Page title: {soup.title.string}")
except Exception as e:
print(f"Error: BeautifulSoup might not be installed or working. {e}")Virtual Environments (Good Practice)
For larger projects, it's good practice to use virtual environments. A virtual environment creates an isolated Python installation for each project.
- Why use it? Prevents conflicts between different project dependencies.
- How to create?
python -m venv myenv - How to activate?
source myenv/bin/activate(Linux/macOS) ormyenv\Scripts\activate(Windows)
After activating, pip install commands only affect that environment.
Check Your Understanding
You've learned about setting up your Python environment for web scraping. Let's test your knowledge!
Recap: Environment Ready!
Great job! You've successfully set up your Python environment for web scraping.
- You installed Requests to fetch web page content.
- You installed BeautifulSoup to parse and navigate HTML.
- You also learned about pip for package management and the benefits of virtual environments.
Now that your tools are ready, we can move on to making our first HTTP requests in the next lesson!
常见问题解答
「配置开发环境」课时是免费的吗？
是的 — 「配置开发环境」的完整文本可在网页上免费阅读。要进行交互式练习（内置代码编辑器和全天候 AI 导师）并解锁 Web Scraping & Bots 课程的其余内容，请升级到 CoddyKit PRO。 Web Scraping & Bots 课程共包含 4 节课。
「配置开发环境」这节课中我会学到什么？
配置 Python 开发环境，安装 Requests 和 BeautifulSoup 等网络抓取所需的库。 你通过在浏览器中直接运行的动手代码来练习 Web Scraping & Bots，全天候 AI 导师会在你学习这节课的过程中回答你的问题。
学习 Web Scraping & Bots 需要有经验吗？
无需任何先前经验。CoddyKit 上的 Web Scraping & Bots 课程适合初学者到高级学习者，你可以从这里开始或从头开始，按照自己的节奏学习。 这是第 1 节课，共 4 节。
「配置开发环境」课时需要多长时间？
大多数 CoddyKit 课程大约需要 5–10 分钟。每节课都很精短且互动，所以你能稳步进步，并在网页和应用中从离开的地方继续。
我能在这节 Web Scraping & Bots 课中编写并运行代码吗？
能。每节 Web Scraping & Bots 课都包含内置代码编辑器，你可以在浏览器中直接编写并运行真实代码，并获得即时 AI 反馈 — 无需本地设置。