استخدام Requests مع عناوين URL

Welcome to using Python for web interactions! In this lesson, we'll dive into the Requests library, your go-to tool for making HTTP requests.

Requests simplifies how your Python program talks to websites, acting like a web browser but without a graphical interface. It's essential for fetching web page content before you can extract data.

Before we can use Requests, we need to install it. If you haven't already, open your terminal or command prompt and run the following command:

pip install requests

This command downloads and installs the library, making it available for your Python scripts. It's a one-time setup for your environment.

The most common type of request is GET. It's used to retrieve data from a specified resource, much like when your browser loads a webpage.

Let's make a simple GET request to fetch content from example.com. We'll then print the HTTP status code and a snippet of the page's text.

When you make a request, the requests.get() function returns a Response object. This object holds all the information about the server's reply.

• response.status_code: An integer indicating the HTTP status (e.g., 200 for OK, 404 for Not Found).
• response.text: The content of the response, usually HTML, as a string.
• response.url: The actual URL of the response.

It's good practice to check if your request was successful. The response.raise_for_status() method is a simple way to do this.

If the HTTP status code indicates an error (e.g., 4xx or 5xx), this method will raise an HTTPError. Otherwise, it does nothing.

Sometimes, websites check for specific HTTP headers to determine if a request is coming from a legitimate browser or a bot.

You can customize your request by passing a dictionary of headers. A common header to set is User-Agent to mimic a browser.

While GET requests are for retrieving data, POST requests are used to send data to a server, typically for creating or updating a resource.

Think of submitting a form on a website – you're usually sending data via a POST request. The data is included in the request body, not in the URL.

To send a POST request with data, you use requests.post() and pass your data as a dictionary to the data parameter.

Let's try sending some simple form data to httpbin.org/post, which will echo back the data it received.

It's crucial to understand when to use GET versus POST:

• GET: Retrieves data, parameters are visible in the URL, requests can be bookmarked and cached. Best for non-sensitive data retrieval.
• POST: Sends data to be processed, parameters are in the request body (not visible in URL), requests are not cached or bookmarked. Best for submitting forms, uploading files, or sensitive data.

Great job! You've taken a significant step in understanding how to interact with the web using Python's Requests library.

• We installed the requests library.
• We learned to send GET requests to fetch web content.
• We explored the response object, checking status codes and content.
• We briefly touched on handling request errors.
• We customized requests with headers.
• We learned to send data using POST requests.
• Finally, we distinguished between GET and POST for different web interactions.

Next, we'll learn how to parse the HTML content you've fetched!