0Pricing
Web Scraping & Bots · レッスン

APIとの統合

ボットを外部APIに接続してデータを充実させたり、アクションを実行したり、他のサービスと連携したりします。

「APIとの統合」はCoddyKit上の無料Web Scraping & Botsレッスンです。 これはレッスン3/4です。 下記で完全なレッスンを無料で読むことができます。その後、ブラウザ内の組み込みコードエディタと24時間対応のAIチューターでハンズオン演習できます。 これはWeb Scraping & Bots学習パスの一部であり、ウェブとCoddyKitアプリ全体で進捗が同期されます。 Web Scraping & Botsコースには全4レッスンが含まれています。

このレッスンの一部はまだ翻訳されておらず、英語で表示されています。

Bots & APIs: A Powerful Combo

You've learned to automate browser interactions and scrape web pages. But what if you need structured data, or to trigger actions on another service?

This is where APIs (Application Programming Interfaces) come in! APIs provide a direct, organized way for your bot to communicate with other software systems.

APIs vs. Web Scraping

While web scraping involves parsing HTML from web pages, APIs offer data in a more machine-readable format, typically JSON or XML.

  • Web Scraping: Best for public data on websites without APIs, or complex UI interactions.
  • API Integration: Ideal for structured data, performing actions (like creating a post), and when an API is explicitly provided.

Often, the most powerful bots combine both!

API Basics: Endpoints & Methods

APIs are accessed via endpoints, which are specific URLs. You interact with them using standard HTTP methods:

  • GET: To retrieve data (like reading a post).
  • POST: To send new data (like creating a post).
  • PUT/PATCH: To update existing data.
  • DELETE: To remove data.

For bots, GET and POST are the most common.

Making a Simple GET Request

Let's use Python's requests library to fetch some data from a public test API. We'll use jsonplaceholder.typicode.com which provides fake data.

Try running this example:

import requests

def main():
    api_url = "https://jsonplaceholder.typicode.com/todos/1"
    response = requests.get(api_url)
    
    print(f"Status Code: {response.status_code}")
    print(response.text)

if __name__ == "__main__":
    main()

Parsing JSON Responses

APIs commonly return data in JSON (JavaScript Object Notation) format. It's a lightweight, human-readable data interchange format.

The requests library can automatically parse JSON for you, turning it into a Python dictionary. Let's extract specific fields from our previous example.

import requests
import json

def main():
    api_url = "https://jsonplaceholder.typicode.com/todos/1"
    response = requests.get(api_url)
    
    if response.status_code == 200:
        todo_item = response.json() # Parse JSON into a Python dict
        print(f"User ID: {todo_item['userId']}")
        print(f"Title: {todo_item['title']}")
        print(f"Completed: {todo_item['completed']}")
    else:
        print("Failed to fetch data.")

if __name__ == "__main__":
    main()

API Authentication Concepts

Many APIs require authentication to ensure only authorized users or bots can access their data or services. Common methods include:

  • API Keys: A unique string sent with each request.
  • Tokens: Often generated after a login, valid for a certain period.
  • OAuth: A more complex standard for secure delegation of access.

For simple bots, API keys are often used.

Using API Keys in Requests

API keys are typically passed as a query parameter in the URL or as an HTTP header. requests makes this easy with the params argument.

This example shows how you would pass a key (using a fictional API for demonstration).

import requests

def main():
    # This is a placeholder for demonstration.
    # In a real scenario, use a valid API key.
    api_key = "YOUR_DUMMY_API_KEY_HERE"
    search_term = "bot automation"
    
    # Fictional API endpoint requiring a key
    api_url = "https://api.example.com/search"
    
    params = {
        "q": search_term,
        "apiKey": api_key # API key as a query parameter
    }
    
    response = requests.get(api_url, params=params)
    print(f"Request URL: {response.url}")
    print(f"Status Code: {response.status_code}")
    # In a real app, you'd process response.json()

if __name__ == "__main__":
    main()

Sending Data with POST Requests

If your bot needs to submit data, like creating a new entry or updating information, you'll use a POST request. The data payload is typically sent in the request body.

requests handles sending JSON data in the body automatically using the json parameter.

import requests
import json

def main():
    api_url = "https://jsonplaceholder.typicode.com/posts"
    
    new_post_data = {
        "title": "Bot-Generated Post",
        "body": "This is content created by our bot!",
        "userId": 1
    }
    
    # The 'json' parameter automatically sets Content-Type
    response = requests.post(api_url, json=new_post_data)
    
    print(f"Status Code: {response.status_code}")
    if response.status_code == 201: # 201 Created is common for successful POST
        print("Post created successfully!")
        print(response.json()) # API returns the created item
    else:
        print("Failed to create post.")
        print(response.text)

if __name__ == "__main__":
    main()

Robust Error Handling for APIs

API calls can fail due to network issues, incorrect requests, or server errors. Your bot should handle these gracefully.

  • Check response.status_code (e.g., 200 for OK, 404 for Not Found, 500 for Server Error).
  • Use response.raise_for_status() to automatically raise an HTTPError for bad responses.
  • Wrap calls in try-except blocks to catch network-related errors.
import requests

def main():
    # Intentional bad URL to show error handling
    api_url = "https://jsonplaceholder.typicode.com/nonexistent_endpoint"
    
    try:
        response = requests.get(api_url, timeout=5) # Set a timeout
        response.raise_for_status() # Raises HTTPError for 4xx/5xx responses
        print(f"Status Code: {response.status_code}")
        print("Successfully fetched data.")
    except requests.exceptions.HTTPError as err:
        print(f"HTTP Error occurred: {err}")
        print(f"Status Code: {response.status_code}")
    except requests.exceptions.ConnectionError as err:
        print(f"Connection Error occurred: {err}")
    except requests.exceptions.Timeout as err:
        print(f"Timeout Error occurred: {err}")
    except requests.exceptions.RequestException as err:
        print(f"An unexpected error occurred: {err}")

if __name__ == "__main__":
    main()

Quick Check: API Interaction

Which of the following are common ways bots interact with APIs?

Recap & Next Steps

Great job! You've learned how to integrate your bots with APIs:

  • APIs provide structured data and allow bots to trigger actions.
  • You use GET for fetching and POST for sending data.
  • Python's requests library simplifies API calls.
  • JSON is the common data format, easily parsed into Python dictionaries.
  • Authentication (like API keys) is crucial for many APIs.
  • Robust error handling is key for reliable bot operations.

Combining web scraping with API integration allows your bots to perform more complex and powerful workflows!

よくある質問

「APIとの統合」レッスンは無料ですか？

はい。「APIとの統合」の完全なテキストはこのウェブで無料で読めます。インタラクティブに演習し（組み込みコードエディタと24時間対応のAIチューター）、Web Scraping & Botsコースの残りをアンロックするには、CoddyKit PROにアップグレードしてください。 Web Scraping & Botsコースには全4レッスンが含まれています。

「APIとの統合」で何を学びますか？

ボットを外部APIに接続してデータを充実させたり、アクションを実行したり、他のサービスと連携したりします。 ブラウザで直接実行するハンズオンコードでWeb Scraping & Botsを演習し、24時間対応のAIチューターがレッスンを進める中での質問に答えます。

Web Scraping & Botsを始めるのに経験は必要ですか？

事前経験は必要ありません。CoddyKitのWeb Scraping & Botsは初級者から上級者向けに構成されているため、ここから始めるか最初から始めて、自分のペースで進むことができます。 これはレッスン3/4です。

「APIとの統合」レッスンにはどのくらい時間がかかりますか？

ほとんどのCoddyKitレッスンは約5～10分かかります。各レッスンはコンパクトでインタラクティブなので、着実に進歩し、ウェブとアプリ全体で正確に前回の場所から再開できます。

このWeb Scraping & Botsレッスンでコードを書いて実行できますか？

はい。すべてのWeb Scraping & Botsレッスンに組み込みコードエディタが含まれているため、ブラウザでリアルコードを書いて実行し、即座のAIフィードバックを取得できます。ローカル設定は不要です。

このコースのすべてのレッスン

  1. ユーザー認証の処理
  2. 複雑なユーザージャーニーの再現
  3. APIとの統合
  4. セッションと Cookie の管理
← Web Scraping & Botsに戻る