การจัดเก็บข้อมูลใน CSV/JSON

After scraping, raw data is often in memory. To use it later, share it, or analyze it, you need to save it permanently.

This lesson introduces two popular file formats: CSV and JSON. They are simple, human-readable, and widely supported.

CSV stands for Comma-Separated Values. It's a plain text file format used to store tabular data, like a spreadsheet.

Each line in a CSV file is a data record. Each record consists of one or more fields, separated by commas.

Imagine a simple table. Each row becomes a line, and each column value is separated by a comma. The first line often contains the column headers.

Python's built-in csv module makes writing data to CSV files easy. We'll use csv.writer and writerow().

The 'w' mode opens the file for writing. newline='' prevents extra blank rows.

JSON (JavaScript Object Notation) is another popular, human-readable format. It's often used for sending data between web servers and web applications.

JSON organizes data into key-value pairs, similar to Python dictionaries, and lists.

JSON data is structured using objects ({}) and arrays ([]).

• An object holds key-value pairs (e.g., "name": "Alice").
• An array holds an ordered list of values (e.g., [{}, {}]).

Python's built-in json module handles JSON data. We'll use json.dump() to write a Python dictionary or list to a file.

indent=2 makes the output file more readable by adding indentation.

Both CSV and JSON are great for data storage, but they excel in different scenarios:

• CSV: Best for simple tabular data, like spreadsheets. Easy to import into databases or Excel.
• JSON: Ideal for complex, hierarchical data. Great for APIs and when data structure might vary.

Just as you can write data, you can also read it back! Both csv and json modules provide functions for this.

• csv.reader() for CSV files.
• json.load() for JSON files.

This allows you to load your scraped data back into Python for further processing.

Which file format is generally better suited for storing hierarchical data with nested structures, like a list of products where each product has multiple attributes and possibly sub-items?

You've learned how to persist your scraped data!

• CSV: Ideal for tabular data, easy with Python's csv module.
• JSON: Great for hierarchical data, handled by Python's json module.
• Choose the format that best fits your data's structure and how you plan to use it.

Saving data is crucial for analysis and future use.