Vector Databases: Pinecone, Weaviate & pgvector · レッスン

Pineconeへのデータのupsert

関連するメタデータとともにベクトルデータをPineconeインデックスへ挿入・更新する手順を習得します。

「Pineconeへのデータのupsert」はCoddyKit上の無料Vector Databases: Pinecone, Weaviate & pgvectorレッスンです。これはレッスン2/4です。下記で完全なレッスンを無料で読むことができます。その後、ブラウザ内の組み込みコードエディタと24時間対応のAIチューターでハンズオン演習できます。これはVector Databases: Pinecone, Weaviate & pgvector学習パスの一部であり、ウェブとCoddyKitアプリ全体で進捗が同期されます。 Vector Databases: Pinecone, Weaviate & pgvectorコースには全4レッスンが含まれています。

このレッスンの一部はまだ翻訳されておらず、英語で表示されています。

What is Upserting Data?

In vector databases like Pinecone, upserting is a key operation. It's a blend of 'update' and 'insert'.

If a vector with a given ID doesn't exist, it's inserted.
If it already exists, the existing vector (and its metadata) is updated with the new data.

This single operation simplifies managing dynamic vector data without needing to check for existence first.

Connecting to Your Pinecone Index

Before we upsert, you need to connect to your Pinecone index. This involves initializing the Pinecone client and selecting your target index.

Remember to replace YOUR_API_KEY and YOUR_ENVIRONMENT with your actual credentials, typically loaded from environment variables.

import os
from pinecone import Pinecone

# Initialize Pinecone client
pc = Pinecone(
    api_key=os.environ.get("PINECONE_API_KEY", "YOUR_API_KEY"),
    environment=os.environ.get("PINECONE_ENVIRONMENT", "YOUR_ENVIRONMENT")
)

# Connect to your index (e.g., 'my-index')
index_name = "my-index"
index = pc.Index(index_name)

print(f"Connected to index: {index_name}")

Upserting a Single Vector

To upsert a single vector, you provide a unique id and the vector data (a list of floats). Each vector needs an ID for Pinecone to identify it.

The dimension of the vector must match the dimension configured for your Pinecone index (e.g., 3 for our simple examples).

Demo: Single Vector Upsert

Here's how to insert a single vector into your index. We'll use a simple 3-dimensional vector for demonstration.

import os
from pinecone import Pinecone

pc = Pinecone(
    api_key=os.environ.get("PINECONE_API_KEY", "YOUR_API_KEY"),
    environment=os.environ.get("PINECONE_ENVIRONMENT", "YOUR_ENVIRONMENT")
)
index = pc.Index("my-index") # Assuming 'my-index' exists

# Upsert a single vector
index.upsert(
    vectors=[
        {"id": "vec1", "values": [0.1, 0.2, 0.3]}
    ]
)

print("Single vector 'vec1' upserted!")

Efficient Batch Upserts

For better performance, it's highly recommended to upsert multiple vectors in batches rather than one by one. This reduces network overhead.

You can prepare a list of dictionaries, where each dictionary represents a vector with its id and values.

Demo: Batch Upserting Vectors

This example shows how to upsert several vectors at once. Notice the vectors parameter takes a list of vector objects.

import os
from pinecone import Pinecone

pc = Pinecone(
    api_key=os.environ.get("PINECONE_API_KEY", "YOUR_API_KEY"),
    environment=os.environ.get("PINECONE_ENVIRONMENT", "YOUR_ENVIRONMENT")
)
index = pc.Index("my-index") # Assuming 'my-index' exists

# Prepare multiple vectors for batch upsert
batch_vectors = [
    {"id": "vec2", "values": [0.4, 0.5, 0.6]},
    {"id": "vec3", "values": [0.7, 0.8, 0.9]},
    {"id": "vec4", "values": [0.11, 0.12, 0.13]}
]

# Upsert the batch
index.upsert(vectors=batch_vectors)

print("Batch of vectors upserted!")

Adding Metadata to Vectors

Metadata allows you to store additional key-value pairs alongside your vectors. This is incredibly useful for filtering search results later.

Metadata can include properties like a document's title, author, category, or creation date. It's stored as a dictionary within each vector object.

Demo: Upsert with Metadata

Let's add some context to our vectors using metadata. This makes them much more powerful for real-world applications.

import os
from pinecone import Pinecone

pc = Pinecone(
    api_key=os.environ.get("PINECONE_API_KEY", "YOUR_API_KEY"),
    environment=os.environ.get("PINECONE_ENVIRONMENT", "YOUR_ENVIRONMENT")
)
index = pc.Index("my-index") # Assuming 'my-index' exists

# Upsert a vector with metadata
index.upsert(
    vectors=[
        {
            "id": "doc1",
            "values": [0.2, 0.3, 0.4],
            "metadata": {"genre": "sci-fi", "year": 2023}
        },
        {
            "id": "doc2",
            "values": [0.5, 0.6, 0.7],
            "metadata": {"genre": "fantasy", "author": "J. Doe"}
        }
    ]
)

print("Vectors 'doc1' and 'doc2' upserted with metadata!")

How Upsert Handles Updates

The 'update' part of 'upsert' means that if you try to upsert a vector with an id that already exists in your index, Pinecone won't create a new entry.

Instead, it will overwrite the existing vector's values and metadata with the new data you provide. This ensures data consistency and avoids duplicates.

Upserting Knowledge Check

You've learned about upserting. Let's check your understanding!

Recap: Mastering Upserts

Great job! You've learned the essentials of upserting data into Pinecone:

Upsert = Update + Insert: A single operation for adding new or modifying existing vectors.
IDs are Key: Each vector requires a unique ID for identification and updates.
Batching for Performance: Always upsert multiple vectors in batches for efficiency.
Metadata for Context: Add key-value pairs to vectors for powerful filtering and search.
Updates are Automatic: Upserting with an existing ID overwrites the old vector.

Next, we'll explore how to query these vectors to find similar items!

よくある質問

「Pineconeへのデータのupsert」レッスンは無料ですか？

はい。「Pineconeへのデータのupsert」の完全なテキストはこのウェブで無料で読めます。インタラクティブに演習し（組み込みコードエディタと24時間対応のAIチューター）、Vector Databases: Pinecone, Weaviate & pgvectorコースの残りをアンロックするには、CoddyKit PROにアップグレードしてください。 Vector Databases: Pinecone, Weaviate & pgvectorコースには全4レッスンが含まれています。

「Pineconeへのデータのupsert」で何を学びますか？

関連するメタデータとともにベクトルデータをPineconeインデックスへ挿入・更新する手順を習得します。ブラウザで直接実行するハンズオンコードでVector Databases: Pinecone, Weaviate & pgvectorを演習し、24時間対応のAIチューターがレッスンを進める中での質問に答えます。

Vector Databases: Pinecone, Weaviate & pgvectorを始めるのに経験は必要ですか？

事前経験は必要ありません。CoddyKitのVector Databases: Pinecone, Weaviate & pgvectorは初級者から上級者向けに構成されているため、ここから始めるか最初から始めて、自分のペースで進むことができます。これはレッスン2/4です。

「Pineconeへのデータのupsert」レッスンにはどのくらい時間がかかりますか？

ほとんどのCoddyKitレッスンは約5～10分かかります。各レッスンはコンパクトでインタラクティブなので、着実に進歩し、ウェブとアプリ全体で正確に前回の場所から再開できます。

このVector Databases: Pinecone, Weaviate & pgvectorレッスンでコードを書いて実行できますか？

はい。すべてのVector Databases: Pinecone, Weaviate & pgvectorレッスンに組み込みコードエディタが含まれているため、ブラウザでリアルコードを書いて実行し、即座のAIフィードバックを取得できます。ローカル設定は不要です。

このコースのすべてのレッスン

← Vector Databases: Pinecone, Weaviate & pgvectorに戻る