リアルタイム更新と削除
ベクトルの効率的なリアルタイム更新や削除など、動的なデータを扱う技術を学びます。
「リアルタイム更新と削除」はCoddyKit上の無料Vector Databases: Pinecone, Weaviate & pgvectorレッスンです。 これはレッスン3/4です。 下記で完全なレッスンを無料で読むことができます。その後、ブラウザ内の組み込みコードエディタと24時間対応のAIチューターでハンズオン演習できます。 これはVector Databases: Pinecone, Weaviate & pgvector学習パスの一部であり、ウェブとCoddyKitアプリ全体で進捗が同期されます。 Vector Databases: Pinecone, Weaviate & pgvectorコースには全4レッスンが含まれています。
このレッスンの一部はまだ翻訳されておらず、英語で表示されています。
Handling Dynamic Vector Data
In real-world applications, data isn't static. It constantly changes! This means the vectors representing your data also need to be updated or removed from your vector database.
Imagine a product catalog where prices change, or user profiles where preferences evolve. Your vector database must reflect these changes to remain accurate.
Why Real-time Changes Matter
Real-time updates and deletions are crucial for maintaining the integrity and relevance of your applications:
- Accuracy: Ensuring your search results are always based on the freshest data.
- Relevance: Keeping recommendations and contextual information up-to-date for users.
- Data Governance: Complying with data retention policies or user requests to delete personal data (e.g., 'right to be forgotten').
Full Vector & Metadata Updates
To completely replace an existing vector's embedding values and its associated metadata in Pinecone, you use the upsert() method.
If a vector with the same ID already exists in your index, upsert() will overwrite its existing vector values and metadata with the new ones you provide. If no vector with that ID exists, it will be inserted as a new entry.
Example: Replacing a Vector
If a product's description changes significantly, its embedding might need a full replacement. We use upsert() with the existing ID to update both the vector and its metadata.
from pinecone import Pinecone, Index
import os
# For this example, we'll use a mock class instead of actual Pinecone connection
# In a real app, replace with:
# pc = Pinecone(api_key=os.environ.get("PINECONE_API_KEY"), environment=os.environ.get("PINECONE_ENVIRONMENT"))
# index = pc.Index("your-index-name")
class MockPineconeIndex:
def upsert(self, vectors):
print(f"Upserting vectors: {vectors}")
index = MockPineconeIndex()
# Assume 'product-123' already exists with an old vector and metadata
print("--- Before Update (Conceptual) ---")
print("Vector 'product-123' has old values and metadata.")
# New vector values and metadata for 'product-123'
new_vector_values = [0.9, 0.8, 0.7, 0.6, 0.5, 0.4, 0.3, 0.2] # Example 8-dim vector
new_metadata = {"category": "electronics", "price": 129.99, "status": "updated"}
# Use upsert to fully replace the vector and metadata for 'product-123'
index.upsert(
vectors=[
{"id": "product-123", "values": new_vector_values, "metadata": new_metadata}
]
)
print("\n--- After Update (Conceptual) ---")
print("Vector 'product-123' now has new values and metadata, replacing old ones.")Partial Updates with `update()`
Sometimes you only need to change a vector's metadata, or perhaps just its vector values without touching metadata. Pinecone provides an update() method for these partial modifications.
Using update() is more efficient than upsert() when you only have partial changes, as you only send the data that has changed, rather than replacing the entire entry.
Example: Updating Metadata Only
To update only the metadata for an existing vector, you use the update() method. You provide the vector's ID and the set_metadata parameter with the new metadata. The existing vector values will remain untouched.
from pinecone import Pinecone, Index
import os
# Mock class for Pinecone's update method
class MockPineconeIndexUpdate:
def update(self, id, values=None, set_metadata=None):
print(f"Updating vector ID: {id}")
if values: print(f" New values provided (vector will be replaced): {values}")
if set_metadata: print(f" Setting metadata: {set_metadata}")
index_update = MockPineconeIndexUpdate() # Replace with pc.Index("your-index-name")
# Assume 'product-456' exists with vector and metadata like {'stock': 10, 'color': 'blue'}
print("--- Before Metadata Update (Conceptual) ---")
print("Vector 'product-456' has existing metadata.")
# Update only the stock count for 'product-456'
updated_metadata = {"stock": 5, "last_checked": "2023-10-27"}
index_update.update(id="product-456", set_metadata=updated_metadata)
print("\n--- After Metadata Update (Conceptual) ---")
print("Vector 'product-456' now has updated stock and last_checked metadata. Other metadata and vector values are unchanged.")Deleting Vectors in Pinecone
Removing vectors from your Pinecone index is a common operation. Pinecone offers flexible ways to delete vectors:
- By one or more specific ID(s).
- By matching a metadata filter.
- Deleting all vectors within an index or a specific namespace.
This functionality is vital for data hygiene, managing outdated information, and adhering to privacy regulations.
Example: Deleting a Single Vector
The most straightforward way to delete a vector is by its unique ID. You pass a list of one or more IDs to the delete() method.
from pinecone import Pinecone, Index
import os
# Mock class for Pinecone's delete method
class MockPineconeIndexDelete:
def delete(self, ids=None, delete_all=False, filter=None):
if ids: print(f"Deleting vectors with IDs: {ids}")
elif delete_all: print("Deleting all vectors.")
elif filter: print(f"Deleting vectors with filter: {filter}")
index_delete = MockPineconeIndexDelete() # Replace with pc.Index("your-index-name")
# Assume 'user-profile-789' exists in the index
print("--- Before Deletion (Conceptual) ---")
print("Vector 'user-profile-789' is present.")
# Delete a single vector by its ID
index_delete.delete(ids=["user-profile-789"])
print("\n--- After Deletion (Conceptual) ---")
print("Vector 'user-profile-789' has been removed from the index.")Deleting Many Vectors by Filter
While you can delete multiple vectors by providing a list of IDs, a powerful feature is deleting vectors based on a metadata filter.
This allows you to efficiently remove all vectors that match specific metadata criteria, such as all products from a certain category, or all inactive user profiles, without knowing their individual IDs.
Example: Deleting with Filters
Let's say we want to remove all vectors associated with products marked as 'out_of_stock'. We can use a filter object within the delete() method.
from pinecone import Pinecone, Index
import os
# Mock class for Pinecone's delete method
class MockPineconeIndexDelete:
def delete(self, ids=None, delete_all=False, filter=None):
if ids: print(f"Deleting vectors with IDs: {ids}")
elif delete_all: print("Deleting all vectors.")
elif filter: print(f"Deleting vectors with filter: {filter}")
index_delete = MockPineconeIndexDelete() # Replace with pc.Index("your-index-name")
# Assume several products exist, some with 'status': 'out_of_stock'
print("--- Before Filtered Deletion (Conceptual) ---")
print("Vectors for products with status 'out_of_stock' are present.")
# Delete all vectors where the 'status' metadata is 'out_of_stock'
index_delete.delete(filter={
"status": "out_of_stock"
})
print("\n--- After Filtered Deletion (Conceptual) ---")
print("All vectors for 'out_of_stock' products have been removed.")Check Your Understanding
Which of the following statements about updating and deleting vectors in Pinecone are TRUE?
Recap & Next Steps
Great job! You've learned how to keep your Pinecone index dynamic and up-to-date.
- We explored how
upsert()performs a full replacement of vectors and metadata. - You saw how the
update()method is used for efficient partial changes, especially for metadata. - Finally, we covered various ways to delete vectors, including by ID and using powerful metadata filters.
These operations are essential for managing evolving datasets in real-world AI applications.
よくある質問
「リアルタイム更新と削除」レッスンは無料ですか？
はい。「リアルタイム更新と削除」の完全なテキストはこのウェブで無料で読めます。インタラクティブに演習し（組み込みコードエディタと24時間対応のAIチューター）、Vector Databases: Pinecone, Weaviate & pgvectorコースの残りをアンロックするには、CoddyKit PROにアップグレードしてください。 Vector Databases: Pinecone, Weaviate & pgvectorコースには全4レッスンが含まれています。
「リアルタイム更新と削除」で何を学びますか？
ベクトルの効率的なリアルタイム更新や削除など、動的なデータを扱う技術を学びます。 ブラウザで直接実行するハンズオンコードでVector Databases: Pinecone, Weaviate & pgvectorを演習し、24時間対応のAIチューターがレッスンを進める中での質問に答えます。
Vector Databases: Pinecone, Weaviate & pgvectorを始めるのに経験は必要ですか？
事前経験は必要ありません。CoddyKitのVector Databases: Pinecone, Weaviate & pgvectorは初級者から上級者向けに構成されているため、ここから始めるか最初から始めて、自分のペースで進むことができます。 これはレッスン3/4です。
「リアルタイム更新と削除」レッスンにはどのくらい時間がかかりますか？
ほとんどのCoddyKitレッスンは約5～10分かかります。各レッスンはコンパクトでインタラクティブなので、着実に進歩し、ウェブとアプリ全体で正確に前回の場所から再開できます。
このVector Databases: Pinecone, Weaviate & pgvectorレッスンでコードを書いて実行できますか？
はい。すべてのVector Databases: Pinecone, Weaviate & pgvectorレッスンに組み込みコードエディタが含まれているため、ブラウザでリアルコードを書いて実行し、即座のAIフィードバックを取得できます。ローカル設定は不要です。
このコースのすべてのレッスン
- メタデータによるフィルタリング
- 名前空間の管理
- リアルタイム更新と削除
- 疎ベクトルと密ベクトルによるハイブリッド検索