timescale/pgai-vectorizer-worker repository overview

pgai simplifies the process of building search⁠, Retrieval Augmented Generation⁠ (RAG), and other AI applications with PostgreSQL.

⁠Overview

The goal of pgai is to make working with AI easier and more accessible to developers. Because data is the foundation of most AI applications, pgai makes it easier to leverage your data in AI workflows. In particular, pgai supports:

Working with embeddings generated from your data:

• Automatically create and sync vector embeddings for your data (learn more⁠)
• Search your data using vector and semantic search (learn more⁠)
• Implement Retrieval Augmented Generation inside a single SQL statement (learn more⁠)
• Perform high-performance, cost-efficient ANN search on large vector workloads with pgvectorscale⁠, which complements pgvector.

Leverage LLMs for data processing tasks:

• Retrieve LLM chat completions from models like Claude Sonnet 3.5, OpenAI GPT4o, Cohere Command, and Llama 3 (via Ollama). (learn more⁠)
• Reason over your data and facilitate use cases like classification, summarization, and data enrichment on your existing relational data in PostgreSQL (see an example⁠).

Learn more about pgai: To learn more about the pgai extension and why we built it, read pgai: Giving PostgreSQL Developers AI Engineering Superpowers⁠.

Contributing: We welcome contributions to pgai! See the Contributing⁠ page for more information.

⁠Getting Started

Here's how to get started with pgai:

For a quick start, try out automatic data embedding using pgai Vectorizer:

• Try our cloud offering by creating a free trial account⁠ and heading over to our pgai Vectorizer documentation⁠.
• or check out our quick start guide⁠ to get up and running in less than 10 minutes with a self-hosted Postgres instance.

For other use cases, first Install pgai⁠ in Timescale Cloud, a pre-built Docker image, or from source. Then, choose your own adventure:

• Automate AI embedding with pgai Vectorizer⁠.
• Use pgai to integrate AI from your provider. Some examples:
  • Ollama⁠ - configure pgai for Ollama, then use the model to embed, chat complete and generate.
  • OpenAI⁠ - configure pgai for OpenAI, then use the model to tokenize, embed, chat complete and moderate. This page also includes advanced examples.
  • Anthropic⁠ - configure pgai for Anthropic, then use the model to generate content.
  • Cohere⁠ - configure pgai for Cohere, then use the model to tokenize, embed, chat complete, classify, and rerank.
• Leverage LLMs for data processing tasks such as classification, summarization, and data enrichment (see the OpenAI example⁠).