Track 08: Embeddings & Vector Databases
How text becomes a vector, what "similarity" means geometrically, how to split real documents into retrievable chunks, and how approximate nearest-neighbor search makes similarity search fast at scale. The direct prerequisite for track 09 (RAG) — most RAG failures are actually embedding or chunking failures.
Modules
- What an Embedding Is
- From Word2Vec to Sentence Embeddings
- Embedding Models Compared
- Cosine Similarity and Distance Metrics
- The Curse of Dimensionality
- Generating Embeddings at Scale
- Chunking: Fixed-Size Strategies
- Chunking: Semantic and Structural
- Chunk Overlap and Metadata
- The Vector Database Landscape
- pgvector and Postgres
- Chroma and Local Development
- Pinecone, Weaviate and Qdrant
- Exact vs. Approximate Search
- HNSW Explained
- IVF, Product Quantization and Other Indexes
- Metadata Filtering and Hybrid Queries
- Capstone Project