Indexing Pipeline in RAG
- Indexing pipeline in RAG: The goal of indexing pipeline is store the data (external/private) in the vector database
Environment setup
- Create a new folder, initialize using uv
- Now add two packages
uv add langchain langchain-community
Document Loaders in Langchain
- Refer Here for the official docs
-
class diagram of hierarchy
-
All the loaders in langchain have a common interface which is BaseLoader
-
Refer Here for document loader notebook
Document Transformers
- Refer Here for document transformers
