ollama setup
- We can use ollama to run opensource llms
- installing ollama
- Using ollama we can pull models
- For the purposes of todays class lets use llama3.1:8b model
ollama run llama3.1:8b
Popular Opensource LLM
- Meta:
- llama
- Microsoft:
- PHI
- Google:
- Gemma
- OpenAI
- GPT-oss
- Ali
- Qwen
- Deepseek
- Mistral
Lets build hitl and use ollama
- Refer Here for basic graph which interacts with local ollama running llama3.1:8b
- Lets add hitl (Approval gate) interrupt + resume Refer Here for changes
Exercise:
- Try to come up with API Endpoints with interrupt and
- Refer Here for api endpoints and audit events
