Why not use ChatGPT or Gemini Directly

• All the LLM (Large Language Models) are pre-trained on publicly available information.
• Then why don’t i use for my needs:
  • LLMS donot have access to private data:
    • My organization has technical manuals, I want to create a chatgpt/gemini kind of solution around user manuals.
  • LLMs can hallucinate
  • LLMs can have bias
  • LLMs cannot perform actions:
    • Chatgpt cannot send email
    • Chatgpt cannot stop servers.
  • LLMs will have cutoff data of training they might not have real time data access

What are different types of Applications

• RAG:
  • This helps in building an intelligent information retrieval system which knows my organization private data and is still secure.
  • Examples:
    • IT Ticket RAG
    • Customer Care Bot
• Agentic AI:
  • Making AI Perform Autonomous Actions and take human feedback if required
  • Agent can perform actions

How do LLMs Work

• Terms
  • Modal: Type (Text/Image/Video/audio)
  • prompt: input
  • completion: output
  • Model (LLM)
    
• LLMs have capability of understanding Natural language.
• LLM generates content based on pre-training
• What do LLMs do?
  • At a very high level they predict next word (token).