Gen-AI Developer Classroom notes 27/Nov/2025

Transformers

• Refer Here
• Steps:
  • Text -> Tokens
  • Token -> Embeddings
  • Adding positions (Positonal Encoding)
  • Multi head Self Attention (Q, K, V)
  • MLP
  • Probability Distribution
• Prompt:

Act as a transfomer, I will be giving you a text show me <> in plain english and also in raw form

Encoder and Decoder

• Encoder understands/summarizes
• Decoder Generates.

How LLMs are trained

• Training

• Transformer + Teach social skills + Communications

  • instruct models
    • (after training we teach manners)
• Add additional qualities
  • Fine tuning
• RLHF (Reinforcement learning with Human feedback)
• Self Supervision.