Encoders and Decoders in Transformer
- Encoder is used to understand
-
Decoder is used to generate
-
Most of the RECENT LLMS are decoder only (GPT, Claude)
How does Image generation work out
- Patch
- Computation
Now how can i make a model behave differently
- A model has Weights which are adjusted during training phases
- Now if we want to make the model behave differently, we need to adjust weights
- Option 1: Adjust all the weights (Full Fine tuning)
- Option 2: Come up with two matrices.
