Transformers: Attention is all you need
- Token: A prompt is broken down into multiple tokens
- Embeddings:
- A vector representation of all possible words
- GPT 3.5 (50k words)
- Vector: A point in a larger dimension
- Words can be converted into vectors (Word2Vec) Refer Here for visualization
