Implementations

• Encoder-Decoder Transformer
• Transformer Encoder in NumPy
• nanoGPT
• GPT2
• Binary Cross Entropy (BCE)
• Cross Entropy (CE)
• Softmax
• Mean Squared Error (MSE)
• Area-Under-Curve (AUC)
• Cosine Learning Rate Scheduler
• Position Encoding
• Single Neuron to Transformer
• Logistic Regression
• GD and SGD

System Design

• Weakly-Supervised Classification System
• Live Data Stream Classification System