.learn()
what I have learned so far
-
Why cross entropy, of all things: from BCE to KL divergence
Why classification uses cross entropy instead of MSE, traced as a single line from information content and entropy through BCE and MLE to KL divergence.
-
ROUGE
Recall-Oriented Understudy for Gisting Evaluation
-
Duck typing, and how Python handles types
What duck typing is, how ABCs and Protocol affect it, and how type hints coexist with duck typing.
-
Four perspectives on matrix multiplication
The four different perspectives of matrix multiplication.
-
How to teach your embedding model new words
A step-by-step guide on adding new vocabulary to a Hugging Face sentence-transformer model, including fine-tuning and using it in LangChain.