Day 2 - ML Basics and Video Recommendation System
Posted: Sun Apr 17, 2022 5:41 pm
ML Basics Topics:
- Handle imbalance class distribution
- Choose the right loss function
- Retraining requirements
- Non-stationary problem: Bayesian Logistic Regression (paper: https://quinonero.net/Publications/AdPr ... -final.pdf)
- Exploration vs. exploitation: Thompson Sampling
- Offline/Online metrics & AB Testing
Video Recommendation System Topics:
- Problem statement
- Metrics design and requirements
- Metrics
- Offline metrics
- Online metrics
Requirements- Training
- Inference
Summary- Multi-stage models
Candidate generation model
Feature engineering
Training data
Model
Ranking model
Feature engineering
Training data
Model- Calculation & estimation
Assumptions
Data size
Bandwidth
Scale- System design
High-level system design
Challenges
Huge data size
Imbalance data
High availability- Scale the design
- Follow up questions
- Summary
Reference:
https://en.wikipedia.org/wiki/Matrix_fa ... 20matrices
https://en.wikipedia.org/wiki/Collaborative_filtering
https://ai.googleblog.com/2020/07/annou ... ector.html
https://engineering.fb.com/2017/03/29/d ... ty-search/