From the course: Building Recommender Systems with Machine Learning and AI
Unlock this course with a free trial
Join today to access over 23,200 courses taught by industry experts.
Review ways to measure your recommender - Python Tutorial
From the course: Building Recommender Systems with Machine Learning and AI
Review ways to measure your recommender
- [Man] We've covered a lot in this section so far, but it's important to understand what makes a good recommender system, before we start trying to build one. So let's reinforce some of what we've learned, with another short quiz. Your first question is, "Which metric was used to evaluate the Netflix prize?" By putting a one million dollar bounty on improving a specific metric, Netflix reshaped the world of recommender system research to focus on that metric, for better or worse. What was it? The answer is, "Root mean squared error." Or "RMSE." But as we've said, accuracy isn't everything in the real world. Users don't care how accurately you can predict how they rated movies they've already seen, they care about your ability to show them new things that they will love. Arguably, Netflix should've focused on a metric more focused on top end recommendations, which leads to our next question. "What's a metric for top-n recommenders that accounts for the rank of the predicted items?" In…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
(Locked)
Train/test and cross-validation3m 49s
-
(Locked)
Accuracy metrics (RMSE and MAE)4m 6s
-
Top-N hit rate: Many ways4m 35s
-
(Locked)
Coverage, diversity, and novelty4m 55s
-
(Locked)
Churn, responsiveness, and A/B tests5m 6s
-
(Locked)
Review ways to measure your recommender2m 55s
-
(Locked)
Walkthrough of RecommenderMetrics.py6m 53s
-
(Locked)
Walkthrough of TestMetrics.py5m 8s
-
(Locked)
Measure the performance of SVD recommendations2m 24s
-
(Locked)
-
-
-
-
-
-
-
-
-
-
-