Learn Before
Adding a Mislabeled Category to the Error Analysis Spreadsheet
If one suspects that the fraction of mislabeled images is significant, one should add a Mislabeled category to keep track of the fraction of examples that are mislabeled. The shown columns are Image, Dog, Great cat, Blurry, Mislabeled, and Comments.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Adding a Mislabeled Category to the Error Analysis Spreadsheet
When to Fix Mislabeled Dev Set Labels
Fix Dev and Test Set Labels Together
What does the term "mislabeled" mean in the context of error analysis on a dev set?
True or False: Mislabeled examples in the dev set refer to errors made by the algorithm.
In dev set error analysis, a "mislabeled" example has an incorrect class label _____ before the algorithm runs.
Match each component of a mislabeled example with its correct definition.
Order the sequence of events leading to the discovery of a mislabeled dev set example.
Explain the concept of mislabeled examples in the dev set during error analysis.
Diagnose the data issue in a cat classifier's dev set.
What is the origin of a mislabeled example in a dev set?
Which of the following is an example of a mislabeled data point (x, y) in a cat classification dev set?
True or False: In a mislabeled example (x, y), the class label y has an incorrect value.
Learn After
When should you add a 'Mislabeled' category to your error analysis spreadsheet?
True or False: You should add a 'Mislabeled' category to your error analysis spreadsheet only when you are certain—not merely suspicious—that examples are mislabeled.
When you suspect a significant fraction of dev set examples have incorrect labels, you should add a _____ column to your error analysis spreadsheet.
When should you add a 'Mislabeled' category to your error analysis spreadsheet according to Machine Learning Yearning?
The 'Mislabeled' column in the error analysis spreadsheet tracks examples where the ground-truth label itself is incorrect.
You should add a Mislabeled category to the error analysis spreadsheet when you suspect the _____ of mislabeled images is significant.
Match each column from the Machine Learning Yearning error analysis spreadsheet to what it captures.
Order the steps for setting up and using a Mislabeled column in an error analysis spreadsheet.
Which of the following is NOT listed as a column in the error analysis spreadsheet shown in Machine Learning Yearning (p. 33)?
According to Machine Learning Yearning, a 'Mislabeled' column should be included in every error analysis spreadsheet as a standard default.
The error analysis spreadsheet in Machine Learning Yearning has columns: Image, Dog, Great cat, Blurry, _____, and Comments.
Match each description to the corresponding column name in the Machine Learning Yearning error analysis spreadsheet.
Order the reasoning steps that lead a practitioner to add a 'Mislabeled' column rather than ignoring suspected label errors.
Explain how to set up error analysis when dataset labels are suspected to be incorrect.
Case study: Designing an error analysis spreadsheet for a dog classifier with incorrect labels.
Identify the tracking purpose and trigger for the 'Mislabeled' column.