How Task Difficulty Affects Training Data Needs
Question: For binary image classification problems, explain how the difficulty of the task changes the amount of training data needed. Include at least two examples that differ in difficulty.
Sample answer: As a task becomes harder, it usually takes more training data to reach the same performance level. Simple binary classification tasks can often be learned from a relatively small dataset, while tasks that require subtle distinctions need much more data. For example, deciding whether a document photo is tilted is a fairly easy binary task and may be learned with limited examples. By contrast, deciding whether a close-up image shows a hairline crack in a ceramic tile is harder because the relevant visual cue is small and easy to miss, so the model generally needs many more labeled images.
Key points:
- Simpler tasks need fewer training examples.
- Harder tasks need substantially more data.
- The answer should give at least two binary image classification examples with different difficulty levels.
Rubric: The essay should clearly explain the link between task difficulty and data requirements. It must include at least two binary image classification examples of different difficulty, such as a simple tilt check versus detecting a subtle crack, to illustrate the relationship.
0
1
Tags
Python Programming Language
Data Science
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Informal View of Task Difficulty in Neural Networks
Which binary classification task is likely the easiest and needs the fewest training examples?
True or False: A simpler binary classification problem usually needs fewer labeled examples than a more difficult one.
Simpler tasks need less data
Match each vision task to its relative difficulty rank in the ordered list (1 = easiest, 5 = hardest).
Order these five classification tasks from easiest (1) to hardest (5).
How does task difficulty influence data needs when dividing a pipeline into subtasks?
A model that must distinguish two very similar bird species usually needs less training data than a model that only decides whether a photo is indoors or outdoors.
Binary Output in Several Toy Image Tasks
Match each image task description to the difficulty category it best fits.
Put the task-formulation steps in a sensible order when choosing a component for a text-classification pipeline.
How Task Difficulty Affects Training Data Needs
Choosing the Easier Image Classification Task
Why Some Classification Tasks Need Less Training Data
Choose Pipeline Components That Can Be Learned from Limited Data