Flutterby™! : Reinforcing bad machine learning

Underpaid Workers Are Being Forced to Train Biased AI on Mechanical Turk

Workers who label images on platforms like Mechanical Turk say they’re being incentivized to fall in line with their responses—or risk losing work.

This summed it up nicely:

“I sometimes find myself thinking like, I think this is a wrong answer ... but I know that if I say what I really think I will get booted from the job, and I will get bad scores,” said Sarah. "And I'm like, okay, I will just do what they want me to do. Even though I think it's a shitty choice.”

So we're paying people crappy wages to continue their education experience.