node created 2019/10/24
The problem with all current "AI"-driven systems be it facial recognition, voice recognition, translating, fraud detection, navigation, whatever, is that they are not 100% right, and when they're wrong, they're hilariously devastatingly super-wrong in a way that humans are not wrong.

But since the success modes are good and human-like, we assume that the failures are going to be human-like as well, but the failure-modes of these system are usually bizarre and alien.