Apple's new AI can automatically change compromised passwords, but giving an agent control of account credentials introduces risks involving prompt injection, lockouts, consent, and compromised devices.
I don’t blame people for it, honestly. If this massive company is telling them that this tool will work as advertised, and clearly believes in it because it’s being widely rolled out across their devices, most people who simply don’t understand the intricacies will believe they’re not being lied to, or at least deceived as to how capable the feature really could be against adversarial attacks or unfavorable circumstances.
People aren’t necessarily stupid per se, they just aren’t constantly skeptical of every single possible claim, and familiar enough with the underlying subjects to understand it in the first place.
In this case, it’s genuinely just “hit the big blue ‘Fix x passwords’ button” and it’s done. Most users won’t even realize it uses an AI model under the hood, and will just assume it’s something to do with how the internet works. And honestly, can we really blame people for that when it’s designed in such a simplistic manner?
If you are stupid enough to give AI permissions like that, you deserve the results.
I don’t blame people for it, honestly. If this massive company is telling them that this tool will work as advertised, and clearly believes in it because it’s being widely rolled out across their devices, most people who simply don’t understand the intricacies will believe they’re not being lied to, or at least deceived as to how capable the feature really could be against adversarial attacks or unfavorable circumstances.
People aren’t necessarily stupid per se, they just aren’t constantly skeptical of every single possible claim, and familiar enough with the underlying subjects to understand it in the first place.
In this case, it’s genuinely just “hit the big blue ‘Fix x passwords’ button” and it’s done. Most users won’t even realize it uses an AI model under the hood, and will just assume it’s something to do with how the internet works. And honestly, can we really blame people for that when it’s designed in such a simplistic manner?