This worked for me:
GRANT USAGE ON *.* TO 'username'@'localhost';
DROP USER 'username'@'localhost';
This creates the user if it doesn’t already exist (and grants it a harmless privilege), then deletes it either way. Found solution here: http://bugs.mysql.com/bug.php?id=19166
Updates: @Hao recommends adding IDENTIFIED BY
; @andreb (in comments) suggests disabling NO_AUTO_CREATE_USER
.