I’m using 7.1.31849.0.
I just tried it again, after using shift+delete on an email, it does seem to get removed from All Email. But when I login on www.gmail.com using a web browser, the mail is still in the All Maill folder.
According to the link, mail should not bypass the trash folder, it should be moved to trash and then deleted.