If you want to delete a file permanently without sending it to the Recycle Bin, add the 'Permanently Delete' item to the Context Menu.

Sdelete, short for Secure Delete, is a powerful but little-known tool from Microsoft's Sysinternals suite that permanently wipes files and folders by overwriting data.