Your scripts still run as native PowerShell, but are encapsulated into an EXE file. To quote the Microsoft Web page referenced above, the utility "does not convert the PowerShell script to an ...

Renegade's Random Tech weblog has a simple how-to for converting batch or .VBS scripts into executable forms using a lesser-known Windows program called IExpress.