First, you need to understand that the only way to increase a happy ghast's flying speed in Minecraft is through commands. The creature is not affected by any swiftness potion thrown at it.

Here is a short guide to explain how you can bridge faster in Minecraft Java Edition.