With that VCF saved somewhere safe, remove your contacts from your phone. For Android, you can use the free Contact Remover, and for iOS the Spring Cleaning app (69p) looks best. Delete them all ...