Usually, this is done via APK files. APK files are Android installer packages downloaded from the internet, and they're often provided by third parties like websites dedicated to hosting the files.

Chinese OEM Xiaomi wants people to stop extracting APK files from Android. It added an entry into the Android OSP.