Pythonにはiteratableなオブジェクトの要素に対して、 それぞれ関数を適用するmap関数があります。 これをマルチプロセスで行うものがmultiprocessingモジュールのPoolクラスに実装されています。

Python's "multiprocessing" module feels like threads, but actually launches processes. Many people, when they start to work with Python, are excited to hear that the language supports threading. And, ...

The multiprocessing module spins up multiple copies of the Python interpreter, each on a separate core, and provides primitives for splitting tasks across cores.

Llama 2 API with multiprocessing The video tutorial below provides valuable insights into creating an API for the Llama 2 language model, with a focus on supporting multiprocessing with PyTorch.