Execution framework for multi-task model parallelism. Enables the training of arbitrarily large models with a single GPU, with linear speedups for multi-gpu multi-task execution.
machine-learning deep-learning gpu distributed-computing pytorch machine-learning-library task-parallel systems-engineering large-scale-machine-learning model-parallel
-
Updated
Aug 13, 2023 - Python