megengine.distributed.backend#

backend = <property object>#

Get or set backend of collective communication. Available backends are [‘nccl’, ‘shm’, ‘rccl’]

实际案例

import megengine.distributed as dist
dist.backend = "nccl"