You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
#3771 binds distributed training to the active accelerator instead of assuming CUDA. Writing that change surfaced a second, independent defect on XPU.
get_default_dist_backend() returns "nccl" for every non-NPU device. Since get_accelerator_device_type() does select XPU, an XPU run reaches init_process_group(backend="nccl") and cannot start at all on a build without NCCL — the same class of failure #3771 fixes for Ascend NPU.
but it advertises a runtime path that nobody here can exercise. We have no Intel XPU hardware in our environment, so under the repository's hardware-validation requirement the XPU arm was the only path #3771 changed without real-device evidence. #3771 therefore keeps the historical "nccl" value for XPU — i.e. exactly the pre-PR behaviour, unchanged — and the selection is tracked here for whoever has the hardware.
What a fix needs
Add the XPU entry above (keep "ccl" only for builds that positively confirm it through torch.distributed.is_ccl_available()).
Run an exact-head 2-rank torchrun on Intel XPU with XCCL, showing per-rank xpu:0 / xpu:1 binding, an all_reduce, DDP forward/backward, the end-of-epoch cache release, plus the exact PyTorch / oneAPI / device versions.
Update tests/test_distributed_device_setup.py accordingly — the current test pins the narrowed behaviour (XPU stays "nccl" even when a build reports is_xccl_available()), so it needs to be flipped.
The mirror of this on the PR side: #3771 is narrowed so it keeps the pre-PR "nccl" value for XPU (no behaviour change there), which is what makes that PR's every changed runtime path verifiable on hardware. See the reply on #3771 for the exact-head Ascend evidence that remains in that PR.
Activity
li-lizhe commentedon Oct 17, 2026
The mirror of this on the PR side: #3771 is narrowed so it keeps the pre-PR
"nccl"value for XPU (no behaviour change there), which is what makes that PR's every changed runtime path verifiable on hardware. See the reply on #3771 for the exact-head Ascend evidence that remains in that PR.fix(train): select XCCL as the XPU distributed backend