Update dependency torch to v2.13.0

[renovate]

ℹ️ Note

This PR body was truncated due to platform limits.

This PR contains the following updates:

Package	Change	Age	Confidence
torch	==2.9.1 → ==2.13.0

---

Release Notes

pytorch/pytorch (torch)

v2.13.0: PyTorch 2.13.0 Release

Compare Source

PyTorch 2.13.0 Release Notes

• Highlights
• Backwards Incompatible Changes
• Deprecations
• New Features
• Improvements
• Bug fixes
• Performance
• Documentation
• Developers

Highlights

FlexAttention lands on Apple Silicon (MPS), with up to ~12x speedup over SDPA on sparse patterns, and gains a deterministic backward path on CUDA for reproducible gradient computation.

CuTeDSL "Native DSL" backend gives Inductor a second high-performance code path (alongside Triton) for key GPU operations, with faster compilation. [Prototype]

nn.LinearCrossEntropyLoss combines the final prediction and loss computation to cut peak GPU memory by up to 4x for large-vocabulary language model training.

torchcomms, a new communications backend for PyTorch Distributed, improves fault tolerance, scalability, and debuggability for large-cluster training.

FSDP2 now overlaps reduce-scatter and all-gather communications via a dedicated process group (opt-in), increasing distributed training throughput.

Python 3.15 wheel support for PyTorch on Linux via the pytorch repository index, including builds compatible with free-threaded 3.15t.

Broader platform support: ROCm gains AOTriton 0.12b with native HIP CMake, Arm adds Armv9-A torch.compile targeting, and Intel XPU exposes new device telemetry APIs.

For more details about these highlighted features, you can look at the release blogpost. Below are the full release notes for this release.

Tracked Regressions

ROCm wheels break torch.compile on CPU in environments without a GPU

Running a torch==2.13.0+rocm7.2 wheel in an environment where no GPU is available (torch.cuda.is_available() is False) breaks torch.compile on the CPU path: the first compile raises RuntimeError: Can't detect vectorized ISA for CPU (#​189194). This is a regression from torch==2.12.1+rocm7.2, which compiles CPU code fine (detecting e.g. VecAVX2) in the same setup. The 2.13 ROCm wheel appears to rely on something present in the ROCm builder image to detect the CPU vectorized ISA, so it works when run on a ROCm image but fails on a plain CPU-only image.

Workaround: run the +rocm wheel on a ROCm image, or install a standard CPU/CUDA build for GPU-less environments.

Backwards Incompatible Changes

• Stop building CPython 3.13t (free-threaded) binaries (#​182951)

  Upstream pypa/manylinux removed CPython 3.13t (free-threaded) on 2026-05-07, because 3.13t
  was experimental and has been superseded by the now-non-experimental CPython 3.14t. As a result,
  PyTorch 2.13 no longer ships cp313t wheels (Linux, Triton, and related artifacts). Users on the
  free-threaded interpreter should move to Python 3.14t.

  PyTorch 2.12:

  # cp313t (free-threaded 3.13) wheels were available
  python3.13t -m pip install torch

  PyTorch 2.13:

  # Use free-threaded Python 3.14t instead
  python3.14t -m pip install torch

• Bare PyObject is no longer allowed in operator schemas (#​184209)

  Bare PyObject was accidentally accepted in operator schema strings in
  PyTorch 2.12. This was undocumented and is now rejected, since torch.compile
  does not support arbitrary PyObject inputs to custom ops. If
  you parse or register a schema with a bare PyObject argument or return type,
  you will now get a schema parse error.

  PyTorch 2.12:

  >>> from torch._C import parse_schema
  >>> parse_schema("foo(PyObject x) -> ()")  # accepted

  PyTorch 2.13:

  >>> from torch._C import parse_schema
  >>> parse_schema("foo(PyObject x) -> ()")  # raises a schema parse error

• Remove Bazel build support (#​180883)

  The Bazel build was never broadly adopted and still depended on the antiquated Bazel 6,
  while the wider ecosystem has since moved to Bazel 9. All Bazel build files and CI jobs have
  been removed. Users building PyTorch with Bazel should migrate to the supported CMake/pip install
  build flow.

  PyTorch 2.12:

  # Build PyTorch with Bazel
  bazel build //:torch

  PyTorch 2.13:

  # Bazel build files have been removed; build from source with pip instead
  pip install --no-build-isolation -e .

• Enforce C++20 minimum in header guards (#​178150). In PyTorch 2.13, C++20 is now required to import PyTorch headers.

• StorageImpl's built-in copy-on-write (COW) materialization is replaced by a pluggable materializer hook (#​179063)

  StorageImpl no longer knows about COW directly. Its internal COW entry points
  StorageImpl::is_cow(), StorageImpl::maybe_materialize_cow(), and the friend
  cow::materialize_cow_storage() have been removed in favor of a single pluggable
  MaterializeFn hook (void(*)(StorageImpl*)) that a backend registers to run once,
  on the first mutable data-pointer access. COW is now just one consumer of this hook
  (c10::impl::cow::materialize_cow), and all COW behavior (lazy clone, refcounted
  shared data, copy-on-write) is unchanged. This also gives accelerator backends and
  eager-mode graph compilers a zero-fast-path-cost place to commit deferred allocations
  or materialize symbolic buffers on first mutation.

  This is a C++-only change. It affects out-of-tree backends/extensions that called the
  removed StorageImpl COW symbols directly; they will fail to compile against 2.13
  with errors such as no member named 'is_cow' in 'c10::StorageImpl'. Migrate to the
  new hook API (set_materializer() / has_materializer() / clear_materializer()).

  PyTorch 2.12:

  // Detect a COW storage and force it to materialize.
  if (storage.is_cow()) {
    storage.maybe_materialize_cow();
  }

  PyTorch 2.13:

  // Register a one-shot materializer; it runs on the next mutable-data access
  // and then clears itself. COW registers c10::impl::cow::materialize_cow this way.
  storage.set_materializer(&my_backend_materialize);  // void(StorageImpl*)
  
  // `has_materializer()` replaces `is_cow()` for "is a deferred materialization pending?"
  if (storage.has_materializer()) { /* ... */ }

• Convert shared_ptr<Node> to intrusive_ptr<Node> (#​181139). This changes the signature of Tensor::grad_fn. Accesses to Tensor.grad_fn() should change from std::shared_ptr<Node> to c10::intrusive_ptr<Node>. Similarly, construction of a C++ autograd function should change:

  PyTorch 2.12:

  std::shared_ptr<CustomCppNode> node(new CustomCppNode(), torch::autograd::deleteNode);

  PyTorch 2.13:

  auto node = c10::make_intrusive<CustomCppNode>();

• The minimum supported NCCL version when building from source is now 2.23 (#​186292)

  PyTorch now requires NCCL >= 2.23 at compile time, and the preprocessor/runtime gates that guarded NCCL features introduced in 2.23 or earlier have been removed. Users who build PyTorch from source against a system NCCL older than 2.23 will hit compile errors against the dropped gates. Upgrade the NCCL installation to >= 2.23 to build. The prebuilt PyTorch wheels already bundle a compatible NCCL, so pip/conda users are unaffected.

• Remove named tensors (#​173895)

  The named tensor feature (a long-deprecated prototype) has been fully removed to reduce overhead and code bloat. All associated Python and C++ APIs are gone, including Tensor.names, Tensor.rename(), Tensor.refine_names(), Tensor.align_to(), Tensor.align_as(), torch.align_tensors(), the names= keyword on factory functions (e.g. torch.zeros, torch.empty, torch.ones), and the C++ Dimname / DimnameList APIs. Code that previously relied on named dimensions must track dimension order positionally and avoid usage of any of these now-removed APIs or op overloads.

• The onednn::qconv2d_pointwise.binary and .binary_tensor operators no longer alias their input but rather return fresh tensors. Previously these ops mutated the qaccum input buffer and returned it directly, violating the PyTorch invariant that custom operator outputs must not alias inputs. This silently bypassed aliasing checks via the old -> Tensor(a!) schema and would become a hard error in a future PyTorch version (as mentioned in #​182063), so the schema and implementation were corrected to return a fresh output. Most users are unaffected, only code that calls these ops directly and relies on the in-place mutation of qaccum must now read the returned tensor instead. (#​177171)

Deprecations

• Custom operators that return an output aliasing one of their inputs are deprecated (#​182063)

  When a custom operator returns an output that is the same tensor as (or otherwise aliases) one of its inputs under torch.compile, PyTorch now emits a UserWarning stating that this is deprecated and will become an error in a future version of PyTorch. Previously the warning stated the change would land in PyTorch 2.12; that timeline has been pushed back. To update your code, return a clone of the offending output instead of the input, or refactor the operator so it does not return the aliased tensor.

  Deprecated:

  @​torch.library.custom_op("mylib::foo", mutates_args=())
  def foo(x: torch.Tensor) -> torch.Tensor:
      return x  # output aliases the input -- deprecated

  Updated:

  @​torch.library.custom_op("mylib::foo", mutates_args=())
  def foo(x: torch.Tensor) -> torch.Tensor:
      return x.clone()  # return a clone instead

• Creating tensors with the quantized dtypes quint8, qint8, and qint32 is now deprecated and emits a warning. This covers both Python and C++ call sites; see #​184982 for migration guidance (#​184984)

  PyTorch 2.12:

  >>> x = torch.quantize_per_tensor(torch.randn(3), 0.1, 0, torch.quint8)

  PyTorch 2.13:

  >>> x = torch.quantize_per_tensor(torch.randn(3), 0.1, 0, torch.quint8)
  UserWarning: Creating tensors with quantized dtypes (quint8, qint8, qint32) is deprecated

• Rename distributed collective ops to the _single naming scheme and deprecate the old names (#​186123, #​186124, #​186125, #​186134, #​186135, #​186144)

  To align the public torch.distributed collective APIs with the naming used by torchcomms' TorchCommBackend, all_gather_into_tensor is renamed to all_gather_single and reduce_scatter_tensor to reduce_scatter_single. The previous names continue to work as thin wrappers that delegate to the new functions, but now emit a FutureWarning.

  PyTorch 2.12:

  dist.all_gather_into_tensor(output, input)
  dist.reduce_scatter_tensor(output, input)

  PyTorch 2.13:

  dist.all_gather_single(output, input)
  dist.reduce_scatter_single(output, input)

New Features

Python Frontend

• Add two new operator tags, torch.Tag.inplace and torch.Tag.out, that let an operator declare how it writes its result: inplace means it mutates a tensor in place, and out means it writes into a caller-provided output tensor. Native PyTorch operators are tagged automatically, and custom operators defined with torch.library can opt in by adding the tag. To be tagged inplace, an operator must take the tensor it mutates as its first positional argument (declared as Tensor(a!), and the only mutable argument) and return that same tensor. Tagging a custom operator this way improves its behavior under torch.compile: inplace ops now go through auto_functionalize, so the reinplacing pass can analyze clones and skip unnecessary copies, and both inplace and out ops get their fake/meta kernels generated for free. See the Python custom operators tutorial for how to author and tag custom operators. (#​181100, #​181099, #​184199, #​184200, #​184201, #​184202, #​184203, #​180851, #​180852)
• Add const_data_ptr() Python binding to torch.Tensor for read-only data pointer access (#​180382)
• Add an abbr property to torch.dtype that returns a dtype's short string abbreviation (e.g. torch.float32.abbr returns "f32") (#​177296)
• Allow positional arguments to be passed as keyword arguments to autograd custom Functions (#​182206)
• Expose rearrange in the torch.func namespace for einops-style tensor reshaping (#​173183)

torch.nn

• Add nn.LinearCrossEntropyLoss, a fused linear-projection plus cross-entropy loss module that avoids materializing the full logits tensor (#​181573, #​185852, #​172286, #​186113)

Autograd

• Add torch.autograd.graph.region_activation_memory_budget (#​185979)
• Support passing gradient inputs as a dict to torch.autograd.grad and torch.autograd.backward (#​178140)

Distributed

• Add a registration API for symmetric memory arguments (lib.register_symm_mem_args()), letting operators (including out-of-tree ops) declare which arguments require symmetric-memory allocation (#​173513)

• Remove NCCLSymmetricMemory's explicit dependency on ProcessGroupNCCL, enabling symmetric memory to work with out-of-tree backends such as torchcomms (#​184260)

• Support accessing the ReduceOp.PREMUL_SUM factor from Python when implementing process group backends in Python (#​185863)

• Expose the NCCL 2.30 maxP2pPeers config binding (#​181686)

• Add rocSHMEM Triton integration for symmetric memory on ROCm (#​178658)

• Support passing extra keyword arguments to the loss function in pipeline schedules via a new loss_kwargs parameter to step(), enabling loss functions that require arguments beyond (output, target) (such as chunked cross-entropy needing token counts for scaling) (#​181057)

Distributed FSDP2

• Add FSDPModule.set_separate_reduce_scatter_group to give reduce-scatter its own NCCL communicator, enabling opt-in overlap of all-gather and reduce-scatter (#​186335)
• Add set_reduce_scatter_max_input_buffers to keep multiple reduce-scatter input buffers in flight, so backward compute no longer stalls waiting to recycle a single reduce-scatter buffer (#​186000)

Profiler

• Profiler/Kineto now emits channel metadata on CUDA backends (#​185968)

Dynamo

• Add torch.compiler.set_default_backend to override the default torch.compile backend globally, so out-of-tree backend authors don't need to pass backend= at every call site (following the pattern of torch.set_default_dtype/torch.set_default_device). Explicit backend= arguments still take precedence (#​178944)
• Add torch.compile(f, isolate_recompiles=True) to give each torch.compile call its own isolated cache bucket, preventing cross-compile interference in cache lookups and recompile-limit checks when multiple torch.compile calls target the same function (#​178351)
• Add register_multi_grad_hook support to @leaf_function, allowing a backward hook to fire once per backward pass when all requires_grad inputs have their gradients computed (#​179609)

Inductor

• Add flash-decoding support to the CPU FlexAttention template (chosen when query length is 1) with a new configurable PARTITION_SIZE kernel option (#​159835)
• Add Triton convolution backward kernels (input and weight gradients) as an autotuning backend in place of the ATen-only fallback (#​178945)
• Add an Inductor FX pass (decomp_comms) that eliminates all_gather for Gram-matrix optimizer patterns (Muon/Shampoo) under FSDP, gated by config.aten_distributed_optimizations.allow_comms_decompositions, yielding 1.25-1.95x training speedups (#​184370)

Ahead-Of-Time Inductor (AOTI)

• Generated C shims for the AOTI stable ABI are now versioned and gated by TORCH_TARGET_VERSION, so shims introduced in newer releases are only exposed when the target version supports them (#​181916)
• Triton CPU AOTI models now work end-to-end through the public torch._inductor.aoti_compile_and_package / aoti_load_package API, including packaging and loading of the multiple .so files emitted per kernel (#​182251)
• Added stable C shim functions (torch_exception_get_what, torch_exception_get_what_without_backtrace, and STABLE_TORCH_ERROR_CODE_CHECK) so extensions built against the stable ABI can retrieve the original error message across the C API boundary (target version 2.13+) (#​180135)
• Added a stable AOTI stream shim aoti_torch_stream_native_handle and torch::stable::accelerator::Stream::nativeHandle(), gated behind TORCH_FEATURE_VERSION >= 2.13, for retrieving a native stream handle from the stable ABI (#​183930)

Release Engineering

• Add Python 3.15 wheel builds across Linux (CPU/CUDA), Triton, ROCm, and XPU (#​182954, #​184600, #​185409, #​184829, #​184891, #​184906, #​185094)

CUDA

• Add CUDAGraph.get_graph_data() for graph topology introspection (#​183165)
• Lightweight API to get private pool reserved memory bytes (#​178240)

MPS

• Add FlexAttention support for MPS (#​182552, #​186215)
• Add support for torch.distributions.Dirichlet on MPS by adding _sample_dirichlet and _dirichlet_grad Metal implementations (#​185458, #​185854)
• Add grid_sampler_2d backward support on MPS (#​179756)
• Add grid_sampler_3d backward support on MPS (#​179388)
• Add lcm support on MPS via a new Metal kernel (#​186279)
• Add complex support to c10/metal/reduction_utils.h (#​180708) and a complex->bool specialization (#​185938)

ROCm

• Enable external events in CUDA graphs (#​178264)
• Enable GPU Address Sanitizer build (#​183792, #​176461)
• Improve Inductor GEMM search space performance using the Origami project (#​172512)
• Use CMake native HIP language support, enable_language(HIP) (#​180485)
• New Inductor benchmarker based on Torch Profiler (#​175097)

XPU

• Add XPU device telemetry APIs for temperature, frequency, power draw, engine utilization, memory bandwidth usage, and used device memory through torch.xpu.* (#​181082, #​183427, #​183428, #​183429, #​183430, #​183431)
• Add FP8 blockwise scaling support for scaled_mm on XPU (#​173630, #​176043)

Improvements

Python Frontend

• Make it possible to load safetensors with torch.load (#​170592)
• Make Storage.pin_memory / Storage.is_pinned device-agnostic (#​186223)
• Add op_overloads to OpOverloadPacket to enumerate an operator's overloads (#​182993)

torch.nn

• Expose num_splits in FlashAttention-2 and bump the flash-attention submodule (#​179760)
• Support linear_bias in linear_cross_entropy on the reference and chunked paths (#​185129, #​185276)

Optimizer

• Fix SequentialLR wrong learning rate initialization when milestones contain 0 (#​185986)

Autograd

• Implement autograd derivatives for torch.nextafter (#​148820)
• Add torch.autograd.enforce_grad_layout_policy to control the memory layout policy for accumulated gradients (#​180552)

Distributed

• When TorchComms is enabled, route new_group through split_group for subgroup creation, raising NotImplementedError for arguments split_group cannot honor (e.g. use_local_synchronization=True, sort_ranks=False) instead of silently falling back (#​185416)

• Delegate dist.new_group to custom process group subclasses (#​184262)

• Surface started-work metadata in NCCL watchdog timeouts (#​183656)

• Add a health check endpoint to the distributed debug server (#​179326)

• Make the DeviceMesh non-overlapping check stricter (#​172343)

• Allow elastic_launch/launch_agent to accept a pre-created torchelastic health check server, so it can be started before rendezvous (#​180543)

• Add an overlap_pp_comm flag to pipeline schedules (default True) that, when set to False, defers each pipeline RECV op to immediately before the compute op that consumes it, using rank-parity P2P ordering to avoid deadlock (helps platforms such as AMD ROCm where a pending RECV blocks unrelated compute) (#​178815)

DTensor

• Migrate embedding and random ops to single-dim sharding strategies and increase op coverage (#​180281, #​180503)
• Add auto-infrastructure that derives single-dim sharding strategies for autogenerated op variants (.out, inplace, functional, and foreach), expanding strategy coverage to hundreds of additional ops (#​185386)
• Register sharding strategies for additional ops: scatter, upsample/interpolation backward, anti-aliased upsample, batch norm backward, and aten.detach_.default (#​186149, #​180311, #​184626, #​182743, #​181876)

Distributed FSDP2

• Support forward-mode automatic differentiation (torch.func.jvp) on models wrapped with fully_shard or replicate, including with mixed precision (#​182732)

Linear Algebra Frontend

• Add Half and BFloat16 dispatch support for torch.trace on CPU (#​184874)
• Improve heuristics for the cuSOLVER vs cuBLAS backend switch in torch.linalg.lu (#​185344)

Profiler

• The memory viz tool now more accurately represents GPU footprint when impacted by fragmentation (#​180515)
• The memory viz tool now aggregates stripes per-pool to improve visualization for large snapshots (#​180613)
• Profiler now also exposes CUDA occupancy metadata as a nested dictionary in the .events() output (#​180275)

FX

• split_module now supports torch.Size crossing graph split boundaries by decomposing size() calls into per-dimension sym_size nodes, and builds submodules lazily for faster inference graph splitting (#​179839)

• CapabilityBasedPartitioner can now opt out of horizontal fusion via skip_horizontal_fusion=True, partitioning only through direct data dependencies (#​184904)

• Enable rewriting of FX traces containing complex tensors during compilation (#​169832)

Dynamo

• Implement additional Python operators in Dynamo: bitwise and (#​184788), bitwise xor (#​184789), left/right shift (#​183462), floor division (#​185652), true division (#​185653), remainder (#​185654), and divmod (#​185655)
• Support tracing more constructs in Dynamo: einops 0.8.2 (#​185619), record_function as a decorator (#​184703), inference_mode retracing helpers (#​185066), mark_dirty in the autograd Function HOP (#​184267), warn_only deterministic toggles (#​180373), and the _maybe_view_chunk_cat functional collective (#​180389)
• Support item assignment and deletion (__setitem__/__delitem__) on more container types in Dynamo via sq_ass_item/mp_ass_subscript slots (#​182862, #​182996)
• Support torch.accelerator.device_index and torch.xpu.device in the device context manager (#​181846, #​181847)
• Improve Triton support under torch.compile: accept tl.constexpr values as kernel arguments (#​181783) and handle capture_triton as a no-op during tracing (#​183555)
• Improve dynamic shape specification: reduce verbosity in shape specs for the common case (#​184271), add SeqSpec for list/tuple specs with better walk-spec errors (#​185327), add ObjectSpec (#​182764), pipe dynamic spec through torch.compile (#​184501), and revisit guarding in mark_dynamic APIs (#​181469)
• Improve torch.compile device mismatch errors with a dedicated FakeTensorDeviceMismatchError and actionable guidance to place inputs, parameters, and buffers on the same device (#​185412)
• Improve error messages and diagnostics: clearer data-dependent errors for .any()/.all() (#​180406), clearer torch._check tensor predicate errors (#​185777), user-friendly reasons for skipped frames (#​183596), carets in stack traces (#​182393), and reporting why a symbol was created dynamically in symbolic_shapes logs (#​168331)
• Make Dynamo exceptions pickleable (#​185725)
• Inline decomposed quantization helpers in Dynamo (#​185628)
• Make Dynamo debug/repro utilities device-agnostic (#​184851)

Inductor

• Support pin_memory for torch.ones, torch.zeros and torch.full (#​174595)
• Add a ROCm config flag to disable the pointer_range_32 optimization (#​179604)
• Add a peak memory threshold config for combo kernels (#​180578)
• Enable autotuning and a fast compensation path for CPU static/dynamic smooth-quant qlinear, with correct handling of 0D x_scale/x_zp and ReinterpretView strides (#​181090)
• Add aot_inductor.autotune_per_kernel_alloc config to allocate-run-delete tensors per kernel during AOTI autotuning, avoiding OOM on large models (#​181176)
• Bound AsyncCompile future waits with the compile_worker_wait_timeout setting (#​181293)
• Add a100_default_flex_config entries for head_dim=192 (#​181835)
• Add an explicit lowering (fallback) for aten.multinomial to avoid graph breaks (#​182423)
• Add an Inductor lowering for _scaled_mm_v2 (#​182527)
• Enable combo_kernel_autotune_grouping by default (#​182567)
• Add cudagraph_partition_memory_budget config for partition reordering (#​183569)
• Add ATen fallbacks for bincount, unique variants, and AMP scale ops so they compile without graph breaks (#​183590)
• Unfuse the bias add from addmm when the bias is a narrowing dtype cast (fp32->bf16/fp16) to preserve bias precision in XPU AMP training (#​183680)
• Emit a clearer diagnostic when a backward CUDAGraph output installed as a .grad buffer is invalidated on a later run (gradient accumulation) (#​184003)
• Support split online softmax reductions in Inductor (#​184069)
• Support fusing index_add-style atomic scatter mutations into Triton template epilogues behind a config flag (#​184179)
• Add a cpp.march Inductor config knob so AOTInductor cpp-only builds can override or suppress the default CPU architecture flag (#​184297)
• Improve the Triton cache directory guidance when loading shared objects from a noexec filesystem fails (#​184362)
• Enable the Bert SDPA pattern rewrite on CUDA while keeping the original matmul/softmax math path (#​184417)
• Improve the Triton launcher argument-mismatch error with a clearer message and a cached preflight check (#​184522)
• Add broader CuteDSL op overrides (rsqrt, exp2, log2, log10, tan, acos, asin, atan, atan2, floor, logical_xor) (#​184538)
• Add an optional fake_mode argument to standalone_compile (with dynamic_shapes="from_example_inputs") so it can reuse the caller's FakeTensorMode/ShapeEnv instead of always creating a fresh one (#​184776)
• Support signbit on unsigned integer dtypes (#​185985)
• Add a keep_static_cubin_raw config to retain cubin bytes in cached kernels so caches restored on another machine avoid recompilation (#​186404)
• Extend BatchLinearLHSFusion's matcher to also match the inlined torch._C._nn.linear form so the (opt-in) fusion can fire on Dynamo-inlined linear (#​186632)
• Add a clearer error message with install instructions when a compatible Flash Attention package is unavailable for flex attention (#​186827)
• Add another anchor node to the batch-linear fusion pass so more small torch._C._nn.linear operations are grouped into a single batched kernel (#​180477)
• Extend the batch fusion pass to support detach() method calls (#​180513)
• Add a deterministic backward for the FlexAttention flash kernel (#​174813)
• Use rand4x for Inductor Triton random number generation (#​184377)
• Add a Quack-based CuTeDSL RMSNorm kernel (#​182108)

Ahead-Of-Time Inductor (AOTI)

• Use fatbinary for multi-arch CUDA kernels (#​184456)
• Support mixed-device constants in update_constant_buffer (#​181114)
• Add FP8 header files in the AOTI shim.h (#​178120)
• Add throttled cudaMemcpy for AOTI constant loading to reduce peak memory usage (#​184823)
• Preserve AOTI proxy_executor error messages (#​180884)
• Enable Triton kernels in AOTI C++ wrapper on CPU (#​181068)
• Skip CPU vec ISA setup for device-only cpp_wrapper (#​182089)
• Expose torchbind constants from AOTIModelPackageLoader (#​182149)
• Improve AOTI error for Python custom ops (#​186305)

Export

• Support serialization of opaque type constants in torch.export save/load (#​181676)
• Make functorch JVP operator torch.export-able (#​179686)
• Add UpdateConstantBufferFromCpu for host-to-device copy (#​181637)

AOTAutograd

• Support CPU activation offloading in the rematerialization pass, including marking recomputed nodes for backward and adding a resize-to-0 deallocation op so offloaded tensors are freed after their host-to-device copy (#​181937, #​181938)
• Use FX node names in merge_view_inputs error messages, so non-differentiable view input mutation errors identify the specific offending inputs (#​180424)

Composability

• Add fake tensor support for _transformer_encoder_layer_fwd so it traces under torch.compile (#​183916)
• Enable Armv9-A target support for torch.compile on AArch64 (#​184555)
• Functionalize in-place c10d collectives in standalone compile (#​181836)

Foreach

• Fix/add empty check for _foreach_max (#​173483)

ONNX

• Add adaptive_max_pool2d and adaptive_max_pool3d decompositions for ONNX export (#​184396)

C++ Frontend

• Add stable ABI for set_python_module on torch::Library (#​182720)
• Add == overloads for HeaderOnlyArrayRef (#​185379)
• Add torch::stable::Generator (#​186423)
• Add c10::layout typecaster for torch.layout (#​179607)
• Add default-args support to def_static (#​175644)
• Add support for controlling scientific notation in C++-side tensor printing (#​173321)

Release Engineering

• Move the NCCL pin to 2.30 (#​181313)
• Advance the Triton pin to 3.7.1 (#​181001, #​186792)
• Upgrade the XPU support package to 2026.0 (#​182003)
• Add a configurable threshold to avoid power-of-two rounding for large pinned memory allocations (#​171662)
• Move some pre-build steps from setup.py to CMake (#​177641)

CUDA

• Debugging tool to verify that external inputs to a CUDA graph are alive before replay (#​174649)
• Add get/set/reset functions for BLAS workspace sizes (#​177912)
• Cleanup double import in BinaryDivFloorKernel.cu (#​179260)
• Return supported CUDA arch list when no GPU is present but GPU is compiled (#​180356)
• Detect and fix stale stream references in autograd during CUDA graph capture (#​180090)
• Use opmath_t in i1 and i1e CUDA kernels (#​183778)
• Support resize_ with address hint (#​178215)
• Support bfloat16 in _embedding_bag_per_sample_weights_backward on CUDA (#​185889)
• Align parsePerProcessMemoryFraction's return type with other parsers (#​185139)
• Improve error message when cuda-bindings version is too old (#​185990)
• Expose torch.cuda.current_solver_handle for cuSOLVER handle sharing (#​176705)

cuDNN

• Add flag to select depthwise convolution backend (#​176500)
• Upgrade cudnn_frontend submodule to 1.24 (#​185554)

MPS

• Migrate many ops from MPSGraph to native Metal kernels for bernoulli (#​182210), native_dropout (#​182232), uniform/normal/randint (#​182386), randperm (#​182528), comparison ops eq/ne/lt/le/gt/ge (#​183019), bitwise ops (#​182839), scatter/gather (#​184028), copy-cast (#​184740), gelu/gelu_backward (#​181451), replication pad (#​183065), embedding backward (#​185119), trace (#​183627), count_nonzero (#​180725), amax/amin/aminmax/all/any (#​180752), and cumsum/cumprod (#​185609), native_group_norm (#​183830, native_group_norm_backward #​184437), topk and kthvalue Metal kernels (#​184106), single-block and multi-block sort, including a stable sort path (#​180714, #​182242, #​181736)
• Support integer inputs to histc (#​178624)
• Support out variants of unary ops (#​184743)
• Improvements to SDPA Metal kernels: prefill attention kernels (#​181575), GQA support (#​183280), is_causal support (#​181855), head dim 256 (#​181852), float mask support (#​183458), and a clearer error for causal + attn mask (#​181856)
• Add an ILP variant for binary tensor iterators and replace unary VEC4 with a generic ILP-per-thread dense kernel (#​182155, #​181509, #​183055)
• Make several Metal kernels stride-aware to avoid unnecessary .contiguous() calls: Col2Im (#​181949), Im2Col (#​182709), Repeat (#​182718), LossOps (#​182714), and HistogramKernel (#​181951)
• Enable NDHWC+DHWIO fast path for Conv3d on channels_last_3d (#​184612)
• Clear the MPSGraph cache in torch.mps.empty_cache() (#​181485)
• Add a private API to get the host alias of Metal storage (#​180961)
• Add input validation: stride > 0 in pool ops (#​184875), F.fold (#​182067), im2col (#​183593), and bernoulli probabilities (#​185065)
• Alert on non-deterministic algorithms on MPS (#​185061)
• Raise a clear not-implemented error for dropout_p (#​184126)
• Use proper precise log functions in unary kernels (#​185381)

ROCm

• Additional cub::DeviceHistogram hipify mappings (#​180433)
• SDPA improvements via AOTriton 0.12b: head_dim != head_dim_v, use_deterministic_algorithms, gfx1100 and gfx1151 promoted out of experimental, partial FAv3 support on gfx950 (#​184288)

XPU

• Add last_level_cache_size and is_integrated_gpu to XPU device properties (#​184499, #​182624)
• Add XPU dispatch for _fused_adagrad_ (#​185577)
• Support mixed-type operations between Nested and Dense tensors on XPU (#​182654)
• Support torch.xpu.device in Dynamo device management (#​181847)
• Recognize additional Intel BMG device IDs on XPU (#​183414)
• Enable XPU device support for sparse Triton ops (#​179805)
• Enable the bmm_outer_product Triton override on XPU (#​180441)
• Improve test coverage for the XPU backend (#​174370, #​180881, #​171154)
• Support non-blocking pinned device-to-host copies on XPU (#​186224)
• Refactor the XPU oneDNN integration from the C API to the C++ API (#​184486)

Functorch

• Add vmap batching rule for torch.unbind_copy (#​178035)
• Add vmap batching rule for Tensor.view(dtype) (aten::view.dtype) (#​180728)

Sparse Frontend

• Validate mat1/mat2 layouts in sspaddmm and clarify error messages (#​179037)

Bug Fixes

Python Frontend

• Add opt_dtype validation to torch.nanmean() for consistent error handling (#​172809)
• Route torch.nansum integer output dtype through nan_to_num + sum for correct results (#​183808)
• Fix out-of-bounds read in CUDAStream::stream() (#​184237)
• Align XPU logspace/linspace ref tests with upstream XFAIL state (#​178734)

Dataloader Frontend

• Fix DataLoader file descriptor leak from atexit cleanup (#​176607)

torch.nn

• Validate stride/padding/kernel_size length in slow_conv3d (#​181063)
• Validate inputs in math_channel_shuffle (#​181029)
• Validate delta type in nn.HuberLoss constructor (#​184012)
• Lowercase the environment variable in torch/serialization.py so it matches the true values (#​180959)
• Fix int32 overflow in layer_norm on CUDA for tensors with more than 2^32 elements (#​181600)
• Reject NestedTensor inputs in flex_attention with a clear error instead of an unclear backend failure (#​183516)
• Fix SDPA incorrect early return on 0 head dim qk with valid v (#​184914)
• Fix reflection_pad1d backward CUDA launch for large batches (#​185024)
• Fix lp_pool infinity norm handling ([#

✂ Note

PR body was truncated to here.

---

Configuration

📅 Schedule: (UTC)

• Branch creation
  • At any time (no schedule defined)
• Automerge
  • At any time (no schedule defined)

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

This PR was generated by Mend Renovate. View the repository job log.