Merge branch 'master' into feature/comet-logger-update

Author: Lothiraldan

Diff for: .github/workflows/call-clear-cache.yml

@@ -23,18 +23,18 @@ on:
 jobs:
   cron-clear:
     if: github.event_name == 'schedule' || github.event_name == 'pull_request'
-    uses: Lightning-AI/utilities/.github/workflows/[email protected].7
+    uses: Lightning-AI/utilities/.github/workflows/[email protected].8
     with:
-      scripts-ref: v0.11.7
+      scripts-ref: v0.11.8
       dry-run: ${{ github.event_name == 'pull_request' }}
       pattern: "latest|docs"
       age-days: 7
 
   direct-clear:
     if: github.event_name == 'workflow_dispatch' || github.event_name == 'pull_request'
-    uses: Lightning-AI/utilities/.github/workflows/[email protected].7
+    uses: Lightning-AI/utilities/.github/workflows/[email protected].8
     with:
-      scripts-ref: v0.11.7
+      scripts-ref: v0.11.8
       dry-run: ${{ github.event_name == 'pull_request' }}
       pattern: ${{ inputs.pattern || 'pypi_wheels' }} # setting str in case of PR / debugging
       age-days: ${{ fromJSON(inputs.age-days) || 0 }} # setting 0 in case of PR / debugging

Diff for: .github/workflows/ci-check-md-links.yml

@@ -14,7 +14,7 @@ on:
 
 jobs:
   check-md-links:
-    uses: Lightning-AI/utilities/.github/workflows/[email protected].7
+    uses: Lightning-AI/utilities/.github/workflows/[email protected].8
     with:
       config-file: ".github/markdown-links-config.json"
       base-branch: "master"

Diff for: .github/workflows/ci-schema.yml

@@ -8,7 +8,7 @@ on:
 
 jobs:
   check:
-    uses: Lightning-AI/utilities/.github/workflows/[email protected].7
+    uses: Lightning-AI/utilities/.github/workflows/[email protected].8
     with:
       # skip azure due to the wrong schema file by MSFT
       # https://github.com/Lightning-AI/lightning-flash/pull/1455#issuecomment-1244793607

Diff for: .pre-commit-config.yaml

@@ -58,7 +58,7 @@ repos:
         #args: ["--write-changes"] # uncomment if you want to get automatic fixing
 
   - repo: https://github.com/PyCQA/docformatter
-    rev: v1.7.5
+    rev: 06907d0267368b49b9180eed423fae5697c1e909 # todo: fix for docformatter after last 1.7.5
     hooks:
       - id: docformatter
         additional_dependencies: [tomli]

Diff for: _notebooks

@@ -52,7 +52,7 @@ Example:
     model = WeightSharingModule()
     trainer = Trainer(max_epochs=1, accelerator="tpu")
 
-See `XLA Documentation <https://github.com/pytorch/xla/blob/master/TROUBLESHOOTING.md#xla-tensor-quirks>`_
+See `XLA Documentation <https://github.com/pytorch/xla/blob/v2.5.0/TROUBLESHOOTING.md#xla-tensor-quirks>`_
 
 ----
 
@@ -61,4 +61,4 @@ XLA
 XLA is the library that interfaces PyTorch with the TPUs.
 For more information check out `XLA <https://github.com/pytorch/xla>`_.
 
-Guide for `troubleshooting XLA <https://github.com/pytorch/xla/blob/master/TROUBLESHOOTING.md>`_
+Guide for `troubleshooting XLA <https://github.com/pytorch/xla/blob/v2.5.0/TROUBLESHOOTING.md>`_

Diff for: docs/source-pytorch/accelerators/tpu_advanced.rst

@@ -108,7 +108,7 @@ There are cases in which training on TPUs is slower when compared with GPUs, for
 - XLA Graph compilation during the initial steps `Reference <https://github.com/pytorch/xla/issues/2383#issuecomment-666519998>`_
 - Some tensor ops are not fully supported on TPU, or not supported at all. These operations will be performed on CPU (context switch).
 
-The official PyTorch XLA `performance guide <https://github.com/pytorch/xla/blob/master/TROUBLESHOOTING.md#known-performance-caveats>`_
+The official PyTorch XLA `performance guide <https://github.com/pytorch/xla/blob/v2.5.0/TROUBLESHOOTING.md#known-performance-caveats>`_
 has more detailed information on how PyTorch code can be optimized for TPU. In particular, the
-`metrics report <https://github.com/pytorch/xla/blob/master/TROUBLESHOOTING.md#get-a-metrics-report>`_ allows
+`metrics report <https://github.com/pytorch/xla/blob/v2.5.0/TROUBLESHOOTING.md#get-a-metrics-report>`_ allows
 one to identify operations that lead to context switching.

Diff for: docs/source-pytorch/accelerators/tpu_basic.rst

@@ -78,7 +78,7 @@ A lot of PyTorch operations aren't lowered to XLA, which could lead to significa
 These operations are moved to the CPU memory and evaluated, and then the results are transferred back to the XLA device(s).
 By using the `xla_debug` Strategy, users could create a metrics report to diagnose issues.
 
-The report includes things like (`XLA Reference <https://github.com/pytorch/xla/blob/master/TROUBLESHOOTING.md#troubleshooting>`_):
+The report includes things like (`XLA Reference <https://github.com/pytorch/xla/blob/v2.5.0/TROUBLESHOOTING.md#troubleshooting>`_):
 
 * how many times we issue XLA compilations and time spent on issuing.
 * how many times we execute and time spent on execution

Diff for: docs/source-pytorch/accelerators/tpu_faq.rst

@@ -6,7 +6,7 @@
      - Then
      - Ref
 
-   * - used PyTorch 3.11
+   * - used PyTorch 1.11
      - upgrade to PyTorch 2.1 or higher
      - `PR18691`_
 

Diff for: docs/source-pytorch/upgrade/sections/2_0_regular.rst

@@ -598,7 +598,7 @@ def _initialize_engine(
     ) -> Tuple["DeepSpeedEngine", Optimizer]:
         """Initialize one model and one optimizer with an optional learning rate scheduler.
 
-        This calls :func:`deepspeed.initialize` internally.
+        This calls ``deepspeed.initialize`` internally.
 
         """
         import deepspeed

Diff for: src/lightning/fabric/strategies/deepspeed.py

@@ -56,7 +56,7 @@ class XLAFSDPStrategy(ParallelStrategy, _Sharded):
 
     .. warning::  This is an :ref:`experimental <versioning:Experimental API>` feature.
 
-    For more information check out https://github.com/pytorch/xla/blob/master/docs/fsdp.md
+    For more information check out https://github.com/pytorch/xla/blob/v2.5.0/docs/fsdp.md
 
     Args:
         auto_wrap_policy: Same as ``auto_wrap_policy`` parameter in

Diff for: src/lightning/fabric/strategies/xla_fsdp.py

@@ -414,7 +414,7 @@ def _setup_model_and_optimizer(
     ) -> Tuple["deepspeed.DeepSpeedEngine", Optimizer]:
         """Initialize one model and one optimizer with an optional learning rate scheduler.
 
-        This calls :func:`deepspeed.initialize` internally.
+        This calls ``deepspeed.initialize`` internally.
 
         """
         import deepspeed

Diff for: src/lightning/pytorch/strategies/deepspeed.py

@@ -1 +1 @@
-2.4.0
+2.5.0.dev