[LSP] use source.fixAll.pyrefly for fix-all code actions by Arths17 · Pull Request #3039 · facebook/pyrefly

Arths17 · 2026-04-07T06:04:55Z

Summary

advertise source.fixAll.pyrefly in server capabilities instead of generic source.fixAll
emit fix-all actions with the pyrefly-specific kind
for context.only, run pyrefly fix-all only when the request includes either source.fixAll or a source.fixAll.pyrefly... kind

Copilot

Pull request overview

Note

Copilot was unable to run its full agentic suite in this review.

This PR adds a synthetic “mock_org” Python package (and a generator script) under perf/scale_test/ intended to stress import graphs and typing/indexing performance. However, the changes shown do not match the PR title/description about LSP source.fixAll.pyrefly code actions (Fixes #3024), suggesting a significant mismatch between the stated intent and the actual diff.

Changes:

Added a code generator (generate_mock_org.py) to create a large, heavily-typed, circularly-importing package for perf scaling tests.
Checked in several large generated modules (core.py, models.py, events.py, analytics.py) plus package __init__.py and a README for the perf dataset.
(Mismatch) No visible LSP/server capability changes related to source.fixAll.pyrefly are included in the provided diff.

Reviewed changes

Copilot reviewed 12 out of 26 changed files in this pull request and generated 7 comments.

Show a summary per file

File	Description
perf/scale_test/mock_org/models.py	Adds large generated “models” module with deep generic types and entity classes.
perf/scale_test/mock_org/events.py	Adds large generated “events” module with similar typing/import stress patterns.
perf/scale_test/mock_org/core.py	Adds large generated “core” module for the perf corpus.
perf/scale_test/mock_org/analytics.py	Adds large generated “analytics” module for the perf corpus.
perf/scale_test/mock_org/init.py	Declares package exports for the synthetic perf package.
perf/scale_test/generate_mock_org.py	Generator script to (re)create the synthetic perf corpus.
perf/scale_test/README.md	Intro README for the perf dataset and regeneration instructions.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-04-07T06:07:44Z

perf/scale_test/generate_mock_org.py

+#!/usr/bin/env python3
+"""Generate a synthetic enterprise-scale Python codebase for indexing benchmarks.
+
+This generator creates a package with many modules that intentionally stress:
+- deep inheritance and large class graphs
+- heavy typing usage (Generic, Protocol, Annotated, callable-heavy signatures)
+- dense cross-module and circular import structure
+- high metadata volume via Google-style docstrings
+"""


The PR title/description is about LSP fix-all code action kinds (source.fixAll.pyrefly), but the diff adds a perf-scale synthetic Python corpus generator + generated modules. Please reconcile this by either (a) updating the PR description/title to match these perf changes, or (b) moving these perf corpus changes to a separate PR and including the intended LSP changes here.

Copilot · 2026-04-07T06:07:45Z

perf/scale_test/mock_org/models.py

+from . import core as prev_mod
+from . import services as next_mod
+from . import utils as next_next_mod


This module imports sibling modules (services, utils) that are not included in the provided diff. As-is, importing mock_org.models will raise ModuleNotFoundError unless those modules already exist. If the intent is to check in a ready-to-import perf corpus, add the missing modules (even as lightweight stubs) or adjust the import strategy (e.g., generate/check in the full set, or gate non-essential imports behind TYPE_CHECKING).

Copilot · 2026-04-07T06:07:45Z

perf/scale_test/mock_org/events.py

+from . import auth as prev_mod
+from . import api as prev_prev_mod
+from . import analytics as next_mod
+


Similar to models.py, this module imports siblings (auth, api) that are not present in the provided diff. If those modules are not already in the repo, mock_org.events will fail to import at runtime. Please ensure the full referenced module set is present/checked in, or modify these imports so the package is importable.

Suggested change

from . import auth as prev_mod

from . import api as prev_prev_mod

from . import analytics as next_mod

try:

from . import auth as prev_mod

except ImportError:

prev_mod = None

try:

from . import api as prev_prev_mod

except ImportError:

prev_prev_mod = None

try:

from . import analytics as next_mod

except ImportError:

next_mod = None

Copilot · 2026-04-07T06:07:45Z

perf/scale_test/mock_org/models.py

+V = TypeVar("V")
+W = TypeVar("W")
+
+ComplexCallable = Callable[[List[T], Dict[str, Any]], Awaitable[V]]


ComplexCallable is defined with Dict[str, Any] (free type vars: T, V), but the file later uses it as if it takes three type parameters (e.g., ComplexCallable[T, U, V], ComplexCallable[int, str, float]). With postponed evaluation, this won’t crash at import time, but type checkers will flag it (wrong number of type args) and it also makes callbacks typed with Dict[str, str] not safely compatible with Dict[str, Any] due to dict invariance. Align the alias with usage (e.g., Dict[str, U]) or update all call sites to match the actual arity.

Suggested change

ComplexCallable = Callable[[List[T], Dict[str, Any]], Awaitable[V]]

ComplexCallable = Callable[[List[T], Dict[str, U]], Awaitable[V]]

Copilot · 2026-04-07T06:07:45Z

perf/scale_test/generate_mock_org.py

+ComplexCallable = Callable[[List[T], Dict[str, U]], Awaitable[V]]
+MergeCallable = Callable[[Sequence[V], Mapping[str, U]], Awaitable[Dict[str, V]]]
+AuditTag = Annotated[str, "benchmark", "{name}"]
+Vector = Annotated[List[Annotated[T, "vector-item"]], "vector"]
+


The checked-in generated modules don’t appear to be reproducible from the current generator output. For example, the generator emits callback(..., {\"position\": position}) (an int), while some committed modules use str(position), and models.py’s ComplexCallable uses Dict[str, Any] rather than Dict[str, U]. This makes regeneration noisy and undermines the README instruction to regenerate the dataset. Recommend updating the generator to exactly match the committed corpus (or re-generating and committing the corpus from this generator) so the process is deterministic.

Copilot · 2026-04-07T06:07:46Z

perf/scale_test/generate_mock_org.py

+        """
+        output: List[V] = []
+        for position, item in enumerate(items):
+            output.append(await callback([item], {{"position": position}}))


The checked-in generated modules don’t appear to be reproducible from the current generator output. For example, the generator emits callback(..., {\"position\": position}) (an int), while some committed modules use str(position), and models.py’s ComplexCallable uses Dict[str, Any] rather than Dict[str, U]. This makes regeneration noisy and undermines the README instruction to regenerate the dataset. Recommend updating the generator to exactly match the committed corpus (or re-generating and committing the corpus from this generator) so the process is deterministic.

Suggested change

output.append(await callback([item], {{"position": position}}))

output.append(await callback([item], {{"position": str(position)}}))

Copilot · 2026-04-07T06:07:46Z

perf/scale_test/generate_mock_org.py

+
+    while len(content.splitlines()) < line_target:
+        filler_index = len(content.splitlines())
+        content += f'''\n\n
+def filler_{name}_{filler_index:04d}(\n    callback: ComplexCallable[int, str, float],\n) -> Annotated[Callable[[List[int], Dict[str, str]], Awaitable[float]], "filler-signature"]:\n    """Return callback unchanged to enlarge AST and annotation graph.\n\n    Args:\n        callback: Existing callback to pass through unchanged.\n\n    Returns:\n        The same callback object.\n    """\n    return callback\n'''


This loop repeatedly calls content.splitlines() (twice per iteration), which becomes increasingly expensive as content grows. Consider tracking the current line count in a variable and incrementing it based on appended filler, or computing splitlines() once per iteration, to keep generation time stable for larger corpora.

Suggested change

while len(content.splitlines()) < line_target:

filler_index = len(content.splitlines())

content += f'''\n\n

def filler_{name}_{filler_index:04d}(\n callback: ComplexCallable[int, str, float],\n) -> Annotated[Callable[[List[int], Dict[str, str]], Awaitable[float]], "filler-signature"]:\n """Return callback unchanged to enlarge AST and annotation graph.\n\n Args:\n callback: Existing callback to pass through unchanged.\n\n Returns:\n The same callback object.\n """\n return callback\n'''

current_line_count = len(content.splitlines())

while current_line_count < line_target:

filler_index = current_line_count

filler = f'''\n\n

def filler_{name}_{filler_index:04d}(\n callback: ComplexCallable[int, str, float],\n) -> Annotated[Callable[[List[int], Dict[str, str]], Awaitable[float]], "filler-signature"]:\n """Return callback unchanged to enlarge AST and annotation graph.\n\n Args:\n callback: Existing callback to pass through unchanged.\n\n Returns:\n The same callback object.\n """\n return callback\n'''

content += filler

current_line_count += len(filler.splitlines())

Code action save hooks currently require enabling generic source.fixAll, which can trigger unrelated servers. This change advertises and emits source.fixAll.pyrefly so editors can target pyrefly-only fix-all behavior.\n\nThe code action filter now accepts both source.fixAll and source.fixAll.* requests so parent-kind clients remain compatible while pyrefly-specific requests are supported.

When a client requests source.fixAll.*, we should not run pyrefly fix-all for sibling providers. Restrict matching to either the generic source.fixAll ancestor or source.fixAll.pyrefly descendants.

Arths17

Force-push update: this PR now contains only the intended LSP fix for #3024 (2 files changed: server.rs and the corresponding LSP interaction test). The earlier Copilot comments on perf/scale_test/* refer to outdated threads from a prior diff and are no longer applicable to the current head commit.

github-actions · 2026-04-07T06:35:33Z

According to mypy_primer, this change doesn't affect type check results on a corpus of open source code. ✅

rchl · 2026-04-09T19:00:00Z

pyrefly/lib/lsp/non_wasm/server.rs

-                .any(|kind| kind == &CodeActionKind::SOURCE_FIX_ALL)
+            kinds.iter().any(|kind| {
+                kind == &CodeActionKind::SOURCE_FIX_ALL
+                    || kind.as_str().starts_with(SOURCE_FIX_ALL_PYREFLY)


I think that the second condition should also match source.fixAll.pyrefly exactly rather than using starts_with because source.fixAll.pyreflyyyyyy shouldn't match, nor should source.fixAll.pyrefly.foo

Copilot AI review requested due to automatic review settings April 7, 2026 06:04

meta-cla bot added the cla signed label Apr 7, 2026

github-actions bot added the size/xl label Apr 7, 2026

Copilot AI reviewed Apr 7, 2026

View reviewed changes

Arths17 added 2 commits April 7, 2026 01:15

lsp: limit source.fixAll matching to pyrefly subtree

4948b1e

When a client requests source.fixAll.*, we should not run pyrefly fix-all for sibling providers. Restrict matching to either the generic source.fixAll ancestor or source.fixAll.pyrefly descendants.

Arths17 force-pushed the lsp-fixall-pyrefly-3024 branch from 3f64a97 to 4948b1e Compare April 7, 2026 06:16

github-actions bot added size/xs and removed size/xl labels Apr 7, 2026

Arths17 commented Apr 7, 2026

View reviewed changes

NathanTempest mentioned this pull request Apr 9, 2026

[LSP] source.fixAll code action should be source.fixAll.pyrefly #3024

Open

rchl reviewed Apr 9, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[LSP] use source.fixAll.pyrefly for fix-all code actions#3039

[LSP] use source.fixAll.pyrefly for fix-all code actions#3039
Arths17 wants to merge 2 commits intofacebook:mainfrom
Arths17:lsp-fixall-pyrefly-3024

Arths17 commented Apr 7, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Apr 7, 2026

Uh oh!

Copilot AI Apr 7, 2026

Uh oh!

Copilot AI Apr 7, 2026

Uh oh!

Copilot AI Apr 7, 2026

Uh oh!

Copilot AI Apr 7, 2026

Uh oh!

Copilot AI Apr 7, 2026

Uh oh!

Copilot AI Apr 7, 2026

Uh oh!

Arths17 left a comment

Uh oh!

github-actions bot commented Apr 7, 2026

Uh oh!

rchl Apr 9, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

	ComplexCallable = Callable[[List[T], Dict[str, Any]], Awaitable[V]]
	ComplexCallable = Callable[[List[T], Dict[str, U]], Awaitable[V]]

	output.append(await callback([item], {{"position": position}}))
	output.append(await callback([item], {{"position": str(position)}}))

-    while len(content.splitlines()) < line_target:
-        filler_index = len(content.splitlines())
-        content += f'''\n\n
-def filler_{name}_{filler_index:04d}(\n    callback: ComplexCallable[int, str, float],\n) -> Annotated[Callable[[List[int], Dict[str, str]], Awaitable[float]], "filler-signature"]:\n    """Return callback unchanged to enlarge AST and annotation graph.\n\n    Args:\n        callback: Existing callback to pass through unchanged.\n\n    Returns:\n        The same callback object.\n    """\n    return callback\n'''
+    current_line_count = len(content.splitlines())
+    while current_line_count < line_target:
+        filler_index = current_line_count
+        filler = f'''\n\n
+def filler_{name}_{filler_index:04d}(\n    callback: ComplexCallable[int, str, float],\n) -> Annotated[Callable[[List[int], Dict[str, str]], Awaitable[float]], "filler-signature"]:\n    """Return callback unchanged to enlarge AST and annotation graph.\n\n    Args:\n        callback: Existing callback to pass through unchanged.\n\n    Returns:\n        The same callback object.\n    """\n    return callback\n'''
+        content += filler
+        current_line_count += len(filler.splitlines())

Conversation

Arths17 commented Apr 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Apr 7, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 7, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 7, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 7, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 7, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 7, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 7, 2026

Choose a reason for hiding this comment

Uh oh!

Arths17 left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Apr 7, 2026

Uh oh!

rchl Apr 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Arths17 commented Apr 7, 2026 •

edited

Loading

rchl Apr 9, 2026 •

edited

Loading