Python test discovery is incompatible with pytest-ruff.

[niksite]

Type: Bug

Behaviour

When discovering tests with pytest-ruff enabled (pytest --ruff command) only very small subset of the tests is available.

Steps to reproduce:

1. pip install pytest-ruff
2. Add --ruff to the addopts in pytest.ini or into the pytestArgs.
3. Try to discover the tests in multiple folders (e.g., a Django project with 'tests' subfolders in every Django app folder).

Extension version: 2024.17.2024102101
VS Code version: Code 1.94.2 (Universal) (384ff7382de624fb94dbaf6da11977bba1ecd427, 2024-10-09T16:08:44.566Z)
OS version: Darwin arm64 24.0.0
Modes:

• Python version (& distribution if applicable, e.g. Anaconda): 3.9.19
• Type of virtual environment used (e.g. conda, venv, virtualenv, etc.): Venv
• Value of the python.languageServer setting: Default

User Settings

languageServer: "Pylance"

testing
• pytestArgs: "<placeholder>"
• pytestEnabled: true

Installed Extensions

Extension Name	Extension Id	Version
Beautify css/sass/scss/less	michelemelluso.code-beautifier	2.3.3
Code Spell Checker	streetsidesoftware.code-spell-checker	3.0.1
Dash	deerawan.vscode-dash	2.4.0
direnv	mkhl.direnv	0.17.0
Django	batisteo.vscode-django	1.15.0
djLint	monosans.djlint	2024.7.0
Docker	ms-azuretools.vscode-docker	1.29.3
ESLint	dbaeumer.vscode-eslint	3.0.10
Even Better TOML	tamasfe.even-better-toml	0.19.2
Excel Viewer	GrapeCity.gc-excelviewer	4.2.62
File Utils	sleistner.vscode-fileutils	3.10.3
GitHub Copilot	GitHub.copilot	1.241.0
GitHub Copilot Chat	GitHub.copilot-chat	0.21.2
GitHub Pull Requests	GitHub.vscode-pull-request-github	0.98.0
GitLens — Git supercharged	eamodio.gitlens	15.6.2
Go	golang.go	0.42.1
GraphQL: Language Feature Support	GraphQL.vscode-graphql	0.12.0
GraphQL: Syntax Highlighting	GraphQL.vscode-graphql-syntax	1.3.6
JavaScript Debugger	ms-vscode.js-debug	1.94.0
JavaScript Debugger Companion Extension	ms-vscode.js-debug-companion	1.1.3
Jupyter	ms-toolsai.jupyter	2024.9.1
Jupyter Cell Tags	ms-toolsai.vscode-jupyter-cell-tags	0.1.9
Jupyter Keymap	ms-toolsai.jupyter-keymap	1.1.2
Jupyter Notebook Renderers	ms-toolsai.jupyter-renderers	1.0.19
Jupyter Slide Show	ms-toolsai.vscode-jupyter-slideshow	0.1.6
keyboard-scroll	selbh.keyboard-scroll	0.1.0
Live Preview	ms-vscode.live-server	0.4.15
Makefile Tools	ms-vscode.makefile-tools	0.11.13
markdownlint	DavidAnson.vscode-markdownlint	0.56.0
Mypy Type Checker	ms-python.mypy-type-checker	2024.0.0
Open In GitHub	sysoev.vscode-open-in-github	1.18.0
Playwright Test for VSCode	ms-playwright.playwright	1.1.11
Project Manager	alefragnani.project-manager	12.8.0
Pylance	ms-python.vscode-pylance	2024.10.1
Python	ms-python.python	2024.17.2024102101
Python Debugger	ms-python.debugpy	2024.12.0
Rainbow CSV	mechatroner.rainbow-csv	3.12.0
Remote - SSH: Editing Configuration Files	ms-vscode-remote.remote-ssh-edit	0.87.0
REST Client	humao.rest-client	0.25.1
Ruff	charliermarsh.ruff	2024.52.0
SemanticDiff	semanticdiff.semanticdiff	0.9.0
shell-format	foxundermoon.shell-format	7.2.5
Table Visualizer for JavaScript Profiles	ms-vscode.vscode-js-profile-table	1.0.10
vscode-random	jrebocho.vscode-random	1.12.0
Vue - Official	Vue.volar	2.1.6
YAML	redhat.vscode-yaml	1.15.0

System Info

Item	Value
CPUs	Apple M3 Max (16 x 2400)
GPU Status	2d_canvas: enabled canvas_oop_rasterization: enabled_on direct_rendering_display_compositor: disabled_off_ok gpu_compositing: enabled multiple_raster_threads: enabled_on opengl: enabled_on rasterization: enabled raw_draw: disabled_off_ok skia_graphite: disabled_off video_decode: enabled video_encode: enabled webgl: enabled webgl2: enabled webgpu: enabled webnn: disabled_off
Load (avg)	3, 2, 3
Memory (System)	64.00GB (31.16GB free)
Process Argv	--crash-reporter-id eea03661-39de-4e7a-b244-2386eea107db
Screen Reader	no
VM	0%

A/B Experiments

vsliv368cf:30146710
vspor879:30202332
vspor708:30202333
vspor363:30204092
vswsl492cf:30256860
vscod805cf:30301675
binariesv615:30325510
vsaa593:30376534
py29gd2263:31024239
c4g48928:30535728
azure-dev_surveyone:30548225
a9j8j154:30646983
962ge761:30959799
pythongtdpath:30769146
pythonnoceb:30805159
asynctok:30898717
pythonmypyd1:30879173
h48ei257:31000450
pythontbext0:30879054
cppperfnew:31000557
dsvsc020:30976470
pythonait:31006305
dsvsc021:30996838
0ee40948:31013168
dvdeprecation:31068756
dwnewjupyter:31046869
newcmakeconfigv2:31071590
impr_priority:31102340
nativerepl2:31139839
refactort:31108082
pythonrstrctxt:31112756
wkspc-onlycs-t:31132770
wkspc-ranged-t:31151552
cf971741:31144450
defaultse:31146405
iacca2:31156134
notype1cf:31157160
5fd0e150:31155592
dwcopilot:31164048
icondisabled:31158250

[eleanorjboyd]

will investigate - thank you for the issue report!

[eleanorjboyd]

closing as a duplicate of: #23933