Skip to content

reduce gc_collect_harder default to 1 on CPython#14441

Merged
bluetech merged 3 commits into
pytest-dev:mainfrom
miketheman:miketheman/speed-up-test-sutie
May 24, 2026
Merged

reduce gc_collect_harder default to 1 on CPython#14441
bluetech merged 3 commits into
pytest-dev:mainfrom
miketheman:miketheman/speed-up-test-sutie

Conversation

@miketheman

Copy link
Copy Markdown
Contributor

The 5-iteration default was borrowed from the Trio project, where it was determined empirically to handle PyPy's object resurrection behavior: on PyPy, objects like coroutines can survive GC rounds because executing their del can resurrect them.

On CPython, reference counting frees most objects immediately. One GC pass is sufficient to handle reference cycles, as confirmed by all test_unraisableexception tests passing (including the refcycle variants).

Use 1 pass on CPython and retain 5 on PyPy.

@miketheman

Copy link
Copy Markdown
Contributor Author

Draft, since I'm not certain this is a good idea.
I was able to shave ~30% of test runtime on a CPython-only test run locally, I'm curious to see the timings produced by GH Actions.

@RonnyPfannschmidt

Copy link
Copy Markdown
Member

Im nit familiar with the plugin myself
Is there a reasonable benchmark we could use as indicator

@miketheman

Copy link
Copy Markdown
Contributor Author

Unknown - I'm looking at history, and there's already once case that resets it to 0 no matter what - #13482

@bluetech

bluetech commented May 8, 2026

Copy link
Copy Markdown
Member

I was uneasy with the multiple gc rounds but I couldn't entirely demonstrate the slowdown. But for me your report is sufficient. The unraisableexception plugin is non-deterministic and doing multiple gc rounds trying to make it so just seems too heavy. So basically +1 from me. I would also not add a special case for PyPI.

@bluetech

bluetech commented May 8, 2026

Copy link
Copy Markdown
Member

See also 391324e.

Also cc @graingert.

@graingert

Copy link
Copy Markdown
Member

Thanks for the CC, I have no opinion on this though

The 5-iteration default was borrowed from the Trio project, where it was
determined empirically to handle PyPy's object resurrection behavior: on
PyPy, objects like coroutines can survive GC rounds because executing their
__del__ can resurrect them.

On CPython, reference counting frees most objects immediately. One GC pass
is sufficient to handle reference cycles, as confirmed by all
test_unraisableexception tests passing (including the refcycle variants).

Use 1 pass on CPython and retain 5 on PyPy.

Signed-off-by: Mike Fiedler <miketheman@gmail.com>
@miketheman miketheman force-pushed the miketheman/speed-up-test-sutie branch from 07255a2 to e2bc38b Compare May 23, 2026 21:54
Using `timeit`, I found a faster call:

```python
import sys
import timeit

def method_hasattr():
    return 5 if hasattr(sys, "pypy_version_info") else 1

def method_implementation():
    return 5 if sys.implementation.name == "pypy" else 1

time1 = timeit.timeit(method_hasattr, number=10000)
time2 = timeit.timeit(method_implementation, number=10000)

print(f"Method Hasattr: {time1:.5f} seconds")
print(f"Method Implementation: {time2:.5f} seconds")
```

Results:
```
$ PYENV_VERSION=3.14.5 python microbench.py
Method Hasattr: 0.00085 seconds
Method Implementation: 0.00054 seconds

$ PYENV_VERSION=pypy3.11-7.3.22 python microbench.py
Method Hasattr: 0.00768 seconds
Method Implementation: 0.00070 seconds
```

Refs: https://docs.python.org/3/library/sys.html#sys.implementation

Signed-off-by: Mike Fiedler <miketheman@gmail.com>
Signed-off-by: Mike Fiedler <miketheman@gmail.com>
@psf-chronographer psf-chronographer Bot added the bot:chronographer:provided (automation) changelog entry is part of PR label May 23, 2026
@miketheman miketheman marked this pull request as ready for review May 23, 2026 22:11
@miketheman

miketheman commented May 23, 2026

Copy link
Copy Markdown
Contributor Author

I found a faster implementation, and added a changelog entry. If there's a benchamrking/test suite somewhere I can hook into, I'd be happy to explore that, but I didn't find one, so pointers would be appreciated.

@miketheman

miketheman commented May 23, 2026

Copy link
Copy Markdown
Contributor Author

CI results compared:


Table 1: Total Job Time (wall clock)

Job                                          Upstream       Ours      Delta   % Change
--------------------------------------------------------------------------------------
  doctesting                                    0m45s      0m53s        +8s     +17.8%
  macos-py310                                   2m03s      1m38s       -25s     -20.3%
  macos-py312                                   1m30s      1m23s        -7s      -7.8%
  macos-py313                                   1m26s      1m46s       +20s     +23.3%
  macos-py314                                   1m49s      1m20s       -29s     -26.6%
  plugins                                       1m19s      0m49s       -30s     -38.0%
  ubuntu-py310-freeze                           0m47s      0m55s        +8s     +17.0%
  ubuntu-py310-lsof-numpy-pexpect              13m58s     12m44s     -1m14s      -8.8%
  ubuntu-py310-pluggy                           2m19s      1m50s       -29s     -20.9%
  ubuntu-py310-unittest-asynctest               0m47s      0m47s        +0s       0.0%
  ubuntu-py310-unittest-twisted24               0m49s      0m52s        +3s      +6.1%
  ubuntu-py310-unittest-twisted25               0m48s      0m52s        +4s      +8.3%
  ubuntu-py310-xdist                            2m11s      1m55s       -16s     -12.2%
  ubuntu-py311                                  7m56s      6m33s     -1m23s     -17.4%
  ubuntu-py312                                  8m32s      7m30s     -1m02s     -12.1%
  ubuntu-py313-pexpect                          9m00s      7m25s     -1m35s     -17.6%
  ubuntu-py314                                  7m48s      6m56s       -52s     -11.1%
  ubuntu-pypy3-xdist                            4m13s      4m23s       +10s      +4.0%  [PyPy]
  windows-py310-pluggy                          3m37s      3m22s       -15s      -6.9%
  windows-py310-unittest-asynctest              1m26s      1m35s        +9s     +10.5%
  windows-py310-unittest-twisted24              1m30s      1m45s       +15s     +16.7%
  windows-py310-unittest-twisted25              1m32s      1m38s        +6s      +6.5%
  windows-py310-xdist                           3m35s      3m40s        +5s      +2.3%
  windows-py311                                 7m18s      6m36s       -42s      -9.6%
  windows-py312                                 7m47s      6m23s     -1m24s     -18.0%
  windows-py313                                 5m39s      6m24s       +45s     +13.3%
  windows-py314                                13m56s     12m00s     -1m56s     -13.9%
--------------------------------------------------------------------------------------
  TOTAL (sum of all jobs)                     114m20s    103m54s    -10m26s      -9.1%

Table 2: Test Step Only (excludes setup/checkout/install/upload)

Job                                          Upstream       Ours      Delta   % Change
--------------------------------------------------------------------------------------
  doctesting                                    0m25s      0m26s        +1s      +4.0%
  macos-py310                                   1m26s      1m05s       -21s     -24.4%
  macos-py312                                   1m10s      1m02s        -8s     -11.4%
  macos-py313                                   1m08s      1m24s       +16s     +23.5%  ← noise
  macos-py314                                   1m29s      1m01s       -28s     -31.5%
  plugins                                       0m37s      0m35s        -2s      -5.4%
  ubuntu-py310-freeze                           0m26s      0m33s        +7s     +26.9%  ← noise
  ubuntu-py310-lsof-numpy-pexpect              13m42s     12m28s     -1m14s      -9.0%
  ubuntu-py310-pluggy                           1m58s      1m37s       -21s     -17.8%
  ubuntu-py310-unittest-asynctest               0m30s      0m29s        -1s      -3.3%
  ubuntu-py310-unittest-twisted24               0m34s      0m34s        +0s       0.0%
  ubuntu-py310-unittest-twisted25               0m29s      0m34s        +5s     +17.2%
  ubuntu-py310-xdist                            1m53s      1m37s       -16s     -14.2%
  ubuntu-py311                                  7m33s      6m19s     -1m14s     -16.3%
  ubuntu-py312                                  8m15s      7m14s     -1m01s     -12.3%
  ubuntu-py313-pexpect                          8m40s      7m10s     -1m30s     -17.3%
  ubuntu-py314                                  7m23s      6m38s       -45s     -10.2%
  ubuntu-pypy3-xdist                            3m51s      3m52s        +1s      +0.4%  [PyPy — no change expected]
  windows-py310-pluggy                          2m41s      2m42s        +1s      +0.6%
  windows-py310-unittest-asynctest              0m44s      0m48s        +4s      +9.1%
  windows-py310-unittest-twisted24              0m49s      0m54s        +5s     +10.2%
  windows-py310-unittest-twisted25              0m48s      0m50s        +2s      +4.2%
  windows-py310-xdist                           2m55s      3m02s        +7s      +4.0%
  windows-py311                                 6m37s      5m59s       -38s      -9.6%
  windows-py312                                 6m56s      5m47s     -1m09s     -16.6%
  windows-py313                                 4m40s      5m32s       +52s     +18.6%  ← noise
  windows-py314                                12m14s     11m09s     -1m05s      -8.9%
--------------------------------------------------------------------------------------
  TOTAL (sum of all test steps)                99m53s     91m21s     -8m32s      -8.5%

Table 3: Test Step Summary by Platform

Group                              Upstream (test)  Ours (test)    Saved        %
----------------------------------------------------------------------------------
  Linux (full suite)                       23m11s       20m11s   -3m00s    12.9%
  Linux (variants)                         32m03s       28m54s   -3m09s     9.8%
  macOS                                     5m13s        4m32s     -41s    13.1%
  Windows                                  38m24s       36m43s   -1m41s     4.4%
  Other                                     1m02s        1m01s      -1s     1.6%
----------------------------------------------------------------------------------
  TOTAL                                    99m53s       91m21s   -8m32s     8.5%

Key takeaways:

  • -8m32s (-8.5%) saved across all test steps summed; -10m26s (-9.1%) in total wall-clock CI time
  • Linux full-suite jobs (py311–py314) show the cleanest signal: consistent 10–17% savings per job
  • PyPy (ubuntu-pypy3-xdist) is flat (+0.4%) — expected, since we kept 5 iterations for PyPy
  • Windows py310 variant jobs (asynctest, twisted, xdist) show small regressions — these run very few tests (<1m each) so the GC savings are tiny and Windows runner variance dominates
  • windows-py313 +52s is almost certainly runner noise — Windows CI timing is high-variance and that job has no structural reason to regress
  • macos-py313 +16s similarly looks like variance; macos-py314 saved 28s on the same runner type

The signal is clear and consistent on Linux where runners are stable.

Comparison script (uses gh CLI to fetch data):

Details
#!/usr/bin/env python3
"""Compare test step timings between two GitHub Actions workflow runs.

Usage:
    python scripts/compare_ci_runs.py <upstream_run_id> <our_run_id> [--repo REPO]

Example:
    python scripts/compare_ci_runs.py 26336401841 26344890356
    python scripts/compare_ci_runs.py 26336401841 26344890356 --repo pytest-dev/pytest

Requires: gh CLI authenticated with repo read access.
"""
from __future__ import annotations

import argparse
import json
import subprocess
import sys
from datetime import datetime


def secs(a: str | None, b: str | None) -> int | None:
    if not a or not b:
        return None
    fmt = "%Y-%m-%dT%H:%M:%SZ"
    try:
        return int((datetime.strptime(b, fmt) - datetime.strptime(a, fmt)).total_seconds())
    except ValueError:
        return None


def fmt_secs(s: int | None) -> str:
    if s is None:
        return "—"
    m, sec = divmod(s, 60)
    return f"{m}m{sec:02d}s"


def delta_fmt(before: int | None, after: int | None) -> str:
    if before is None or after is None:
        return "—"
    d = after - before
    prefix = "+" if d >= 0 else "-"
    m, s = divmod(abs(d), 60)
    return f"{prefix}{m}m{s:02d}s" if m else f"{prefix}{s}s"


def pct(before: int | None, after: int | None) -> str:
    if not before or after is None:
        return "—"
    p = ((after - before) / before) * 100
    return f"{'+' if p > 0 else ''}{p:.1f}%"


def get_jobs(run_id: int, repo: str) -> list[dict]:
    result = subprocess.run(
        ["gh", "run", "view", str(run_id), "--repo", repo, "--json", "jobs"],
        capture_output=True,
        text=True,
        check=True,
    )
    return json.loads(result.stdout)["jobs"]


def parse_jobs(jobs: list[dict]) -> dict[str, dict]:
    parsed = {}
    for job in jobs:
        if not job["name"].startswith("build"):
            continue
        job_secs = secs(job["startedAt"], job["completedAt"])
        test_secs_total = sum(
            secs(s["startedAt"], s["completedAt"]) or 0
            for s in job["steps"]
            if s["name"].startswith("Test ")
            and (secs(s["startedAt"], s["completedAt"]) or 0) > 0
        )
        parsed[job["name"]] = {
            "job_secs": job_secs,
            "test_secs": test_secs_total or None,
        }
    return parsed


PLATFORM_GROUPS = {
    "Linux (full suite)": ["ubuntu-py310", "ubuntu-py311", "ubuntu-py312", "ubuntu-py313", "ubuntu-py314"],
    "Linux (variants)": [
        "ubuntu-py310-freeze", "ubuntu-py310-lsof-numpy-pexpect", "ubuntu-py310-pluggy",
        "ubuntu-py310-unittest-asynctest", "ubuntu-py310-unittest-twisted24",
        "ubuntu-py310-unittest-twisted25", "ubuntu-py310-xdist", "ubuntu-py313-pexpect",
        "ubuntu-pypy3-xdist",
    ],
    "macOS": ["macos-py310", "macos-py312", "macos-py313", "macos-py314"],
    "Windows": [
        "windows-py310-pluggy", "windows-py310-unittest-asynctest", "windows-py310-unittest-twisted24",
        "windows-py310-unittest-twisted25", "windows-py310-xdist", "windows-py311",
        "windows-py312", "windows-py313", "windows-py314",
    ],
}


def get_group(short_name: str) -> str:
    for group, members in PLATFORM_GROUPS.items():
        if short_name in members:
            return group
    return "Other"


def print_table(headers: list[str], rows: list[list[str]], footer: list[str] | None = None) -> None:
    widths = [max(len(str(row[i])) for row in ([headers] + rows + ([footer] if footer else []))) for i in range(len(headers))]
    sep = "-" * (sum(widths) + 3 * len(widths) + 1)
    fmt = "  " + "  ".join(f"{{:<{widths[0]}}}" if i == 0 else f"{{:>{widths[i]}}}" for i in range(len(headers)))
    print(fmt.format(*headers))
    print(sep)
    for row in rows:
        print(fmt.format(*row))
    if footer:
        print(sep)
        print(fmt.format(*footer))


def main() -> None:
    parser = argparse.ArgumentParser(description=__doc__, formatter_class=argparse.RawDescriptionHelpFormatter)
    parser.add_argument("upstream_run_id", type=int)
    parser.add_argument("our_run_id", type=int)
    parser.add_argument("--repo", default="pytest-dev/pytest")
    args = parser.parse_args()

    repo = args.repo
    upstream_url = f"https://github.com/{repo}/actions/runs/{args.upstream_run_id}"
    our_url = f"https://github.com/{repo}/actions/runs/{args.our_run_id}"

    print(f"Fetching upstream run {args.upstream_run_id}...")
    upstream = parse_jobs(get_jobs(args.upstream_run_id, repo))
    print(f"Fetching our run {args.our_run_id}...")
    ours = parse_jobs(get_jobs(args.our_run_id, repo))

    all_names = sorted(set(upstream) | set(ours))

    print(f"\n{'=' * 90}")
    print(f"UPSTREAM: {upstream_url}")
    print(f"OURS:     {our_url}")
    print(f"{'=' * 90}")

    # Table 1: total job time
    print("\n### Table 1: Total Job Time (wall clock)\n")
    rows, total_u, total_o = [], 0, 0
    for name in all_names:
        short = name.removeprefix("build (").removesuffix(")")
        u, o = upstream.get(name, {}), ours.get(name, {})
        uj, oj = u.get("job_secs"), o.get("job_secs")
        if uj: total_u += uj
        if oj: total_o += oj
        note = "  [PyPy]" if "pypy" in name else ""
        rows.append([short + note, fmt_secs(uj), fmt_secs(oj), delta_fmt(uj, oj), pct(uj, oj)])
    print_table(
        ["Job", "Upstream", "Ours", "Delta", "% Change"],
        rows,
        ["TOTAL (sum of all jobs)", fmt_secs(total_u), fmt_secs(total_o), delta_fmt(total_u, total_o), pct(total_u, total_o)],
    )

    # Table 2: test step only
    print("\n\n### Table 2: Test Step Duration Only (excludes setup/checkout/install/upload)\n")
    rows, total_u, total_o = [], 0, 0
    for name in all_names:
        short = name.removeprefix("build (").removesuffix(")")
        u, o = upstream.get(name, {}), ours.get(name, {})
        ut, ot = u.get("test_secs"), o.get("test_secs")
        if ut: total_u += ut
        if ot: total_o += ot
        note = "  [PyPy]" if "pypy" in name else ""
        rows.append([short + note, fmt_secs(ut), fmt_secs(ot), delta_fmt(ut, ot), pct(ut, ot)])
    print_table(
        ["Job", "Upstream", "Ours", "Delta", "% Change"],
        rows,
        ["TOTAL (sum of all test steps)", fmt_secs(total_u), fmt_secs(total_o), delta_fmt(total_u, total_o), pct(total_u, total_o)],
    )

    # Table 3: by platform
    print("\n\n### Table 3: Test Step Summary by Platform\n")
    group_u: dict[str, int] = {}
    group_o: dict[str, int] = {}
    for name in all_names:
        short = name.removeprefix("build (").removesuffix(")")
        g = get_group(short)
        group_u[g] = group_u.get(g, 0) + (upstream.get(name, {}).get("test_secs") or 0)
        group_o[g] = group_o.get(g, 0) + (ours.get(name, {}).get("test_secs") or 0)
    rows, gtot_u, gtot_o = [], 0, 0
    for g in [*PLATFORM_GROUPS, "Other"]:
        gu, go = group_u.get(g, 0), group_o.get(g, 0)
        gtot_u += gu
        gtot_o += go
        rows.append([g, fmt_secs(gu), fmt_secs(go), delta_fmt(gu, go), pct(gu, go)])
    print_table(
        ["Group", "Upstream (test)", "Ours (test)", "Saved", "%"],
        rows,
        ["TOTAL", fmt_secs(gtot_u), fmt_secs(gtot_o), delta_fmt(gtot_u, gtot_o), pct(gtot_u, gtot_o)],
    )


if __name__ == "__main__":
    main()

@bluetech bluetech left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great, thank you!

@bluetech bluetech merged commit d84fccb into pytest-dev:main May 24, 2026
33 of 36 checks passed
@miketheman miketheman deleted the miketheman/speed-up-test-sutie branch May 24, 2026 18:41
paulzuradzki added a commit to paulzuradzki/pytest that referenced this pull request May 24, 2026
…gure

pytest-dev#14441 reduced the default gc_collect_harder passes to 1 on CPython
(5 on PyPy, where __del__ can resurrect objects). That change lived in
cleanup(), which this branch emptied when it moved GC into
pytest_unconfigure. Carry the same default into the new location so the
relocation does not silently revert pytest-dev#14441. CPython still collects the
refcycle regression tests in a single pass.
Zac-HD pushed a commit that referenced this pull request May 27, 2026
* Add failing regression test for #14263 (red)

filterwarnings = error::ResourceWarning does not fail tests that leak
resources through a reference cycle. collect_unraisable wraps the
captured ResourceWarning in PytestUnraisableExceptionWarning, a class
the user has no filter for, so the run exits 0.

This test pins that contract: on a refcycle-leaking test with
error::ResourceWarning configured, pytest should exit non-zero and the
output should show the inner ResourceWarning rather than the wrapping
PytestUnraisableExceptionWarning. Fails at this commit; the next
commit ships the fix that turns it green.

Refs #14263.

* Surface filter-promoted unraisable warnings directly (#14263)

When sys.unraisablehook captures a Warning subclass instance and the
user has an active ``error::<that class>`` filter, raise the original
warning rather than wrapping in PytestUnraisableExceptionWarning. The
wrap path remains for any case where no matching error filter is set,
so suites that don't use ``error::<warning>`` filters see no change.

Filter matching is approximate: category only, not message/module/lineno.
The check errs toward false negatives, never false positives.

The regression test added in the previous commit now passes. Additional
coverage:

- test_refcycle_userwarning_filter: locks the contract for a non-builtin
  Warning subclass.
- test_unraisable_warning_without_filter_still_wraps: scope guard. A
  Warning raised from __del__ without a matching error filter must
  still be wrapped, not raised directly.
- test_unraisable_warning_filter_add_note_dedups: covers the duplicate-
  note guard in the unwrap path for singleton/cached Warning instances.

Tightens the ``errors`` list type from list[Exception] to
list[Warning | RuntimeError]. Adds Paul Zuradzki to AUTHORS. Notes in
test_create_task_raises_unraisable_warning_filter that the propagated
class is now bare RuntimeWarning rather than the wrapping
PytestUnraisableExceptionWarning (because -Werror activates the new
unwrap path).

Closes #14263.

* Add failing regression test for cleanup-stack ordering (red)

Forces the bad LIFO order with a conftest that registers a
warnings.resetwarnings cleanup via @hookimpl(trylast=True): it pops
before unraisableexception's cleanup and clears the user's
error::ResourceWarning filter before GC runs, so the leak exits 0. The
next commit moves GC into pytest_unconfigure (runs before the cleanup
stack closes), making the test pass regardless of plugin order.

Refs #14263.

* Move unraisable GC to pytest_unconfigure (refs #14263)

Register only the hook-restore + stash-cleanup as the
config.add_cleanup callback. Move the GC pump and collect_unraisable
call into a new pytest_unconfigure(config) hook.

pytest_unconfigure fires before _cleanup_stack.close(), so warning
filters managed via the cleanup stack (the warnings plugin's
catch_warnings context, in particular) are guaranteed active when GC
runs. This decouples the unraisable step from plugin registration
order in default_plugins. The previous arrangement worked only because
of LIFO ordering on _cleanup_stack; #13057 (Dec 2024) reordered
default_plugins to make that ordering correct, but the structural
fragility remained.

No observable behavior change. The 141 existing tests in
test_unraisableexception + test_warnings + test_recwarn +
test_threadexception still pass. The previous commit's
test_refcycle_resource_warning_filter continues to fail on main and
pass here.

This is the structural side of the issue's two proposed fixes; the
user-visible side shipped in the previous commit.

* Add failing regression test for unset stash guard (red)

After GC moved into pytest_unconfigure, a plugin whose pytest_configure
raises UsageError leaves the stash key unset while pytest_unconfigure
still runs. Without a presence check it hits KeyError and reports
INTERNALERROR instead of USAGE_ERROR. The next commit adds the guard.

Refs #14263.

* Guard pytest_unconfigure against unset stash (refs #14263)

When another plugin's pytest_configure raises (e.g. pytest.UsageError
in testing/acceptance_test.py::test_config_error), pluggy skips
remaining configure hooks. unraisableexception.pytest_configure never
runs, config.stash[unraisable_exceptions] is never set. The previous
config.add_cleanup callback wasn't registered in that case either, so
cleanup was a no-op. The pytest_unconfigure hook introduced in the
previous commit ran unconditionally and hit KeyError on the unset
stash, surfacing as INTERNAL_ERROR where pytest should exit with
USAGE_ERROR.

Guard with a stash-presence check at the top of pytest_unconfigure.
test_config_error catches the regression direction.

* Tighten comments in unraisableexception

* Add failure messages to result.ret assertions

* Adopt #14441's CPython gc_collect default in pytest_unconfigure

#14441 reduced the default gc_collect_harder passes to 1 on CPython
(5 on PyPy, where __del__ can resurrect objects). That change lived in
cleanup(), which this branch emptied when it moved GC into
pytest_unconfigure. Carry the same default into the new location so the
relocation does not silently revert #14441. CPython still collects the
refcycle regression tests in a single pass.

* PR feedback: keep GC in cleanup(), drop direct-raise of unraisable warnings

Reviewer feedback on #14499:

- Keep the GC + queue drain in cleanup() as well as pytest_unconfigure, so
  objects freed while the cleanup stack unwinds still surface.
- Drop the direct-raise path (_warning_class_has_error_filter plus the unwrap
  branch in collect_unraisable). Re-raising the inner warning lost the
  traceback the hook captures as a string, and the filter match was only
  approximate. collect_unraisable now always wraps in
  PytestUnraisableExceptionWarning and lets the warnings machinery decide.

Tests dropped or reworked:

- Removed test_refcycle_resource_warning_filter: with only error::ResourceWarning
  the leak no longer fails the suite, which was the dropped direct-raise.
- Removed test_refcycle_userwarning_filter: redundant with
  test_refcycle_unraisable_warning_filter once the wrapper is always raised.
- Removed test_unraisable_warning_filter_add_note_dedups: covered the deleted
  add_note code.
- Reworked test_unraisable_decouples_from_cleanup_stack_order to raise
  ValueError from __del__ and filter on error::pytest.PytestUnraisableExceptionWarning.
  A ResourceWarning leak only enters the unraisable pipeline through an
  error::ResourceWarning filter, which no longer promotes the wrapper; a raised
  exception is wrapped unconditionally, so the timing fix stays observable.

Changelog reworded to describe the pytest_unconfigure timing fix instead of the
dropped direct-raise behavior.
luketainton pushed a commit to luketainton/repos_PwnedPW that referenced this pull request Jun 18, 2026
This PR contains the following updates:

| Package | Change | [Age](https://docs.renovatebot.com/merge-confidence/) | [Confidence](https://docs.renovatebot.com/merge-confidence/) |
|---|---|---|---|
| [pytest](https://github.com/pytest-dev/pytest) ([changelog](https://docs.pytest.org/en/stable/changelog.html)) | `<9.1.0,>=9.0.0` → `<9.1.1,>=9.1.0` | ![age](https://developer.mend.io/api/mc/badges/age/pypi/pytest/9.1.0?slim=true) | ![confidence](https://developer.mend.io/api/mc/badges/confidence/pypi/pytest/9.0.3/9.1.0?slim=true) |

---

### Release Notes

<details>
<summary>pytest-dev/pytest (pytest)</summary>

### [`v9.1.0`](https://github.com/pytest-dev/pytest/releases/tag/9.1.0)

[Compare Source](pytest-dev/pytest@9.0.3...9.1.0)

### pytest 9.1.0 (2026-06-13)

#### Removals and backward incompatible breaking changes

- [#&#8203;14533](pytest-dev/pytest#14533): When using `--doctest-modules`, autouse fixtures with `module`, `package` or `session` scope that are defined inline in Python test modules (not plugins or conftests) will now possibly execute twice.

  If this is undesirable, move the fixture definition to a `conftest.py` file if possible.

  Technical explanation for those interested:
  When using <span class="title-ref">--doctest-modules</span>, pytest possibly collects Python modules twice, once as `pytest.Module` and once as a `DoctestModule` (depending on the configuration).
  Due to improvements in pytest's fixture implementation, if e.g. the `DoctestModule` collects a fixture, it is now visible to it only, and not to the `Module`.
  This means that both need to register the fixtures independently.

#### Deprecations (removal in next major release)

- [#&#8203;10819](pytest-dev/pytest#10819): Added a deprecation warning for class-scoped fixtures defined as instance methods (without `@classmethod`). Such fixtures set attributes on a different instance than the test methods use, leading to unexpected behavior. Use `@classmethod` decorator instead -- by `yastcher`.

  See `10819` and `14011`.

- [#&#8203;12882](pytest-dev/pytest#12882): Calling `request.getfixturevalue() <pytest.FixtureRequest.getfixturevalue>` during teardown to request a fixture that was not already requested is now deprecated and will become an error in pytest 10.

  See `dynamic-fixture-request-during-teardown` for details.

- [#&#8203;13409](pytest-dev/pytest#13409): Using non-`~collections.abc.Collection` iterables (such as generators, iterators, or custom iterable objects) for the `argvalues` parameter in `@pytest.mark.parametrize <pytest.mark.parametrize ref>` and `metafunc.parametrize <pytest.Metafunc.parametrize>` is now deprecated.

  These iterables get exhausted after the first iteration,
  leading to tests getting unexpectedly skipped in cases such as running `pytest.main()` multiple times,
  using class-level parametrize decorators,
  or collecting tests multiple times.

  See `parametrize-iterators` for details and suggestions.

- [#&#8203;13946](pytest-dev/pytest#13946): The private `config.inicfg` attribute is now deprecated.
  Use `config.getini() <pytest.Config.getini>` to access configuration values instead.

  See `config-inicfg` for more details.

- [#&#8203;14004](pytest-dev/pytest#14004): Passing `baseid` to `~pytest.FixtureDef` or `nodeid` strings to fixture registration APIs is now deprecated. These are internal pytest APIs that are used by some plugins.

  Use the `node` parameter instead for fixture scoping. This enables more robust node-based
  matching instead of string prefix matching.
  If you've used `nodeid=None`, pass `node=session` instead.

  This will be removed in pytest 10.

- [#&#8203;14335](pytest-dev/pytest#14335): The method of configuring hooks using markers, deprecated since pytest 7.2, is now scheduled to be removed in pytest 10.
  See `hook-markers` for more details.

- [#&#8203;14434](pytest-dev/pytest#14434): The `--pastebin` option is now deprecated.
  The same functionality is now available in an external plugin, `pytest-pastebin`.
  See `pastebin-deprecated` for more details.

- [#&#8203;14513](pytest-dev/pytest#14513): The private `FixtureDef.has_location` attribute is now deprecated and will be removed in pytest 10.
  See `fixturedef-has-location-deprecated` for details.

- [#&#8203;1764](pytest-dev/pytest#1764): `pytest.console_main` is now deprecated and will be removed in pytest 10.
  It was never intended for programmatic use; use `pytest.main` instead.

#### New features

- [#&#8203;12376](pytest-dev/pytest#12376): Added `pytest.register_fixture()` to register fixtures using an imperative interface.

  This is an advanced function intended for use by plugins.

  Normally, fixtures should be registered declaratively using the `@pytest.fixture <pytest.fixture>` decorator.
  Pytest looks for these fixture definitions during the collection phase and registers them automatically.
  For some plugin usecases the declarative interface can be cumbersome or unviable, in which case this imperative interface can be used.

- [#&#8203;14023](pytest-dev/pytest#14023): Added <span class="title-ref">--report-chars</span> long CLI option.

- [#&#8203;14371](pytest-dev/pytest#14371): Added `--max-warnings` command-line option and `max_warnings` configuration option to fail the test run when the number of warnings exceeds a given threshold -- by `miketheman`.

- [#&#8203;6757](pytest-dev/pytest#6757): Added the `assertion_text_diff_style` configuration option, allowing
  string equality failures to be rendered as separate `Left:` and `Right:`
  blocks instead of `ndiff` output.

- [#&#8203;8395](pytest-dev/pytest#8395): Added support for `~datetime.datetime` and `~datetime.timedelta` comparisons with `pytest.approx`. An explicit `abs` or `rel` tolerance as a `~datetime.timedelta` is required and relative tolerance is not supported for datetime comparisons -- by `hamza-mobeen`.

#### Improvements in existing functionality

- [#&#8203;11225](pytest-dev/pytest#11225): `pytest.warns` now shows "Regex pattern did not match" instead of "DID NOT WARN" when warnings were emitted but the `match` pattern did not match.

- [#&#8203;11295](pytest-dev/pytest#11295): Improved output of `--fixtures-per-test` by excluding internal-implementation fixtures generated by `@pytest.mark.parametrize` and similar.

- [#&#8203;13241](pytest-dev/pytest#13241): `pytest.raises`, `pytest.warns` and `pytest.deprecated_call` now uses `ParamSpec` for the type hint to the (old and not recommended) callable overload, instead of `Any`. This allows type checkers to raise errors when passing incorrect function parameters.
  `func` can now also be passed as a kwarg, which the type hint previously showed as possible but didn't accept.

- [#&#8203;13862](pytest-dev/pytest#13862): Improved the readability of "DID NOT RAISE" error messages by using the exception type's name instead of its <span class="title-ref">repr</span>.

- [#&#8203;14026](pytest-dev/pytest#14026): Added test coverage for compiled regex patterns in `pytest.raises` match parameter.

- [#&#8203;14137](pytest-dev/pytest#14137): <span class="title-ref">pytest.ScopeName</span> is now public to allow using it in function signatures.

- [#&#8203;14342](pytest-dev/pytest#14342): Marked `yield_fixture` as deprecated to type checkers using the `deprecated` decorator. Note it
  `has originally been deprecated <yield-fixture-deprecated>` in pytest 6.2 already.

- [#&#8203;14373](pytest-dev/pytest#14373): Added type annotations for `pytest.approx`.

- [#&#8203;14430](pytest-dev/pytest#14430): When using `--setup-show`, a space is now printed after the test name (and possibly used fixtures), to separate it from the test result.

- [#&#8203;14441](pytest-dev/pytest#14441): Reduced the default number of `gc.collect()` passes in the `unraisableexception` plugin from 5 to 1 on CPython, where reference counting makes a single pass sufficient. PyPy retains 5 passes due to object resurrection via `__del__`. This can noticeably speed up test suites that trigger many pytester runs.

- [#&#8203;14461](pytest-dev/pytest#14461): Improved assertion failure explanations for equality comparisons between mapping objects that are not `dict` instances.

- [#&#8203;14513](pytest-dev/pytest#14513): The order in which fixture definitions overriding each other are resolved is now determined first by their *visibility* in the collection tree rather than by the order in which they are registered.

  A fixture defined for a more specific node (e.g. a module or an item) now always takes precedence over one with the same name defined for a more general node (e.g. the session), even when the more general one was registered later.
  Fixtures with non-comparable visibility or the same visibility keep the existing behavior of "last registered wins".
  This change is supposed to only affect plugins which register multiple fixtures programmatically with the same name.

- [#&#8203;14524](pytest-dev/pytest#14524): Add official Python 3.15 support.

- [#&#8203;1764](pytest-dev/pytest#1764): Improved argparse program name to show `pytest`, `python -m pytest`, or `pytest.main()` based on how pytest was invoked, making help and error messages clearer.

- [#&#8203;8265](pytest-dev/pytest#8265): Emit a `PytestCollectionWarning` when a module-level `__getattr__` returns `None` for `pytestmark` instead of raising `AttributeError`.

  Previously this caused a cryptic `TypeError: got None instead of Mark` error.
  Now pytest issues a helpful warning and continues collecting the module normally.

#### Bug fixes

- [#&#8203;13192](pytest-dev/pytest#13192): Fixed <span class="title-ref">|</span> (pipe) not being treated as a regex meta-character that needs escaping in `pytest.raises(match=...) <pytest.raises>`.

- [#&#8203;13484](pytest-dev/pytest#13484): Fixed `-W` option values being duplicated in `Config.known_args_namespace`.

- [#&#8203;13626](pytest-dev/pytest#13626): Fixed function-scoped fixture values being kept alive after a test was interrupted by `KeyboardInterrupt` or early exit,
  allowing them to potentially be released more promptly.

- [#&#8203;13784](pytest-dev/pytest#13784): Fixed `capteesys` producing doubled output when used with `--capture=no` (`-s`).

- [#&#8203;13817](pytest-dev/pytest#13817): Fixed a secondary <span class="title-ref">AttributeError</span> masking the original error when an option argument fails to initialize.

- [#&#8203;13884](pytest-dev/pytest#13884): Fixed rare internal IndexError caused by <span class="title-ref">builtins.compile</span> being overridden in client code.

- [#&#8203;13885](pytest-dev/pytest#13885): Fixed autouse fixtures defined inside a `unittest.TestCase` class running even when the class is decorated with `unittest.skip` or `unittest.skipIf` -- regression since pytest 8.1.0.

- [#&#8203;13917](pytest-dev/pytest#13917): `unittest.SkipTest` is no longer considered an interactive exception, i.e. `pytest_exception_interact` is no longer called for it.

- [#&#8203;13963](pytest-dev/pytest#13963): Fixed subtests running with `pytest-xdist` when their contexts contain objects that are not JSON-serializable.

  Fixes [pytest-dev/pytest-xdist#1273](pytest-dev/pytest-xdist#1273).

- [#&#8203;14004](pytest-dev/pytest#14004): Fixed conftest.py fixture scoping when `testpaths` points outside of the `rootdir <rootdir>`.

  Previously, fixtures from nested conftest.py files would incorrectly leak to sibling directories
  when using a relative `testpaths` like `../tests/sdk`.

  Conftest fixtures are now parsed during `Directory <pytest.Directory>` collection, using the `Directory` node for proper scoping.

- [#&#8203;14050](pytest-dev/pytest#14050): Display dictionary differences in assertion failures using the original key insertion order instead of sorted order.

- [#&#8203;14080](pytest-dev/pytest#14080): fix missing type annotations on `Pytester.makepyfile` and `Pytester.maketxtfile` methods.

- [#&#8203;14114](pytest-dev/pytest#14114): An exception from `pytest_fixture_post_finalizer` no longer prevents fixtures from being torn down, causing additional errors in the following tests.

- [#&#8203;14161](pytest-dev/pytest#14161): Fixed `monkeypatch.setattr() <pytest.MonkeyPatch.setattr>` leaving a stale entry on the undo stack when the underlying `setattr()` call fails (e.g. on immutable targets), causing an `AttributeError` crash during teardown.

- [#&#8203;14214](pytest-dev/pytest#14214): Fixed `-v` hint in `pytest.raises` match diff not working because assertion verbosity was not propagated.

- [#&#8203;14234](pytest-dev/pytest#14234): Allow `pytest.HIDDEN_PARAM <hidden-param>` in `@pytest.mark.parametrize(ids=...) <pytest.mark.parametrize ref>` typing.

- [#&#8203;14248](pytest-dev/pytest#14248): Fixed direct parametrization causing the static fixture closure (as reflected in `request.fixturenames <pytest.FixtureRequest.fixturenames>`) to omit fixtures that are requested transitively from overridden fixtures.

- [#&#8203;14263](pytest-dev/pytest#14263): Unraisable exceptions from finalizers are now collected during `pytest_unconfigure`, before pytest tears down the warning filters installed for the session. Previously the collection ran from a cleanup callback whose order relative to other plugins' cleanups was not guaranteed, so an active `error` filter could be removed before the exception surfaced and a late resource leak would pass silently. A `-W error` filter, or any filter matching `pytest.PytestUnraisableExceptionWarning`, now promotes these exceptions to failures regardless of plugin cleanup order.

- [#&#8203;14377](pytest-dev/pytest#14377): Fixed crash in <span class="title-ref">Config.get\_terminal\_writer</span> when an assertion fails with the `terminalreporter` plugin disabled.

- [#&#8203;14381](pytest-dev/pytest#14381): Fixed `-V` (short form of `--version`) to properly display the current version.

- [#&#8203;14389](pytest-dev/pytest#14389): Improved `pytest.raises(..., match=...) <pytest.raises>` failures to suppress the mismatched exception as a cause of the resulting `AssertionError`.

- [#&#8203;14392](pytest-dev/pytest#14392): Fixed a bug in `pytest.raises(match=...) <pytest.raises>` "fully escaped" detection, causing the regex diff display to be shown in some instances when the raw string diff display should be shown instead.

- [#&#8203;14442](pytest-dev/pytest#14442): Fixed a regression in pytest 9.0 where `--strict-markers` and `--strict-config` specified through `addopts` were silently ignored.

  Note that when targeting pytest >= 9.0, it's nicer to use `strict_markers` and `strict_config`, or `strict mode <strict mode>`.

- [#&#8203;14456](pytest-dev/pytest#14456): Fixed `pytest.approx` not recognizing types with `__array_interface__` as numpy-like arrays.

- [#&#8203;14474](pytest-dev/pytest#14474): Fixed a regression where `-k` and `-m` expressions containing both backslash characters in identifiers and string literal arguments would incorrectly raise a `SyntaxError` about escaping.

- [#&#8203;14483](pytest-dev/pytest#14483): Fixed JUnit XML report incorrectly escaping high Unicode codepoints (supplementary plane characters like emoji) in test failure messages. -- by `EternalRights`

- [#&#8203;14492](pytest-dev/pytest#14492): Fixed `Code.getargs()` incorrectly including local variable names in the returned argument tuple for functions with `*args` and/or `**kwargs`. The method was using `co_flags` bitmask values (`4` and `8`) directly as counts instead of converting them to `1` via `bool()`, and was not accounting for `co_kwonlyargcount` when `var=True`.

- [#&#8203;3697](pytest-dev/pytest#3697): Logging capture now works for non-propagating loggers.
  Previously only logs which reached the root logger were captured.
  This includes `caplog` and the "Captured log calls" test reporting.

- [#&#8203;3850](pytest-dev/pytest#3850): Fixed JUnit XML report: the `tests` attribute of the `<testsuite>` element now always matches the number of `<testcase>` elements in the file. In some cases (test passes but fails during teardown) the `tests` attribute would report an incorrect number of testcases in the XML file.

- [#&#8203;5848](pytest-dev/pytest#5848): `pytest_fixture_post_finalizer` is no longer called extra times for the same fixture teardown in some cases.

- [#&#8203;719](pytest-dev/pytest#719): Fixed `@pytest.mark.parametrize <pytest.mark.parametrize ref>` not unpacking single-element tuple values when using a string argnames with a trailing comma (e.g., `"arg,"`).

  The trailing comma form now correctly behaves like the tuple form `("arg",)`, treating argvalues as a list of tuples to unpack.

#### Improved documentation

- [#&#8203;11022](pytest-dev/pytest#11022): Document safer alternatives and scope guidance for monkeypatching standard library functions.
- [#&#8203;11307](pytest-dev/pytest#11307): Document that `@pytest.hookimpl(specname=...)` only works for function names starting with `pytest_`.
- [#&#8203;13038](pytest-dev/pytest#13038): Document that doctests do not support parametrized fixtures, including parametrized autouse fixtures.
- [#&#8203;13155](pytest-dev/pytest#13155): Clarified how the `request` fixture provides indirect parametrization values via `request.param`.
- [#&#8203;13304](pytest-dev/pytest#13304): Clarified in the documentation that hook implementations defined in `conftest.py` files are not available to other plugins during their `pytest_addoption()` execution, as conftest files are discovered and loaded after builtin and third-party plugins have been initialized. However, initial conftest files themselves can implement `pytest_addoption()` to add their own command-line options.
- [#&#8203;13902](pytest-dev/pytest#13902): Clarified how subtest progress markers are shown in the documentation.
- [#&#8203;14012](pytest-dev/pytest#14012): The `ini options ref` section of the API Reference now specified the type and default value of every configuration option.
- [#&#8203;14148](pytest-dev/pytest#14148): Documented a safe `pytestconfig.cache` access pattern when the
  `cacheprovider` plugin is disabled.
- [#&#8203;14303](pytest-dev/pytest#14303): The documentation is now built with Sphinx >= 9.
- [#&#8203;14465](pytest-dev/pytest#14465): Updated the hooks how-to page to link the `newhooks.py` file in `pytest-xdist` at tag `v3.8.0` instead of an unrelated 2017-era commit under the old layout. Pointing at a tag keeps the example in sync with the version users actually install, while remaining stable when the project's main branch moves on.

#### Miscellaneous internal changes

- [#&#8203;14582](pytest-dev/pytest#14582): Improved the recursion traceback test to exercise all requested traceback styles.

</details>

---

### Configuration

📅 **Schedule**: (UTC)

- Branch creation
  - At any time (no schedule defined)
- Automerge
  - At any time (no schedule defined)

🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Mend Renovate](https://github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0My4yMjAuMCIsInVwZGF0ZWRJblZlciI6IjQzLjIyMC4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyJ1bml0LXRlc3RzIl19-->

Reviewed-on: https://git.tainton.uk/repos/PwnedPW/pulls/340
Co-authored-by: renovate[bot] <renovate-bot@git.tainton.uk>
Co-committed-by: renovate[bot] <renovate-bot@git.tainton.uk>
luketainton pushed a commit to luketainton/repos_pypilot that referenced this pull request Jun 18, 2026
This PR contains the following updates:

| Package | Change | [Age](https://docs.renovatebot.com/merge-confidence/) | [Confidence](https://docs.renovatebot.com/merge-confidence/) |
|---|---|---|---|
| [pytest](https://github.com/pytest-dev/pytest) ([changelog](https://docs.pytest.org/en/stable/changelog.html)) | `<9.1.0,>=9.0.0` → `<9.1.1,>=9.1.0` | ![age](https://developer.mend.io/api/mc/badges/age/pypi/pytest/9.1.0?slim=true) | ![confidence](https://developer.mend.io/api/mc/badges/confidence/pypi/pytest/9.0.3/9.1.0?slim=true) |

---

### Release Notes

<details>
<summary>pytest-dev/pytest (pytest)</summary>

### [`v9.1.0`](https://github.com/pytest-dev/pytest/releases/tag/9.1.0)

[Compare Source](pytest-dev/pytest@9.0.3...9.1.0)

### pytest 9.1.0 (2026-06-13)

#### Removals and backward incompatible breaking changes

- [#&#8203;14533](pytest-dev/pytest#14533): When using `--doctest-modules`, autouse fixtures with `module`, `package` or `session` scope that are defined inline in Python test modules (not plugins or conftests) will now possibly execute twice.

  If this is undesirable, move the fixture definition to a `conftest.py` file if possible.

  Technical explanation for those interested:
  When using <span class="title-ref">--doctest-modules</span>, pytest possibly collects Python modules twice, once as `pytest.Module` and once as a `DoctestModule` (depending on the configuration).
  Due to improvements in pytest's fixture implementation, if e.g. the `DoctestModule` collects a fixture, it is now visible to it only, and not to the `Module`.
  This means that both need to register the fixtures independently.

#### Deprecations (removal in next major release)

- [#&#8203;10819](pytest-dev/pytest#10819): Added a deprecation warning for class-scoped fixtures defined as instance methods (without `@classmethod`). Such fixtures set attributes on a different instance than the test methods use, leading to unexpected behavior. Use `@classmethod` decorator instead -- by `yastcher`.

  See `10819` and `14011`.

- [#&#8203;12882](pytest-dev/pytest#12882): Calling `request.getfixturevalue() <pytest.FixtureRequest.getfixturevalue>` during teardown to request a fixture that was not already requested is now deprecated and will become an error in pytest 10.

  See `dynamic-fixture-request-during-teardown` for details.

- [#&#8203;13409](pytest-dev/pytest#13409): Using non-`~collections.abc.Collection` iterables (such as generators, iterators, or custom iterable objects) for the `argvalues` parameter in `@pytest.mark.parametrize <pytest.mark.parametrize ref>` and `metafunc.parametrize <pytest.Metafunc.parametrize>` is now deprecated.

  These iterables get exhausted after the first iteration,
  leading to tests getting unexpectedly skipped in cases such as running `pytest.main()` multiple times,
  using class-level parametrize decorators,
  or collecting tests multiple times.

  See `parametrize-iterators` for details and suggestions.

- [#&#8203;13946](pytest-dev/pytest#13946): The private `config.inicfg` attribute is now deprecated.
  Use `config.getini() <pytest.Config.getini>` to access configuration values instead.

  See `config-inicfg` for more details.

- [#&#8203;14004](pytest-dev/pytest#14004): Passing `baseid` to `~pytest.FixtureDef` or `nodeid` strings to fixture registration APIs is now deprecated. These are internal pytest APIs that are used by some plugins.

  Use the `node` parameter instead for fixture scoping. This enables more robust node-based
  matching instead of string prefix matching.
  If you've used `nodeid=None`, pass `node=session` instead.

  This will be removed in pytest 10.

- [#&#8203;14335](pytest-dev/pytest#14335): The method of configuring hooks using markers, deprecated since pytest 7.2, is now scheduled to be removed in pytest 10.
  See `hook-markers` for more details.

- [#&#8203;14434](pytest-dev/pytest#14434): The `--pastebin` option is now deprecated.
  The same functionality is now available in an external plugin, `pytest-pastebin`.
  See `pastebin-deprecated` for more details.

- [#&#8203;14513](pytest-dev/pytest#14513): The private `FixtureDef.has_location` attribute is now deprecated and will be removed in pytest 10.
  See `fixturedef-has-location-deprecated` for details.

- [#&#8203;1764](pytest-dev/pytest#1764): `pytest.console_main` is now deprecated and will be removed in pytest 10.
  It was never intended for programmatic use; use `pytest.main` instead.

#### New features

- [#&#8203;12376](pytest-dev/pytest#12376): Added `pytest.register_fixture()` to register fixtures using an imperative interface.

  This is an advanced function intended for use by plugins.

  Normally, fixtures should be registered declaratively using the `@pytest.fixture <pytest.fixture>` decorator.
  Pytest looks for these fixture definitions during the collection phase and registers them automatically.
  For some plugin usecases the declarative interface can be cumbersome or unviable, in which case this imperative interface can be used.

- [#&#8203;14023](pytest-dev/pytest#14023): Added <span class="title-ref">--report-chars</span> long CLI option.

- [#&#8203;14371](pytest-dev/pytest#14371): Added `--max-warnings` command-line option and `max_warnings` configuration option to fail the test run when the number of warnings exceeds a given threshold -- by `miketheman`.

- [#&#8203;6757](pytest-dev/pytest#6757): Added the `assertion_text_diff_style` configuration option, allowing
  string equality failures to be rendered as separate `Left:` and `Right:`
  blocks instead of `ndiff` output.

- [#&#8203;8395](pytest-dev/pytest#8395): Added support for `~datetime.datetime` and `~datetime.timedelta` comparisons with `pytest.approx`. An explicit `abs` or `rel` tolerance as a `~datetime.timedelta` is required and relative tolerance is not supported for datetime comparisons -- by `hamza-mobeen`.

#### Improvements in existing functionality

- [#&#8203;11225](pytest-dev/pytest#11225): `pytest.warns` now shows "Regex pattern did not match" instead of "DID NOT WARN" when warnings were emitted but the `match` pattern did not match.

- [#&#8203;11295](pytest-dev/pytest#11295): Improved output of `--fixtures-per-test` by excluding internal-implementation fixtures generated by `@pytest.mark.parametrize` and similar.

- [#&#8203;13241](pytest-dev/pytest#13241): `pytest.raises`, `pytest.warns` and `pytest.deprecated_call` now uses `ParamSpec` for the type hint to the (old and not recommended) callable overload, instead of `Any`. This allows type checkers to raise errors when passing incorrect function parameters.
  `func` can now also be passed as a kwarg, which the type hint previously showed as possible but didn't accept.

- [#&#8203;13862](pytest-dev/pytest#13862): Improved the readability of "DID NOT RAISE" error messages by using the exception type's name instead of its <span class="title-ref">repr</span>.

- [#&#8203;14026](pytest-dev/pytest#14026): Added test coverage for compiled regex patterns in `pytest.raises` match parameter.

- [#&#8203;14137](pytest-dev/pytest#14137): <span class="title-ref">pytest.ScopeName</span> is now public to allow using it in function signatures.

- [#&#8203;14342](pytest-dev/pytest#14342): Marked `yield_fixture` as deprecated to type checkers using the `deprecated` decorator. Note it
  `has originally been deprecated <yield-fixture-deprecated>` in pytest 6.2 already.

- [#&#8203;14373](pytest-dev/pytest#14373): Added type annotations for `pytest.approx`.

- [#&#8203;14430](pytest-dev/pytest#14430): When using `--setup-show`, a space is now printed after the test name (and possibly used fixtures), to separate it from the test result.

- [#&#8203;14441](pytest-dev/pytest#14441): Reduced the default number of `gc.collect()` passes in the `unraisableexception` plugin from 5 to 1 on CPython, where reference counting makes a single pass sufficient. PyPy retains 5 passes due to object resurrection via `__del__`. This can noticeably speed up test suites that trigger many pytester runs.

- [#&#8203;14461](pytest-dev/pytest#14461): Improved assertion failure explanations for equality comparisons between mapping objects that are not `dict` instances.

- [#&#8203;14513](pytest-dev/pytest#14513): The order in which fixture definitions overriding each other are resolved is now determined first by their *visibility* in the collection tree rather than by the order in which they are registered.

  A fixture defined for a more specific node (e.g. a module or an item) now always takes precedence over one with the same name defined for a more general node (e.g. the session), even when the more general one was registered later.
  Fixtures with non-comparable visibility or the same visibility keep the existing behavior of "last registered wins".
  This change is supposed to only affect plugins which register multiple fixtures programmatically with the same name.

- [#&#8203;14524](pytest-dev/pytest#14524): Add official Python 3.15 support.

- [#&#8203;1764](pytest-dev/pytest#1764): Improved argparse program name to show `pytest`, `python -m pytest`, or `pytest.main()` based on how pytest was invoked, making help and error messages clearer.

- [#&#8203;8265](pytest-dev/pytest#8265): Emit a `PytestCollectionWarning` when a module-level `__getattr__` returns `None` for `pytestmark` instead of raising `AttributeError`.

  Previously this caused a cryptic `TypeError: got None instead of Mark` error.
  Now pytest issues a helpful warning and continues collecting the module normally.

#### Bug fixes

- [#&#8203;13192](pytest-dev/pytest#13192): Fixed <span class="title-ref">|</span> (pipe) not being treated as a regex meta-character that needs escaping in `pytest.raises(match=...) <pytest.raises>`.

- [#&#8203;13484](pytest-dev/pytest#13484): Fixed `-W` option values being duplicated in `Config.known_args_namespace`.

- [#&#8203;13626](pytest-dev/pytest#13626): Fixed function-scoped fixture values being kept alive after a test was interrupted by `KeyboardInterrupt` or early exit,
  allowing them to potentially be released more promptly.

- [#&#8203;13784](pytest-dev/pytest#13784): Fixed `capteesys` producing doubled output when used with `--capture=no` (`-s`).

- [#&#8203;13817](pytest-dev/pytest#13817): Fixed a secondary <span class="title-ref">AttributeError</span> masking the original error when an option argument fails to initialize.

- [#&#8203;13884](pytest-dev/pytest#13884): Fixed rare internal IndexError caused by <span class="title-ref">builtins.compile</span> being overridden in client code.

- [#&#8203;13885](pytest-dev/pytest#13885): Fixed autouse fixtures defined inside a `unittest.TestCase` class running even when the class is decorated with `unittest.skip` or `unittest.skipIf` -- regression since pytest 8.1.0.

- [#&#8203;13917](pytest-dev/pytest#13917): `unittest.SkipTest` is no longer considered an interactive exception, i.e. `pytest_exception_interact` is no longer called for it.

- [#&#8203;13963](pytest-dev/pytest#13963): Fixed subtests running with `pytest-xdist` when their contexts contain objects that are not JSON-serializable.

  Fixes [pytest-dev/pytest-xdist#1273](pytest-dev/pytest-xdist#1273).

- [#&#8203;14004](pytest-dev/pytest#14004): Fixed conftest.py fixture scoping when `testpaths` points outside of the `rootdir <rootdir>`.

  Previously, fixtures from nested conftest.py files would incorrectly leak to sibling directories
  when using a relative `testpaths` like `../tests/sdk`.

  Conftest fixtures are now parsed during `Directory <pytest.Directory>` collection, using the `Directory` node for proper scoping.

- [#&#8203;14050](pytest-dev/pytest#14050): Display dictionary differences in assertion failures using the original key insertion order instead of sorted order.

- [#&#8203;14080](pytest-dev/pytest#14080): fix missing type annotations on `Pytester.makepyfile` and `Pytester.maketxtfile` methods.

- [#&#8203;14114](pytest-dev/pytest#14114): An exception from `pytest_fixture_post_finalizer` no longer prevents fixtures from being torn down, causing additional errors in the following tests.

- [#&#8203;14161](pytest-dev/pytest#14161): Fixed `monkeypatch.setattr() <pytest.MonkeyPatch.setattr>` leaving a stale entry on the undo stack when the underlying `setattr()` call fails (e.g. on immutable targets), causing an `AttributeError` crash during teardown.

- [#&#8203;14214](pytest-dev/pytest#14214): Fixed `-v` hint in `pytest.raises` match diff not working because assertion verbosity was not propagated.

- [#&#8203;14234](pytest-dev/pytest#14234): Allow `pytest.HIDDEN_PARAM <hidden-param>` in `@pytest.mark.parametrize(ids=...) <pytest.mark.parametrize ref>` typing.

- [#&#8203;14248](pytest-dev/pytest#14248): Fixed direct parametrization causing the static fixture closure (as reflected in `request.fixturenames <pytest.FixtureRequest.fixturenames>`) to omit fixtures that are requested transitively from overridden fixtures.

- [#&#8203;14263](pytest-dev/pytest#14263): Unraisable exceptions from finalizers are now collected during `pytest_unconfigure`, before pytest tears down the warning filters installed for the session. Previously the collection ran from a cleanup callback whose order relative to other plugins' cleanups was not guaranteed, so an active `error` filter could be removed before the exception surfaced and a late resource leak would pass silently. A `-W error` filter, or any filter matching `pytest.PytestUnraisableExceptionWarning`, now promotes these exceptions to failures regardless of plugin cleanup order.

- [#&#8203;14377](pytest-dev/pytest#14377): Fixed crash in <span class="title-ref">Config.get\_terminal\_writer</span> when an assertion fails with the `terminalreporter` plugin disabled.

- [#&#8203;14381](pytest-dev/pytest#14381): Fixed `-V` (short form of `--version`) to properly display the current version.

- [#&#8203;14389](pytest-dev/pytest#14389): Improved `pytest.raises(..., match=...) <pytest.raises>` failures to suppress the mismatched exception as a cause of the resulting `AssertionError`.

- [#&#8203;14392](pytest-dev/pytest#14392): Fixed a bug in `pytest.raises(match=...) <pytest.raises>` "fully escaped" detection, causing the regex diff display to be shown in some instances when the raw string diff display should be shown instead.

- [#&#8203;14442](pytest-dev/pytest#14442): Fixed a regression in pytest 9.0 where `--strict-markers` and `--strict-config` specified through `addopts` were silently ignored.

  Note that when targeting pytest >= 9.0, it's nicer to use `strict_markers` and `strict_config`, or `strict mode <strict mode>`.

- [#&#8203;14456](pytest-dev/pytest#14456): Fixed `pytest.approx` not recognizing types with `__array_interface__` as numpy-like arrays.

- [#&#8203;14474](pytest-dev/pytest#14474): Fixed a regression where `-k` and `-m` expressions containing both backslash characters in identifiers and string literal arguments would incorrectly raise a `SyntaxError` about escaping.

- [#&#8203;14483](pytest-dev/pytest#14483): Fixed JUnit XML report incorrectly escaping high Unicode codepoints (supplementary plane characters like emoji) in test failure messages. -- by `EternalRights`

- [#&#8203;14492](pytest-dev/pytest#14492): Fixed `Code.getargs()` incorrectly including local variable names in the returned argument tuple for functions with `*args` and/or `**kwargs`. The method was using `co_flags` bitmask values (`4` and `8`) directly as counts instead of converting them to `1` via `bool()`, and was not accounting for `co_kwonlyargcount` when `var=True`.

- [#&#8203;3697](pytest-dev/pytest#3697): Logging capture now works for non-propagating loggers.
  Previously only logs which reached the root logger were captured.
  This includes `caplog` and the "Captured log calls" test reporting.

- [#&#8203;3850](pytest-dev/pytest#3850): Fixed JUnit XML report: the `tests` attribute of the `<testsuite>` element now always matches the number of `<testcase>` elements in the file. In some cases (test passes but fails during teardown) the `tests` attribute would report an incorrect number of testcases in the XML file.

- [#&#8203;5848](pytest-dev/pytest#5848): `pytest_fixture_post_finalizer` is no longer called extra times for the same fixture teardown in some cases.

- [#&#8203;719](pytest-dev/pytest#719): Fixed `@pytest.mark.parametrize <pytest.mark.parametrize ref>` not unpacking single-element tuple values when using a string argnames with a trailing comma (e.g., `"arg,"`).

  The trailing comma form now correctly behaves like the tuple form `("arg",)`, treating argvalues as a list of tuples to unpack.

#### Improved documentation

- [#&#8203;11022](pytest-dev/pytest#11022): Document safer alternatives and scope guidance for monkeypatching standard library functions.
- [#&#8203;11307](pytest-dev/pytest#11307): Document that `@pytest.hookimpl(specname=...)` only works for function names starting with `pytest_`.
- [#&#8203;13038](pytest-dev/pytest#13038): Document that doctests do not support parametrized fixtures, including parametrized autouse fixtures.
- [#&#8203;13155](pytest-dev/pytest#13155): Clarified how the `request` fixture provides indirect parametrization values via `request.param`.
- [#&#8203;13304](pytest-dev/pytest#13304): Clarified in the documentation that hook implementations defined in `conftest.py` files are not available to other plugins during their `pytest_addoption()` execution, as conftest files are discovered and loaded after builtin and third-party plugins have been initialized. However, initial conftest files themselves can implement `pytest_addoption()` to add their own command-line options.
- [#&#8203;13902](pytest-dev/pytest#13902): Clarified how subtest progress markers are shown in the documentation.
- [#&#8203;14012](pytest-dev/pytest#14012): The `ini options ref` section of the API Reference now specified the type and default value of every configuration option.
- [#&#8203;14148](pytest-dev/pytest#14148): Documented a safe `pytestconfig.cache` access pattern when the
  `cacheprovider` plugin is disabled.
- [#&#8203;14303](pytest-dev/pytest#14303): The documentation is now built with Sphinx >= 9.
- [#&#8203;14465](pytest-dev/pytest#14465): Updated the hooks how-to page to link the `newhooks.py` file in `pytest-xdist` at tag `v3.8.0` instead of an unrelated 2017-era commit under the old layout. Pointing at a tag keeps the example in sync with the version users actually install, while remaining stable when the project's main branch moves on.

#### Miscellaneous internal changes

- [#&#8203;14582](pytest-dev/pytest#14582): Improved the recursion traceback test to exercise all requested traceback styles.

</details>

---

### Configuration

📅 **Schedule**: (UTC)

- Branch creation
  - At any time (no schedule defined)
- Automerge
  - At any time (no schedule defined)

🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Mend Renovate](https://github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0My4yMjAuMCIsInVwZGF0ZWRJblZlciI6IjQzLjIyMC4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyJ0eXBlL2RlcGVuZGVuY2llcyJdfQ==-->

Reviewed-on: https://git.tainton.uk/repos/pypilot/pulls/454
Co-authored-by: renovate[bot] <renovate-bot@git.tainton.uk>
Co-committed-by: renovate[bot] <renovate-bot@git.tainton.uk>
luketainton pushed a commit to luketainton/repos_epage that referenced this pull request Jun 18, 2026
This PR contains the following updates:

| Package | Change | [Age](https://docs.renovatebot.com/merge-confidence/) | [Confidence](https://docs.renovatebot.com/merge-confidence/) |
|---|---|---|---|
| [pytest](https://github.com/pytest-dev/pytest) ([changelog](https://docs.pytest.org/en/stable/changelog.html)) | `<9.1.0,>=9.0.0` → `<9.1.1,>=9.1.0` | ![age](https://developer.mend.io/api/mc/badges/age/pypi/pytest/9.1.0?slim=true) | ![confidence](https://developer.mend.io/api/mc/badges/confidence/pypi/pytest/9.0.3/9.1.0?slim=true) |

---

### Release Notes

<details>
<summary>pytest-dev/pytest (pytest)</summary>

### [`v9.1.0`](https://github.com/pytest-dev/pytest/releases/tag/9.1.0)

[Compare Source](pytest-dev/pytest@9.0.3...9.1.0)

### pytest 9.1.0 (2026-06-13)

#### Removals and backward incompatible breaking changes

- [#&#8203;14533](pytest-dev/pytest#14533): When using `--doctest-modules`, autouse fixtures with `module`, `package` or `session` scope that are defined inline in Python test modules (not plugins or conftests) will now possibly execute twice.

  If this is undesirable, move the fixture definition to a `conftest.py` file if possible.

  Technical explanation for those interested:
  When using <span class="title-ref">--doctest-modules</span>, pytest possibly collects Python modules twice, once as `pytest.Module` and once as a `DoctestModule` (depending on the configuration).
  Due to improvements in pytest's fixture implementation, if e.g. the `DoctestModule` collects a fixture, it is now visible to it only, and not to the `Module`.
  This means that both need to register the fixtures independently.

#### Deprecations (removal in next major release)

- [#&#8203;10819](pytest-dev/pytest#10819): Added a deprecation warning for class-scoped fixtures defined as instance methods (without `@classmethod`). Such fixtures set attributes on a different instance than the test methods use, leading to unexpected behavior. Use `@classmethod` decorator instead -- by `yastcher`.

  See `10819` and `14011`.

- [#&#8203;12882](pytest-dev/pytest#12882): Calling `request.getfixturevalue() <pytest.FixtureRequest.getfixturevalue>` during teardown to request a fixture that was not already requested is now deprecated and will become an error in pytest 10.

  See `dynamic-fixture-request-during-teardown` for details.

- [#&#8203;13409](pytest-dev/pytest#13409): Using non-`~collections.abc.Collection` iterables (such as generators, iterators, or custom iterable objects) for the `argvalues` parameter in `@pytest.mark.parametrize <pytest.mark.parametrize ref>` and `metafunc.parametrize <pytest.Metafunc.parametrize>` is now deprecated.

  These iterables get exhausted after the first iteration,
  leading to tests getting unexpectedly skipped in cases such as running `pytest.main()` multiple times,
  using class-level parametrize decorators,
  or collecting tests multiple times.

  See `parametrize-iterators` for details and suggestions.

- [#&#8203;13946](pytest-dev/pytest#13946): The private `config.inicfg` attribute is now deprecated.
  Use `config.getini() <pytest.Config.getini>` to access configuration values instead.

  See `config-inicfg` for more details.

- [#&#8203;14004](pytest-dev/pytest#14004): Passing `baseid` to `~pytest.FixtureDef` or `nodeid` strings to fixture registration APIs is now deprecated. These are internal pytest APIs that are used by some plugins.

  Use the `node` parameter instead for fixture scoping. This enables more robust node-based
  matching instead of string prefix matching.
  If you've used `nodeid=None`, pass `node=session` instead.

  This will be removed in pytest 10.

- [#&#8203;14335](pytest-dev/pytest#14335): The method of configuring hooks using markers, deprecated since pytest 7.2, is now scheduled to be removed in pytest 10.
  See `hook-markers` for more details.

- [#&#8203;14434](pytest-dev/pytest#14434): The `--pastebin` option is now deprecated.
  The same functionality is now available in an external plugin, `pytest-pastebin`.
  See `pastebin-deprecated` for more details.

- [#&#8203;14513](pytest-dev/pytest#14513): The private `FixtureDef.has_location` attribute is now deprecated and will be removed in pytest 10.
  See `fixturedef-has-location-deprecated` for details.

- [#&#8203;1764](pytest-dev/pytest#1764): `pytest.console_main` is now deprecated and will be removed in pytest 10.
  It was never intended for programmatic use; use `pytest.main` instead.

#### New features

- [#&#8203;12376](pytest-dev/pytest#12376): Added `pytest.register_fixture()` to register fixtures using an imperative interface.

  This is an advanced function intended for use by plugins.

  Normally, fixtures should be registered declaratively using the `@pytest.fixture <pytest.fixture>` decorator.
  Pytest looks for these fixture definitions during the collection phase and registers them automatically.
  For some plugin usecases the declarative interface can be cumbersome or unviable, in which case this imperative interface can be used.

- [#&#8203;14023](pytest-dev/pytest#14023): Added <span class="title-ref">--report-chars</span> long CLI option.

- [#&#8203;14371](pytest-dev/pytest#14371): Added `--max-warnings` command-line option and `max_warnings` configuration option to fail the test run when the number of warnings exceeds a given threshold -- by `miketheman`.

- [#&#8203;6757](pytest-dev/pytest#6757): Added the `assertion_text_diff_style` configuration option, allowing
  string equality failures to be rendered as separate `Left:` and `Right:`
  blocks instead of `ndiff` output.

- [#&#8203;8395](pytest-dev/pytest#8395): Added support for `~datetime.datetime` and `~datetime.timedelta` comparisons with `pytest.approx`. An explicit `abs` or `rel` tolerance as a `~datetime.timedelta` is required and relative tolerance is not supported for datetime comparisons -- by `hamza-mobeen`.

#### Improvements in existing functionality

- [#&#8203;11225](pytest-dev/pytest#11225): `pytest.warns` now shows "Regex pattern did not match" instead of "DID NOT WARN" when warnings were emitted but the `match` pattern did not match.

- [#&#8203;11295](pytest-dev/pytest#11295): Improved output of `--fixtures-per-test` by excluding internal-implementation fixtures generated by `@pytest.mark.parametrize` and similar.

- [#&#8203;13241](pytest-dev/pytest#13241): `pytest.raises`, `pytest.warns` and `pytest.deprecated_call` now uses `ParamSpec` for the type hint to the (old and not recommended) callable overload, instead of `Any`. This allows type checkers to raise errors when passing incorrect function parameters.
  `func` can now also be passed as a kwarg, which the type hint previously showed as possible but didn't accept.

- [#&#8203;13862](pytest-dev/pytest#13862): Improved the readability of "DID NOT RAISE" error messages by using the exception type's name instead of its <span class="title-ref">repr</span>.

- [#&#8203;14026](pytest-dev/pytest#14026): Added test coverage for compiled regex patterns in `pytest.raises` match parameter.

- [#&#8203;14137](pytest-dev/pytest#14137): <span class="title-ref">pytest.ScopeName</span> is now public to allow using it in function signatures.

- [#&#8203;14342](pytest-dev/pytest#14342): Marked `yield_fixture` as deprecated to type checkers using the `deprecated` decorator. Note it
  `has originally been deprecated <yield-fixture-deprecated>` in pytest 6.2 already.

- [#&#8203;14373](pytest-dev/pytest#14373): Added type annotations for `pytest.approx`.

- [#&#8203;14430](pytest-dev/pytest#14430): When using `--setup-show`, a space is now printed after the test name (and possibly used fixtures), to separate it from the test result.

- [#&#8203;14441](pytest-dev/pytest#14441): Reduced the default number of `gc.collect()` passes in the `unraisableexception` plugin from 5 to 1 on CPython, where reference counting makes a single pass sufficient. PyPy retains 5 passes due to object resurrection via `__del__`. This can noticeably speed up test suites that trigger many pytester runs.

- [#&#8203;14461](pytest-dev/pytest#14461): Improved assertion failure explanations for equality comparisons between mapping objects that are not `dict` instances.

- [#&#8203;14513](pytest-dev/pytest#14513): The order in which fixture definitions overriding each other are resolved is now determined first by their *visibility* in the collection tree rather than by the order in which they are registered.

  A fixture defined for a more specific node (e.g. a module or an item) now always takes precedence over one with the same name defined for a more general node (e.g. the session), even when the more general one was registered later.
  Fixtures with non-comparable visibility or the same visibility keep the existing behavior of "last registered wins".
  This change is supposed to only affect plugins which register multiple fixtures programmatically with the same name.

- [#&#8203;14524](pytest-dev/pytest#14524): Add official Python 3.15 support.

- [#&#8203;1764](pytest-dev/pytest#1764): Improved argparse program name to show `pytest`, `python -m pytest`, or `pytest.main()` based on how pytest was invoked, making help and error messages clearer.

- [#&#8203;8265](pytest-dev/pytest#8265): Emit a `PytestCollectionWarning` when a module-level `__getattr__` returns `None` for `pytestmark` instead of raising `AttributeError`.

  Previously this caused a cryptic `TypeError: got None instead of Mark` error.
  Now pytest issues a helpful warning and continues collecting the module normally.

#### Bug fixes

- [#&#8203;13192](pytest-dev/pytest#13192): Fixed <span class="title-ref">|</span> (pipe) not being treated as a regex meta-character that needs escaping in `pytest.raises(match=...) <pytest.raises>`.

- [#&#8203;13484](pytest-dev/pytest#13484): Fixed `-W` option values being duplicated in `Config.known_args_namespace`.

- [#&#8203;13626](pytest-dev/pytest#13626): Fixed function-scoped fixture values being kept alive after a test was interrupted by `KeyboardInterrupt` or early exit,
  allowing them to potentially be released more promptly.

- [#&#8203;13784](pytest-dev/pytest#13784): Fixed `capteesys` producing doubled output when used with `--capture=no` (`-s`).

- [#&#8203;13817](pytest-dev/pytest#13817): Fixed a secondary <span class="title-ref">AttributeError</span> masking the original error when an option argument fails to initialize.

- [#&#8203;13884](pytest-dev/pytest#13884): Fixed rare internal IndexError caused by <span class="title-ref">builtins.compile</span> being overridden in client code.

- [#&#8203;13885](pytest-dev/pytest#13885): Fixed autouse fixtures defined inside a `unittest.TestCase` class running even when the class is decorated with `unittest.skip` or `unittest.skipIf` -- regression since pytest 8.1.0.

- [#&#8203;13917](pytest-dev/pytest#13917): `unittest.SkipTest` is no longer considered an interactive exception, i.e. `pytest_exception_interact` is no longer called for it.

- [#&#8203;13963](pytest-dev/pytest#13963): Fixed subtests running with `pytest-xdist` when their contexts contain objects that are not JSON-serializable.

  Fixes [pytest-dev/pytest-xdist#1273](pytest-dev/pytest-xdist#1273).

- [#&#8203;14004](pytest-dev/pytest#14004): Fixed conftest.py fixture scoping when `testpaths` points outside of the `rootdir <rootdir>`.

  Previously, fixtures from nested conftest.py files would incorrectly leak to sibling directories
  when using a relative `testpaths` like `../tests/sdk`.

  Conftest fixtures are now parsed during `Directory <pytest.Directory>` collection, using the `Directory` node for proper scoping.

- [#&#8203;14050](pytest-dev/pytest#14050): Display dictionary differences in assertion failures using the original key insertion order instead of sorted order.

- [#&#8203;14080](pytest-dev/pytest#14080): fix missing type annotations on `Pytester.makepyfile` and `Pytester.maketxtfile` methods.

- [#&#8203;14114](pytest-dev/pytest#14114): An exception from `pytest_fixture_post_finalizer` no longer prevents fixtures from being torn down, causing additional errors in the following tests.

- [#&#8203;14161](pytest-dev/pytest#14161): Fixed `monkeypatch.setattr() <pytest.MonkeyPatch.setattr>` leaving a stale entry on the undo stack when the underlying `setattr()` call fails (e.g. on immutable targets), causing an `AttributeError` crash during teardown.

- [#&#8203;14214](pytest-dev/pytest#14214): Fixed `-v` hint in `pytest.raises` match diff not working because assertion verbosity was not propagated.

- [#&#8203;14234](pytest-dev/pytest#14234): Allow `pytest.HIDDEN_PARAM <hidden-param>` in `@pytest.mark.parametrize(ids=...) <pytest.mark.parametrize ref>` typing.

- [#&#8203;14248](pytest-dev/pytest#14248): Fixed direct parametrization causing the static fixture closure (as reflected in `request.fixturenames <pytest.FixtureRequest.fixturenames>`) to omit fixtures that are requested transitively from overridden fixtures.

- [#&#8203;14263](pytest-dev/pytest#14263): Unraisable exceptions from finalizers are now collected during `pytest_unconfigure`, before pytest tears down the warning filters installed for the session. Previously the collection ran from a cleanup callback whose order relative to other plugins' cleanups was not guaranteed, so an active `error` filter could be removed before the exception surfaced and a late resource leak would pass silently. A `-W error` filter, or any filter matching `pytest.PytestUnraisableExceptionWarning`, now promotes these exceptions to failures regardless of plugin cleanup order.

- [#&#8203;14377](pytest-dev/pytest#14377): Fixed crash in <span class="title-ref">Config.get\_terminal\_writer</span> when an assertion fails with the `terminalreporter` plugin disabled.

- [#&#8203;14381](pytest-dev/pytest#14381): Fixed `-V` (short form of `--version`) to properly display the current version.

- [#&#8203;14389](pytest-dev/pytest#14389): Improved `pytest.raises(..., match=...) <pytest.raises>` failures to suppress the mismatched exception as a cause of the resulting `AssertionError`.

- [#&#8203;14392](pytest-dev/pytest#14392): Fixed a bug in `pytest.raises(match=...) <pytest.raises>` "fully escaped" detection, causing the regex diff display to be shown in some instances when the raw string diff display should be shown instead.

- [#&#8203;14442](pytest-dev/pytest#14442): Fixed a regression in pytest 9.0 where `--strict-markers` and `--strict-config` specified through `addopts` were silently ignored.

  Note that when targeting pytest >= 9.0, it's nicer to use `strict_markers` and `strict_config`, or `strict mode <strict mode>`.

- [#&#8203;14456](pytest-dev/pytest#14456): Fixed `pytest.approx` not recognizing types with `__array_interface__` as numpy-like arrays.

- [#&#8203;14474](pytest-dev/pytest#14474): Fixed a regression where `-k` and `-m` expressions containing both backslash characters in identifiers and string literal arguments would incorrectly raise a `SyntaxError` about escaping.

- [#&#8203;14483](pytest-dev/pytest#14483): Fixed JUnit XML report incorrectly escaping high Unicode codepoints (supplementary plane characters like emoji) in test failure messages. -- by `EternalRights`

- [#&#8203;14492](pytest-dev/pytest#14492): Fixed `Code.getargs()` incorrectly including local variable names in the returned argument tuple for functions with `*args` and/or `**kwargs`. The method was using `co_flags` bitmask values (`4` and `8`) directly as counts instead of converting them to `1` via `bool()`, and was not accounting for `co_kwonlyargcount` when `var=True`.

- [#&#8203;3697](pytest-dev/pytest#3697): Logging capture now works for non-propagating loggers.
  Previously only logs which reached the root logger were captured.
  This includes `caplog` and the "Captured log calls" test reporting.

- [#&#8203;3850](pytest-dev/pytest#3850): Fixed JUnit XML report: the `tests` attribute of the `<testsuite>` element now always matches the number of `<testcase>` elements in the file. In some cases (test passes but fails during teardown) the `tests` attribute would report an incorrect number of testcases in the XML file.

- [#&#8203;5848](pytest-dev/pytest#5848): `pytest_fixture_post_finalizer` is no longer called extra times for the same fixture teardown in some cases.

- [#&#8203;719](pytest-dev/pytest#719): Fixed `@pytest.mark.parametrize <pytest.mark.parametrize ref>` not unpacking single-element tuple values when using a string argnames with a trailing comma (e.g., `"arg,"`).

  The trailing comma form now correctly behaves like the tuple form `("arg",)`, treating argvalues as a list of tuples to unpack.

#### Improved documentation

- [#&#8203;11022](pytest-dev/pytest#11022): Document safer alternatives and scope guidance for monkeypatching standard library functions.
- [#&#8203;11307](pytest-dev/pytest#11307): Document that `@pytest.hookimpl(specname=...)` only works for function names starting with `pytest_`.
- [#&#8203;13038](pytest-dev/pytest#13038): Document that doctests do not support parametrized fixtures, including parametrized autouse fixtures.
- [#&#8203;13155](pytest-dev/pytest#13155): Clarified how the `request` fixture provides indirect parametrization values via `request.param`.
- [#&#8203;13304](pytest-dev/pytest#13304): Clarified in the documentation that hook implementations defined in `conftest.py` files are not available to other plugins during their `pytest_addoption()` execution, as conftest files are discovered and loaded after builtin and third-party plugins have been initialized. However, initial conftest files themselves can implement `pytest_addoption()` to add their own command-line options.
- [#&#8203;13902](pytest-dev/pytest#13902): Clarified how subtest progress markers are shown in the documentation.
- [#&#8203;14012](pytest-dev/pytest#14012): The `ini options ref` section of the API Reference now specified the type and default value of every configuration option.
- [#&#8203;14148](pytest-dev/pytest#14148): Documented a safe `pytestconfig.cache` access pattern when the
  `cacheprovider` plugin is disabled.
- [#&#8203;14303](pytest-dev/pytest#14303): The documentation is now built with Sphinx >= 9.
- [#&#8203;14465](pytest-dev/pytest#14465): Updated the hooks how-to page to link the `newhooks.py` file in `pytest-xdist` at tag `v3.8.0` instead of an unrelated 2017-era commit under the old layout. Pointing at a tag keeps the example in sync with the version users actually install, while remaining stable when the project's main branch moves on.

#### Miscellaneous internal changes

- [#&#8203;14582](pytest-dev/pytest#14582): Improved the recursion traceback test to exercise all requested traceback styles.

</details>

---

### Configuration

📅 **Schedule**: (UTC)

- Branch creation
  - At any time (no schedule defined)
- Automerge
  - At any time (no schedule defined)

🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Mend Renovate](https://github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0My4yMjAuMCIsInVwZGF0ZWRJblZlciI6IjQzLjIyMC4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyJ0eXBlL2RlcGVuZGVuY2llcyJdfQ==-->

Reviewed-on: https://git.tainton.uk/repos/epage/pulls/225
Co-authored-by: renovate[bot] <renovate-bot@git.tainton.uk>
Co-committed-by: renovate[bot] <renovate-bot@git.tainton.uk>
luketainton pushed a commit to luketainton/luke_instant-msg-api that referenced this pull request Jun 18, 2026
This PR contains the following updates:

| Package | Change | [Age](https://docs.renovatebot.com/merge-confidence/) | [Confidence](https://docs.renovatebot.com/merge-confidence/) |
|---|---|---|---|
| [pytest](https://github.com/pytest-dev/pytest) ([changelog](https://docs.pytest.org/en/stable/changelog.html)) | `<9.1.0,>=9.0.0` → `<9.1.1,>=9.1.0` | ![age](https://developer.mend.io/api/mc/badges/age/pypi/pytest/9.1.0?slim=true) | ![confidence](https://developer.mend.io/api/mc/badges/confidence/pypi/pytest/9.0.3/9.1.0?slim=true) |

---

### Release Notes

<details>
<summary>pytest-dev/pytest (pytest)</summary>

### [`v9.1.0`](https://github.com/pytest-dev/pytest/releases/tag/9.1.0)

[Compare Source](pytest-dev/pytest@9.0.3...9.1.0)

### pytest 9.1.0 (2026-06-13)

#### Removals and backward incompatible breaking changes

- [#&#8203;14533](pytest-dev/pytest#14533): When using `--doctest-modules`, autouse fixtures with `module`, `package` or `session` scope that are defined inline in Python test modules (not plugins or conftests) will now possibly execute twice.

  If this is undesirable, move the fixture definition to a `conftest.py` file if possible.

  Technical explanation for those interested:
  When using <span class="title-ref">--doctest-modules</span>, pytest possibly collects Python modules twice, once as `pytest.Module` and once as a `DoctestModule` (depending on the configuration).
  Due to improvements in pytest's fixture implementation, if e.g. the `DoctestModule` collects a fixture, it is now visible to it only, and not to the `Module`.
  This means that both need to register the fixtures independently.

#### Deprecations (removal in next major release)

- [#&#8203;10819](pytest-dev/pytest#10819): Added a deprecation warning for class-scoped fixtures defined as instance methods (without `@classmethod`). Such fixtures set attributes on a different instance than the test methods use, leading to unexpected behavior. Use `@classmethod` decorator instead -- by `yastcher`.

  See `10819` and `14011`.

- [#&#8203;12882](pytest-dev/pytest#12882): Calling `request.getfixturevalue() <pytest.FixtureRequest.getfixturevalue>` during teardown to request a fixture that was not already requested is now deprecated and will become an error in pytest 10.

  See `dynamic-fixture-request-during-teardown` for details.

- [#&#8203;13409](pytest-dev/pytest#13409): Using non-`~collections.abc.Collection` iterables (such as generators, iterators, or custom iterable objects) for the `argvalues` parameter in `@pytest.mark.parametrize <pytest.mark.parametrize ref>` and `metafunc.parametrize <pytest.Metafunc.parametrize>` is now deprecated.

  These iterables get exhausted after the first iteration,
  leading to tests getting unexpectedly skipped in cases such as running `pytest.main()` multiple times,
  using class-level parametrize decorators,
  or collecting tests multiple times.

  See `parametrize-iterators` for details and suggestions.

- [#&#8203;13946](pytest-dev/pytest#13946): The private `config.inicfg` attribute is now deprecated.
  Use `config.getini() <pytest.Config.getini>` to access configuration values instead.

  See `config-inicfg` for more details.

- [#&#8203;14004](pytest-dev/pytest#14004): Passing `baseid` to `~pytest.FixtureDef` or `nodeid` strings to fixture registration APIs is now deprecated. These are internal pytest APIs that are used by some plugins.

  Use the `node` parameter instead for fixture scoping. This enables more robust node-based
  matching instead of string prefix matching.
  If you've used `nodeid=None`, pass `node=session` instead.

  This will be removed in pytest 10.

- [#&#8203;14335](pytest-dev/pytest#14335): The method of configuring hooks using markers, deprecated since pytest 7.2, is now scheduled to be removed in pytest 10.
  See `hook-markers` for more details.

- [#&#8203;14434](pytest-dev/pytest#14434): The `--pastebin` option is now deprecated.
  The same functionality is now available in an external plugin, `pytest-pastebin`.
  See `pastebin-deprecated` for more details.

- [#&#8203;14513](pytest-dev/pytest#14513): The private `FixtureDef.has_location` attribute is now deprecated and will be removed in pytest 10.
  See `fixturedef-has-location-deprecated` for details.

- [#&#8203;1764](pytest-dev/pytest#1764): `pytest.console_main` is now deprecated and will be removed in pytest 10.
  It was never intended for programmatic use; use `pytest.main` instead.

#### New features

- [#&#8203;12376](pytest-dev/pytest#12376): Added `pytest.register_fixture()` to register fixtures using an imperative interface.

  This is an advanced function intended for use by plugins.

  Normally, fixtures should be registered declaratively using the `@pytest.fixture <pytest.fixture>` decorator.
  Pytest looks for these fixture definitions during the collection phase and registers them automatically.
  For some plugin usecases the declarative interface can be cumbersome or unviable, in which case this imperative interface can be used.

- [#&#8203;14023](pytest-dev/pytest#14023): Added <span class="title-ref">--report-chars</span> long CLI option.

- [#&#8203;14371](pytest-dev/pytest#14371): Added `--max-warnings` command-line option and `max_warnings` configuration option to fail the test run when the number of warnings exceeds a given threshold -- by `miketheman`.

- [#&#8203;6757](pytest-dev/pytest#6757): Added the `assertion_text_diff_style` configuration option, allowing
  string equality failures to be rendered as separate `Left:` and `Right:`
  blocks instead of `ndiff` output.

- [#&#8203;8395](pytest-dev/pytest#8395): Added support for `~datetime.datetime` and `~datetime.timedelta` comparisons with `pytest.approx`. An explicit `abs` or `rel` tolerance as a `~datetime.timedelta` is required and relative tolerance is not supported for datetime comparisons -- by `hamza-mobeen`.

#### Improvements in existing functionality

- [#&#8203;11225](pytest-dev/pytest#11225): `pytest.warns` now shows "Regex pattern did not match" instead of "DID NOT WARN" when warnings were emitted but the `match` pattern did not match.

- [#&#8203;11295](pytest-dev/pytest#11295): Improved output of `--fixtures-per-test` by excluding internal-implementation fixtures generated by `@pytest.mark.parametrize` and similar.

- [#&#8203;13241](pytest-dev/pytest#13241): `pytest.raises`, `pytest.warns` and `pytest.deprecated_call` now uses `ParamSpec` for the type hint to the (old and not recommended) callable overload, instead of `Any`. This allows type checkers to raise errors when passing incorrect function parameters.
  `func` can now also be passed as a kwarg, which the type hint previously showed as possible but didn't accept.

- [#&#8203;13862](pytest-dev/pytest#13862): Improved the readability of "DID NOT RAISE" error messages by using the exception type's name instead of its <span class="title-ref">repr</span>.

- [#&#8203;14026](pytest-dev/pytest#14026): Added test coverage for compiled regex patterns in `pytest.raises` match parameter.

- [#&#8203;14137](pytest-dev/pytest#14137): <span class="title-ref">pytest.ScopeName</span> is now public to allow using it in function signatures.

- [#&#8203;14342](pytest-dev/pytest#14342): Marked `yield_fixture` as deprecated to type checkers using the `deprecated` decorator. Note it
  `has originally been deprecated <yield-fixture-deprecated>` in pytest 6.2 already.

- [#&#8203;14373](pytest-dev/pytest#14373): Added type annotations for `pytest.approx`.

- [#&#8203;14430](pytest-dev/pytest#14430): When using `--setup-show`, a space is now printed after the test name (and possibly used fixtures), to separate it from the test result.

- [#&#8203;14441](pytest-dev/pytest#14441): Reduced the default number of `gc.collect()` passes in the `unraisableexception` plugin from 5 to 1 on CPython, where reference counting makes a single pass sufficient. PyPy retains 5 passes due to object resurrection via `__del__`. This can noticeably speed up test suites that trigger many pytester runs.

- [#&#8203;14461](pytest-dev/pytest#14461): Improved assertion failure explanations for equality comparisons between mapping objects that are not `dict` instances.

- [#&#8203;14513](pytest-dev/pytest#14513): The order in which fixture definitions overriding each other are resolved is now determined first by their *visibility* in the collection tree rather than by the order in which they are registered.

  A fixture defined for a more specific node (e.g. a module or an item) now always takes precedence over one with the same name defined for a more general node (e.g. the session), even when the more general one was registered later.
  Fixtures with non-comparable visibility or the same visibility keep the existing behavior of "last registered wins".
  This change is supposed to only affect plugins which register multiple fixtures programmatically with the same name.

- [#&#8203;14524](pytest-dev/pytest#14524): Add official Python 3.15 support.

- [#&#8203;1764](pytest-dev/pytest#1764): Improved argparse program name to show `pytest`, `python -m pytest`, or `pytest.main()` based on how pytest was invoked, making help and error messages clearer.

- [#&#8203;8265](pytest-dev/pytest#8265): Emit a `PytestCollectionWarning` when a module-level `__getattr__` returns `None` for `pytestmark` instead of raising `AttributeError`.

  Previously this caused a cryptic `TypeError: got None instead of Mark` error.
  Now pytest issues a helpful warning and continues collecting the module normally.

#### Bug fixes

- [#&#8203;13192](pytest-dev/pytest#13192): Fixed <span class="title-ref">|</span> (pipe) not being treated as a regex meta-character that needs escaping in `pytest.raises(match=...) <pytest.raises>`.

- [#&#8203;13484](pytest-dev/pytest#13484): Fixed `-W` option values being duplicated in `Config.known_args_namespace`.

- [#&#8203;13626](pytest-dev/pytest#13626): Fixed function-scoped fixture values being kept alive after a test was interrupted by `KeyboardInterrupt` or early exit,
  allowing them to potentially be released more promptly.

- [#&#8203;13784](pytest-dev/pytest#13784): Fixed `capteesys` producing doubled output when used with `--capture=no` (`-s`).

- [#&#8203;13817](pytest-dev/pytest#13817): Fixed a secondary <span class="title-ref">AttributeError</span> masking the original error when an option argument fails to initialize.

- [#&#8203;13884](pytest-dev/pytest#13884): Fixed rare internal IndexError caused by <span class="title-ref">builtins.compile</span> being overridden in client code.

- [#&#8203;13885](pytest-dev/pytest#13885): Fixed autouse fixtures defined inside a `unittest.TestCase` class running even when the class is decorated with `unittest.skip` or `unittest.skipIf` -- regression since pytest 8.1.0.

- [#&#8203;13917](pytest-dev/pytest#13917): `unittest.SkipTest` is no longer considered an interactive exception, i.e. `pytest_exception_interact` is no longer called for it.

- [#&#8203;13963](pytest-dev/pytest#13963): Fixed subtests running with `pytest-xdist` when their contexts contain objects that are not JSON-serializable.

  Fixes [pytest-dev/pytest-xdist#1273](pytest-dev/pytest-xdist#1273).

- [#&#8203;14004](pytest-dev/pytest#14004): Fixed conftest.py fixture scoping when `testpaths` points outside of the `rootdir <rootdir>`.

  Previously, fixtures from nested conftest.py files would incorrectly leak to sibling directories
  when using a relative `testpaths` like `../tests/sdk`.

  Conftest fixtures are now parsed during `Directory <pytest.Directory>` collection, using the `Directory` node for proper scoping.

- [#&#8203;14050](pytest-dev/pytest#14050): Display dictionary differences in assertion failures using the original key insertion order instead of sorted order.

- [#&#8203;14080](pytest-dev/pytest#14080): fix missing type annotations on `Pytester.makepyfile` and `Pytester.maketxtfile` methods.

- [#&#8203;14114](pytest-dev/pytest#14114): An exception from `pytest_fixture_post_finalizer` no longer prevents fixtures from being torn down, causing additional errors in the following tests.

- [#&#8203;14161](pytest-dev/pytest#14161): Fixed `monkeypatch.setattr() <pytest.MonkeyPatch.setattr>` leaving a stale entry on the undo stack when the underlying `setattr()` call fails (e.g. on immutable targets), causing an `AttributeError` crash during teardown.

- [#&#8203;14214](pytest-dev/pytest#14214): Fixed `-v` hint in `pytest.raises` match diff not working because assertion verbosity was not propagated.

- [#&#8203;14234](pytest-dev/pytest#14234): Allow `pytest.HIDDEN_PARAM <hidden-param>` in `@pytest.mark.parametrize(ids=...) <pytest.mark.parametrize ref>` typing.

- [#&#8203;14248](pytest-dev/pytest#14248): Fixed direct parametrization causing the static fixture closure (as reflected in `request.fixturenames <pytest.FixtureRequest.fixturenames>`) to omit fixtures that are requested transitively from overridden fixtures.

- [#&#8203;14263](pytest-dev/pytest#14263): Unraisable exceptions from finalizers are now collected during `pytest_unconfigure`, before pytest tears down the warning filters installed for the session. Previously the collection ran from a cleanup callback whose order relative to other plugins' cleanups was not guaranteed, so an active `error` filter could be removed before the exception surfaced and a late resource leak would pass silently. A `-W error` filter, or any filter matching `pytest.PytestUnraisableExceptionWarning`, now promotes these exceptions to failures regardless of plugin cleanup order.

- [#&#8203;14377](pytest-dev/pytest#14377): Fixed crash in <span class="title-ref">Config.get\_terminal\_writer</span> when an assertion fails with the `terminalreporter` plugin disabled.

- [#&#8203;14381](pytest-dev/pytest#14381): Fixed `-V` (short form of `--version`) to properly display the current version.

- [#&#8203;14389](pytest-dev/pytest#14389): Improved `pytest.raises(..., match=...) <pytest.raises>` failures to suppress the mismatched exception as a cause of the resulting `AssertionError`.

- [#&#8203;14392](pytest-dev/pytest#14392): Fixed a bug in `pytest.raises(match=...) <pytest.raises>` "fully escaped" detection, causing the regex diff display to be shown in some instances when the raw string diff display should be shown instead.

- [#&#8203;14442](pytest-dev/pytest#14442): Fixed a regression in pytest 9.0 where `--strict-markers` and `--strict-config` specified through `addopts` were silently ignored.

  Note that when targeting pytest >= 9.0, it's nicer to use `strict_markers` and `strict_config`, or `strict mode <strict mode>`.

- [#&#8203;14456](pytest-dev/pytest#14456): Fixed `pytest.approx` not recognizing types with `__array_interface__` as numpy-like arrays.

- [#&#8203;14474](pytest-dev/pytest#14474): Fixed a regression where `-k` and `-m` expressions containing both backslash characters in identifiers and string literal arguments would incorrectly raise a `SyntaxError` about escaping.

- [#&#8203;14483](pytest-dev/pytest#14483): Fixed JUnit XML report incorrectly escaping high Unicode codepoints (supplementary plane characters like emoji) in test failure messages. -- by `EternalRights`

- [#&#8203;14492](pytest-dev/pytest#14492): Fixed `Code.getargs()` incorrectly including local variable names in the returned argument tuple for functions with `*args` and/or `**kwargs`. The method was using `co_flags` bitmask values (`4` and `8`) directly as counts instead of converting them to `1` via `bool()`, and was not accounting for `co_kwonlyargcount` when `var=True`.

- [#&#8203;3697](pytest-dev/pytest#3697): Logging capture now works for non-propagating loggers.
  Previously only logs which reached the root logger were captured.
  This includes `caplog` and the "Captured log calls" test reporting.

- [#&#8203;3850](pytest-dev/pytest#3850): Fixed JUnit XML report: the `tests` attribute of the `<testsuite>` element now always matches the number of `<testcase>` elements in the file. In some cases (test passes but fails during teardown) the `tests` attribute would report an incorrect number of testcases in the XML file.

- [#&#8203;5848](pytest-dev/pytest#5848): `pytest_fixture_post_finalizer` is no longer called extra times for the same fixture teardown in some cases.

- [#&#8203;719](pytest-dev/pytest#719): Fixed `@pytest.mark.parametrize <pytest.mark.parametrize ref>` not unpacking single-element tuple values when using a string argnames with a trailing comma (e.g., `"arg,"`).

  The trailing comma form now correctly behaves like the tuple form `("arg",)`, treating argvalues as a list of tuples to unpack.

#### Improved documentation

- [#&#8203;11022](pytest-dev/pytest#11022): Document safer alternatives and scope guidance for monkeypatching standard library functions.
- [#&#8203;11307](pytest-dev/pytest#11307): Document that `@pytest.hookimpl(specname=...)` only works for function names starting with `pytest_`.
- [#&#8203;13038](pytest-dev/pytest#13038): Document that doctests do not support parametrized fixtures, including parametrized autouse fixtures.
- [#&#8203;13155](pytest-dev/pytest#13155): Clarified how the `request` fixture provides indirect parametrization values via `request.param`.
- [#&#8203;13304](pytest-dev/pytest#13304): Clarified in the documentation that hook implementations defined in `conftest.py` files are not available to other plugins during their `pytest_addoption()` execution, as conftest files are discovered and loaded after builtin and third-party plugins have been initialized. However, initial conftest files themselves can implement `pytest_addoption()` to add their own command-line options.
- [#&#8203;13902](pytest-dev/pytest#13902): Clarified how subtest progress markers are shown in the documentation.
- [#&#8203;14012](pytest-dev/pytest#14012): The `ini options ref` section of the API Reference now specified the type and default value of every configuration option.
- [#&#8203;14148](pytest-dev/pytest#14148): Documented a safe `pytestconfig.cache` access pattern when the
  `cacheprovider` plugin is disabled.
- [#&#8203;14303](pytest-dev/pytest#14303): The documentation is now built with Sphinx >= 9.
- [#&#8203;14465](pytest-dev/pytest#14465): Updated the hooks how-to page to link the `newhooks.py` file in `pytest-xdist` at tag `v3.8.0` instead of an unrelated 2017-era commit under the old layout. Pointing at a tag keeps the example in sync with the version users actually install, while remaining stable when the project's main branch moves on.

#### Miscellaneous internal changes

- [#&#8203;14582](pytest-dev/pytest#14582): Improved the recursion traceback test to exercise all requested traceback styles.

</details>

---

### Configuration

📅 **Schedule**: (UTC)

- Branch creation
  - At any time (no schedule defined)
- Automerge
  - At any time (no schedule defined)

🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Mend Renovate](https://github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0My4yMjAuMCIsInVwZGF0ZWRJblZlciI6IjQzLjIyMC4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyJ0eXBlL2RlcGVuZGVuY2llcyJdfQ==-->

Reviewed-on: https://git.tainton.uk/luke/instant-msg-api/pulls/263
Co-authored-by: renovate[bot] <renovate-bot@git.tainton.uk>
Co-committed-by: renovate[bot] <renovate-bot@git.tainton.uk>
luketainton pushed a commit to luketainton/repos_webexmemebot that referenced this pull request Jun 18, 2026
This PR contains the following updates:

| Package | Change | [Age](https://docs.renovatebot.com/merge-confidence/) | [Confidence](https://docs.renovatebot.com/merge-confidence/) |
|---|---|---|---|
| [pytest](https://github.com/pytest-dev/pytest) ([changelog](https://docs.pytest.org/en/stable/changelog.html)) | `<9.1.0,>=9.0.0` → `<9.1.1,>=9.1.0` | ![age](https://developer.mend.io/api/mc/badges/age/pypi/pytest/9.1.0?slim=true) | ![confidence](https://developer.mend.io/api/mc/badges/confidence/pypi/pytest/9.0.3/9.1.0?slim=true) |

---

### Release Notes

<details>
<summary>pytest-dev/pytest (pytest)</summary>

### [`v9.1.0`](https://github.com/pytest-dev/pytest/releases/tag/9.1.0)

[Compare Source](pytest-dev/pytest@9.0.3...9.1.0)

### pytest 9.1.0 (2026-06-13)

#### Removals and backward incompatible breaking changes

- [#&#8203;14533](pytest-dev/pytest#14533): When using `--doctest-modules`, autouse fixtures with `module`, `package` or `session` scope that are defined inline in Python test modules (not plugins or conftests) will now possibly execute twice.

  If this is undesirable, move the fixture definition to a `conftest.py` file if possible.

  Technical explanation for those interested:
  When using <span class="title-ref">--doctest-modules</span>, pytest possibly collects Python modules twice, once as `pytest.Module` and once as a `DoctestModule` (depending on the configuration).
  Due to improvements in pytest's fixture implementation, if e.g. the `DoctestModule` collects a fixture, it is now visible to it only, and not to the `Module`.
  This means that both need to register the fixtures independently.

#### Deprecations (removal in next major release)

- [#&#8203;10819](pytest-dev/pytest#10819): Added a deprecation warning for class-scoped fixtures defined as instance methods (without `@classmethod`). Such fixtures set attributes on a different instance than the test methods use, leading to unexpected behavior. Use `@classmethod` decorator instead -- by `yastcher`.

  See `10819` and `14011`.

- [#&#8203;12882](pytest-dev/pytest#12882): Calling `request.getfixturevalue() <pytest.FixtureRequest.getfixturevalue>` during teardown to request a fixture that was not already requested is now deprecated and will become an error in pytest 10.

  See `dynamic-fixture-request-during-teardown` for details.

- [#&#8203;13409](pytest-dev/pytest#13409): Using non-`~collections.abc.Collection` iterables (such as generators, iterators, or custom iterable objects) for the `argvalues` parameter in `@pytest.mark.parametrize <pytest.mark.parametrize ref>` and `metafunc.parametrize <pytest.Metafunc.parametrize>` is now deprecated.

  These iterables get exhausted after the first iteration,
  leading to tests getting unexpectedly skipped in cases such as running `pytest.main()` multiple times,
  using class-level parametrize decorators,
  or collecting tests multiple times.

  See `parametrize-iterators` for details and suggestions.

- [#&#8203;13946](pytest-dev/pytest#13946): The private `config.inicfg` attribute is now deprecated.
  Use `config.getini() <pytest.Config.getini>` to access configuration values instead.

  See `config-inicfg` for more details.

- [#&#8203;14004](pytest-dev/pytest#14004): Passing `baseid` to `~pytest.FixtureDef` or `nodeid` strings to fixture registration APIs is now deprecated. These are internal pytest APIs that are used by some plugins.

  Use the `node` parameter instead for fixture scoping. This enables more robust node-based
  matching instead of string prefix matching.
  If you've used `nodeid=None`, pass `node=session` instead.

  This will be removed in pytest 10.

- [#&#8203;14335](pytest-dev/pytest#14335): The method of configuring hooks using markers, deprecated since pytest 7.2, is now scheduled to be removed in pytest 10.
  See `hook-markers` for more details.

- [#&#8203;14434](pytest-dev/pytest#14434): The `--pastebin` option is now deprecated.
  The same functionality is now available in an external plugin, `pytest-pastebin`.
  See `pastebin-deprecated` for more details.

- [#&#8203;14513](pytest-dev/pytest#14513): The private `FixtureDef.has_location` attribute is now deprecated and will be removed in pytest 10.
  See `fixturedef-has-location-deprecated` for details.

- [#&#8203;1764](pytest-dev/pytest#1764): `pytest.console_main` is now deprecated and will be removed in pytest 10.
  It was never intended for programmatic use; use `pytest.main` instead.

#### New features

- [#&#8203;12376](pytest-dev/pytest#12376): Added `pytest.register_fixture()` to register fixtures using an imperative interface.

  This is an advanced function intended for use by plugins.

  Normally, fixtures should be registered declaratively using the `@pytest.fixture <pytest.fixture>` decorator.
  Pytest looks for these fixture definitions during the collection phase and registers them automatically.
  For some plugin usecases the declarative interface can be cumbersome or unviable, in which case this imperative interface can be used.

- [#&#8203;14023](pytest-dev/pytest#14023): Added <span class="title-ref">--report-chars</span> long CLI option.

- [#&#8203;14371](pytest-dev/pytest#14371): Added `--max-warnings` command-line option and `max_warnings` configuration option to fail the test run when the number of warnings exceeds a given threshold -- by `miketheman`.

- [#&#8203;6757](pytest-dev/pytest#6757): Added the `assertion_text_diff_style` configuration option, allowing
  string equality failures to be rendered as separate `Left:` and `Right:`
  blocks instead of `ndiff` output.

- [#&#8203;8395](pytest-dev/pytest#8395): Added support for `~datetime.datetime` and `~datetime.timedelta` comparisons with `pytest.approx`. An explicit `abs` or `rel` tolerance as a `~datetime.timedelta` is required and relative tolerance is not supported for datetime comparisons -- by `hamza-mobeen`.

#### Improvements in existing functionality

- [#&#8203;11225](pytest-dev/pytest#11225): `pytest.warns` now shows "Regex pattern did not match" instead of "DID NOT WARN" when warnings were emitted but the `match` pattern did not match.

- [#&#8203;11295](pytest-dev/pytest#11295): Improved output of `--fixtures-per-test` by excluding internal-implementation fixtures generated by `@pytest.mark.parametrize` and similar.

- [#&#8203;13241](pytest-dev/pytest#13241): `pytest.raises`, `pytest.warns` and `pytest.deprecated_call` now uses `ParamSpec` for the type hint to the (old and not recommended) callable overload, instead of `Any`. This allows type checkers to raise errors when passing incorrect function parameters.
  `func` can now also be passed as a kwarg, which the type hint previously showed as possible but didn't accept.

- [#&#8203;13862](pytest-dev/pytest#13862): Improved the readability of "DID NOT RAISE" error messages by using the exception type's name instead of its <span class="title-ref">repr</span>.

- [#&#8203;14026](pytest-dev/pytest#14026): Added test coverage for compiled regex patterns in `pytest.raises` match parameter.

- [#&#8203;14137](pytest-dev/pytest#14137): <span class="title-ref">pytest.ScopeName</span> is now public to allow using it in function signatures.

- [#&#8203;14342](pytest-dev/pytest#14342): Marked `yield_fixture` as deprecated to type checkers using the `deprecated` decorator. Note it
  `has originally been deprecated <yield-fixture-deprecated>` in pytest 6.2 already.

- [#&#8203;14373](pytest-dev/pytest#14373): Added type annotations for `pytest.approx`.

- [#&#8203;14430](pytest-dev/pytest#14430): When using `--setup-show`, a space is now printed after the test name (and possibly used fixtures), to separate it from the test result.

- [#&#8203;14441](pytest-dev/pytest#14441): Reduced the default number of `gc.collect()` passes in the `unraisableexception` plugin from 5 to 1 on CPython, where reference counting makes a single pass sufficient. PyPy retains 5 passes due to object resurrection via `__del__`. This can noticeably speed up test suites that trigger many pytester runs.

- [#&#8203;14461](pytest-dev/pytest#14461): Improved assertion failure explanations for equality comparisons between mapping objects that are not `dict` instances.

- [#&#8203;14513](pytest-dev/pytest#14513): The order in which fixture definitions overriding each other are resolved is now determined first by their *visibility* in the collection tree rather than by the order in which they are registered.

  A fixture defined for a more specific node (e.g. a module or an item) now always takes precedence over one with the same name defined for a more general node (e.g. the session), even when the more general one was registered later.
  Fixtures with non-comparable visibility or the same visibility keep the existing behavior of "last registered wins".
  This change is supposed to only affect plugins which register multiple fixtures programmatically with the same name.

- [#&#8203;14524](pytest-dev/pytest#14524): Add official Python 3.15 support.

- [#&#8203;1764](pytest-dev/pytest#1764): Improved argparse program name to show `pytest`, `python -m pytest`, or `pytest.main()` based on how pytest was invoked, making help and error messages clearer.

- [#&#8203;8265](pytest-dev/pytest#8265): Emit a `PytestCollectionWarning` when a module-level `__getattr__` returns `None` for `pytestmark` instead of raising `AttributeError`.

  Previously this caused a cryptic `TypeError: got None instead of Mark` error.
  Now pytest issues a helpful warning and continues collecting the module normally.

#### Bug fixes

- [#&#8203;13192](pytest-dev/pytest#13192): Fixed <span class="title-ref">|</span> (pipe) not being treated as a regex meta-character that needs escaping in `pytest.raises(match=...) <pytest.raises>`.

- [#&#8203;13484](pytest-dev/pytest#13484): Fixed `-W` option values being duplicated in `Config.known_args_namespace`.

- [#&#8203;13626](pytest-dev/pytest#13626): Fixed function-scoped fixture values being kept alive after a test was interrupted by `KeyboardInterrupt` or early exit,
  allowing them to potentially be released more promptly.

- [#&#8203;13784](pytest-dev/pytest#13784): Fixed `capteesys` producing doubled output when used with `--capture=no` (`-s`).

- [#&#8203;13817](pytest-dev/pytest#13817): Fixed a secondary <span class="title-ref">AttributeError</span> masking the original error when an option argument fails to initialize.

- [#&#8203;13884](pytest-dev/pytest#13884): Fixed rare internal IndexError caused by <span class="title-ref">builtins.compile</span> being overridden in client code.

- [#&#8203;13885](pytest-dev/pytest#13885): Fixed autouse fixtures defined inside a `unittest.TestCase` class running even when the class is decorated with `unittest.skip` or `unittest.skipIf` -- regression since pytest 8.1.0.

- [#&#8203;13917](pytest-dev/pytest#13917): `unittest.SkipTest` is no longer considered an interactive exception, i.e. `pytest_exception_interact` is no longer called for it.

- [#&#8203;13963](pytest-dev/pytest#13963): Fixed subtests running with `pytest-xdist` when their contexts contain objects that are not JSON-serializable.

  Fixes [pytest-dev/pytest-xdist#1273](pytest-dev/pytest-xdist#1273).

- [#&#8203;14004](pytest-dev/pytest#14004): Fixed conftest.py fixture scoping when `testpaths` points outside of the `rootdir <rootdir>`.

  Previously, fixtures from nested conftest.py files would incorrectly leak to sibling directories
  when using a relative `testpaths` like `../tests/sdk`.

  Conftest fixtures are now parsed during `Directory <pytest.Directory>` collection, using the `Directory` node for proper scoping.

- [#&#8203;14050](pytest-dev/pytest#14050): Display dictionary differences in assertion failures using the original key insertion order instead of sorted order.

- [#&#8203;14080](pytest-dev/pytest#14080): fix missing type annotations on `Pytester.makepyfile` and `Pytester.maketxtfile` methods.

- [#&#8203;14114](pytest-dev/pytest#14114): An exception from `pytest_fixture_post_finalizer` no longer prevents fixtures from being torn down, causing additional errors in the following tests.

- [#&#8203;14161](pytest-dev/pytest#14161): Fixed `monkeypatch.setattr() <pytest.MonkeyPatch.setattr>` leaving a stale entry on the undo stack when the underlying `setattr()` call fails (e.g. on immutable targets), causing an `AttributeError` crash during teardown.

- [#&#8203;14214](pytest-dev/pytest#14214): Fixed `-v` hint in `pytest.raises` match diff not working because assertion verbosity was not propagated.

- [#&#8203;14234](pytest-dev/pytest#14234): Allow `pytest.HIDDEN_PARAM <hidden-param>` in `@pytest.mark.parametrize(ids=...) <pytest.mark.parametrize ref>` typing.

- [#&#8203;14248](pytest-dev/pytest#14248): Fixed direct parametrization causing the static fixture closure (as reflected in `request.fixturenames <pytest.FixtureRequest.fixturenames>`) to omit fixtures that are requested transitively from overridden fixtures.

- [#&#8203;14263](pytest-dev/pytest#14263): Unraisable exceptions from finalizers are now collected during `pytest_unconfigure`, before pytest tears down the warning filters installed for the session. Previously the collection ran from a cleanup callback whose order relative to other plugins' cleanups was not guaranteed, so an active `error` filter could be removed before the exception surfaced and a late resource leak would pass silently. A `-W error` filter, or any filter matching `pytest.PytestUnraisableExceptionWarning`, now promotes these exceptions to failures regardless of plugin cleanup order.

- [#&#8203;14377](pytest-dev/pytest#14377): Fixed crash in <span class="title-ref">Config.get\_terminal\_writer</span> when an assertion fails with the `terminalreporter` plugin disabled.

- [#&#8203;14381](pytest-dev/pytest#14381): Fixed `-V` (short form of `--version`) to properly display the current version.

- [#&#8203;14389](pytest-dev/pytest#14389): Improved `pytest.raises(..., match=...) <pytest.raises>` failures to suppress the mismatched exception as a cause of the resulting `AssertionError`.

- [#&#8203;14392](pytest-dev/pytest#14392): Fixed a bug in `pytest.raises(match=...) <pytest.raises>` "fully escaped" detection, causing the regex diff display to be shown in some instances when the raw string diff display should be shown instead.

- [#&#8203;14442](pytest-dev/pytest#14442): Fixed a regression in pytest 9.0 where `--strict-markers` and `--strict-config` specified through `addopts` were silently ignored.

  Note that when targeting pytest >= 9.0, it's nicer to use `strict_markers` and `strict_config`, or `strict mode <strict mode>`.

- [#&#8203;14456](pytest-dev/pytest#14456): Fixed `pytest.approx` not recognizing types with `__array_interface__` as numpy-like arrays.

- [#&#8203;14474](pytest-dev/pytest#14474): Fixed a regression where `-k` and `-m` expressions containing both backslash characters in identifiers and string literal arguments would incorrectly raise a `SyntaxError` about escaping.

- [#&#8203;14483](pytest-dev/pytest#14483): Fixed JUnit XML report incorrectly escaping high Unicode codepoints (supplementary plane characters like emoji) in test failure messages. -- by `EternalRights`

- [#&#8203;14492](pytest-dev/pytest#14492): Fixed `Code.getargs()` incorrectly including local variable names in the returned argument tuple for functions with `*args` and/or `**kwargs`. The method was using `co_flags` bitmask values (`4` and `8`) directly as counts instead of converting them to `1` via `bool()`, and was not accounting for `co_kwonlyargcount` when `var=True`.

- [#&#8203;3697](pytest-dev/pytest#3697): Logging capture now works for non-propagating loggers.
  Previously only logs which reached the root logger were captured.
  This includes `caplog` and the "Captured log calls" test reporting.

- [#&#8203;3850](pytest-dev/pytest#3850): Fixed JUnit XML report: the `tests` attribute of the `<testsuite>` element now always matches the number of `<testcase>` elements in the file. In some cases (test passes but fails during teardown) the `tests` attribute would report an incorrect number of testcases in the XML file.

- [#&#8203;5848](pytest-dev/pytest#5848): `pytest_fixture_post_finalizer` is no longer called extra times for the same fixture teardown in some cases.

- [#&#8203;719](pytest-dev/pytest#719): Fixed `@pytest.mark.parametrize <pytest.mark.parametrize ref>` not unpacking single-element tuple values when using a string argnames with a trailing comma (e.g., `"arg,"`).

  The trailing comma form now correctly behaves like the tuple form `("arg",)`, treating argvalues as a list of tuples to unpack.

#### Improved documentation

- [#&#8203;11022](pytest-dev/pytest#11022): Document safer alternatives and scope guidance for monkeypatching standard library functions.
- [#&#8203;11307](pytest-dev/pytest#11307): Document that `@pytest.hookimpl(specname=...)` only works for function names starting with `pytest_`.
- [#&#8203;13038](pytest-dev/pytest#13038): Document that doctests do not support parametrized fixtures, including parametrized autouse fixtures.
- [#&#8203;13155](pytest-dev/pytest#13155): Clarified how the `request` fixture provides indirect parametrization values via `request.param`.
- [#&#8203;13304](pytest-dev/pytest#13304): Clarified in the documentation that hook implementations defined in `conftest.py` files are not available to other plugins during their `pytest_addoption()` execution, as conftest files are discovered and loaded after builtin and third-party plugins have been initialized. However, initial conftest files themselves can implement `pytest_addoption()` to add their own command-line options.
- [#&#8203;13902](pytest-dev/pytest#13902): Clarified how subtest progress markers are shown in the documentation.
- [#&#8203;14012](pytest-dev/pytest#14012): The `ini options ref` section of the API Reference now specified the type and default value of every configuration option.
- [#&#8203;14148](pytest-dev/pytest#14148): Documented a safe `pytestconfig.cache` access pattern when the
  `cacheprovider` plugin is disabled.
- [#&#8203;14303](pytest-dev/pytest#14303): The documentation is now built with Sphinx >= 9.
- [#&#8203;14465](pytest-dev/pytest#14465): Updated the hooks how-to page to link the `newhooks.py` file in `pytest-xdist` at tag `v3.8.0` instead of an unrelated 2017-era commit under the old layout. Pointing at a tag keeps the example in sync with the version users actually install, while remaining stable when the project's main branch moves on.

#### Miscellaneous internal changes

- [#&#8203;14582](pytest-dev/pytest#14582): Improved the recursion traceback test to exercise all requested traceback styles.

</details>

---

### Configuration

📅 **Schedule**: (UTC)

- Branch creation
  - At any time (no schedule defined)
- Automerge
  - At any time (no schedule defined)

🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Mend Renovate](https://github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0My4yMjAuMCIsInVwZGF0ZWRJblZlciI6IjQzLjIyMC4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyJ0eXBlL2RlcGVuZGVuY2llcyJdfQ==-->

Reviewed-on: https://git.tainton.uk/repos/webexmemebot/pulls/590
Co-authored-by: renovate[bot] <renovate-bot@git.tainton.uk>
Co-committed-by: renovate[bot] <renovate-bot@git.tainton.uk>
luketainton pushed a commit to luketainton/repos_roboluke that referenced this pull request Jun 18, 2026
This PR contains the following updates:

| Package | Change | [Age](https://docs.renovatebot.com/merge-confidence/) | [Confidence](https://docs.renovatebot.com/merge-confidence/) |
|---|---|---|---|
| [pytest](https://github.com/pytest-dev/pytest) ([changelog](https://docs.pytest.org/en/stable/changelog.html)) | `<9.1.0,>=9.0.0` → `<9.1.1,>=9.1.0` | ![age](https://developer.mend.io/api/mc/badges/age/pypi/pytest/9.1.0?slim=true) | ![confidence](https://developer.mend.io/api/mc/badges/confidence/pypi/pytest/9.0.3/9.1.0?slim=true) |

---

### Release Notes

<details>
<summary>pytest-dev/pytest (pytest)</summary>

### [`v9.1.0`](https://github.com/pytest-dev/pytest/releases/tag/9.1.0)

[Compare Source](pytest-dev/pytest@9.0.3...9.1.0)

### pytest 9.1.0 (2026-06-13)

#### Removals and backward incompatible breaking changes

- [#&#8203;14533](pytest-dev/pytest#14533): When using `--doctest-modules`, autouse fixtures with `module`, `package` or `session` scope that are defined inline in Python test modules (not plugins or conftests) will now possibly execute twice.

  If this is undesirable, move the fixture definition to a `conftest.py` file if possible.

  Technical explanation for those interested:
  When using <span class="title-ref">--doctest-modules</span>, pytest possibly collects Python modules twice, once as `pytest.Module` and once as a `DoctestModule` (depending on the configuration).
  Due to improvements in pytest's fixture implementation, if e.g. the `DoctestModule` collects a fixture, it is now visible to it only, and not to the `Module`.
  This means that both need to register the fixtures independently.

#### Deprecations (removal in next major release)

- [#&#8203;10819](pytest-dev/pytest#10819): Added a deprecation warning for class-scoped fixtures defined as instance methods (without `@classmethod`). Such fixtures set attributes on a different instance than the test methods use, leading to unexpected behavior. Use `@classmethod` decorator instead -- by `yastcher`.

  See `10819` and `14011`.

- [#&#8203;12882](pytest-dev/pytest#12882): Calling `request.getfixturevalue() <pytest.FixtureRequest.getfixturevalue>` during teardown to request a fixture that was not already requested is now deprecated and will become an error in pytest 10.

  See `dynamic-fixture-request-during-teardown` for details.

- [#&#8203;13409](pytest-dev/pytest#13409): Using non-`~collections.abc.Collection` iterables (such as generators, iterators, or custom iterable objects) for the `argvalues` parameter in `@pytest.mark.parametrize <pytest.mark.parametrize ref>` and `metafunc.parametrize <pytest.Metafunc.parametrize>` is now deprecated.

  These iterables get exhausted after the first iteration,
  leading to tests getting unexpectedly skipped in cases such as running `pytest.main()` multiple times,
  using class-level parametrize decorators,
  or collecting tests multiple times.

  See `parametrize-iterators` for details and suggestions.

- [#&#8203;13946](pytest-dev/pytest#13946): The private `config.inicfg` attribute is now deprecated.
  Use `config.getini() <pytest.Config.getini>` to access configuration values instead.

  See `config-inicfg` for more details.

- [#&#8203;14004](pytest-dev/pytest#14004): Passing `baseid` to `~pytest.FixtureDef` or `nodeid` strings to fixture registration APIs is now deprecated. These are internal pytest APIs that are used by some plugins.

  Use the `node` parameter instead for fixture scoping. This enables more robust node-based
  matching instead of string prefix matching.
  If you've used `nodeid=None`, pass `node=session` instead.

  This will be removed in pytest 10.

- [#&#8203;14335](pytest-dev/pytest#14335): The method of configuring hooks using markers, deprecated since pytest 7.2, is now scheduled to be removed in pytest 10.
  See `hook-markers` for more details.

- [#&#8203;14434](pytest-dev/pytest#14434): The `--pastebin` option is now deprecated.
  The same functionality is now available in an external plugin, `pytest-pastebin`.
  See `pastebin-deprecated` for more details.

- [#&#8203;14513](pytest-dev/pytest#14513): The private `FixtureDef.has_location` attribute is now deprecated and will be removed in pytest 10.
  See `fixturedef-has-location-deprecated` for details.

- [#&#8203;1764](pytest-dev/pytest#1764): `pytest.console_main` is now deprecated and will be removed in pytest 10.
  It was never intended for programmatic use; use `pytest.main` instead.

#### New features

- [#&#8203;12376](pytest-dev/pytest#12376): Added `pytest.register_fixture()` to register fixtures using an imperative interface.

  This is an advanced function intended for use by plugins.

  Normally, fixtures should be registered declaratively using the `@pytest.fixture <pytest.fixture>` decorator.
  Pytest looks for these fixture definitions during the collection phase and registers them automatically.
  For some plugin usecases the declarative interface can be cumbersome or unviable, in which case this imperative interface can be used.

- [#&#8203;14023](pytest-dev/pytest#14023): Added <span class="title-ref">--report-chars</span> long CLI option.

- [#&#8203;14371](pytest-dev/pytest#14371): Added `--max-warnings` command-line option and `max_warnings` configuration option to fail the test run when the number of warnings exceeds a given threshold -- by `miketheman`.

- [#&#8203;6757](pytest-dev/pytest#6757): Added the `assertion_text_diff_style` configuration option, allowing
  string equality failures to be rendered as separate `Left:` and `Right:`
  blocks instead of `ndiff` output.

- [#&#8203;8395](pytest-dev/pytest#8395): Added support for `~datetime.datetime` and `~datetime.timedelta` comparisons with `pytest.approx`. An explicit `abs` or `rel` tolerance as a `~datetime.timedelta` is required and relative tolerance is not supported for datetime comparisons -- by `hamza-mobeen`.

#### Improvements in existing functionality

- [#&#8203;11225](pytest-dev/pytest#11225): `pytest.warns` now shows "Regex pattern did not match" instead of "DID NOT WARN" when warnings were emitted but the `match` pattern did not match.

- [#&#8203;11295](pytest-dev/pytest#11295): Improved output of `--fixtures-per-test` by excluding internal-implementation fixtures generated by `@pytest.mark.parametrize` and similar.

- [#&#8203;13241](pytest-dev/pytest#13241): `pytest.raises`, `pytest.warns` and `pytest.deprecated_call` now uses `ParamSpec` for the type hint to the (old and not recommended) callable overload, instead of `Any`. This allows type checkers to raise errors when passing incorrect function parameters.
  `func` can now also be passed as a kwarg, which the type hint previously showed as possible but didn't accept.

- [#&#8203;13862](pytest-dev/pytest#13862): Improved the readability of "DID NOT RAISE" error messages by using the exception type's name instead of its <span class="title-ref">repr</span>.

- [#&#8203;14026](pytest-dev/pytest#14026): Added test coverage for compiled regex patterns in `pytest.raises` match parameter.

- [#&#8203;14137](pytest-dev/pytest#14137): <span class="title-ref">pytest.ScopeName</span> is now public to allow using it in function signatures.

- [#&#8203;14342](pytest-dev/pytest#14342): Marked `yield_fixture` as deprecated to type checkers using the `deprecated` decorator. Note it
  `has originally been deprecated <yield-fixture-deprecated>` in pytest 6.2 already.

- [#&#8203;14373](pytest-dev/pytest#14373): Added type annotations for `pytest.approx`.

- [#&#8203;14430](pytest-dev/pytest#14430): When using `--setup-show`, a space is now printed after the test name (and possibly used fixtures), to separate it from the test result.

- [#&#8203;14441](pytest-dev/pytest#14441): Reduced the default number of `gc.collect()` passes in the `unraisableexception` plugin from 5 to 1 on CPython, where reference counting makes a single pass sufficient. PyPy retains 5 passes due to object resurrection via `__del__`. This can noticeably speed up test suites that trigger many pytester runs.

- [#&#8203;14461](pytest-dev/pytest#14461): Improved assertion failure explanations for equality comparisons between mapping objects that are not `dict` instances.

- [#&#8203;14513](pytest-dev/pytest#14513): The order in which fixture definitions overriding each other are resolved is now determined first by their *visibility* in the collection tree rather than by the order in which they are registered.

  A fixture defined for a more specific node (e.g. a module or an item) now always takes precedence over one with the same name defined for a more general node (e.g. the session), even when the more general one was registered later.
  Fixtures with non-comparable visibility or the same visibility keep the existing behavior of "last registered wins".
  This change is supposed to only affect plugins which register multiple fixtures programmatically with the same name.

- [#&#8203;14524](pytest-dev/pytest#14524): Add official Python 3.15 support.

- [#&#8203;1764](pytest-dev/pytest#1764): Improved argparse program name to show `pytest`, `python -m pytest`, or `pytest.main()` based on how pytest was invoked, making help and error messages clearer.

- [#&#8203;8265](pytest-dev/pytest#8265): Emit a `PytestCollectionWarning` when a module-level `__getattr__` returns `None` for `pytestmark` instead of raising `AttributeError`.

  Previously this caused a cryptic `TypeError: got None instead of Mark` error.
  Now pytest issues a helpful warning and continues collecting the module normally.

#### Bug fixes

- [#&#8203;13192](pytest-dev/pytest#13192): Fixed <span class="title-ref">|</span> (pipe) not being treated as a regex meta-character that needs escaping in `pytest.raises(match=...) <pytest.raises>`.

- [#&#8203;13484](pytest-dev/pytest#13484): Fixed `-W` option values being duplicated in `Config.known_args_namespace`.

- [#&#8203;13626](pytest-dev/pytest#13626): Fixed function-scoped fixture values being kept alive after a test was interrupted by `KeyboardInterrupt` or early exit,
  allowing them to potentially be released more promptly.

- [#&#8203;13784](pytest-dev/pytest#13784): Fixed `capteesys` producing doubled output when used with `--capture=no` (`-s`).

- [#&#8203;13817](pytest-dev/pytest#13817): Fixed a secondary <span class="title-ref">AttributeError</span> masking the original error when an option argument fails to initialize.

- [#&#8203;13884](pytest-dev/pytest#13884): Fixed rare internal IndexError caused by <span class="title-ref">builtins.compile</span> being overridden in client code.

- [#&#8203;13885](pytest-dev/pytest#13885): Fixed autouse fixtures defined inside a `unittest.TestCase` class running even when the class is decorated with `unittest.skip` or `unittest.skipIf` -- regression since pytest 8.1.0.

- [#&#8203;13917](pytest-dev/pytest#13917): `unittest.SkipTest` is no longer considered an interactive exception, i.e. `pytest_exception_interact` is no longer called for it.

- [#&#8203;13963](pytest-dev/pytest#13963): Fixed subtests running with `pytest-xdist` when their contexts contain objects that are not JSON-serializable.

  Fixes [pytest-dev/pytest-xdist#1273](pytest-dev/pytest-xdist#1273).

- [#&#8203;14004](pytest-dev/pytest#14004): Fixed conftest.py fixture scoping when `testpaths` points outside of the `rootdir <rootdir>`.

  Previously, fixtures from nested conftest.py files would incorrectly leak to sibling directories
  when using a relative `testpaths` like `../tests/sdk`.

  Conftest fixtures are now parsed during `Directory <pytest.Directory>` collection, using the `Directory` node for proper scoping.

- [#&#8203;14050](pytest-dev/pytest#14050): Display dictionary differences in assertion failures using the original key insertion order instead of sorted order.

- [#&#8203;14080](pytest-dev/pytest#14080): fix missing type annotations on `Pytester.makepyfile` and `Pytester.maketxtfile` methods.

- [#&#8203;14114](pytest-dev/pytest#14114): An exception from `pytest_fixture_post_finalizer` no longer prevents fixtures from being torn down, causing additional errors in the following tests.

- [#&#8203;14161](pytest-dev/pytest#14161): Fixed `monkeypatch.setattr() <pytest.MonkeyPatch.setattr>` leaving a stale entry on the undo stack when the underlying `setattr()` call fails (e.g. on immutable targets), causing an `AttributeError` crash during teardown.

- [#&#8203;14214](pytest-dev/pytest#14214): Fixed `-v` hint in `pytest.raises` match diff not working because assertion verbosity was not propagated.

- [#&#8203;14234](pytest-dev/pytest#14234): Allow `pytest.HIDDEN_PARAM <hidden-param>` in `@pytest.mark.parametrize(ids=...) <pytest.mark.parametrize ref>` typing.

- [#&#8203;14248](pytest-dev/pytest#14248): Fixed direct parametrization causing the static fixture closure (as reflected in `request.fixturenames <pytest.FixtureRequest.fixturenames>`) to omit fixtures that are requested transitively from overridden fixtures.

- [#&#8203;14263](pytest-dev/pytest#14263): Unraisable exceptions from finalizers are now collected during `pytest_unconfigure`, before pytest tears down the warning filters installed for the session. Previously the collection ran from a cleanup callback whose order relative to other plugins' cleanups was not guaranteed, so an active `error` filter could be removed before the exception surfaced and a late resource leak would pass silently. A `-W error` filter, or any filter matching `pytest.PytestUnraisableExceptionWarning`, now promotes these exceptions to failures regardless of plugin cleanup order.

- [#&#8203;14377](pytest-dev/pytest#14377): Fixed crash in <span class="title-ref">Config.get\_terminal\_writer</span> when an assertion fails with the `terminalreporter` plugin disabled.

- [#&#8203;14381](pytest-dev/pytest#14381): Fixed `-V` (short form of `--version`) to properly display the current version.

- [#&#8203;14389](pytest-dev/pytest#14389): Improved `pytest.raises(..., match=...) <pytest.raises>` failures to suppress the mismatched exception as a cause of the resulting `AssertionError`.

- [#&#8203;14392](pytest-dev/pytest#14392): Fixed a bug in `pytest.raises(match=...) <pytest.raises>` "fully escaped" detection, causing the regex diff display to be shown in some instances when the raw string diff display should be shown instead.

- [#&#8203;14442](pytest-dev/pytest#14442): Fixed a regression in pytest 9.0 where `--strict-markers` and `--strict-config` specified through `addopts` were silently ignored.

  Note that when targeting pytest >= 9.0, it's nicer to use `strict_markers` and `strict_config`, or `strict mode <strict mode>`.

- [#&#8203;14456](pytest-dev/pytest#14456): Fixed `pytest.approx` not recognizing types with `__array_interface__` as numpy-like arrays.

- [#&#8203;14474](pytest-dev/pytest#14474): Fixed a regression where `-k` and `-m` expressions containing both backslash characters in identifiers and string literal arguments would incorrectly raise a `SyntaxError` about escaping.

- [#&#8203;14483](pytest-dev/pytest#14483): Fixed JUnit XML report incorrectly escaping high Unicode codepoints (supplementary plane characters like emoji) in test failure messages. -- by `EternalRights`

- [#&#8203;14492](pytest-dev/pytest#14492): Fixed `Code.getargs()` incorrectly including local variable names in the returned argument tuple for functions with `*args` and/or `**kwargs`. The method was using `co_flags` bitmask values (`4` and `8`) directly as counts instead of converting them to `1` via `bool()`, and was not accounting for `co_kwonlyargcount` when `var=True`.

- [#&#8203;3697](pytest-dev/pytest#3697): Logging capture now works for non-propagating loggers.
  Previously only logs which reached the root logger were captured.
  This includes `caplog` and the "Captured log calls" test reporting.

- [#&#8203;3850](pytest-dev/pytest#3850): Fixed JUnit XML report: the `tests` attribute of the `<testsuite>` element now always matches the number of `<testcase>` elements in the file. In some cases (test passes but fails during teardown) the `tests` attribute would report an incorrect number of testcases in the XML file.

- [#&#8203;5848](pytest-dev/pytest#5848): `pytest_fixture_post_finalizer` is no longer called extra times for the same fixture teardown in some cases.

- [#&#8203;719](pytest-dev/pytest#719): Fixed `@pytest.mark.parametrize <pytest.mark.parametrize ref>` not unpacking single-element tuple values when using a string argnames with a trailing comma (e.g., `"arg,"`).

  The trailing comma form now correctly behaves like the tuple form `("arg",)`, treating argvalues as a list of tuples to unpack.

#### Improved documentation

- [#&#8203;11022](pytest-dev/pytest#11022): Document safer alternatives and scope guidance for monkeypatching standard library functions.
- [#&#8203;11307](pytest-dev/pytest#11307): Document that `@pytest.hookimpl(specname=...)` only works for function names starting with `pytest_`.
- [#&#8203;13038](pytest-dev/pytest#13038): Document that doctests do not support parametrized fixtures, including parametrized autouse fixtures.
- [#&#8203;13155](pytest-dev/pytest#13155): Clarified how the `request` fixture provides indirect parametrization values via `request.param`.
- [#&#8203;13304](pytest-dev/pytest#13304): Clarified in the documentation that hook implementations defined in `conftest.py` files are not available to other plugins during their `pytest_addoption()` execution, as conftest files are discovered and loaded after builtin and third-party plugins have been initialized. However, initial conftest files themselves can implement `pytest_addoption()` to add their own command-line options.
- [#&#8203;13902](pytest-dev/pytest#13902): Clarified how subtest progress markers are shown in the documentation.
- [#&#8203;14012](pytest-dev/pytest#14012): The `ini options ref` section of the API Reference now specified the type and default value of every configuration option.
- [#&#8203;14148](pytest-dev/pytest#14148): Documented a safe `pytestconfig.cache` access pattern when the
  `cacheprovider` plugin is disabled.
- [#&#8203;14303](pytest-dev/pytest#14303): The documentation is now built with Sphinx >= 9.
- [#&#8203;14465](pytest-dev/pytest#14465): Updated the hooks how-to page to link the `newhooks.py` file in `pytest-xdist` at tag `v3.8.0` instead of an unrelated 2017-era commit under the old layout. Pointing at a tag keeps the example in sync with the version users actually install, while remaining stable when the project's main branch moves on.

#### Miscellaneous internal changes

- [#&#8203;14582](pytest-dev/pytest#14582): Improved the recursion traceback test to exercise all requested traceback styles.

</details>

---

### Configuration

📅 **Schedule**: (UTC)

- Branch creation
  - At any time (no schedule defined)
- Automerge
  - At any time (no schedule defined)

🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.

♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Mend Renovate](https://github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0My4yMjAuMCIsInVwZGF0ZWRJblZlciI6IjQzLjIyMC4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyJ0eXBlL2RlcGVuZGVuY2llcyJdfQ==-->

Reviewed-on: https://git.tainton.uk/repos/roboluke/pulls/456
Co-authored-by: renovate[bot] <renovate-bot@git.tainton.uk>
Co-committed-by: renovate[bot] <renovate-bot@git.tainton.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bot:chronographer:provided (automation) changelog entry is part of PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants