ci: add bench / pr job

[mccutchen]

This job uses benchstat to compare benchmarks for the current commit on a pull request to the baseline benchmarks recorded for the last commit to the main branch and posts a comment with a summary.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 79.39%. Comparing base (0b6bcf4) to head (ab2c198).
Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main      #22   +/-   ##
=======================================
  Coverage   79.39%   79.39%           
=======================================
  Files           3        3           
  Lines         427      427           
=======================================
  Hits          339      339           
  Misses         64       64           
  Partials       24       24           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[github-actions]

benchstats: 0b6bcf4...ab2c198

View full benchmark output for ab2c198 on the workflow summary.

goos: linux
goarch: amd64
pkg: github.com/mccutchen/websocket
cpu: AMD EPYC 7763 64-Core Processor                
                       │ bench-results-main.txt │       bench-commit-ab2c198.txt       │
                       │         sec/op         │    sec/op     vs base                │
ReadFrame/1KiB-4                   1017.5n ± 1%    957.4n ± 0%   -5.91% (p=0.001 n=10)
ReadFrame/1MiB-4                    855.6µ ± 1%    844.3µ ± 1%   -1.32% (p=0.000 n=10)
ReadFrame/8MiB-4                    6.429m ± 1%    6.551m ± 0%   +1.90% (p=0.001 n=10)
ReadFrame/16MiB-4                   13.05m ± 1%    13.23m ± 1%   +1.39% (p=0.001 n=10)
ReadMessage/1MiB/1-4                943.3µ ± 0%   1019.2µ ± 0%   +8.04% (p=0.000 n=10)
ReadMessage/8MiB/1-4                7.185m ± 1%    7.417m ± 2%   +3.22% (p=0.000 n=10)
ReadMessage/16MiB/1-4               14.59m ± 1%    14.69m ± 1%   +0.66% (p=0.019 n=10)
ReadMessage/1MiB/4-4                1.413m ± 6%    1.453m ± 3%   +2.83% (p=0.019 n=10)
ReadMessage/8MiB/4-4                8.912m ± 4%   10.838m ± 3%  +21.61% (p=0.000 n=10)
ReadMessage/16MiB/4-4               18.08m ± 4%    18.34m ± 1%        ~ (p=0.393 n=10)
ReadMessage/1MiB/16-4               2.310m ± 6%    1.972m ± 4%  -14.62% (p=0.000 n=10)
ReadMessage/8MiB/16-4               15.97m ± 5%    15.85m ± 5%        ~ (p=0.579 n=10)
ReadMessage/16MiB/16-4              24.48m ± 5%    22.53m ± 4%   -7.97% (p=0.001 n=10)
geomean                             2.984m         2.998m        +0.49%

                       │ bench-results-main.txt │       bench-commit-ab2c198.txt        │
                       │          B/op          │     B/op      vs base                 │
ReadFrame/1KiB-4                   1.055Ki ± 0%   1.055Ki ± 0%       ~ (p=1.000 n=10) ¹
ReadFrame/1MiB-4                   1.000Mi ± 0%   1.000Mi ± 0%  +0.00% (p=0.000 n=10)
ReadFrame/8MiB-4                   8.000Mi ± 0%   8.000Mi ± 0%  +0.00% (p=0.000 n=10)
ReadFrame/16MiB-4                  16.00Mi ± 0%   16.00Mi ± 0%  +0.00% (p=0.003 n=10)
ReadMessage/1MiB/1-4               1.000Mi ± 0%   1.000Mi ± 0%  +0.00% (p=0.000 n=10)
ReadMessage/8MiB/1-4               8.000Mi ± 0%   8.000Mi ± 0%  +0.00% (p=0.000 n=10)
ReadMessage/16MiB/1-4              16.00Mi ± 0%   16.00Mi ± 0%  +0.00% (p=0.000 n=10)
ReadMessage/1MiB/4-4               3.602Mi ± 0%   3.602Mi ± 0%  +0.00% (p=0.000 n=10)
ReadMessage/8MiB/4-4               28.57Mi ± 0%   28.57Mi ± 0%  +0.00% (p=0.011 n=10)
ReadMessage/16MiB/4-4              57.09Mi ± 0%   57.09Mi ± 0%       ~ (p=0.108 n=10)
ReadMessage/1MiB/16-4              5.407Mi ± 0%   5.407Mi ± 0%  -0.00% (p=0.000 n=10)
ReadMessage/8MiB/16-4              47.22Mi ± 0%   47.22Mi ± 0%       ~ (p=0.117 n=10)
ReadMessage/16MiB/16-4             93.81Mi ± 0%   93.81Mi ± 0%  -0.00% (p=0.024 n=10)
geomean                            5.263Mi        5.263Mi       +0.00%
¹ all samples are equal

                       │ bench-results-main.txt │      bench-commit-ab2c198.txt       │
                       │       allocs/op        │ allocs/op   vs base                 │
ReadFrame/1KiB-4                     5.000 ± 0%   5.000 ± 0%       ~ (p=1.000 n=10) ¹
ReadFrame/1MiB-4                     5.000 ± 0%   5.000 ± 0%       ~ (p=1.000 n=10) ¹
ReadFrame/8MiB-4                     5.000 ± 0%   5.000 ± 0%       ~ (p=1.000 n=10) ¹
ReadFrame/16MiB-4                    5.000 ± 0%   5.000 ± 0%       ~ (p=1.000 n=10) ¹
ReadMessage/1MiB/1-4                 6.000 ± 0%   6.000 ± 0%       ~ (p=1.000 n=10) ¹
ReadMessage/8MiB/1-4                 6.000 ± 0%   6.000 ± 0%       ~ (p=1.000 n=10) ¹
ReadMessage/16MiB/1-4                6.000 ± 0%   6.000 ± 0%       ~ (p=1.000 n=10) ¹
ReadMessage/1MiB/4-4                 24.00 ± 0%   24.00 ± 0%       ~ (p=1.000 n=10) ¹
ReadMessage/8MiB/4-4                 24.00 ± 0%   24.00 ± 0%       ~ (p=1.000 n=10) ¹
ReadMessage/16MiB/4-4                24.00 ± 0%   24.00 ± 0%       ~ (p=1.000 n=10) ¹
ReadMessage/1MiB/16-4                90.00 ± 0%   90.00 ± 0%       ~ (p=1.000 n=10) ¹
ReadMessage/8MiB/16-4                90.00 ± 0%   90.00 ± 0%       ~ (p=1.000 n=10) ¹
ReadMessage/16MiB/16-4               90.00 ± 0%   90.00 ± 0%       ~ (p=1.000 n=10) ¹
geomean                              14.59        14.59       +0.00%
¹ all samples are equal