Skip to content

chore(pipeline): add metrics for pipeling building timelines#21591

Merged
Maddiaa0 merged 1 commit into
merge-train/spartanfrom
md/further-pipeline-overlapping
Apr 10, 2026
Merged

chore(pipeline): add metrics for pipeling building timelines#21591
Maddiaa0 merged 1 commit into
merge-train/spartanfrom
md/further-pipeline-overlapping

Conversation

@Maddiaa0

@Maddiaa0 Maddiaa0 commented Mar 16, 2026

Copy link
Copy Markdown
Member

Overview

Metrics to keep an eye on checkpoint construction

@Maddiaa0 Maddiaa0 force-pushed the md/update-latency-explorer branch from 3850b5a to 94d5685 Compare March 16, 2026 18:08
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from e636f49 to 3a1ba92 Compare March 16, 2026 18:08
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from 3a1ba92 to 6b3361c Compare March 18, 2026 11:33
@Maddiaa0 Maddiaa0 force-pushed the md/update-latency-explorer branch from 94d5685 to 5c7471a Compare March 18, 2026 11:33
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from 6b3361c to 94cdd36 Compare March 18, 2026 11:59
@Maddiaa0 Maddiaa0 force-pushed the md/update-latency-explorer branch from 5c7471a to 2e68fe2 Compare March 18, 2026 11:59
@Maddiaa0 Maddiaa0 changed the base branch from md/update-latency-explorer to graphite-base/21591 March 19, 2026 22:03
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from 94cdd36 to 6da9164 Compare March 19, 2026 22:19
@Maddiaa0 Maddiaa0 force-pushed the graphite-base/21591 branch from 2e68fe2 to 191d1bb Compare March 19, 2026 22:19
@Maddiaa0 Maddiaa0 changed the base branch from graphite-base/21591 to md/update-latency-explorer March 19, 2026 22:19
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from 6da9164 to dea8538 Compare March 19, 2026 23:57
@Maddiaa0 Maddiaa0 force-pushed the md/update-latency-explorer branch 2 times, most recently from 63f38ed to df9a22b Compare March 20, 2026 13:21
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from dea8538 to 3009e59 Compare March 20, 2026 13:21
@Maddiaa0 Maddiaa0 marked this pull request as ready for review March 30, 2026 14:15

@spalladino spalladino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reading the PR I'm not sure I understand the rationale for this. Why do we need to shorten specifically the last block? If we want to allow more time at the end of the slot for assembling the checkpoint, we can bump the CHECKPOINT_ASSEMBLE_TIME, and reduce the time for all blocks proportionally (or the number of blocks for that matter), so we don't have an edge case when handling the very last block.

Comment thread yarn-project/archiver/src/store/block_store.ts Outdated
Comment thread yarn-project/end-to-end/src/e2e_epochs/epochs_mbps.pipeline.parallel.test.ts Outdated
Comment thread yarn-project/end-to-end/src/e2e_epochs/epochs_mbps.pipeline.parallel.test.ts Outdated
@Maddiaa0 Maddiaa0 changed the base branch from md/update-latency-explorer to graphite-base/21591 April 8, 2026 19:33
@Maddiaa0 Maddiaa0 force-pushed the graphite-base/21591 branch from df9a22b to 59aca30 Compare April 8, 2026 19:33
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from 3009e59 to 942c73e Compare April 8, 2026 19:33
@Maddiaa0 Maddiaa0 force-pushed the graphite-base/21591 branch from 59aca30 to 8fd3bbe Compare April 8, 2026 19:52
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from 942c73e to 25ca323 Compare April 8, 2026 19:52
@Maddiaa0 Maddiaa0 force-pushed the graphite-base/21591 branch from 8fd3bbe to 0c09382 Compare April 8, 2026 20:08
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from 25ca323 to 87abfed Compare April 8, 2026 20:08
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from 87abfed to a21bee9 Compare April 9, 2026 17:00
@Maddiaa0 Maddiaa0 changed the base branch from graphite-base/21591 to merge-train/spartan April 9, 2026 17:00
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch 2 times, most recently from d705812 to 6eba91a Compare April 9, 2026 18:46
@Maddiaa0 Maddiaa0 changed the title chore(pipeline): shorten last block in checkpoint build duration to allow checkpoint construction chore(pipeline): add metrics for pipeling building timelines Apr 9, 2026
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch 2 times, most recently from fe17f27 to 98f8e36 Compare April 9, 2026 19:07

@spalladino spalladino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Just a heads up: if we add a metric to track when the checkpoint is sent to L1, that may overlap with the starting of the next checkpoint if handled by the same proposer.

@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch 4 times, most recently from 06170d8 to ea38e95 Compare April 10, 2026 13:49
@Maddiaa0 Maddiaa0 force-pushed the md/further-pipeline-overlapping branch from ea38e95 to acb2191 Compare April 10, 2026 13:51
@Maddiaa0 Maddiaa0 merged commit a3f7fe9 into merge-train/spartan Apr 10, 2026
13 checks passed
@Maddiaa0 Maddiaa0 deleted the md/further-pipeline-overlapping branch April 10, 2026 14:12
github-merge-queue Bot pushed a commit that referenced this pull request Apr 11, 2026
BEGIN_COMMIT_OVERRIDE
fix(p2p): back off on repeated auth handshake failures (#22435)
chore(pipeline): add metrics for pipeling building timelines (#21591)
fix: no division by zero in sentinel (#22467)
chore(pipelining): update next net  (#22466)
feat(claude): add skill to read gists (#22471)
feat(node): add fee prediction API for upcoming L2 slots (#22116)
fix: lower EXPECTED_BLOCKS_PER_CHECKPOINT for CI stability (#22480)
END_COMMIT_OVERRIDE
critesjosh pushed a commit that referenced this pull request Apr 14, 2026
## Overview

Metrics to keep an eye on checkpoint construction
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants