feat(synapse-core): add SP-to-SP piece pull functionality#544
Merged
Conversation
Deploying with
|
| Status | Name | Latest Commit | Preview URL | Updated (UTC) |
|---|---|---|---|---|
| ✅ Deployment successful! View logs |
synapse-dev | d416aec | Commit Preview URL Branch Preview URL |
Feb 26 2026, 05:29 AM |
5 tasks
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
c2011f6 to
7af205b
Compare
Collaborator
Author
|
Added a temporary utils/example-sp-fetch-e2e.js testing file to test the sp-sp fetch flow. It stores pieces with one SP, confirms they are parked, then asks the second SP to fetch from the first and confirms they are parked. It's working currently on devnet using FilOzone/foc-devnet#34 👌. |
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
ac3552a to
3c5cdb9
Compare
hugomrdias
force-pushed
the
hugomrdias/move-tests
branch
2 times, most recently
from
0a20df0 to
a231d32
Compare
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
3c5cdb9 to
429c2e3
Compare
rvagg
changed the base branch from
hugomrdias/move-tests
to
hugomrdias/session-key
Collaborator
Author
|
Rebased on top of the latest @hugomrdias stack #571 |
Base automatically changed from
hugomrdias/session-key
to
hugomrdias/payments
January 30, 2026 12:03
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
429c2e3 to
8ec5942
Compare
hugomrdias
force-pushed
the
hugomrdias/move-tests
branch
from
a5f8971 to
d75fb75
Compare
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
8ec5942 to
b6d3479
Compare
rvagg
changed the title
rvagg
commented
Feb 4, 2026
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
2 times, most recently
from
b221f97 to
ff14a1d
Compare
5 tasks
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
ff14a1d to
13ed974
Compare
rvagg
changed the title
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
13ed974 to
2d1a65e
Compare
Collaborator
Author
|
latest fixup in here adds the ability to supply a pre-built |
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
2d1a65e to
caebe09
Compare
Collaborator
Author
|
And another fix, I realised I still had a ton of "fetch" in here. Now all "pull". |
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
2 times, most recently
from
2f8c0ca to
59e576b
Compare
hugomrdias
requested changes
Feb 10, 2026
Member
hugomrdias
left a comment
hugomrdias
left a comment
There was a problem hiding this comment.
im not the biggest fan of this idempotent POST endpoint, left some comment inline.
github-project-automation
Bot
moved this from 🔎 Awaiting review
to ⌨️ In Progress
in FOC
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
59e576b to
63c6170
Compare
Collaborator
Author
|
Force pushed a gnarly rebase, now just one commit on top of master. 🤞 |
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
2 times, most recently
from
2d43c4f to
70fa757
Compare
Collaborator
Author
|
I borked the rebase when I said this was done yesterday, didn't include the fixes I said I'd made! Should be good now though. And #593 is on top of this. They are both now on top of latest master. |
Open
3 tasks
hugomrdias
approved these changes
Feb 25, 2026
Member
hugomrdias
left a comment
hugomrdias
left a comment
There was a problem hiding this comment.
Need rebase besides that all good
Add low-level Pull module for initiating piece pulls from external storage providers to the local SP via Curio's POST /pdp/piece/pull endpoint. Features: - pullPieces: Initiate pull requests with EIP-712 signed authorization - waitForPullStatus: Poll until completion with status callbacks - Support for both existing data sets (signAddPieces) and new data sets (signCreateDataSetAndAddPieces) - Configurable timeout and abort signal support The pull endpoint is idempotent - repeated calls with the same extraData return status updates rather than creating duplicates.
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
70fa757 to
d416aec
Compare
lordshashank
pushed a commit
to lordshashank/synapse-sdk
that referenced
this pull request
Mar 9, 2026
Add low-level Pull module for initiating piece pulls from external storage providers to the local SP via Curio's POST /pdp/piece/pull endpoint. Features: - pullPieces: Initiate pull requests with EIP-712 signed authorisation - waitForPullStatus: Poll until completion with status callbacks - Support for both existing data sets (signAddPieces) and new data sets (signCreateDataSetAndAddPieces) - Configurable timeout and abort signal support The pull endpoint is idempotent - repeated calls with the same extraData return status updates rather than creating duplicates.
1 task
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Ref: filecoin-project/curio#864
Part of #494