Skip to content

source-marketo: limit which streams are enabled after discovery#337

Merged
Alex-Bair merged 1 commit intomasterfrom
bair/source-marketo-conditionally-discover-bindings-as-disabled
Aug 8, 2025
Merged

source-marketo: limit which streams are enabled after discovery#337
Alex-Bair merged 1 commit intomasterfrom
bair/source-marketo-conditionally-discover-bindings-as-disabled

Conversation

@Alex-Bair
Copy link
Member

@Alex-Bair Alex-Bair commented Aug 8, 2025

We've observed issues with the conditional discovery logic for all the activity_foobar bindings. It's not reliable, so sometimes these bindings are discovered and sometimes they aren't. If these bindings disappear when they were disabled then are re-discovered later as enabled, that could blow up certain API limits. To avoid that, I'm choosing to only enable the bindings that are consistently discovered, and the remaining conditionally discovered bindings are disabled.

Tested on a local stack and confirmed that all the activity_foobar bindings are discovered as disabled.

We've observed issues with the the conditional discovery logic for all
the `activity_foobar` bindings. It's not reliable, so sometimes these
bindings are discovered and sometimes they aren't. If these bindings
disappear when they were disabled then are re-discovered later
as enabled, that could blow up certain API limits. To avoid that, I'm
choosing to only enable the bindings that are consistently discovered,
and the remaining conditionally discovered bindings are disabled.
@Alex-Bair Alex-Bair requested a review from psFried August 8, 2025 16:09
Copy link
Member

@psFried psFried left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Alex-Bair Alex-Bair merged commit 5adeef7 into master Aug 8, 2025
46 of 57 checks passed
@Alex-Bair Alex-Bair deleted the bair/source-marketo-conditionally-discover-bindings-as-disabled branch August 8, 2025 17:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants