remove items from queue if they error x amount of times

[danstarns]

When an error happens in the ingest span queues, it just keeps retrying. TODO @danstarns to populate this more.

[iamYashSinha]

What should be expected here? Which code file is responsible for this, how one can recreate this issue?

[danstarns]

Hey @iamYashSinha thanks for taking a look.

It looks like for foreign spans(spans that aren't generated from GraphQL debugger trace schema) we try 10 times then stop processing the span

• https://github.com/rocket-connect/graphql-debugger/blob/main/apps/collector-proxy/src/workers/foreign-traces.ts#L46

However, for normal spans, located here:

• https://github.com/rocket-connect/graphql-debugger/blob/main/apps/collector-proxy/src/workers/post-traces.ts#L13

We don't have any retry logic.

We should check that:

1. undigestable spans don't block the queue
2. all failing spans are retried a few times before being ingested

Cheers.

[iamYashSinha]

Please assign me this issue 👍