Skip to content

perf(orchestrator): parallelize cloud-init secret creation#137

Merged
mrhillsman merged 1 commit into
mainfrom
parallelize-cloudinit-secret-creation
May 30, 2026
Merged

perf(orchestrator): parallelize cloud-init secret creation#137
mrhillsman merged 1 commit into
mainfrom
parallelize-cloudinit-secret-creation

Conversation

@mrhillsman

Copy link
Copy Markdown
Contributor

Use errgroup with a concurrency limit of 10 to create cloud-init secrets in parallel instead of sequentially. This removes the bottleneck before the concurrent VM creation phase when running with many VMs (e.g., --vm-count 50 across multiple workloads).

Resolves #126

@exe-prow-github-app
exe-prow-github-app Bot requested a review from OchiengEd May 30, 2026 02:19
@exe-prow-github-app

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: mrhillsman

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@exe-prow-github-app exe-prow-github-app Bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label May 30, 2026
@mrhillsman
mrhillsman removed the request for review from OchiengEd May 30, 2026 02:19
Use errgroup with a concurrency limit of 10 to create cloud-init
secrets in parallel instead of sequentially. This removes the
bottleneck before the concurrent VM creation phase when running
with many VMs (e.g., --vm-count 50 across multiple workloads).

Resolves #126

Signed-off-by: Melvin Hillsman <mhillsma@redhat.com>
@mrhillsman
mrhillsman force-pushed the parallelize-cloudinit-secret-creation branch from 575c060 to 42a05db Compare May 30, 2026 02:47
@mrhillsman
mrhillsman merged commit 5ea0b02 into main May 30, 2026
3 of 4 checks passed
@mrhillsman
mrhillsman deleted the parallelize-cloudinit-secret-creation branch May 30, 2026 05:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Tech Debt]: Cloud-init secret creation is sequential

1 participant