Skip to content

add migration skills - #26

Merged
cosmicBboy merged 5 commits into
mainfrom
evals-harness
Jul 28, 2026
Merged

add migration skills#26
cosmicBboy merged 5 commits into
mainfrom
evals-harness

Conversation

@cosmicBboy

Copy link
Copy Markdown
Collaborator

No description provided.

cosmicBboy and others added 5 commits July 23, 2026 14:42
Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
The plugin directory was renamed plugins/flyte-skills -> plugins/flyte (and the
flyte-mcp-server skill became a bundled MCP server). Update the harness:

- skill path references (spec.py skill_dir_template, evaluate.py, runners/base.py,
  select.py regex, manifest.yaml globs, tests) flyte-skills -> flyte
- drop the flyte-mcp-server static scenario (skill no longer exists)
- refresh branding in README/docstrings

Verified: static lint 14/14, 29 unit tests passing.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
* update flyte-skills to flyte-agent-plugin

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* add Flyte 1 to 2 migration skills + eval coverage

Convert the official Flyte 1->2 migration guide
(union.ai/docs/v2/flyte/user-guide/migration/flyte-2) into 6 agent skills:

- flyte-migrate            start-here orchestrator (concept mapping, the two
                           mechanical changes, strategy, hybrid v1/v2, gotchas)
- flyte-migrate-tasks-workflows   @task/@workflow/@dynamic -> @env.task
- flyte-migrate-config     images/resources/cache/secrets/scheduling + CLI
- flyte-migrate-control-flow   conditional/@dynamic/on_failure/map_task
- flyte-migrate-data-io    FlyteFile/StructuredDataset -> flyte.io.*
- flyte-migrate-ml         ML workloads + new-in-v2 patterns

Each skill carries verbatim before/after code, concept/parameter mapping
tables, and anti-patterns.

Eval harness: add static + trajectory scenarios for all 6 skills (12 total).
Trajectory scenarios feed the agent real v1 flytekit code and assert the
migrated output uses v2 APIs with no leftover v1 constructs. Update both
READMEs with a Migration section.

Verified: static lint 21/21 skills passing, 29 unit tests passing,
select.py correctly scopes migration-skill changes.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

---------

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@cosmicBboy
cosmicBboy merged commit ddfcb46 into main Jul 28, 2026
2 checks passed
@cosmicBboy
cosmicBboy deleted the evals-harness branch July 28, 2026 13:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant