Skip to content

AI: Animation in-betweening (ONNX) #409

Description

@fernandotonon

Parent epic: #397

Goal

Fill missing keyframes in sparse animations using Robust Motion In-betweening (Ubisoft, 2020) — a small transformer model that predicts intermediate poses given start/end keyframes and a target duration.

Why

Curve-editor and dope-sheet workflows often leave large gaps between keyframes. Hand-authoring smooth transitions is tedious. Local ML in-betweening is small enough to ship and produces noticeably better results than naive linear/Bezier interpolation.

Scope

Acceptance Criteria

  • Two human-pose keyframes plus a target duration produce smooth, plausible intermediate motion.
  • Visibly better than linear interpolation on a test animation in the test fixtures.
  • Falls back to spline interpolation with a warning when the input skeleton is incompatible.
  • CLI/MCP/GUI parity.
  • Sentry breadcrumb ai.assist.in_between recorded.

Dependencies

Effort

~10 days.

Metadata

Metadata

Assignees

No one assigned

    Labels

    ai-assistLocal-AI-assisted 3D workflows (epic prefix: AI:)enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions