Skip to content

AI: Real-ESRGAN texture upscaling #405

Description

@fernandotonon

Parent epic: #397

Goal

Add 2×/4× texture super-resolution using Real-ESRGAN via the ncnn-Vulkan port (or ONNX as fallback). Useful for upscaling low-resolution imported textures and sd.cpp outputs.

Scope

  • Pick the backend:
    • Preferred: realesrgan-ncnn-vulkan (native C++, cross-platform GPU).
    • Fallback: ONNX Runtime if Vulkan availability is a concern on macOS arm64.
  • CLI: qtmesh material --texture low.png --upscale 4 -o high.png.
  • GUI: Material Editor right-click on a texture slot → "Upscale 2×/4×".
  • MCP: upscale_texture tool.
  • Cache + skip re-upscale of already-upscaled images.

Acceptance Criteria

  • 4× upscale of a 256×256 albedo produces a sharp 1024×1024 image.
  • Works on macOS arm64, Windows MinGW, and Linux CI.
  • Falls back gracefully when the backend is unavailable (clear error, no crash).
  • Sentry breadcrumb ai.assist.upscale recorded.

Effort

~3–4 days.

Metadata

Metadata

Assignees

No one assigned

    Labels

    ai-assistLocal-AI-assisted 3D workflows (epic prefix: AI:)enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions