Skip to content

Expose additional information about decoded frames in the viewer#7932

Merged
Wumpf merged 7 commits intomainfrom
andreas/additional-frame-information
Oct 30, 2024
Merged

Expose additional information about decoded frames in the viewer#7932
Wumpf merged 7 commits intomainfrom
andreas/additional-frame-information

Conversation

@Wumpf
Copy link
Member

@Wumpf Wumpf commented Oct 29, 2024

What

image

Minimized by default.

Originally, I wanted to add some more information from the get-go like i/idr/p/b-frame type but turns out we don't really have all that much information around today for sure - a big part of this is that typically just pass in chunks to decoder and get 0-1 frames out for each chunk (my current understand is that it could be 0-n, but n>1 typically doesn't make sense because a single mp4 sample has a single timestamp!). Meaning we typically don't maintain the chunk/frame relationship.
However, this adjusted structure should make it easy to expose optional fields on FrameInfo to forward all sort of things

Checklist

  • I have read and agree to Contributor Guide and the Code of Conduct
  • I've included a screenshot or gif (if applicable)
  • I have tested the web demo (if applicable):
  • The PR title and labels are set such as to maximize their usefulness for the next release's CHANGELOG
  • If applicable, add a new check to the release checklist!
  • If have noted any breaking changes to the log API in CHANGELOG.md and the migration guide

To run all checks from main, comment on the PR with @rerun-bot full-check.

@Wumpf Wumpf added 📺 re_viewer affects re_viewer itself include in changelog feat-video anything video decoding, player, querying, data modelling of videos etc. labels Oct 29, 2024
@emilk emilk self-requested a review October 30, 2024 08:09
Copy link
Member

@emilk emilk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great!

time_range: _, // TODO(emilk): maybe add to `PickableTexturedRect` and `PickingHitType::TexturedRect` so we can show on hover?
is_pending,
show_spinner,
frame_info: _, // TODO(emilk): maybe add to `PickableTexturedRect` and `PickingHitType::TexturedRect` so we can show on hover?
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, this would be nice! :)

@Wumpf Wumpf merged commit 413f7a1 into main Oct 30, 2024
@Wumpf Wumpf deleted the andreas/additional-frame-information branch October 30, 2024 10:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feat-video anything video decoding, player, querying, data modelling of videos etc. include in changelog 📺 re_viewer affects re_viewer itself

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants