Rotation issue

[emakovsky]

1. record a video in portrait using native android camcorder (nexus 4)
2. play it using native player. Rotation is correct
3. play it using demo app (SimplePlayerActivity). Video is rotated.

Example of the test video:
https://drive.google.com/file/d/0B9_5dr6in8cWcmlGZlJrSlhHS1U/view?usp=sharing

Metadata of the mp4 contains a property:
Rotation : 90°
but it's ignored by the exo player.

[ojw28]

Hm. This is pretty easy to fix on Lollypop. It actually already rotates the video on Lollypop, the only thing that's still wrong is that the video dimensions aren't also swapped (for 90 and 270 degree).

Pre-Lollypop any fix is going to be more difficult, because MediaExtractor doesn't parse out the video rotation.

[emakovsky]

So let's mark the issue as a bug. Because the behavior is not as expected and it is possible to fix it somehow.

[ryango]

in the mean time you can use mediametadataretriever to get the rotation and a textureview and apply a transform to the texture pretty easily (thanks ojw for the hint)

[abhishekgupta92]

@ojw28 Is it possible to do so by parsing rotation using MediaMetadataRetriever? Would love to stick to SurfaceView as the only advantage that we seem to get from using TextureView would be the right rotation.

[IanDBird]

We're also having issues with this lack of functionality.

[andrejvanderzee]

Same problem here.

[andrejvanderzee]

Any plans on fixing this?

[ryango]

I would argue this is a MediaCodec/libstagefright bug not an ExoPlayer bug as MediaCodec is what's doing the rendering. ExoPlayer is just managing the samples and timing. Also this is evident in the Lollipop libstagefright fix in which it respects the rotation (which screws things up for my use and I had to add this to counteract it)

            MediaFormat format = extractor.getTrackFormat(trackIndex);
            if (format.containsKey("rotation-degrees")) {
                // Decoded video is rotated automatically in Android 5.0 lollipop.
                // refer: https://android.googlesource.com/platform/frameworks/av/+blame/lollipop-release/media/libstagefright/Utils.cpp
                format.setInteger("rotation-degrees", 0);
            }

[IanDBird]

Has anyone seen whether it's still an issue if you're using the MP4 support currently in development? It's currently available on the dev branch here (https://github.com/google/ExoPlayer/blob/dev/demo/src/main/java/com/google/android/exoplayer/demo/player/Mp4RendererBuilder.java#L35). Arguably, that's one of the benefits of adding MP4 support into ExoPlayer rather than relying on the MediaCodec/libstagefright support.

[ojw28]

Pulling the extractor up to ExoPlayer wont fix the issue, because the issue is in the decoder (not being pulled up) not the extractor (being pulled up).

[andrejvanderzee]

So what would be the recommended way to solve this? The TextureView instead of SurfaceView approach like Inikkila kindly posted?

[Ood-Tsen]

Hi @IanDBird @ryango
You may check my quick update parse mp4 rotation degree

"rotation-degrees" is defined in the ACodec, but it's hidden.
we cannot guarantee it still available in the future.

"rotation-degrees" is available in Android 5.0, not for Android KK.