Decoding Raw H264 stream in android?

by

I can’t provide any code for this unfortunately, but I’ll do my best to explain it based on how I got it to work.

So here is my overview of how I got raw H.264 encoded video to work using the MediaCodec class.

Using the link above there is an example of getting the decoder setup and how to use it, you will need to set it up for decoding H264 AVC.

The format of H.264 is that it’s made up of NAL Units, each starting with a start prefix of three bytes with the values 0x00, 0x00, 0x01 and each unit has a different type depending on the value of the 4th byte right after these 3 starting bytes. One NAL Unit IS NOT one frame in the video, each frame is made up of a number of NAL Units.

Basically I wrote a method that finds each individual unit and passes it to the decoder (one NAL Unit being the starting prefix and any bytes there after up until the next starting prefix).

Now if you have the decoder setup for decoding H.264 AVC and have an InputBuffer from the decoder then you are ready to go. You need to fill this InputBuffer with a NAL Unit and pass it back to the decoder and continue doing this for the length of the stream.
But, to make this work I had to pass the decoder a SPS (Sequence Parameter Set) NAL Unit first. This unit has a byte value of 0x67 after the starting prefix (the 4th byte), on some devices the decoder would crash unless it received this Unit first.
Basically until you find this unit, ignore all other NAL Units and keep parsing the stream until you get this unit, then you can pass all other units to the decoder.

Some devices didn’t need the SPS first and some did, but you are better of passing it in first.

Now if you had a surface that you passed to the decoder when you configured it then once it gets enough NAL units for a frame it should display it on the surface.

More Related Contents:

  1. Use FFMPEG on Android [closed]
  2. FFmpeg on Android
  3. ffmpeg for a android (using tutorial: “ffmpeg and Android.mk”)
  4. MediaCodec and Camera: colorspaces don’t match
  5. Fast Video Compression on Android
  6. Video streaming using RTSP: Android
  7. Using FFmpeg with Android-NDK
  8. Encoding H.264 from camera with Android MediaCodec
  9. Play RTSP streaming in an Android application
  10. Adding watermark bitmap over video in android: 4.3’s MediaMuxer or ffmpeg
  11. How to use MediaCodec without MediaExtractor for H264
  12. How to compile ffmpeg-2.2.2 on windows with cygwin and android ndk r9c
  13. How to reduce latency in MediaCodec video/avc decoding
  14. How to encode Bitmaps into a video using MediaCodec?
  15. RTSP youtube link
  16. Android byte[] to image in Camera.onPreviewFrame
  17. How to get RTSP Links Android
  18. How to change audio tempo and pitch individuality using ffmpeg?
  19. ScrollView Inside ScrollView
  20. Implementations of Emoji (Emoticon) View/Keyboard Layouts
  21. AutoCompleteTextView backed by CursorLoader
  22. Android map v2 zoom to show all the markers
  23. Android – Playing mp3 from byte[]
  24. How to set android layout to support all screen sizes?
  25. Android; Check if file exists without creating a new one
  26. How to add footer to NavigationView – Android support design library?
  27. How to change Toolbar Navigation and Overflow Menu icons (appcompat v7)?
  28. How can I display a dialog from an Android broadcast receiver?
  29. Add Icons to SlidingTabLayout instead of Text
  30. How to open Alert DIalog System level in android

Leave a Comment