ffmpeg android decoder problem about performance

The ffplay program meets the needs of playing audio and video.

ffprobe is used to analyze audio and video streaming media data.

ffplay is used to play audio and video and needs to rely on SDL.

ffmpeg is used for audio, video and video format conversion, video cropping, etc.

Task details 4.1 Decoding ffplay on mobile to play audio and videoįrom FFmpeg official source code, you can compile three executable programs, namely ffmpeg, ffplay, ffprobe:

The web client can directly use the video elements to decode the audio and video, and then use the WebGL to render video, and use the video elements to play audio.ģ.

The mobile phone can use the FFmpeg library to decode the video stream, and then use OpenGL to render the video, and use the respective audio interfaces of Android and iOS to play audio.

Android and iOS are regarded as the same issues together, the solution has the following two points: This is built this way because the ABCMouse project needs to be compatible with Android, iOS, and Web.

Because of platform differentiation, there are still visual inconsistencies and inconsistent performance issues. The biggest drawback of the ABCMouse project is that Android, iOS, and web needs to be implemented separately, and the development and maintenance costs are high. There is an afterimage of video components when exiting the scene.The mask component cannot be used to limit the video shape.No other rendering components can be added to the video component.Due to the implementation of the video component provided by the engine, the video component and the game interface are layered, which leads to the following problems: Tencent’s ABCMouse project uses Cocos Creator. There is a trend in China’s educational software to use a game engine for their apps. Their original tutorial has been translated into English for more exposure to this great project.Ĥ.1 ffplay on mobile terminal to play audio and videoĤ.2 JavaScriptB binding video component interface

They shared their work at our Guangzhou salon, and we wanted to share it with you. We have to thank the team at Tencent’s Online Education for this tutorial.

Ffmpeg android decoder problem about performance