harmony 鸿蒙Using OpenSL ES for Audio Playback

2023-06-24
浏览 (622)

Using OpenSL ES for Audio Playback

OpenSL ES, short for Open Sound Library for Embedded Systems, is an embedded, cross-platform audio processing library that is free of charge. It provides high-performance and low-latency APIs for you to develop applications running on embedded mobile multimedia devices. OpenHarmony have implemented certain native APIs based on OpenSL ES 1.0.1 API specifications developed by the Khronos Group. You can use these APIs through and .

OpenSL ES on OpenHarmony

Currently, OpenHarmony implements parts of OpenSL ES APIs to implement basic audio playback functionalities.

If an API that has not been implemented on OpenHarmony is called, SL_RESULT_FEATURE_UNSUPPORTED is returned.

The following lists the OpenSL ES APIs that have been implemented on OpenHarmony. For details, see the OpenSL ES specifications.

Engine APIs implemented on OpenHarmony
- SLresult (*CreateAudioPlayer) (SLEngineItf self, SLObjectItf * pPlayer, SLDataSource *pAudioSrc, SLDataSink *pAudioSnk, SLuint32 numInterfaces, const SLInterfaceID * pInterfaceIds, const SLboolean * pInterfaceRequired)
- SLresult (*CreateAudioRecorder) (SLEngineItf self, SLObjectItf * pRecorder, SLDataSource *pAudioSrc, SLDataSink *pAudioSnk, SLuint32 numInterfaces, const SLInterfaceID * pInterfaceIds, const SLboolean * pInterfaceRequired)
- SLresult (*CreateOutputMix) (SLEngineItf self, SLObjectItf * pMix, SLuint32 numInterfaces, const SLInterfaceID * pInterfaceIds, const SLboolean * pInterfaceRequired)
Object APIs implemented on OpenHarmony
- SLresult (*Realize) (SLObjectItf self, SLboolean async)
- SLresult (*GetState) (SLObjectItf self, SLuint32 * pState)
- SLresult (*GetInterface) (SLObjectItf self, const SLInterfaceID iid, void * pInterface)
- void (*Destroy) (SLObjectItf self)
Playback APIs implemented on OpenHarmony
- SLresult (*SetPlayState) (SLPlayItf self, SLuint32 state)
- SLresult (*GetPlayState) (SLPlayItf self, SLuint32 *pState)
Volume control APIs implemented on OpenHarmony
- SLresult (*SetVolumeLevel) (SLVolumeItf self, SLmillibel level)
- SLresult (*GetVolumeLevel) (SLVolumeItf self, SLmillibel *pLevel)
- SLresult (*GetMaxVolumeLevel) (SLVolumeItf self, SLmillibel *pMaxLevel)
BufferQueue APIs implemented on OpenHarmony

The APIs listed below can be used only after is introduced. |API|Description| |——–|——–| |SLresult (*Enqueue) (SLOHBufferQueueItf self, const void *buffer, SLuint32 size)|Adds a buffer to the corresponding queue.
For an audio playback operation, this API adds the buffer with audio data to the filledBufferQ_ queue. For an audio recording operation, this API adds the idle buffer after recording data storage to the freeBufferQ_ queue.
The self parameter indicates the BufferQueue object that calls this API.
The buffer parameter indicates the pointer to the buffer with audio data or the pointer to the idle buffer after the recording data is stored.
The size parameter indicates the size of the buffer.| |SLresult (*Clear) (SLOHBufferQueueItf self)|Releases a BufferQueue object.
The self parameter indicates the BufferQueue object that calls this API.| |SLresult (*GetState) (SLOHBufferQueueItf self, SLOHBufferQueueState *state)|Obtains the state of a BufferQueue object.
The self parameter indicates the BufferQueue object that calls this API.
The state parameter indicates the pointer to the state of the BufferQueue object.| |SLresult (*RegisterCallback) (SLOHBufferQueueItf self, SlOHBufferQueueCallback callback, void* pContext)|Registers a callback.
The self parameter indicates the BufferQueue object that calls this API.
The callback parameter indicates the callback to be registered for the audio playback or recording operation.
The pContext parameter indicates the pointer to the audio file to be played for an audio playback operation or the pointer to the audio file to be recorded for an audio recording operation.| |SLresult (*GetBuffer) (SLOHBufferQueueItf self, SLuint8** buffer, SLuint32* size)|Obtains a buffer.
For an audio playback operation, this API obtains an idle buffer from the freeBufferQ_ queue. For an audio recording operation, this API obtains the buffer that carries recording data from the filledBufferQ_ queue.
The self parameter indicates the BufferQueue object that calls this API.
The buffer parameter indicates the double pointer to the idle buffer or the buffer carrying recording data.
The size parameter indicates the size of the buffer.|

Sample Code

Refer to the sample code below to play an audio file.

Add the header files.

   #include <OpenSLES.h>
   #include <OpenSLES_OpenHarmony.h>
   #include <OpenSLES_Platform.h>

Use the slCreateEngine API to obtain an engine instance.

   SLObjectItf engineObject = nullptr;
   slCreateEngine(&engineObject, 0, nullptr, 0, nullptr, nullptr);
   (*engineObject)->Realize(engineObject, SL_BOOLEAN_FALSE);

Obtain the engineEngine instance of the SL_IID_ENGINE API.

   SLEngineItf engineEngine = nullptr;
   (*engineObject)->GetInterface(engineObject, SL_IID_ENGINE, &engineEngine);

Configure the player and create an AudioPlayer instance.

   SLDataLocator_BufferQueue slBufferQueue = {
       SL_DATALOCATOR_BUFFERQUEUE,
       0
   };
   
   // Configure the parameters based on the audio file format.
   SLDataFormat_PCM pcmFormat = {
       SL_DATAFORMAT_PCM,
       2,                           // Number of channels.
       SL_SAMPLINGRATE_48,          // Sampling rate.
       SL_PCMSAMPLEFORMAT_FIXED_16, // Audio sample format.
       0,
       0,
       0
   };
   SLDataSource slSource = {&slBufferQueue, &pcmFormat};
   SLObjectItf pcmPlayerObject = nullptr;
   (*engineEngine)->CreateAudioPlayer(engineEngine, &pcmPlayerObject, &slSource, nullptr, 0, nullptr, nullptr);
   (*pcmPlayerObject)->Realize(pcmPlayerObject, SL_BOOLEAN_FALSE);

Obtain the bufferQueueItf instance of the SL_IID_OH_BUFFERQUEUE API.

   SLOHBufferQueueItf bufferQueueItf;
   (*pcmPlayerObject)->GetInterface(pcmPlayerObject, SL_IID_OH_BUFFERQUEUE, &bufferQueueItf);

Open an audio file and register the BufferQueueCallback function.

   static void BufferQueueCallback (SLOHBufferQueueItf bufferQueueItf, void *pContext, SLuint32 size)
   {
       SLuint8 *buffer = nullptr;
       SLuint32 pSize;
       (*bufferQueueItf)->GetBuffer(bufferQueueItf, &buffer, &pSize);
       // Write the audio data to be played to the buffer.
       (*bufferQueueItf)->Enqueue(bufferQueueItf, buffer, size);
   }
   void *pContext; // This callback can be used to obtain the custom context information passed in.
   (*bufferQueueItf)->RegisterCallback(bufferQueueItf, BufferQueueCallback, pContext);

Obtain the playItf instance of the SL_PLAYSTATE_PLAYING API and start playing.

   SLPlayItf playItf = nullptr;
   (*pcmPlayerObject)->GetInterface(pcmPlayerObject, SL_IID_PLAY, &playItf);
   (*playItf)->SetPlayState(playItf, SL_PLAYSTATE_PLAYING);

Stop playing.

   (*playItf)->SetPlayState(playItf, SL_PLAYSTATE_STOPPED);
   (*pcmPlayerObject)->Destroy(pcmPlayerObject);
   (*engineObject)->Destroy(engineObject);