Support built-in camera microphone

[JosephXu2]

@ernestp When calling the UVC device's photo and video recording APIs without using system API calls, an error occurs: the local library "libUACAudio.so" is not found.Could you please tell me where to add "libUACAudio.so" locally, or is it missing?
java.lang.UnsatisfiedLinkError: dlopen failed: library "libUACAudio.so" not found
at java.lang.Runtime.loadLibrary0(Runtime.java:1090)
at java.lang.Runtime.loadLibrary0(Runtime.java:1012)
at java.lang.System.loadLibrary(System.java:1765)
at com.jiangdg.uac.UACAudio.(UACAudio.java:26)
at com.jiangdg.uac.UACAudioHandler$AudioThread.handleInitAudioRecord(UACAudioHandler.java:179)
at com.jiangdg.uac.UACAudioHandler.handleMessage(UACAudioHandler.java:129)
at android.os.Handler.dispatchMessage(Handler.java:110)
at android.os.Looper.loopOnce(Looper.java:248)
at android.os.Looper.loop(Looper.java:338)
at com.jiangdg.uac.UACAudioHandler$AudioThread.run(UACAudioHandler.java:308)

[ernestp]

Hi,

It seems neither this repo or original repo contains this library, you may need to compile and add it to your project yourself.

See also jiangdongguo/AndroidUSBCamera#494

[JosephXu2]

@ernestp if you have it locally, could you provide it?

[ernestp]

@JosephXu2 Sorry, I don't have it and even cannot find sources anywhere in Internet.

My suggestion would be to implement audio recording in Kotlin/Java and mux it into resulting video.

[JosephXu2]

@ernestp This means it uses the system's default microphone for recording. But does replacing the original UVC camera's built-in microphone mean it lacks this .so library? It just uses the system default.

[ernestp]

@JosephXu2 Can you share your camera datasheet or product page?

Does microphone recognized by Android out of the box?

[JosephXu2]

@ernestp On Android devices with version 16 (SDK36), the AudioStrategySystem and DemoFragment interfaces automatically recognize UVC cameras and record audio normally because they follow the system defaults. However, in the DemoMultiCameraFragment, which is specifically designed for UVC devices and uses the AudioStrategyUAC method, the built-in microphone does not work.

[JosephXu2]

@ernestp HD 720P, preferably compatible with most commonly used UVC camera external cameras on the market, rather than being specific to any particular model.

[JosephXu2]

@ernestp Currently, recording audio using the system's default microphone (phone or tablet, etc.) works fine. However, when using the built-in microphone of the UVC device written by the author, it throws an error indicating a missing "libUACAudio.so" file. My requirement is to use the built-in microphone of the external SUVCamera device, for peripheral use, not the phone's default microphone.

[ernestp]

@JosephXu2 I have dozen of different USB camera modules, but none of them has microphone. I might try some WebCam though.

Do I get it right that for your use case you need to use more than one camera and more than one microphone?

And I don't get the answer for the question:

Does camera microphone recognized by Android out of the box, as it does for audio headset?

[JosephXu2]

@ernestp Yes, the same applies. If my device can record normally when connected to an external wired headset, it means it's using the headset's built-in microphone. In that case, the external UVC can use the built-in microphone normally. This is because the author wrote that libUACAudio.so is missing, which is why I can't verify it now.

[JosephXu2]

@ernestp My use case only requires one external camera. If necessary, I can disable the multi-management function. I only need one. However, the author's project already has multi-management functionality, so the more comprehensive the better. If it does, I'll add it. If not, a UVC camera in the main preview interface is sufficient. But I still need to use the built-in microphone of the external UVC camera for recording, not the system default one.

[JosephXu2]

@ernestp My use case doesn't require multiple cameras and microphones, but since the author has this feature, I think adding it would be better. My understanding is that the author manages the external UVC Cameras in a list for each one, preventing confusion. Position 0 belongs to the first UVC Camera, position 1 belongs to the second UVC Camera, and they can each work independently to take photos, record videos, or record audio. Am I correct in my understanding?

[ernestp]

Agreed, would be nice if someone prepare pull request for this feature, reopen the issue