Usb camera android (isochronous transfer)

Question

0.00/5 (No votes)

See more:

Hello,

because of the fact of certain chipsets on Android does not support Isochronous transfer for usb camera streaming, I want to try a different way over a selfcompiled app. This app should use it's access to the camera over JNA to get the video stream running.

You can see my project on github:

GitHub - Peter-St/UVC_camera_usb_iso[^]

The first thing was to correctly link the JNA.jar to the program. I solved this by downloading the jna.jar from jna/dist at master · java-native-access/jna · GitHub[^] and linked it with the correct *.so library to the project. Next part is to study the app to get the video stream running

Regards,

Peter

What I have tried:

In my project I'm using the usbiso.java code which can be found: UsbIso - USB isochronous transfer controller (Java class for Android / Linux)[^]
The rest of the project runns over the main.java code.

Posted 7-Jan-18 6:55am

Peter____

Updated 19-Jan-18 17:16pm

v2

Add a Solution

Comments

David Crow 7-Jan-18 21:51pm

"...but the app always crashes with a java class error."

And that error would be what exactly?

David Crow 16-Jan-18 16:16pm

Logcat messages aside, which most of them are system messages, what exactly is the problem? All I see in your code is the creation of a UsbIso object, followed by calling its preallocateRequests() and getRequest() methods. Are those not working? Is an exception being thrown?

Peter____ 19-Jan-18 6:06am

With my microdia Camera I'll get the following error:

E/UsbCamTest1: Error in MainActivity
java.lang.Exception: Unable to claim camera control interface.
at humer.uvc_camera.Main.openCameraDevice(Main.java:318)
at humer.uvc_camera.Main.openCam(Main.java:200)
at humer.uvc_camera.Main.openCamButtonClickEvent(Main.java:191)
at java.lang.reflect.Method.invokeNative(Native Method)
at java.lang.reflect.Method.invoke(Method.java:511)
at android.view.View$1.onClick(View.java:3058)
at android.view.View.performClick(View.java:3534)
at android.view.View$PerformClick.run(View.java:14263)
at android.os.Handler.handleCallback(Handler.java:605)
at android.os.Handler.dispatchMessage(Handler.java:92)
at android.os.Looper.loop(Looper.java:137)
at android.app.ActivityThread.main(ActivityThread.java:4441)
at java.lang.reflect.Method.invokeNative(Native Method)
at java.lang.reflect.Method.invoke(Method.java:511)
at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java)
at de.robv.android.xposed.XposedBridge.main(XposedBridge.java:132)
at dalvik.system.NativeStart.main(Native Method)

Peter____ 19-Jan-18 6:07am

With my arcmicro camera i receive following logcat:

D/libEGL: loaded /system/lib/egl/libEGL_mali.so
D/libEGL: loaded /system/lib/egl/libGLESv1_CM_mali.so
D/libEGL: loaded /system/lib/egl/libGLESv2_mali.so
D/OpenGLRenderer: Enabling debug mode 0
I/UsbCamTest1: USB devices count = 1
I/UsbCamTest1: USB device "/dev/bus/usb/001/025": UsbDevice[mName=/dev/bus/usb/001/025,mVendorId=6380,mProductId=13200,mClass=239,mSubclass=2,mProtocol=1,mInterfaces=[Landroid.os.Parcelable;@41e025f8]
I/UsbCamTest1: USB devices count = 1
I/UsbCamTest1: USB device "/dev/bus/usb/001/025": UsbDevice[mName=/dev/bus/usb/001/025,mVendorId=6380,mProductId=13200,mClass=239,mSubclass=2,mProtocol=1,mInterfaces=[Landroid.os.Parcelable;@41e05318]
I/UsbCamTest1: USB devices count = 1
I/UsbCamTest1: USB device "/dev/bus/usb/001/025": UsbDevice[mName=/dev/bus/usb/001/025,mVendorId=6380,mProductId=13200,mClass=239,mSubclass=2,mProtocol=1,mInterfaces=[Landroid.os.Parcelable;@41e0a258]
D/dalvikvm: Trying to load lib /data/data/humer.uvc_camera/lib/libjnidispatch.so 0x41dcf1a8
D/dalvikvm: Added shared lib /data/data/humer.uvc_camera/lib/libjnidispatch.so 0x41dcf1a8
I/UsbCamTest1: Warning: getVideoStreamErrorCode() failed: java.lang.Exception: VS_STREAM_ERROR_CODE_CONTROL failed, len=-1.
I/UsbCamTest1: Initial streaming parms: hint=0x0 format=1 frame=1 frameInterval=2000000 keyFrameRate=0 pFrameRate=0 compQuality=0 compWindowSize=0 delay=0 maxVideoFrameSize=0 maxPayloadTransferSize=0
I/UsbCamTest1: Probed streaming parms: hint=0x0 format=1 frame=1 frameInterval=2000000 keyFrameRate=0 pFrameRate=0 compQuality=0 compWindowSize=0 delay=0 maxVideoFrameSize=614400 maxPayloadTransferSize=3000
I/UsbCamTest1: Final streaming parms: hint=0x0 format=1 frame=1 frameInterval=2000000 keyFrameRate=0 pFrameRate=0 compQuality=0 compWindowSize=0 delay=0 maxVideoFrameSize=614400 maxPayloadTransferSize=3000

Here were no Error messages, but the app only shows a blanc white screen. The question would be, how to get the videostream running?

Thanks in advance,

Peter

Peter____ 19-Jan-18 6:17am

The whole android studio project is on my github repo:

https://github.com/Peter-St/UVC_camera_usb_iso

Peter____ 19-Jan-18 12:32pm

I think I'm missing the correct values for a part of my Main.java to get the stream running:

case arkmicro:
camStreamingAltSetting = 11;
maxPacketSize = 3 * 1000;
camFormatIndex = 1;
camFrameIndex = 1;
camFrameInterval = 2000000;
packetsPerRequest = 40;
activeUrbs = 8;
break;

These values i read out with the command "lsusb -v -d xxxx:xxxx" wich are part of the video stream. With different values of the variables: "packetsPerRequest" and "activeUrbs" I recieve different error messages("No Space left on Device", "Allocation size must be greater than zero" and "Out of memory"). If I leave this variables away, I'll get no error, but also no video stream.

David Crow 19-Jan-18 15:59pm

Have you considered asking the author of the UsbIso class, Christian d'Heureuse?

Peter____ 19-Jan-18 22:54pm

yes, he told me, that the 2 variables were important for the webcamstream. An other suggestion would be to look through the source code (log statements) to understand the process flow of the app. I'm currentl trying it out.
Interesting here is, that with 2 different devices, which I tested the program, gets two different errorcodes: One of them is the no space left on device error, which this device also gets through the normal way over JNI when connecting to a webcam.
Next thing would be to get the program working on the two cameras, which I'm going to use on a microscope to get pictures of the recording.
If it helps, I can also post the output of my two cameras to understand the processflow (lsusb -v -d xxxx:xxxx).

So far,

Peter

Peter____ 2-Feb-18 8:01am

Update:

I solved to get the first frames from the camera. And with it comes some new trouble. The frames I receive were too small (first: 10436 byte, second: 21848 byte, third: 21848 byte, and the next ones are much smaller ... ~ 4000 bytes.) For a working stream the frames should be 38400 bytes large (resolution = 160 x 120).
Next steps would be to enlarge the framesize by faster ratio reception --> lower PacketSize, maxPacketSize and more packetsPerRequest.

Peter

Peter____ 2-Feb-18 8:03am

Received Frames:

D/dalvikvm: GC_CONCURRENT freed 440K, 18% free 3500K/4231K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 412K, 17% free 3516K/4231K, paused 1ms+2ms
D/dalvikvm: GC_CONCURRENT freed 483K, 19% free 3513K/4295K, paused 1ms+3ms
D/dalvikvm: GC_CONCURRENT freed 464K, 18% free 3533K/4295K, paused 2ms+1ms
D/dalvikvm: GC_CONCURRENT freed 471K, 19% free 3521K/4295K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 446K, 18% free 3538K/4295K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 440K, 18% free 3540K/4295K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 447K, 18% free 3540K/4295K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 429K, 18% free 3563K/4295K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 441K, 18% free 3546K/4295K, paused 1ms+2ms
D/dalvikvm: GC_CONCURRENT freed 422K, 18% free 3554K/4295K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 438K, 18% free 3553K/4295K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 439K, 18% free 3552K/4295K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 402K, 17% free 3567K/4295K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 395K, 17% free 3573K/4295K, paused 1ms+2ms
D/dalvikvm: GC_CONCURRENT freed 471K, 19% free 3574K/4359K, paused 1ms+1ms
D/dalvikvm: GC_CONCURRENT freed 447K, 18% free 3593K/4359K, paused 1ms+1ms
I/UsbCamTest1: requests=317 packetCnt=317 packetErrorCnt=0 packet0Cnt=5, packet12Cnt=0, packetDataCnt=312 packetHdr8cCnt=123 frameCnt=57
I/UsbCamTest1: 1/0 len=1280 data=0c 8c 00 00 00 00 9c 1e 4b 4b 31 05 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 2/0 len=1280 data=0c 8c 00 00 00 00 0c d5 66 4b 3f 06 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 3/0 len=1280 data=0c 8c 00 00 00 00 35 ea 6f 4b 97 06 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 4/0 len=1280 data=0c 8c 00 00 00 00 8e 27 78 4b e7 06 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 9/0 len=1280 data=0c 8c 00 00 00 00 df 37 81 4b 3f 07 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 10/0 len=1280 data=0c 8c 00 00 00 00 a5 00 ca 4b 01 02 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 11/0 len=1280 data=0c 8c 00 00 00 00 ba 7e cf 4b 37 02 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 12/0 len=1280 data=0c 8c 00 00 00 00 02 be e5 4b 0f 03 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 13/0 len=304 data=0c 8e 00 00 00 00 1f a3 fd 4b f7 03 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 EOF frameLen=10436
I/UsbCamTest1: 14/0 len=1280 data=0c 8d 70 0f 13 4c 8d 0f 13 4c c7 04 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 15/0 len=1280 data=0c 8d 70 0f 13 4c 21 d2 26 4c 87 05 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 16/0 len=1280 data=0c 8d 70 0f 13 4c 65 9c 3a 4c 47 06 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 17/0 len=1280 data=0c 8d 70 0f 13 4c d3 62 4e 4c 07 07 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 18/0 len=1280 data=0c 8d 70 0f 13 4c f6 47 66 4c ef 07 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80 10 80
I/UsbCamTest1: 19/0 len=1280 data=0c 8d 70 0f 13 4c 6d 99 93 4c a7 01 01 7d 00 7e 01 7e 01 7e 02 7b 02 7f 02 7b 01 7f 01 7d 01 7f
I/UsbCamTest1: 20/0 len=1280 data=0c 8d 70 0f 13 4c 60 ca ae 4c af 02 01 7c 00 7f 00 7c 00 7e 00 7c 00 7e 00 7c 01 7f 00 7b 00 7d
I/UsbCamTest1: 21/0 len=1280 data=0c 8d 70 0f 13 4c a9 65 d1 4c ff 03 02 79 02 7c 02 7a 01 7e 00 7b 01 7d 02 7a 02 7d 02 7a 01 7d
I/UsbCamTest1: 22/0 len=1280 data=0c 8d 70 0f 13 4c 22 88 f1 4c 37 05 02 7a 02 7d 02 78 02 7e 02 7a 01 7d 02 7b 02 7e 02 7a 02 7e
I/UsbCamTest1: 23/0 len=1280 data=0c 8d 70 0f 13 4c 3f 6d 09 4d 1f 06 11 77 11 7e 10 76 0f 7c 0f 78 0f 7e 10 76 0f 7d 0e 77 0e 7f
I/UsbCamTest1: 24/0 len=1280 data=0c 8d 70 0f 13 4c 7c 7f 20 4d ff 06 11 7c 11 84 11 78

Peter____ 4-Feb-18 14:07pm

UPDATE:

By the while I was still able to get some Frames from my camera. The specific thing is, that the device only can submit frames, which were sent by low maxPacketSize. Most cameras support more than one maxPacketSizes to submit the stream and here is a difference in specific Chipsets of the Telephons of MTK and Novathor which only submits a low maxPacketSize. My qualcom devices receives all the maxPacketSizes the camera can send.
Some more Info about Uvc stream can be found here --> http://www.usb.org/developers/docs/devclass_docs/

Also it was easier for the devices to get the frames in MJPEG format that uncompressed YUV.

So far,

Peter

Peter____ 14-Feb-18 13:46pm

So far the MJpeg Stream is working and over the Huffmantable I'm able to receive a JPeg Bitmap, which can be displayed over the Imageview class to the Userinterface.

Next part will be to get a running video. Two possibilities were, ones over the mediaplayer class or directly to for example the VLC. At the moment I'm working on it, but I'm glad for help, how to get a video stream on my existing project.

So far,

Peter

Peter____ 11-Mar-18 13:59pm

Update: The videostream is working now. The stream on newer devices (KitKat) is quite fast and without lag. On older Devices the Videostream also works, but there is a moderate lag on high resolution.

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Peter____ · Accepted Answer · 2019-03-03T21:42:00

Solution 3

New link for the working project:

GitHub - Peter-St/Android-UVC-Camera[^]

Peter

Posted 3-Mar-19 21:42pm

Peter____

Updated 3-Mar-19 21:54pm