Difference between revisions of "Template:Linux-RK3399MIPICamera"
(→Linux下使用MIPI摄像头OV13850) |
(updated by API) |
||
(9 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
− | === | + | ===Using Camera on Linux (MIPI Camera OV13850 & OV4689, and webcam logitect C920)=== |
Hardware Setting: | Hardware Setting: | ||
− | The | + | The Camera module can be connected to a MIPI port:<br /> |
{{#switch: {{{1}}} | {{#switch: {{{1}}} | ||
| NanoPC-T4 = | | NanoPC-T4 = | ||
[[File:T4-mipi-single-camera.jpg|frameless|500px]]<br> | [[File:T4-mipi-single-camera.jpg|frameless|500px]]<br> | ||
| NanoPi-M4 = | | NanoPi-M4 = | ||
+ | [[File:M4-mipi-single-camera.jpg|frameless|500px]]<br> | ||
+ | | NanoPi-M4V2 = | ||
+ | [[File:M4-mipi-single-camera.jpg|frameless|500px]]<br> | ||
+ | | NanoPi-M4B = | ||
[[File:M4-mipi-single-camera.jpg|frameless|500px]]<br> | [[File:M4-mipi-single-camera.jpg|frameless|500px]]<br> | ||
| NanoPi-NEO4 = | | NanoPi-NEO4 = | ||
Line 17: | Line 21: | ||
--> | --> | ||
− | FriendlyELEC provides | + | FriendlyELEC provides some scripts use to test a camera's functions. You can run it in a commandline to test picture taking and video recording. <br /> |
+ | You may try update this script to the lastest version by using the following commands: | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
− | + | cd /tmp/ | |
+ | git clone https://github.com/friendlyarm/gst-camera-sh.git | ||
+ | sudo cp gst-camera-sh/*.sh /usr/bin/ | ||
</syntaxhighlight> | </syntaxhighlight> | ||
− | ====gst-camera.sh | + | |
+ | There are three scripts:<br /> | ||
+ | gst-camera.sh: preview, photo and video of a single camera <br /> | ||
+ | dual-camera.sh: preview two cameras <br /> | ||
+ | stop-gst-camera.sh: stop preview<br /> | ||
+ | <br /> | ||
+ | |||
+ | ====Options in "gst-camera.sh"==== | ||
::{| class="wikitable" | ::{| class="wikitable" | ||
|- | |- | ||
− | | | + | |Options || Comment |
|- | |- | ||
− | | -- | + | | --index or -i || Camera's index, it can be either 0 or 1. When two cameras are connected to a board you need to specify 1 to access the second camera. |
|- | |- | ||
− | | -- | + | | --action or -a || Specify an action, it can be "preview" to preview, "photo" to take a picture or "video" to record video |
|- | |- | ||
− | | -- | + | | --output or -o || Specify an output file to save a picture when taking a picture or video file when recording video |
|- | |- | ||
− | | -- | + | | --verbose or -v || If it is specified as "yes" it will output the complete command when "gst-launch-1.0" is called |
|- | |- | ||
− | | | + | | -x || Using the rkximagesink plugin, the preview image will be output to the X11 window for the FriendlyDesktop and Lubuntu systems |
+ | |- | ||
+ | | -g || Using the glimagesink plugin, the preview image will be output to the X11 window for the FriendlyDesktop and Lubuntu systems | ||
+ | |- | ||
+ | | -k || Using the kmssink plugin, the preview image will be output directly to the screen for the FriendlyCore system | ||
|} | |} | ||
− | ====gst-camera.sh | + | The script gst-camera.sh will automatically recognize OV13850, OV4689 and C920 camera, and then pass the appropriate parameters to gst-launch-1.0. |
− | * ''' | + | |
+ | ====Usage of gst-camera.sh==== | ||
+ | * '''Preview''' | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
gst-camera.sh --action preview | gst-camera.sh --action preview | ||
</syntaxhighlight> | </syntaxhighlight> | ||
− | * ''' | + | * '''Picture Taking''' |
− | + | You can run the following command to take a picture and save it as a "1.jpg" file, | |
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
− | gst-camera.sh - | + | gst-camera.sh -a photo -o 1.jpg |
</syntaxhighlight> | </syntaxhighlight> | ||
− | * ''' | + | |
− | + | * '''Preview and Record''' | |
+ | You can run the following command to record video and save your video to a "1.ts" file. Hardware encoding is activated when it is recording video. | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
gst-camera.sh --action video -output 1.ts | gst-camera.sh --action video -output 1.ts | ||
</syntaxhighlight> | </syntaxhighlight> | ||
<br /> | <br /> | ||
− | * ''' | + | * '''Show Complete Command''' |
− | + | If you add the "--verbose yes" option it will show a complete gsteamer command. | |
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
gst-camera.sh --action video --output 1.ts --verbose yes | gst-camera.sh --action video --output 1.ts --verbose yes | ||
</syntaxhighlight> | </syntaxhighlight> | ||
− | + | Here is the complete gsteamer command you will see: | |
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
− | gst-launch-1.0 rkisp num-buffers=512 io-mode= | + | gst-launch-1.0 rkisp num-buffers=512 device=/dev/video0 io-mode=1 ! \ |
− | + | video/x-raw,format=NV12,width=1280,height=720,framerate=30/1 ! \ | |
− | + | mpph264enc ! queue ! h264parse ! mpegtsmux ! \ | |
− | + | filesink location=/tmp/camera-record.ts | |
</syntaxhighlight> | </syntaxhighlight> | ||
+ | |||
+ | * '''Preview dual camera''' | ||
+ | Connect two mipi cameras, or one mipi camera and one usb camera (tested only: Logitech C920 pro), call the following command: | ||
+ | <syntaxhighlight lang="bash"> | ||
+ | dual-camera.sh | ||
+ | </syntaxhighlight> | ||
+ | Note: It is recommended to test this on FriendlyDesktop. | ||
+ | |||
+ | ====gst-launch-1.0 parameter description==== | ||
+ | Preview camera on FriendlyDesktop: | ||
+ | <syntaxhighlight lang="bash"> | ||
+ | gst-launch-1.0 rkisp device=/dev/video1 io-mode=4 ! video/x-raw,format=NV12,width=1280,height=720,framerate=30/1 ! rkximagesink | ||
+ | </syntaxhighlight> | ||
+ | Important parameters | ||
+ | ::{| class="wikitable" | ||
+ | |- | ||
+ | |parameter || description | ||
+ | |- | ||
+ | | device || preview device(selfpath): /dev/video1 and /dev/video5, picture device(mainpath): /dev/video0 and /dev/video4, webcam device: /dev/video8 | ||
+ | |- | ||
+ | | io-mode || 1: memory map, 4:dmabuf | ||
+ | |- | ||
+ | | rkximagesink/glimagesink/kmssink || rkximagesink for FriendlyDesktop, kmssink for FriendlyCore, glimagesink for webcam on FriendlyDesktop | ||
+ | |} | ||
+ | |||
+ | ====Access the camera in OpenCV==== | ||
+ | MIPI camera: | ||
+ | <syntaxhighlight lang="python"> | ||
+ | cv.VideoCapture('rkisp device=/dev/video1 io-mode=4 ! video/x-raw,format=NV12,width=640,height=480,framerate=30/1 ! videoconvert ! appsink', cv.CAP_GSTREAMER) | ||
+ | </syntaxhighlight> | ||
+ | USB camera: | ||
+ | <syntaxhighlight lang="python"> | ||
+ | cv.VideoCapture('rkisp device=/dev/video8 io-mode=4 ! videoconvert ! video/x-raw,format=NV12,width=640,height=480,framerate=30/1 ! videoconvert ! appsink', cv.CAP_GSTREAMER) | ||
+ | </syntaxhighlight> | ||
+ | <br /> | ||
+ | Please refer to the sample code here for details:https://github.com/friendlyarm/install-opencv-on-friendlycore/tree/rk3399/examples<br /> | ||
+ | <br /> | ||
+ | |||
+ | ====Camera application tutorial: Push video stream==== | ||
+ | Please refre this guide: [[How to setup RTMP server on NanoPC-T4]]<br /> | ||
+ | |||
+ | ====Reference resource==== | ||
+ | http://blog.iotwrt.com/media/2017/10/01/camera/ | ||
+ | http://www.360doc.com/content/16/1019/17/496343_599664458.shtml |
Latest revision as of 06:35, 27 November 2019
Contents
1 Using Camera on Linux (MIPI Camera OV13850 & OV4689, and webcam logitect C920)
Hardware Setting:
The Camera module can be connected to a MIPI port:
FriendlyELEC provides some scripts use to test a camera's functions. You can run it in a commandline to test picture taking and video recording.
You may try update this script to the lastest version by using the following commands:
cd /tmp/ git clone https://github.com/friendlyarm/gst-camera-sh.git sudo cp gst-camera-sh/*.sh /usr/bin/
There are three scripts:
gst-camera.sh: preview, photo and video of a single camera
dual-camera.sh: preview two cameras
stop-gst-camera.sh: stop preview
1.1 Options in "gst-camera.sh"
Options Comment --index or -i Camera's index, it can be either 0 or 1. When two cameras are connected to a board you need to specify 1 to access the second camera. --action or -a Specify an action, it can be "preview" to preview, "photo" to take a picture or "video" to record video --output or -o Specify an output file to save a picture when taking a picture or video file when recording video --verbose or -v If it is specified as "yes" it will output the complete command when "gst-launch-1.0" is called -x Using the rkximagesink plugin, the preview image will be output to the X11 window for the FriendlyDesktop and Lubuntu systems -g Using the glimagesink plugin, the preview image will be output to the X11 window for the FriendlyDesktop and Lubuntu systems -k Using the kmssink plugin, the preview image will be output directly to the screen for the FriendlyCore system
The script gst-camera.sh will automatically recognize OV13850, OV4689 and C920 camera, and then pass the appropriate parameters to gst-launch-1.0.
1.2 Usage of gst-camera.sh
- Preview
gst-camera.sh --action preview
- Picture Taking
You can run the following command to take a picture and save it as a "1.jpg" file,
gst-camera.sh -a photo -o 1.jpg
- Preview and Record
You can run the following command to record video and save your video to a "1.ts" file. Hardware encoding is activated when it is recording video.
gst-camera.sh --action video -output 1.ts
- Show Complete Command
If you add the "--verbose yes" option it will show a complete gsteamer command.
gst-camera.sh --action video --output 1.ts --verbose yes
Here is the complete gsteamer command you will see:
gst-launch-1.0 rkisp num-buffers=512 device=/dev/video0 io-mode=1 ! \ video/x-raw,format=NV12,width=1280,height=720,framerate=30/1 ! \ mpph264enc ! queue ! h264parse ! mpegtsmux ! \ filesink location=/tmp/camera-record.ts
- Preview dual camera
Connect two mipi cameras, or one mipi camera and one usb camera (tested only: Logitech C920 pro), call the following command:
dual-camera.sh
Note: It is recommended to test this on FriendlyDesktop.
1.3 gst-launch-1.0 parameter description
Preview camera on FriendlyDesktop:
gst-launch-1.0 rkisp device=/dev/video1 io-mode=4 ! video/x-raw,format=NV12,width=1280,height=720,framerate=30/1 ! rkximagesink
Important parameters
parameter description device preview device(selfpath): /dev/video1 and /dev/video5, picture device(mainpath): /dev/video0 and /dev/video4, webcam device: /dev/video8 io-mode 1: memory map, 4:dmabuf rkximagesink/glimagesink/kmssink rkximagesink for FriendlyDesktop, kmssink for FriendlyCore, glimagesink for webcam on FriendlyDesktop
1.4 Access the camera in OpenCV
MIPI camera:
cv.VideoCapture('rkisp device=/dev/video1 io-mode=4 ! video/x-raw,format=NV12,width=640,height=480,framerate=30/1 ! videoconvert ! appsink', cv.CAP_GSTREAMER)
USB camera:
cv.VideoCapture('rkisp device=/dev/video8 io-mode=4 ! videoconvert ! video/x-raw,format=NV12,width=640,height=480,framerate=30/1 ! videoconvert ! appsink', cv.CAP_GSTREAMER)
Please refer to the sample code here for details:https://github.com/friendlyarm/install-opencv-on-friendlycore/tree/rk3399/examples
1.5 Camera application tutorial: Push video stream
Please refre this guide: How to setup RTMP server on NanoPC-T4
1.6 Reference resource
http://blog.iotwrt.com/media/2017/10/01/camera/ http://www.360doc.com/content/16/1019/17/496343_599664458.shtml