攝像頭概述

Qt Multimedia API 提供瞭許多攝像頭相關類,因此可以從移動設備攝像頭 (或網絡攝像頭) 訪問圖像和視頻。常見任務有 C++ 和 QML API 兩者。

攝像頭特徵

為使用攝像頭類,需要快速概述攝像頭工作方式。若已對此很熟悉,可以跳到 攝像頭實現細節 .

鏡頭匯編

At one end of the camera assembly is the lens assembly (one or more lenses, arranged to focus light onto the sensor). The lenses themselves can sometimes be moved to adjust things like focus and zoom, or they might be fixed in an arrangement to give a good balance between objects in focus, and cost.

Some lens assemblies can automatically be adjusted so that an object at different distances from the camera can be kept in focus. This is usually done by measuring how sharp a particular area of the frame is, and by adjusting the lens assembly until it is maximally sharp. In some cases the camera will always use the center of the frame for this. Other cameras may also allow the region to focus to be specified (for "touch to zoom", or "face zoom" features).

傳感器

Once light arrives at the sensor, it gets converted into digital pixels. This process can depend on a number of things but ultimately comes down to two things - how long the conversion is allowed to take, and how bright the light is. The longer a conversion can take, the better the quality. Using a flash can assist with letting more light hit the sensor, allowing it to convert pixels faster, giving better quality for the same amount of time. Conversely, allowing a longer conversion time can let you take photos in darker environments, as long as the camera is steady.

圖像處理

After the image has been captured by the sensor, the camera firmware performs various image processing tasks on it to compensate for various sensor characteristics, current lighting, and desired image properties. Faster sensor pixel conversion times tend to introduce digital noise, so some amount of image processing can be done to remove this based on the camera sensor settings.

The color of the image can also be adjusted at this stage to compensate for different light sources - fluorescent lights and sunlight give very different appearances to the same object, so the image can be adjusted based on the white balance of the picture (due to the different color temperatures of the light sources).

Some forms of "special effects" can also be performed at this stage. Black and white, sepia, or "negative" style images can be produced.

為後世錄製

Finally, once a perfectly focused, exposed and processed image has been created, it can be put to good use. Camera images can be further processed by application code (for example, to detect barcodes, or to stitch together a panoramic image), or saved to a common format like JPEG, or used to create a movie. Many of these tasks have classes to assist them.

攝像頭實現細節

檢測和選擇攝像頭

Before using the camera APIs, you should check that a camera is available at runtime. If there is none, you could for example disable camera related features in your application. To perform this check in C++, use the QCameraInfo::availableCameras () function, as shown in the example below:

bool checkCameraAvailability()
{
    if (QCameraInfo::availableCameras().count() > 0)
        return true;
    else
        return false;
}
					

在 QML,使用 QtMultimedia.availableCameras 特性:

Item {
    property bool isCameraAvailable: QtMultimedia.availableCameras.length > 0
}
					

After determining whether a camera is available, access it using the QCamera class in C++ or the Camera type in QML.

When multiple cameras are available, you can specify which one to use.

在 C++:

const QList<QCameraInfo> cameras = QCameraInfo::availableCameras();
for (const QCameraInfo &cameraInfo : cameras) {
    if (cameraInfo.deviceName() == "mycamera")
        camera = new QCamera(cameraInfo);
}
					

在 QML,可以設置 Camera deviceId 特性。所有可用 ID 可以檢索自 QtMultimedia.availableCameras :

Camera {
    deviceId: QtMultimedia.availableCameras[0].deviceId
}
					

You can also select the camera by its physical position on the system rather than its device ID. This is useful on mobile devices, which often have a front-facing and a back-facing camera.

在 C++:

camera = new QCamera(QCamera::FrontFace);
					

在 QML:

Camera {
    position: Camera.FrontFace
}
					

If neither device ID nor position is specified, the default camera will be used. On desktop platforms, the default camera is set by the user in the system settings. On a mobile device, the back-facing camera is usually the default camera. You can get information about the default camera using QCameraInfo::defaultCamera () in C++ or QtMultimedia.defaultCamera in QML.

取景器

While not strictly necessary, it's often useful to be able to see what the camera is pointing at. Most digital cameras allow an image feed from the camera sensor at a lower resolution (usually up to the size of the display of the camera) so you can compose a photo or video, and then switch to a slower but higher resolution mode for capturing the image.

Depending on whether you're using QML or C++, you can do this in multiple ways. In QML, you can use Camera and VideoOutput together to show a simple viewfinder:

VideoOutput {
    source: camera
    Camera {
        id: camera
        // You can adjust various settings in here
    }
}
					

In C++, your choice depends on whether you are using widgets, or QGraphicsView QCameraViewfinder class is used in the widgets case, and QGraphicsVideoItem is useful for QGraphicsView .

camera = new QCamera;
viewfinder = new QCameraViewfinder;
camera->setViewfinder(viewfinder);
viewfinder->show();
camera->start(); // to start the viewfinder
					

For advanced usage (like processing viewfinder frames as they come, to detect objects or patterns), you can also derive from QAbstractVideoSurface and set that as the viewfinder for the QCamera object. In this case you will need to render the viewfinder image yourself.

camera = new QCamera;
mySurface = new MyVideoSurface;
camera->setViewfinder(mySurface);
camera->start();
// MyVideoSurface::present(..) will be called with viewfinder frames
					

On mobile devices, the viewfinder image might not always be in the orientation you would expect. The camera sensors on these devices are often mounted in landscape while the natural orientation of the screen is portrait. This results in the image appearing sideways or inverted depending on the device orientation. In order to reflect on screen what the user actually sees, you should make sure the viewfinder frames are always rotated to the correct orientation, taking into account the camera sensor orientation and the current display orientation.

// Assuming a QImage has been created from the QVideoFrame that needs to be presented
QImage videoFrame;
QCameraInfo cameraInfo(camera); // needed to get the camera sensor position and orientation
// Get the current display orientation
const QScreen *screen = QGuiApplication::primaryScreen();
const int screenAngle = screen->angleBetween(screen->nativeOrientation(), screen->orientation());
int rotation;
if (cameraInfo.position() == QCamera::BackFace) {
    rotation = (cameraInfo.orientation() - screenAngle) % 360;
} else {
    // Front position, compensate the mirror
    rotation = (360 - cameraInfo.orientation() + screenAngle) % 360;
}
// Rotate the frame so it always shows in the correct orientation
videoFrame = videoFrame.transformed(QTransform().rotate(rotation));
					
					

靜止圖像

After setting up a viewfinder and finding something photogenic, to capture an image we need to initialize a new QCameraImageCapture object. All that is then needed is to start the camera, lock it so that things are in focus and the settings are not different from the viewfinder while the image capture occurs, capture the image, and finally unlock the camera ready for the next photo.

imageCapture = new QCameraImageCapture(camera);
camera->setCaptureMode(QCamera::CaptureStillImage);
camera->start(); // Viewfinder frames start flowing
//on half pressed shutter button
camera->searchAndLock();
//on shutter button pressed
imageCapture->capture();
//on shutter button released
camera->unlock();
					
					

影片

Previously we saw code that allowed the capture of a still image. Recording video requires the use of a QMediaRecorder 對象。

To record video we need to create a camera object as before but this time as well as creating a viewfinder, we will also initialize a media recorder object.

camera = new QCamera;
recorder = new QMediaRecorder(camera);
camera->setCaptureMode(QCamera::CaptureVideo);
camera->start();
//on shutter button pressed
recorder->record();
// sometime later, or on another press
recorder->stop();
					

Signals from the mediaRecorder can be connected to slots to react to changes in the state of the recorder or error events. Recording itself starts with the record() function of mediaRecorder being called, this causes the signal stateChanged() to be emitted. The recording process can be changed with the record() , stop() and setMuted() slots in QMediaRecorder .

控製成像管道

Now that the basics of capturing images or movies are covered, there are a number of ways to control the imaging pipeline to implement some interesting techniques. As explained earlier, several physical and electronic elements combine to determine the final images, and you can control them with different classes.

對焦和縮放

Focusing (and zoom) is managed primarily by the QCameraFocus 類。 QCameraFocus allows the developer to set the general policy by means of the enums for the FocusMode FocusPointMode . FocusMode deals with settings such as AutoFocus , ContinuousFocus and InfinityFocus ,而 FocusPointMode deals with the various focus zones within the view that are used for autofocus modes. FocusPointMode has support for face recognition (where the camera supports it), center focus and a custom focus where the focus point can be specified.

For camera hardware that supports it, Macro focus allows imaging of things that are close to the sensor. This is useful in applications like barcode recognition, or business card scanning.

In addition to focus, QCameraFocus allows you to control any available optical or digital zoom. In general, optical zoom is higher quality, but more expensive to manufacture, so the available zoom range might be limited (or fixed to unity).

曝光、光圈、快門速度和閃光

There are a number of settings that affect the amount of light that hits the camera sensor, and hence the quality of the resulting image. The QCameraExposure class allows you to adjust these settings. You can use this class to implement some techniques like High Dynamic Range (HDR) photos by locking the exposure parameters (with QCamera::searchAndLock ()), or motion blur by setting slow shutter speeds with small apertures.

The main settings for automatic image taking are the exposure mode and flash mode . Several other settings (aperture, ISO setting, shutter speed) are usually managed automatically but can also be overridden if desired.

You can also adjust the QCameraExposure::meteringMode () to control which parts of the camera frame to measure exposure at. Some camera implementations also allow you to specify a specific point that should be used for exposure metering - this is useful if you can let the user touch or click on an interesting part of the viewfinder, and then use this point so that the image exposure is best at that point.

Finally, you can control the flash hardware (if present) using this class. In some cases the hardware may also double as a torch (typically when the flash is LED based, rather than a xenon or other bulb). See also Torch for an easy to use API for torch functionality.

圖像處理

The QCameraImageProcessing class lets you adjust the image processing part of the pipeline. This includes the 白平衡 (or color temperature), contrast , saturation , sharpening and denoising . Most cameras support automatic settings for all of these, so you shouldn't need to adjust them unless the user wants a specific setting.

If you're taking a series of images (for example, to stitch them together for a panoramic image), you should lock the image processing settings so that all the images taken appear similar with QCamera::searchAndLock ( QCamera::LockWhiteBalance ) /

取消異步操作

Various operations such as image capture and auto focusing occur asynchrously. These operations can often be canceled by the start of a new operation as long as this is supported by the camera. For image capture, the operation can be canceled by calling cancelCapture() . For AutoFocus, autoexposure or white balance cancellation can be done by calling QCamera::unlock ( QCamera::LockFocus ) .

範例

存在 C++ 和 QML 兩種可用範例。

C++ 範例

攝像頭範例

攝像頭範例展示如何使用 API 捕獲靜止圖像或視頻。

QML 範例

QML 攝像頭範例

攝像頭範例展示如何使用 API 捕獲靜止圖像或視頻。

參考文檔編製

C++ 類

QCamera

係統攝像頭設備接口

QCamera::FrameRateRange

FrameRateRange 錶示最小和最大速率的幀速率範圍

QCameraExposure

用於曝光相關攝像頭設置的接口

QCameraFocus

用於對焦和縮放相關攝像頭設置的接口

QCameraFocusZone

用於攝像頭自動對焦的區域信息

QCameraImageCapture

用於錄製媒體內容

QCameraImageProcessing

用於圖像處理相關攝像頭設置的接口

QCameraInfo

有關攝像頭設備的一般信息

QCameraViewfinderSettings

取景器設置集

QImageEncoderSettings

圖像編碼器設置集

QML 類型

Camera

訪問取景器幀,並拍攝照片及影片

CameraCapture

捕獲攝像頭圖像的接口

CameraExposure

曝光相關攝像頭設置的接口

CameraFlash

閃光相關攝像頭設置的接口

CameraFocus

對焦相關攝像頭設置的接口

CameraImageProcessing

攝像頭捕獲相關設置的接口

CameraRecorder

控製攝像頭錄製視頻