CN109309784B

CN109309784B - Mobile terminal

Info

Publication number: CN109309784B
Application number: CN201710635632.9A
Authority: CN
Inventors: 毛亚磊
Original assignee: Spreadtrum Communications Shanghai Co Ltd
Current assignee: Spreadtrum Communications Shanghai Co Ltd
Priority date: 2017-07-28
Filing date: 2017-07-28
Publication date: 2021-05-28
Anticipated expiration: 2037-07-28
Also published as: CN109309784A

Abstract

A mobile terminal, comprising: host processing ware and many camera modules, wherein: the main processor comprises a DCAM and an ISP (Internet service provider) coupled with the DCAM, and is suitable for processing image signals of a plurality of cameras at the same time, the DCAM is suitable for receiving the image signals of a multi-camera module, acquiring images and outputting acquisition results to the ISP for processing, and the format is YUV or RAW RGB; the multi-camera module is a module consisting of a plurality of cameras and is suitable for shooting images, the cameras are coupled in series through a channel CSI (channel State information) interface, and the multi-camera module is coupled with the DCAM through the CSI interface. By applying the terminal, the image signals of the plurality of cameras can be received and processed simultaneously by adopting one channel of CSI interface, one channel of DCAM and one ISP, and the imaging effect and the cost are considered.

Description

Mobile terminal

Technical Field

The embodiment of the invention relates to the field of communication, in particular to a mobile terminal.

Background

With the increasing dependence of users on the mobile phone, the depth of field can be calculated by two cameras on the mobile phone at present, so that the background blurring function is realized. Depth of field refers to the range of object distances over which the camera lens can image objects sharply, beyond which (including foreground and background) the camera lens blurs the objects. Through the control to the depth of field, the photographer can control the definition of picture main part and background environment to show the picture theme better, this kind of background blurring effect is enjoyed by people deeply. The principle of double-camera shooting is that the shooting is carried out firstly and then the focusing is carried out, namely the main camera is responsible for shooting, the depth of field information can be calculated by utilizing the images of the main camera and the auxiliary camera through an algorithm, and the focus in a picture can be adjusted at will after a user shoots, so that the background blurring function is realized.

In the current product scheme, there are two implementation schemes for a multi-camera (2 or more than 2 cameras) mobile phone: 1. image signals of the multiple cameras are respectively transmitted to a multiple Digital Camera module (DCAM) and multiple Image Signal Processor (ISP) units coupled to the multiple Digital Camera module through a multiple Camera Serial Interface (CSI) interface to perform Image preprocessing. The scheme has the disadvantages that a plurality of CSI interfaces, a plurality of DCAMs and a plurality of ISP units are needed, the design area of a main processor of the mobile terminal is increased, and the cost is increased; meanwhile, the simultaneous operation of the multiple CSI interfaces, the multiple DCAMs and the multiple ISP units increases the power consumption of the main processor, reduces the performance of the main processor, and finally reduces the competitiveness of the scheme. 2. The scheme has the disadvantages that the image signals of a plurality of cameras are subjected to image preprocessing by time sharing through the single-channel CSI interface, the single-channel DCAM and the single ISP which are coupled with the single-channel CSI interface, and scene change of a shot object and calculation errors occur in the time sharing processing, so that the imaging effect is reduced.

Disclosure of Invention

The technical problem solved by the embodiment of the invention is how to process signals of a plurality of cameras so as to take imaging effect and cost into consideration.

In order to solve the above technical problem, an embodiment of the present invention provides a mobile terminal, where the mobile terminal includes: host processing ware and many camera modules, wherein: the main processor comprises a DCAM and an ISP (Internet service provider) coupled with the DCAM, and is suitable for processing image signals of a plurality of cameras at the same time, the DCAM is suitable for receiving the image signals of a multi-camera module, acquiring images and outputting acquisition results to the ISP for processing, and the format is YUV or RAW RGB; the multi-camera module is a module formed by a plurality of cameras and is suitable for shooting images, the cameras are coupled in series through a channel CSI interface, and the multi-camera module is coupled with the DCAM through the CSI interface.

Optionally, the DCAM is coupled to the ISP through a DDR, and the DCAM is adapted to receive an image signal of a multi-camera module, perform image acquisition, and output an acquisition result to the DDR for the ISP to acquire.

Optionally, in a series circuit formed by the plurality of cameras through the CSI interfaces, each camera combines an image signal of a previous camera connected in series with the camera and an image signal generated by the camera and outputs the combined image signal to a next camera connected in series with the camera, and a last camera in the series circuit outputs the combined image signal to the DCAM through the CSI interface.

Optionally, the main processor further comprises: and the management unit is suitable for managing the plurality of cameras and the ISP.

Optionally, the management unit includes: and the man-machine interaction interface is suitable for a user to manually manage the plurality of cameras and the ISP.

Optionally, the main processor further comprises: and the image processing algorithm unit is suitable for calculating the depth information of the shot object by adopting a preset processing algorithm according to the processing result of the ISP.

Compared with the prior art, the technical scheme of the embodiment of the invention has the following beneficial effects:

the embodiment of the invention provides a mobile terminal, which is characterized in that a plurality of cameras are connected in series through a channel of CSI interface and are output to a channel of DCAM and an ISP for image preprocessing, so that the image signals of the plurality of cameras can be received and processed simultaneously by adopting the channel of CSI interface, the channel of DCAM and the ISP, and the imaging effect and the cost are considered.

Drawings

Fig. 1 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention;

fig. 2 is a schematic diagram of an image signal transmission process according to an embodiment of the present invention.

Detailed Description

The current multi-camera mobile phone has two realization schemes: 1. the image is preprocessed through the multiple CSI interfaces, the multiple DCAMs and the multiple ISPs, the design area of a main processor of the mobile terminal is increased, so that the cost is increased, meanwhile, the power consumption of the main processor is increased due to the fact that the multiple CSI interfaces, the multiple DCAMs and the multiple ISP units work simultaneously, the performance of the main processor is reduced, and finally the competitiveness of the scheme is reduced. 2. By carrying out image preprocessing through the single-channel CSI interface, the single-channel DCAM and the single ISP in a time-sharing mode, the scheme has the defect that scene change of a shot object and calculation errors occur in the time-sharing processing, so that the imaging effect is reduced.

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.

Referring to fig. 1, an embodiment of the present invention provides a mobile terminal 10, where the mobile terminal 10 includes: a multi-camera module 11 and a main processor 12, wherein:

the main processor 12 includes a DCAM 121 and an ISP122 coupled thereto, and is adapted to process image signals of multiple cameras at the same time, where the DCAM 121 is adapted to receive image signals of the multiple-camera module 11, perform image acquisition, and output an acquisition result to the ISP122 for processing, and the format is YUV or RAW RGB.

The multi-camera module 11 is a module formed by a plurality of cameras and is suitable for shooting images, the plurality of cameras are coupled in series through a Channel State Information (CSI) interface, and the multi-camera module is coupled with the DCAM through the CSI interface.

In one implementation, the DCAM 121 and the ISP122 may be coupled directly or may be coupled via a Double Data Rate (DDR) (not shown). When the DCAM 121 and the ISP122 are coupled through the DDR, the DCAM 121 is adapted to receive image signals of a plurality of cameras through the CSI interface, and output an acquisition result to the DDR after image acquisition is completed, so that the ISP122 acquires data for processing.

In a specific implementation, in a serial circuit formed by the plurality of cameras through the CSI interfaces, each camera combines an image signal of a previous camera connected in series with the camera and an image signal generated by self-shooting, and outputs the combined image signal to a next camera connected in series with the camera, and a last camera in the serial circuit outputs the combined image signal to the DCAM 121 through the CSI interface.

For example, in an embodiment of the present invention, the image signal of the first camera may be output to the second camera through the CSI interface, then the second camera combines the image signal of the first camera and the image signal of the second camera and outputs the combined image signal to the third camera through the CSI interface, the third camera combines the image signal input by the second camera and the image signal input by the third camera and outputs the combined image signal to the fourth camera …, and so on, until the last camera combines the image signal input by the last camera and outputs the combined image signal to the DCAM 121 through the CSI interface.

In a specific implementation, since the DCAM 121 may receive the image signals of the multiple cameras through one CSI interface, the image signals of the multiple cameras may be processed at the same time.

In a specific implementation, in order to better improve the imaging quality of the multi-camera module 11 and the processing effect of the image signal, the main processor 12 may further include: a management unit (not shown) adapted to manage the plurality of cameras and the ISP 122. For example, the management unit may manage operating times of the plurality of cameras, and may also manage information such as image transmission speeds and lens focal lengths of the plurality of cameras.

In a specific implementation, the management unit may be implemented in software.

In an embodiment of the present invention, the management unit may include: a human-machine interface (not shown) adapted to manually manage the plurality of cameras and the ISP 122.

In a specific implementation, the main processor 12 may further include: and the image processing algorithm unit can calculate the depth information of the shot object by adopting a preset processing algorithm according to the processing result of the ISP.

In a specific implementation, the image processing algorithm unit may be implemented in software.

By applying the terminal, a plurality of cameras are connected in series through one channel of CSI interface and are output to one channel of DCAM and one ISP for image preprocessing, so that the image signals of the plurality of cameras can be received and processed simultaneously by adopting one channel of CSI interface, one channel of DCAM and one ISP, and the imaging effect and the cost are considered.

In order to make the present invention better understood and realized by those skilled in the art, the embodiment of the present invention provides a schematic diagram of an image signal transmission process, as shown in fig. 2.

In an embodiment of the present invention, referring to fig. 2, the multi-camera module 21 includes a plurality of cameras, and the main processor 22 includes a DCAM 221 and an ISP 222 coupled thereto. The image signal transmission process includes: an image signal of the camera 1 is output to the camera 2 through one channel of CSI interface, then the camera 2 combines the image signal of the camera 1 and the image signal of the camera 2 and outputs the combined image signal to the camera 3 through the CSI interface, the camera 3 combines the image signal input by the camera 2 and the image signal of the camera 3 and outputs the combined image signal to the camera 4 … through the CSI interface, and so on until the camera N combines the image signal input by the camera N-1 and the image signal of the camera N and outputs the combined image signal to the DCAM 221 and the ISP 222 coupled thereto through the CSI interface.

Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications may be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A mobile terminal, comprising: host processing ware and many camera modules, wherein:

the main processor comprises a DCAM and an ISP (Internet service provider) coupled with the DCAM, and is suitable for processing image signals of a plurality of cameras at the same time, the DCAM is suitable for receiving the image signals of a multi-camera module, acquiring images and outputting acquisition results to the ISP for processing, and the format is YUV or RAW RGB;

the multi-camera module is a module consisting of a plurality of cameras and is suitable for shooting images, the plurality of cameras are coupled in series through a Channel State Information (CSI) interface, and the multi-camera module is coupled with the DCAM through the CSI interface;

in a series circuit formed by the plurality of cameras through the CSI interfaces, each camera combines an image signal of a previous camera connected in series with the camera and an image signal generated by self-shooting and outputs the combined image signal to a next camera connected in series with the camera, and the last camera of the series circuit outputs the combined image signal to the DCAM through the CSI interfaces.

2. The mobile terminal according to claim 1, wherein the DCAM is coupled to the ISP through a DDR, and the DCAM is adapted to receive an image signal of a multi-camera module, capture the image and output a capture result to the DDR for the ISP to obtain.

3. The mobile terminal of claim 1, wherein the main processor further comprises: and the management unit is suitable for managing the plurality of cameras and the ISP.

4. The mobile terminal according to claim 3, wherein the management unit comprises: and the man-machine interaction interface is suitable for a user to manually manage the plurality of cameras and the ISP.

5. The mobile terminal of claim 1, wherein the main processor further comprises: and the image processing algorithm unit is suitable for calculating the depth information of the shot object by adopting a preset processing algorithm according to the processing result of the ISP.