The application is a divisional application of a patent with the application number of 2017108551951 and the application date of 09 and 20 in 2017, and is named as a method for simultaneously integrating a real-time monitoring function and a user information acquisition function.
Disclosure of Invention
In order to solve the above problems, the present invention provides a method for simultaneously integrating a real-time monitoring function and a user information collecting function, which performs target detection on the surrounding environment, starts a normal set-top box service when a set-top box is identified to register a user, enters a user state collecting mode related to audience statistics, closes the set-top box service when a set-top box is not identified to register a user, and switches the current mode from the user state collecting mode to a monitoring mode.
The invention has at least the following two important points:
(1) by controlling the self-adaptive switching of the resolution/frame rate of each image acquisition unit, the power consumption of the acquisition units is reduced while the moving object is not lost and the imaging quality of the moving object is ensured, the waste of power resources is avoided, and the cruising ability of the tracking system is ensured;
(2) the image to be processed is partitioned through histogram cluster analysis, and the partitioned sub-images are subjected to self-adaptive target segmentation threshold range determination based on the noise amplitude, so that the reliability of subsequent target identification can be improved.
According to an aspect of the present invention, there is provided a method of simultaneously integrating a real-time monitoring function and a user information collecting function, the method including:
1) there is provided a multifunctional dual tuner set-top box located in a home residence, the set-top box comprising: the set top box comprises a set top box body, a plurality of rows of radiating holes, a plurality of switch buttons, a plurality of alarm buttons and an integrated circuit board, wherein the radiating holes are arranged on the top layer of the square box body and are arranged in parallel, the radiating holes are arranged on the rear side surface of the square box body, the switch buttons and the alarm buttons are arranged on the front side surface of the square box body, the integrated circuit board is arranged inside the square box body, and the integrated circuit board is provided with a double tuner and a processing assembly corresponding to the double tuner;
the self-adaptive resolution acquisition equipment is arranged above the square box body and comprises a mode switching unit, a motion detection unit and a plurality of image acquisition units, wherein the plurality of image acquisition units are used for acquiring surrounding image data at different angles respectively to output a plurality of sub-angle images, the default working mode of each image acquisition unit is a low resolution acquisition mode, the motion detection unit is respectively connected with the plurality of image acquisition units and is used for detecting whether a moving object exists in the sub-angle images shot by each image acquisition unit, the mode switching unit is connected with the motion detection unit and is also respectively connected with the plurality of image acquisition units and is used for switching the working mode of the image acquisition unit into a high resolution acquisition mode when receiving that a moving object exists in one image acquisition unit and is used for receiving that no moving object exists in one image acquisition unit, switching the working mode of the image acquisition unit to a low resolution acquisition mode;
the dynamic range comparison equipment is connected with the plurality of image acquisition units and is used for receiving the plurality of angle-dividing images and outputting the angle-dividing image with the largest dynamic range in the plurality of angle-dividing images as an image to be processed;
the block processing equipment is used for receiving the image to be processed and segmenting the image to be processed through histogram clustering analysis to obtain each subimage;
the noise amplitude detection device is connected with the block processing device and used for receiving each sub-image, carrying out noise type detection on each sub-image so as to obtain amplitudes of various types of noise, and determining the total noise amplitude of each sub-image based on the amplitudes of various types of noise and amplitude weights respectively corresponding to various types of noise;
the threshold selection device is respectively connected with the block processing device and the noise amplitude detection device and is used for receiving each sub-image and each total noise amplitude of each sub-image, and determining the human body segmentation threshold range of each sub-image based on the total noise amplitude of each sub-image, wherein the larger the total noise amplitude of each sub-image is, the smaller the width of the human body segmentation threshold range of each sub-image is;
the image segmentation device is connected with the threshold selection device and used for executing human body segmentation processing based on the corresponding human body segmentation threshold on each sub-image to obtain a corresponding sub-pattern and splicing the sub-patterns of all the sub-images to obtain each spliced pattern;
the target detection equipment is connected with the image segmentation equipment and is used for respectively carrying out set top box registered user contour detection on each spliced pattern so as to determine the spliced pattern with the highest contour similarity with the set top box registered user and output the spliced pattern as a set top box registered user image;
the mode control equipment is respectively connected with the adaptive resolution acquisition equipment and the target detection equipment, and is used for switching the current mode of the adaptive resolution acquisition equipment from the monitoring mode to the user state acquisition mode when receiving a user registration signal of the set top box, and is also used for switching the current mode of the adaptive resolution acquisition equipment from the user state acquisition mode to the monitoring mode when receiving a user registration signal of the inorganic set top box;
the system comprises a self-adaptive resolution acquisition device, a monitoring mode and a user state acquisition mode, wherein the self-adaptive resolution acquisition device is also used for acquiring and identifying data of nearby suspects in the monitoring mode, and the self-adaptive resolution acquisition device acquires and counts user information for watching television in the user state acquisition mode; and
2) and operating the set-top box.
Detailed Description
Embodiments of the multi-function dual tuner set-top box of the present invention will be described in detail below with reference to the accompanying drawings.
In order to overcome the defects, the invention provides a method for simultaneously integrating a real-time monitoring function and a user information acquisition function, which comprises the following steps: 1) providing a multifunctional dual-tuner set-top box; and 2) operating the set-top box. The invention provides the audience rating statistics and the on-site monitoring function besides the normal television related service, thereby fully utilizing the existing hardware resources.
Fig. 1 is a schematic front-view structural diagram of a multifunctional dual-tuner set-top box according to an embodiment of the present invention, and fig. 2 is a schematic top-view structural diagram of the multifunctional dual-tuner set-top box according to the embodiment of the present invention, as shown in the figure, the set-top box includes:
the set top box comprises a set top box body, a plurality of rows of radiating holes, a plurality of switch buttons, a plurality of alarm buttons and an integrated circuit board, wherein the radiating holes are arranged on the top layer of the square box body and are arranged in parallel, the radiating holes are arranged on the rear side surface of the square box body, the switch buttons and the alarm buttons are arranged on the front side surface of the square box body, the integrated circuit board is arranged inside the square box body, and the integrated circuit board is provided with a double tuner and a processing assembly corresponding to the double tuner;
the self-adaptive resolution acquisition equipment is arranged above the square box body and comprises a mode switching unit, a motion detection unit and a plurality of image acquisition units, wherein the plurality of image acquisition units are used for acquiring surrounding image data at different angles respectively to output a plurality of sub-angle images, the default working mode of each image acquisition unit is a low resolution acquisition mode, the motion detection unit is respectively connected with the plurality of image acquisition units and is used for detecting whether a moving object exists in the sub-angle images shot by each image acquisition unit, the mode switching unit is connected with the motion detection unit and is also respectively connected with the plurality of image acquisition units and is used for switching the working mode of the image acquisition unit into a high resolution acquisition mode when receiving that a moving object exists in one image acquisition unit and is used for receiving that no moving object exists in one image acquisition unit, switching the working mode of the image acquisition unit to a low resolution acquisition mode;
the dynamic range comparison equipment is connected with the plurality of image acquisition units and is used for receiving the plurality of angle-dividing images and outputting the angle-dividing image with the largest dynamic range in the plurality of angle-dividing images as an image to be processed;
the block processing equipment is used for receiving the image to be processed and segmenting the image to be processed through histogram clustering analysis to obtain each subimage;
the noise amplitude detection device is connected with the block processing device and used for receiving each sub-image, carrying out noise type detection on each sub-image so as to obtain amplitudes of various types of noise, and determining the total noise amplitude of each sub-image based on the amplitudes of various types of noise and amplitude weights respectively corresponding to various types of noise;
the threshold selection device is respectively connected with the block processing device and the noise amplitude detection device and is used for receiving each sub-image and each total noise amplitude of each sub-image, and determining the human body segmentation threshold range of each sub-image based on the total noise amplitude of each sub-image, wherein the larger the total noise amplitude of each sub-image is, the smaller the width of the human body segmentation threshold range of each sub-image is;
the image segmentation device is connected with the threshold selection device and used for executing human body segmentation processing based on the corresponding human body segmentation threshold on each sub-image to obtain a corresponding sub-pattern and splicing the sub-patterns of all the sub-images to obtain each spliced pattern;
the target detection equipment is connected with the image segmentation equipment and is used for respectively carrying out set top box registered user contour detection on each spliced pattern so as to determine the spliced pattern with the highest contour similarity with the set top box registered user and output the spliced pattern as a set top box registered user image;
the mode control equipment is respectively connected with the adaptive resolution acquisition equipment and the target detection equipment, and is used for switching the current mode of the adaptive resolution acquisition equipment from the monitoring mode to the user state acquisition mode when receiving a user registration signal of the set top box, and is also used for switching the current mode of the adaptive resolution acquisition equipment from the user state acquisition mode to the monitoring mode when receiving a user registration signal of the inorganic set top box;
the adaptive resolution acquisition equipment is also used for acquiring and identifying data of nearby suspects in the monitoring mode, and the adaptive resolution acquisition equipment acquires and counts user information for watching television in the user state acquisition mode.
Next, the detailed structure of the multifunctional dual-tuner set-top box of the present invention will be further explained.
In the multifunctional dual-tuner set-top box, further comprising:
the double tuners arranged on the integrated circuit board are a ground digital television receiving tuner and an ultra-clear digital television receiving tuner respectively.
In the multi-function dual-tuner set-top box:
each image acquisition unit performs image data acquisition with 960 × 540 resolution when the operation mode is the low resolution acquisition mode.
In the multi-function dual-tuner set-top box:
when the working mode is a low-resolution acquisition mode, each image acquisition unit acquires image data at 1920 × 1080 resolution.
In the multi-function dual-tuner set-top box:
when the working mode is the high-resolution acquisition mode, each image acquisition unit acquires image data at the resolution of 3840 multiplied by 2160.
In the multi-function dual-tuner set-top box:
and when the working mode of each image acquisition unit is a low-resolution acquisition mode, acquiring image data at a low frame rate.
In the multi-function dual-tuner set-top box:
and when the working mode of each image acquisition unit is a high-resolution acquisition mode, acquiring image data at a high frame rate.
And in the multi-function dual-tuner set-top box:
when the working mode of each image acquisition unit is a low-resolution acquisition mode, acquiring image data at a frame rate of 10 frames per second;
when the working mode of each image acquisition unit is a high-resolution acquisition mode, acquiring image data at a frame rate of 50 frames per second;
in addition, the mode control device may be implemented using a DSP processing chip. The DSP chip adopts a Harvard structure with separated programs and data, is provided with a special hardware multiplier, widely adopts pipeline operation, provides special DSP instructions, and can be used for quickly realizing various digital signal processing algorithms.
According to the requirements of digital signal processing, a DSP chip generally has some main features as follows: (1) one multiply and one add may be done in one instruction cycle. (2) The program and data spaces are separate and instructions and data may be accessed simultaneously. (3) On-chip with fast RAM, it is usually accessible in two blocks simultaneously via separate data buses. (4) Hardware support with low or no overhead loops and jumps. (5) Fast interrupt handling and hardware I/O support. (6) There are multiple hardware address generators operating in a single cycle. (7) Multiple operations may be performed in parallel. (8) And pipeline operation is supported, so that the operations of fetching, decoding, executing and the like can be executed in an overlapping way.
The multifunctional double-tuner set-top box is adopted, aiming at the technical problem of low utilization rate of set-top box hardware in the prior art, the mode control equipment is used for switching the current mode of the adaptive resolution acquisition equipment from the monitoring mode to the user state acquisition mode when receiving a signal of a registered user of the set-top box, and is also used for switching the current mode of the adaptive resolution acquisition equipment from the user state acquisition mode to the monitoring mode when receiving a signal of a registered user of the inorganic set-top box, the adaptive resolution acquisition equipment is also used for acquiring and identifying data of a suspect nearby in the monitoring mode, and the adaptive resolution acquisition equipment acquires and counts user information for watching television in the user state acquisition mode, so that the technical problem is solved.
It is to be understood that while the present invention has been described in conjunction with the preferred embodiments thereof, it is not intended to limit the invention to those embodiments. It will be apparent to those skilled in the art from this disclosure that many changes and modifications can be made, or equivalents modified, in the embodiments of the invention without departing from the scope of the invention. Therefore, any simple modification, equivalent change and modification made to the above embodiments according to the technical essence of the present invention are still within the scope of the protection of the technical solution of the present invention, unless the contents of the technical solution of the present invention are departed.