TW201419228A - Infrared remote signal processing system and processing method thereof - Google Patents

Abstract

An infrared remote signal processing system and processing method adapted for the system are provided. The processing system and the processing method are used in an electronic device. The method includes the following steps: capturing a video of objects outside the electronic device; extracting images from the video with a predetermined period; selecting a variety of continuous images after the images including the first infrared signal, and setting a binary code corresponding to the selecting images; selecting a variety of continuous images after the images corresponding to the set binary code, and setting the binary code corresponding to the selecting images until a binary coding string of N bits is obtained.

Description

Infrared remote control signal processing system and processing method

The present invention relates to the field of image processing technologies, and in particular, to a processing system and a processing method for an infrared remote control signal.

In order to improve the convenience of users in daily life, most of today's electronic devices are moving toward integrating more functions into one. For example, today's set-top boxes typically have a built-in camera and remote control signal receiver. However, setting the camera and the remote control signal receiver simultaneously on an electronic device requires opening a remote control signal receiving window and a camera window on the casing of the electronic device, which undoubtedly affects the appearance of the electronic device and increases the processing cost. In addition, the imaging device and the remote control signal receiving device occupy most of the space inside the electronic device, so that the electronic device is limited in design space in the design process.

In view of the above, it is necessary to provide a processing system and a processing method for an infrared signal, which can solve the above problems.

The invention provides an infrared remote control signal processing system, which is operated in an electronic device, and the electronic device can receive an infrared remote control signal sent by an infrared remote control, and the infrared remote control signal is a binary code "1" to be a predetermined number N After the intermittent burst signal composed of the binary code "0" is preceded by an identification code, the infrared emitting diode in the infrared remote controller is emitted to the electronic device at a certain blinking frequency by an infrared signal, wherein the infrared ray is emitted. The first infrared signal in the signal corresponds to the identification code, and each bit binary code has a predetermined pulse width and interval. The processing system of the infrared remote control signal includes:

An image acquisition module for instantly capturing an image of an object surrounding the electronic device;

An image extraction module is configured to acquire an image captured by the image acquisition module, extract a multi-frame image from the image at a predetermined cycle, and then convert the extracted image of each frame into image data. The period of the image extraction is smaller than the pulse width and the interval of the identification code and the binary code, and the image data of each frame image obtained by the conversion includes the gray value of each primitive point in the frame image;

a pulse signal analysis module, configured to select consecutive multi-frame images from a continuous frame image including the first infrared signal according to a combination of a pulse width and an interval of the binary code and a period of the image extraction period Determining, in the selected multi-frame image, an image including a primitive point having a specific gray value and an image not including the primitive point having the specific gray value, and determining, according to the period of the image extraction, including a duration of a continuous multi-frame image having the primitive point of the particular gray value and a duration of the continuous multi-frame image not including the primitive point having the particular gray value, then the The duration of the continuous multi-frame image including the primitive point having the specific gray value and the duration of the continuous multi-frame image not including the primitive point having the specific gray value respectively The pulse width of the binary code "1" and the interval or the pulse width of the binary code "0" are compared with the interval, thereby setting a binary code corresponding to the extracted multi-frame image; and also for setting the selection more After the binary image corresponding to the frame image, continue After the binary code has been set in continuous frame images select a continuous multi-frame image, sets a multi-frame image corresponding to the selected binary code, until a binary N-bit code string; and

An output module is configured to output a N-bit binary code string obtained by the pulse signal analysis module, so that the electronic device performs a corresponding operation according to the binary code string.

The invention also provides a method for processing an infrared remote control signal, which is operated in an electronic device, and the electronic device can receive an infrared remote control signal sent by an infrared remote control, wherein the infrared remote control signal is a binary code "1" to be a predetermined number N And after adding an identification code to the intermittent burst signal composed of the binary code "0", the infrared emitting diode in the infrared remote controller transmits the infrared signal to the electronic device at a certain blinking frequency, wherein The first infrared signal in the infrared signal corresponds to the identification code, and each bit binary code has a predetermined pulse width and interval. The method includes:

Instantly capturing images of objects around the electronic device;

Extracting a plurality of frames of images from the image at a predetermined period, and then converting the extracted frames into image data, wherein the period of the image extraction is smaller than the pulse width of the identification code and the binary code And spacing, the image data of each frame image obtained by the conversion includes a gray value of each primitive point in the frame image;

Selecting a continuous multi-frame image from the continuous frame image including the first infrared signal according to the combination of the pulse width and the interval of the binary code and the period of the image extraction, and determining the selected multi-frame image An image including a primitive point having a specific gray value and an image not including a primitive point having the specific gray value, and determining the image including the specific gray value according to the period of the image extraction The duration of the continuous multi-frame image of the element and the duration of the continuous multi-frame image that does not include the primitive point having the particular gray value, and then including the particular gray value The duration of the continuous multi-frame image of the primitive point and the duration of the continuous multi-frame image not including the primitive point having the specific gray value, respectively, and the pulse width of the binary code "1" Comparing with the pulse width and interval of the interval or binary code "0", thereby setting a binary code corresponding to the extracted multi-frame image;

Continuing to select a continuous multi-frame image from the consecutive frame images of the set binary code, and setting a binary code corresponding to the selected multi-frame image until an N-bit binary encoded string is obtained; with

The N-bit binary code string is output, so that the electronic device performs a corresponding operation according to the binary code string.

Compared with the prior art, the present invention immediately captures an image of an object around the electronic device, extracts a required infrared remote control signal therefrom, and eliminates a remote control signal receiver that needs to be additionally provided in the prior art, thereby reducing cost and also reducing cost. Make the space design of the electronic device more flexible.

1 is a hardware architecture diagram of an infrared remote control signal processing system 10 in accordance with a preferred embodiment of the present invention. The infrared remote control signal processing system 10 runs on an electronic device 100, such as a set top box, wherein the electronic device 100 can communicate with an infrared remote controller 2, receive an infrared remote control signal sent from the infrared remote controller 2, and then receive the infrared remote control signal. The infrared remote control signal is processed. The infrared remote control signal from the infrared remote controller 2 is a binary number of a predetermined number N (including a binary code "1" and a binary bit) that the infrared remote controller 2 will generate corresponding to the operated button. The discontinuous pulse train signal (such as "11001") composed of the code "0" is preceded by an identification code, modulated with a sine wave of a specific frequency, and then the infrared emitting diode in the infrared remote controller 2 (not shown) The display is transmitted to the electronic device 100 at a certain blinking frequency in the form of an infrared signal. The first infrared signal of the infrared signal corresponds to the identification code, and the electronic device 100 processes the infrared remote control signal after identifying the first infrared signal to prevent mutual interference with other devices. . The infrared remote controller 2 can generate the aforementioned intermittent pulse train signal by using an existing infrared remote control coding method. The identification code, each binary binary code "1" and each binary binary code "0" each have a predetermined pulse width and interval, and the combination of the pulse width and the interval of each binary binary code is the same As shown in FIG. 2, the electronic device 100 indicates the identification code with a combination of a pulse width of T21 and an interval of T22; a combination of a pulse width of T11 and an interval of T12 represents a binary code "1"; and a pulse width of T01 The combination of the interval and the interval T02 represents the binary "0"; the combination of the pulse width T21 and the interval T22 is equal to the combination of the pulse width T11 and the interval T12. Of course, the infrared remote control coding mode can also be changed according to actual needs, thereby changing the pulse width and interval of each bit binary code of the discontinuous burst signal.

In this embodiment, the infrared remote control signal processing system 10 includes an image acquisition module 11, an image extraction module 12, and an identification code analysis module 13, a pulse signal analysis module 14, and an output mode. Group 15.

The image acquisition module 11 is configured to instantly capture an image of an object around the electronic device 100. In the embodiment, the image acquisition module 11 includes a camera built in the electronic device 100 and an image sensor, wherein the camera can directly adopt an ordinary camera, and the image sensor can sense visible light. And infrared light. In other embodiments, the electronic device 100 is externally connected to a camera. The image acquisition module 11 includes only the image sensor capable of sensing visible light and infrared light. The image acquisition module 11 acquires the electronic device 100 through the camera. An image of the surrounding objects.

The image extraction module 12 is configured to acquire an image captured by the image acquisition module 11 , extract a multi-frame image from the image at a predetermined cycle, and then convert the extracted image of each frame into image data. The period of the image extraction is smaller than the pulse width and interval of the identification code and each bit binary code, that is, the period of the image extraction is smaller than the pulse widths T01, T11, T21 and the intervals T02, T12, T22; the image data of each frame image obtained by the conversion includes a gray value of each primitive point in the frame image.

The identifier analysis module 13 is configured to determine an image including a primitive point having a specific gray value in the current continuous multi-frame image and an image not including the primitive point having the specific gray value. Determining, according to the period of the image extraction, whether there is a continuous multi-frame image including the primitive point having the specific gray value, and the difference between the duration and the pulse width of the identification code is within a predetermined range (ie, The duration is close to the pulse width of the identification code, and whether there is a continuous multi-frame image of the primitive point not including the predetermined specific gray value, the difference between the duration and the interval of the identification code is predetermined Within the range (ie, the duration is close to the interval of the identification code). The size of the predetermined range may be set according to actual needs, such as being set to 0.5 milliseconds. If the identification code analysis module 13 determines that the duration of the continuous multi-frame image including the primitive point having the specific gray value is close to the pulse width of the identification code, and does not include the predetermined specific gray scale The duration of the continuous multi-frame image of the value of the primitive point is close to the interval of the identification code, indicating that the current continuous multi-frame image includes the first infrared signal, and the infrared remote controller 2 is The electronic device 100 transmits an infrared remote control signal. At this time, the identification code analysis module 13 generates a control command.

For example, the pulse width and interval of the identification code are 6 milliseconds and 2 milliseconds, respectively. In this case, the first infrared signal of the infrared remote control signal emitted by the infrared remote controller 2 is an infrared signal that is continuously illuminated for 6 milliseconds and then dark for 2 milliseconds. If the period of the image extraction is 0.8 milliseconds, the identifier analysis module 13 can determine that there are currently consecutive seven frames of images with primitive points having a specific gray value, and the seven frames are consecutive two frames. The image has a primitive point that does not have a specific gray value. Then, the identifier analysis module 13 compares that the duration of the seven-frame image is 5.6 seconds, which is close to the pulse width of the identifier; the two frames The duration of the image is 1.6 seconds, and the interval close to the identification code indicates that the continuous multi-frame image includes the first infrared signal, and the infrared remote controller 2 is sending an infrared remote control to the electronic device 100. signal.

The pulse signal analysis module 14 is configured to: after receiving the control command sent by the identifier analysis module 13, according to the combination of the pulse width and the interval of the binary code and the period of the image extraction, including the first A continuous multi-frame image is selected from the image after the continuous frame image of the infrared signal, and the selected continuous multi-frame image includes the first binary code after the identification code. For example, if the combination of the pulse width and the interval of each bit binary code is 8 milliseconds, the period of the image extraction is 0.8 milliseconds, and the identification code analysis module 13 determines the continuous frame including the first infrared signal. After the image, the pulse signal analysis module 14 selects 10 consecutive images from the continuous frame image including the first infrared signal. The pulse signal analysis module 14 is further configured to determine, in the selected multi-frame image, an image including a primitive point having a specific gray value, and an image not including the primitive point having the specific gray value. Determining a duration of a continuous multi-frame image including the primitive point having the specific gray value and a continuous multi-frame graph not including the primitive point having the specific gray value according to the period of the image extraction The duration of the image, and then the duration of the continuous multi-frame image including the primitive point having the particular gray value and the continuous inclusion of the primitive point having the particular gray value The duration of the frame image is compared with the pulse width and interval of the binary code "1" or the pulse width and interval of the binary code "0", respectively, thereby setting a binary code corresponding to the selected multi-frame image. Specifically, if the difference between the duration of the continuous multi-frame image including the primitive point having the specific gray value and the pulse width of the binary code “1” is within a predetermined range, and the Setting the duration of the continuous multi-frame image of the primitive point of the specific gray value to the interval of the binary code "1" within a predetermined range, setting the selected multi-frame image to correspond to the binary code "1" Otherwise, if the difference between the duration of the continuous multi-frame image including the primitive point having the specific gray value and the pulse width of the binary code "0" is within a predetermined range, and does not include the Setting the duration of the continuous multi-frame image of the primitive point of the specific gray value to the interval of the binary code "0" within a predetermined range, setting the selected multi-frame image to correspond to the binary code "0" . The pulse signal analysis module 14 is further configured to: after setting the binary code corresponding to the selected multi-frame image, continue to select consecutive multi-frame images from the consecutive frame images of the set binary code, A binary code corresponding to the selected multi-frame image is set until an N-bit binary encoded string is obtained.

Wherein, since infrared rays and visible light act on different wavelength bands, the images respectively have different gray values, so if a picture element in one frame image includes an infrared signal, the picture element has the predetermined gray level. The value is such that the identifier analysis module 13 and the pulse signal analysis module 14 can determine whether the pixel point includes an infrared signal according to whether each primitive point on each frame image has the predetermined gray value. The above process of determining the infrared signal according to the gradation can refer to the existing gradation judging technology. For example, it can be combined with the "outdoor early fire multiple feature comprehensive identification method" proposed by Nanjing Aeronautical Aerospace University on July 4, 2008 (patent application number) 200810124425.8).

The output module 15 is configured to output the N-bit binary code string obtained by the pulse signal analysis module 14, so that the electronic device 100 can perform a corresponding operation according to the binary code string.

FIG. 3 is a flowchart of a method for processing an infrared remote control signal according to a preferred embodiment of the present invention, wherein the method is applied to the electronic device 100, and the method includes the following steps:

Step S31: The image acquisition module 11 immediately captures an image of an object around the electronic device 100.

Step S32: The image extraction module 12 acquires the image captured by the image acquisition module 11, extracts a multi-frame image from the image at a predetermined cycle, and then converts the extracted image into an image. Data, wherein the period of the image extraction is smaller than the pulse width and interval of the identification code and the binary code; the image data of each frame image obtained by the conversion includes the gray value of each primitive point in the frame image. .

Step S33: The identification code analysis module 13 determines that an image of a primitive point having a specific gray value is included in the current continuous multi-frame image and a map that does not include the primitive point having the specific gray value. image.

Step S34: The identification code analysis module 13 determines, according to the period of the image extraction, whether there is a continuous multi-frame image including the primitive point having the specific gray value, the duration thereof and the pulse width of the identification code. The difference is within a predetermined range (ie, the duration is close to the pulse width of the identification code), and whether there are consecutive multi-frame images of the primitive points not including the predetermined specific gray value, the duration of which is The difference in the interval of the identification code is within a predetermined range (i.e., the duration is close to the interval of the identification code). If it is determined that the duration of the continuous multi-frame image including the primitive point having the specific gray value is close to the pulse width of the identification code, and the continuity of the primitive point not including the predetermined specific gray value If the duration of the multi-frame image is close to the interval of the identification code, proceed to step S35; otherwise, return to step S33.

Step S35: The pulse signal analysis module 14 determines that the current continuous multi-frame image includes the first infrared signal, and then according to the combination of the pulse width and the interval of the binary code and the period of the image extraction. The continuous multi-frame image is selected from the image after the continuous frame image including the first infrared signal, and the selected multi-frame image includes an image of the primitive point having the specific gray value and An image having a primitive point having the specific gray value is not included, and a duration of the continuous multi-frame image including the primitive point having the specific gray value is determined according to the period of the image extraction and is not included a duration of a continuous multi-frame image having a primitive point of the particular gray value, and then duration of the continuous multi-frame image including the primitive point having the particular gray value The duration of consecutive multi-frame images excluding the primitive points having the particular gray value is compared with the pulse width and spacing of the binary code "1" or the pulse width and spacing of the binary code "0", respectively. To set the multiframe image with the selection Like the corresponding binary code.

Step S36: The pulse signal analysis module 14 determines the number of binary codes that have been set. If the number of binary bits that have been set does not reach the predetermined number of the intermittent burst signals, step S37 is performed; otherwise, Go to step S38.

Step S37: The pulse signal analysis module 14 continues to select consecutive multi-frame images from the consecutive frame images of the set binary code, and sets a binary code corresponding to the selected multi-frame image.

Step S38: The pulse signal analysis module 14 obtains an N-bit binary code string, and the output module 15 outputs the N-bit binary code string, so that the electronic device 100 can execute according to the binary code string. The corresponding operation.

It is to be understood by those skilled in the art that the above embodiments are only intended to illustrate the invention, and are not intended to limit the invention, as long as it is within the spirit of the invention Changes and modifications are intended to fall within the scope of the invention.

100. . . Electronic device

2. . . Infrared remote control

10. . . Infrared remote control signal processing system

11. . . Image acquisition module

12. . . Image extraction module

13. . . Identification code analysis module

14. . . Pulse signal analysis module

15. . . Output module

1 is a hardware architecture diagram of a processing system for an infrared remote control signal in accordance with a preferred embodiment of the present invention.

2 is a schematic diagram of an infrared remote control signal of the present invention.

3 is a flow chart of a method for processing an infrared remote control signal in accordance with a preferred embodiment of the present invention.

100. . . Electronic device

2. . . Infrared remote control

10. . . Infrared remote control signal processing system

11. . . Image acquisition module

12. . . Image extraction module

13. . . Identification code analysis module

14. . . Pulse signal analysis module

15. . . Output module

Claims (8)

A processing system for an infrared remote control signal, running in an electronic device, the electronic device receiving an infrared remote control signal sent by an infrared remote control, the infrared remote control signal being a binary code "1" and a binary carryer of a predetermined number N After the intermittent burst signal composed of the code “0” is preceded by an identification code, the infrared emitting diode in the infrared remote controller emits the infrared signal to the electronic device at a certain blinking frequency, wherein the infrared signal is The first infrared signal corresponds to the identification code, and each bit binary code has a predetermined pulse width and interval. The improvement is that the processing system of the infrared remote control signal comprises:
An image acquisition module for instantly capturing an image of an object surrounding the electronic device;
An image extraction module is configured to acquire an image captured by the image acquisition module, extract a multi-frame image from the image at a predetermined cycle, and then convert the extracted image of each frame into image data. The period of the image extraction is smaller than the pulse width and the interval of the identification code and the binary code, and the image data of each frame image obtained by the conversion includes the gray value of each primitive point in the frame image;
a pulse signal analysis module, configured to select consecutive multi-frame images from a continuous frame image including the first infrared signal according to a combination of a pulse width and an interval of the binary code and a period of the image extraction period Determining, in the selected multi-frame image, an image including a primitive point having a specific gray value and an image not including the primitive point having the specific gray value, and determining, according to the period of the image extraction, including a duration of a continuous multi-frame image having the primitive point of the particular gray value and a duration of the continuous multi-frame image not including the primitive point having the particular gray value, then the The duration of the continuous multi-frame image including the primitive point having the specific gray value and the duration of the continuous multi-frame image not including the primitive point having the specific gray value respectively The pulse width of the binary code "1" and the interval or the pulse width of the binary code "0" are compared with the interval, thereby setting a binary code corresponding to the extracted multi-frame image; and also for setting the selection more After the binary image corresponding to the frame image, continue After the consecutive frame images of the binary code are set, consecutive image frames are selected, and the binary code corresponding to the selected multi-frame image is set until an N-bit binary code string is obtained; The output module is configured to output a N-bit binary code string obtained by the pulse signal analysis module, so that the electronic device performs a corresponding operation according to the binary code string. The processing system of the infrared remote control signal according to the first aspect of the invention, wherein the image acquisition module comprises a camera built in the electronic device and an image sensor, wherein the camera can directly adopt an ordinary image. The camera, whose image sensor is capable of sensing visible light as well as infrared light. The processing system of the infrared remote control signal according to the first aspect of the invention, wherein the electronic device is externally connected to a camera, the image acquisition module comprises an image sensor capable of sensing visible light and infrared light, the image acquisition mode The group acquires an image of an object around the electronic device through the camera. The processing system of the infrared remote control signal according to claim 1, wherein if a pixel point includes an infrared signal, the primitive point has the predetermined gray value; the identification code analysis module and the pulse The signal analysis module determines whether the pixel point includes an infrared signal according to whether each primitive point on each frame image has the predetermined gray value. The processing system of the infrared remote control signal according to claim 1, wherein the pulse signal analysis module determines the duration of the continuous multi-frame image including the primitive point having the specific gray value. The difference from the pulse width of the binary code "1" is within a predetermined range, and the duration of the continuous multi-frame image of the primitive point not including the specific gray value is the same as the binary code "1" Setting the selected multi-frame image to correspond to the binary code "1" when the interval is within the predetermined range; determining the duration of the continuous multi-frame image including the primitive point having the specific gray value The difference of the pulse width of the binary code "0" is within a predetermined range, and the duration of the continuous multi-frame image of the primitive point not including the specific gray value is spaced from the binary code "0" When the predetermined range is within, the selected multi-frame image is set to correspond to the binary code "0". The processing system for infrared remote control signals according to claim 1, wherein the identification code has a predetermined pulse width and interval; the system further comprises an identification code analysis module for determining the current continuous multi-frame. An image including a primitive point having a specific gray value and an image not including a primitive point having the specific gray value are included in the image, and determining whether the presence includes the a continuous multi-frame image of a primitive point of a specific gray value whose difference between the duration and the pulse width of the identification code is within a predetermined range, and whether there is a primitive point not including the predetermined specific gray value a continuous multi-frame image whose difference between the duration and the interval of the identification code is within a predetermined range, and if so, the identification code analysis module determines that the current continuous multi-frame image includes the first infrared The signal then generates a control command; the pulse signal analysis module is configured to perform a corresponding operation after receiving the control command. A method for processing an infrared remote control signal, running in an electronic device, the electronic device receiving an infrared remote control signal sent by an infrared remote control, the infrared remote control signal being a binary code "1" and a binary carryer of a predetermined number N After the intermittent burst signal composed of the code “0” is preceded by an identification code, the infrared emitting diode in the infrared remote controller emits the infrared signal to the electronic device at a certain blinking frequency, wherein the infrared signal is The first infrared signal corresponds to the identification code, and each bit binary code has a predetermined pulse width and interval. The improvement is that the method comprises:
Instantly capturing images of objects around the electronic device;
Extracting a plurality of frames of images from the image at a predetermined period, and then converting the extracted frames into image data, wherein the period of the image extraction is smaller than the pulse width of the identification code and the binary code And spacing, the image data of each frame image obtained by the conversion includes a gray value of each primitive point in the frame image;
Selecting a continuous multi-frame image from the continuous frame image including the first infrared signal according to the combination of the pulse width and the interval of the binary code and the period of the image extraction, and determining the selected multi-frame image An image including a primitive point having a specific gray value and an image not including a primitive point having the specific gray value, and determining the image including the specific gray value according to the period of the image extraction The duration of the continuous multi-frame image of the element and the duration of the continuous multi-frame image that does not include the primitive point having the particular gray value, and then including the particular gray value The duration of the continuous multi-frame image of the primitive point and the duration of the continuous multi-frame image not including the primitive point having the specific gray value, respectively, and the pulse width of the binary code "1" Comparing with the pulse width and interval of the interval or binary code "0", thereby setting a binary code corresponding to the extracted multi-frame image;
Continuing to select a continuous multi-frame image from the consecutive frame images of the set binary code, and setting a binary code corresponding to the selected multi-frame image until an N-bit binary encoded string is obtained; And outputting the N-bit binary code string, so that the electronic device performs a corresponding operation according to the binary code string. The method for processing an infrared remote control signal according to claim 7, wherein the identification code has a predetermined pulse width and interval; the step of “combining a pulse width and an interval according to the binary code and the map The extraction period selects a continuous multi-frame image from a continuous frame image including the first infrared signal.
Determining, in the current continuous multi-frame image, an image including a primitive point having a specific gray value and an image not including a primitive point having the specific gray value;
Determining, according to the period of the image extraction, whether there is a continuous multi-frame image including the primitive point having the specific gray value, the difference between the duration and the pulse width of the identification code being within a predetermined range, and whether There is a continuous multi-frame image that does not include the primitive point of the predetermined specific gray value, and the difference between the duration and the interval of the identification code is within a predetermined range, and if so, the identification code analysis module determines the current a continuous multi-frame image including the first infrared signal, and then generating a control command; and after receiving the control command, an image from the continuous frame image including the first infrared signal A continuous multi-frame image is selected.