TWI839893B - Field image remote monitoring system and fish-farm image remote monitoring system - Google Patents

Abstract

A field image remote monitoring system and a fish-farm image remote monitoring system are provided. The field image remote monitoring system has a controllable-light-source color calibration panel, an image capturing device, and a remote host. The controllable-light-source color calibration panel is applied to a field to display a frame of image according to a display parameter. The frame of image has at least one colored block area. The image capturing device captures a target object and the controllable-light-source color calibration panel at the field to generate a raw image. The target object and the controllable-light-source color calibration panel are included in the raw image. The remote host communicates with the controllable-light-source color calibration panel and the image capturing device, outputs the display parameter to the controllable-light-source color calibration panel, and receives the raw image outputted from the image capturing device to analyze a color deviation between the display parameter and the at least one colored block area of the raw image to calibrate the color of the raw image based on the color deviation.

Description

Field image remote monitoring system and fish pond image remote monitoring system

The present invention relates to a remote monitoring system, in particular to a field image remote monitoring system and a fish pond image remote monitoring system.

The conventional method of image color correction is to place a color correction board made of paper in the camera's imaging range when taking photos with a camera. The color correction board may be, for example, a Macbeth color checker. The color correction board has a plurality of color blocks of different colors, and the color of each color block corresponds to a known color code. Therefore, an image taken by the camera includes both the photographed scene and the color correction board. Then, the image file is imported into an image processing software (such as Photpshop) in a computer to correct the color of the image according to the color difference between the known color code and the color block of the color correction board in the image.

Taking aquaculture as an example, the water colour of fish ponds is closely related to the water quality. For example, when the water colour is greenish, it means that there may be too much algae in the fish pond. Excessive algae will consume a large amount of oxygen in the water, causing fish and shrimp to be at risk of hypoxia. Therefore, personnel of aquaculture operators can observe the water colour of the fish ponds on site to facilitate timely implementation of algae removal operations.

Because natural ambient light will affect personnel's observation and judgment of the water color of the fish pond, for example, under natural ambient light conditions of sunny weather, dusk or cloudy days, in addition to the water color observed by personnel, there may be a difference in the water color. In the images taken by cameras and other imaging devices, there will also be color differences in the water color. Therefore, the image color correction of the fish pond water color can be performed through the known image color correction method as described above, so as to observe the fish pond water color in the corrected image and reduce the impact of natural ambient light.

However, paper color calibration plates easily absorb moisture and are difficult to preserve. Moreover, the color blocks fade over time, affecting the color calibration effect of the image. In addition, personnel must carry the color calibration plates to the fish pond, which causes troublesome travel.

In view of this, the main purpose of the present invention is to provide a field image remote monitoring system and a fish pond image remote monitoring system, so as to overcome the problem of the conventional image color correction method that the paper color correction board is difficult to preserve, and the disadvantage that the personnel must operate the color correction board on site, which causes trouble.

The field image remote monitoring system of the present invention comprises: A controllable light source color calibration board, which is set in a field to display a picture according to a display parameter, and the picture includes at least one color block area; An imaging device, which shoots a target scene in the field and the controllable light source color calibration board to generate an original image, and the original image includes the target scene and the at least one color block area; and A remote host, which connects the controllable light source color calibration board and the imaging device, outputs the display parameter to the controllable light source color calibration board, and receives the original image output by the imaging device to analyze the color difference between the display parameter and the at least one color block area in the original image to correct the color of the original image.

The fish pond image remote monitoring system of the present invention comprises: A controllable light source color calibration board, which is provided in a fish pond field to display a picture according to a display parameter, and the picture includes at least one color block area; An imaging device, which photographs a fish pond in the fish pond field and the controllable light source color calibration board to generate an original image, and the original image includes the fish pond and the at least one color block area; and A remote host, which connects the controllable light source color calibration board and the imaging device, outputs the display parameter to the controllable light source color calibration board, and receives the original image output by the imaging device, so as to analyze the color difference between the display parameter and the at least one color block area of the original image and correct the color of the original image.

Compared with the prior art, the present invention can achieve the following effects:

1. The controllable light source calibration board is a light-emitting device controlled by the remote host. It is not a paper object without a light-emitting function like the conventional calibration board. It naturally does not have the problem of easy water absorption and moisture absorption and difficult preservation of the paper calibration board, and its service life is longer than the conventional paper calibration board. On the other hand, the color of the color block area displayed by the controllable light source calibration board is controlled by the display parameter. Naturally, it does not have the fading problem like the conventional paper calibration board, and is relatively unaffected by the natural ambient light. For example, it can be used normally in sunny weather, dusk, cloudy days, and even at night.

2. The present invention uses the connection architecture and collaborative operation of the controllable light source calibration board, the imaging device and the remote host, so that personnel do not need to be present at the site (such as the fish pond site) to operate the controllable light source calibration board on site. Instead, they can operate the remote host in other places (such as the office) to remotely operate the display screen of the controllable light source calibration board, effectively avoiding the trouble of traveling.

Please refer to FIG. 1 . The field image remote monitoring system of the present invention can be applied to a field outdoors or indoors. In the present invention, the field is a fish pond field as an example, so the present invention also provides a fish pond image remote monitoring system. However, it should be noted that the field of application of the present invention is not limited to the fish pond field.

The field image remote monitoring system or fish pond image remote monitoring system of the present invention includes a controllable light source calibration board 10, an imaging device 20 and a remote host 30, which can form an Internet of Things (IoT) connection architecture, so that the remote host 30 can remotely start or shut down the controllable light source calibration board 10 and the imaging device 20, and can also remotely control the picture displayed by the controllable light source calibration board 10 and remotely control the imaging device 20 to take pictures or videos, and can also receive the image taken by the imaging device 20 and perform image analysis, as described below.

The controllable light source color calibration board 10 is provided in the field, and the controllable light source color calibration board 10 can form a TV wall. Taking the fish pond field as an example, please refer to FIG. 2 , the controllable light source color calibration board 10 can be installed and fixed on a fixing seat 100, and the fixing seat 100 is set on the bank 40 of the fish pond field. Referring to FIG. 3 , an embodiment of the controllable light source calibration board 10 is a color light emitting diode matrix (RGB LED Matrix) display 11. The color light emitting diode matrix display 11 includes at least one color LED matrix unit board 121 and a display driving module 122 electrically connected to the at least one color LED matrix unit board 121. Each color LED matrix unit board 121 includes a plurality of color LED elements 1210 arranged in a matrix. That is, the controllable light source calibration board 10 may include a single color LED matrix unit board 121, or include a plurality of color LED matrix unit boards 121 spliced together as shown in FIG. 3 ; the display driving module 122 may, for example, be a Raspberry Pi with a wireless or wired network connection function. Pi) circuit module or Arduino circuit module, which can be set to an Internet address (IP Address). Alternatively, other embodiments of the controllable light source calibration board 10 can be a liquid crystal display (LCD) or an organic light emitting diode (OLED) display with wireless or wired network connection function.

The imaging device 20 is provided in the field, and can be a monitor, a camera or a camera with a wireless or wired network connection function. When the controllable light source calibration plate 10 and the imaging device 20 are set up, the light emitting side of the controllable light source calibration plate 10 faces the imaging device 20, and the imaging range of the imaging device 20 covers a target scene and the controllable light source calibration plate 10. In this way, the imaging device 20 can simultaneously shoot the target scene and the controllable light source calibration plate 10 in the field. Taking the fish pond as an example, please refer to Figure 2. The target scene is a fish pond 41 in the fish pond. The imaging device 20 can be mounted and fixed on a bracket 200. The bracket 200 is set on the bank 40 of the fish pond. The controllable light source calibration plate 10 and the imaging device 20 can be located on opposite sides of the fish pond 41 respectively, so that the imaging device 20 can simultaneously shoot the fish pond 41 and the controllable light source calibration plate 10.

The remote host 30 can be a computer for user operation, which can be connected to the Internet through a fixed-line telecommunication service system or a mobile network service system provided by a telecommunications operator, so the remote host 30 can be connected to the controllable light source calibration board 10 and the imaging device 20 through the Internet. As mentioned above, the controllable light source calibration board 10 and the imaging device 20 both have a network connection function. The following describes a feasible embodiment of connecting the controllable light source calibration board 10 and the imaging device 20 to the remote host 30, but is not limited thereto. As long as the controllable light source calibration board 10 and the imaging device 20 are connected to the remote host 30, it will be sufficient.

Please refer to Figure 3, the feasible embodiment includes a mobile communication wireless router 50, which can be set up in the field. The mobile communication wireless router 50 can be used to insert a mobile communication SIM (Subscriber Identity Module) card, such as a fourth generation (4G) or fifth generation (5G) mobile communication SIM card. The mobile communication wireless router 50 also includes a Wi-Fi module and a network cable socket. The imaging device 20 can be an Internet camera (IP Cam) with a Wi-Fi connection function to connect to the Wi-Fi module of the mobile communication wireless router 50. In each embodiment of the controllable light source calibration board 10, the display driver module 122, the liquid crystal display or the organic light-emitting diode display can have a network cable socket to connect to the network cable socket of the mobile communication wireless router 50 via a network cable. Thereby, the controllable light source calibration board 10 and the imaging device 20 can realize 4G or 5G mobile Internet access function through the mobile communication wireless router 50, and then connect to the Internet. The remote host 30 can be connected to the imaging device 20 and the controllable light source calibration board 10 according to the Internet address set in the imaging device 20 and the controllable light source calibration board 10.

Another embodiment of the image capturing device 20 may be a smart phone with camera and mobile network connection functions, the smart phone may install and run an application, and the Internet address of the remote host 30 is set in the application. In this way, the smart phone may connect to the remote host 30, take pictures according to the user's operation, and transmit the captured images to the remote host 30.

Based on the connection structure of the controllable light source calibration board 10, the imaging device 20 and the remote host 30 as described above, the remote host 30 can output a display parameter P to the controllable light source calibration board 10, and the controllable light source calibration board 10 can receive the display parameter P from the remote host 30 and display a picture according to the display parameter P, the picture includes at least one color block area, that is, the display parameter P includes the distribution position and color code (such as RGB value) of the at least one color block area, if it is a plurality of color block areas, the color codes of the plurality of color block areas can be different from each other. When the controllable light source calibration board 10 adopts the color light emitting diode matrix display 11 as shown in FIG. 3, the plurality of LED elements 1210 therein display each of the color block areas.

As mentioned above, the imaging device 20 captures the target scene and the controllable light source calibration plate 10 in the scene, so the image generated by the imaging device 20 includes the target scene and the at least one color block area. In the present invention, the image generated by the imaging device 20 is defined as an original image Im, and the remote host 30 receives the original image Im output by the imaging device 20. Taking the fish pond scene as an example, please refer to the schematic diagram of the original image Im shown in FIG4, which includes the fish pond 41 and a plurality of color block areas 13, and the colors of the plurality of color block areas 13 are different from each other.

After the remote host 30 obtains the original image Im, it analyzes the color difference between the display parameter P and the at least one color block area 13 in the original image Im, and corrects the color of the original image Im according to the color difference, that is, the color of the target scene in the original image Im is also corrected. It should be noted that the color analysis and correction means executed by the remote host 30 are common knowledge in the field of image processing technology, and can also be achieved by commercially available software (such as Photoshop), and its principle is not described in detail. In short, the color code of the display parameter P is a known default color code. The remote host 30 reads the color code of each color block area 13 of the original image Im and analyzes it with the color code of the display parameter P, so that the color difference between the two can be obtained, and the original image Im is corrected based on the color difference data, so that the color of the target scene in the original image Im is also corrected. Taking the fish pond as an example, the corrected original image Im can reflect the real water color of the fish pond 41 so as to effectively evaluate the water quality of the fish pond 41 .

In other embodiments, please refer to FIG. 1 , the display parameter P outputted by the remote host 30 to the controllable light source calibration board 10 may further include an image of a two-dimensional barcode QR. Correspondingly, the screen displayed by the controllable light source calibration board 10 according to the display parameter P includes the image of the two-dimensional barcode QR. As shown in FIG. 5 , the original image Im captured by the imaging device 20 includes the image of the two-dimensional barcode QR. Thus, the remote host 30 recognizes the content of the two-dimensional barcode QR from the original image Im to obtain information, which may be a website, code, number or text message, etc. Taking the fish pond as an example, the remote host 30 recognizes the two-dimensional barcode QR from the original image Im to obtain information of a fish pond number.

Please refer to Figures 6 and 7. The present invention further includes a controllable steering device 60 for installation in the field (fish pond field). The controllable steering device 60 is connected to the remote host 30, and the controllable light source calibration board 10 is installed on the controllable steering device 60. The controllable steering device 60 is controlled by the remote host 30 to control the light emitting side of the controllable light source calibration board 10 to be turned. The following describes a feasible embodiment of the controllable steering device 60, but is not limited thereto. As long as the controllable steering device 60 is controlled by the remote host 30 and controls the light emitting side of the controllable light source calibration board 10 to be turned, it can be used.

The controllable steering device 60 includes a carrier 61, a motor 62 connected to the carrier 61, and a motor controller 63 electrically connected to the motor 62, wherein the motor 62 is disposed in a housing 64, and the motor 62 can be a stepper motor, and its rotation shaft 620 can be axially connected to the bottom center position of the carrier 61, so that the carrier 61 can be driven by the motor 62 to rotate, and the controllable light source calibration plate 10 can be mounted on the top of the carrier 61, so that the light-emitting side of the controllable light source calibration plate 10 can rotate along with the carrier 61. The motor controller 63 can be, for example, a Raspberry Pi circuit module or an Arduino circuit module with a wireless or wired network connection function. The connection architecture between the display driver module 122 and the remote host 30 described above can be referred to. The motor controller 63 can also be connected to the remote host 30 via the mobile communication wireless router 50. In this way, the remote host 30 can output a turning command S to the motor controller 63. The turning command S includes turning angle information. The motor controller 63 drives the motor 62 to operate according to the turning command S, so that the carrier 61 and the controllable light source calibration board 10 rotate by a set angle.

The following describes the use scenario of the controllable steering device 60 , but the application of the present invention is not limited to the use scenario.

Please refer to FIG. 8A and FIG. 8B . The controllable light source calibration plate 10 and the imaging device 20 can be located on the same side of the fish pond 41. Since the motor controller 63 is controlled by the remote host 30, the motor 62 can be controlled to be positioned. The controllable light source calibration plate 10 is in an initial position at the position shown in FIG. 8A . At this time, the imaging device 20 can simultaneously photograph the fish pond 41 and the light-emitting side of the controllable light source calibration plate 10. As mentioned above, the original image Im photographed by the imaging device 20 includes a color block area 13 or further includes a two-dimensional barcode (not shown in the figure). Under natural ambient light, the present invention can control the controllable light source calibration plate 10 to be in the initial position, and the remote host 30 performs color analysis and correction on the original image Im shown in FIG. 8B .

At night, the remote host 30 can output the turning instruction S to the motor controller 63 according to the user's operation or automatically, as shown in Figures 9A and 9B, so that the light-emitting side of the controllable light source calibration plate 10 faces the fish pond 41. In addition, the remote host 30 can change the display parameter P according to the user's operation instruction, so that the controllable light source calibration plate 10 emits a light color of a specific wavelength, so that the light color of the specific wavelength can be irradiated on the fish pond 41, for example, the controllable light source calibration plate 10 is controlled to emit white light to provide auxiliary lighting, so as to facilitate the fish pond feeding operation. On the other hand, the turning instruction S output by the remote host 30 can also restore the controllable light source calibration plate 10 to the initial position shown in Figure 8A.

In summary, the controllable light source calibration board 10 is a light-emitting device controlled by the remote host 30, and the color of the color block area 13 displayed by it is controlled by the display parameter P, and it can be used normally in different ambient light situations. The present invention uses the connection structure and collaborative operation of the controllable light source calibration board 10, the imaging device 20 and the remote host 30, so that personnel do not need to be present at the scene to operate the controllable light source calibration board 10, but can operate the remote host 30 in other places, and remotely operate the controllable light source calibration board 10, the imaging device 20 and the controllable steering device 60, which greatly improves practicality.

The embodiment of the present invention involves the application of the two-dimensional barcode QR. The remote host 30 can store the original image Im transmitted by the imaging device 20 as historical data. The remote host 30 can identify the fish farm number from the two-dimensional barcode QR of each frame of the original image Im. In this way, aquaculture operators can evaluate the relationship between the change of water quality in a specific fish pond 41 and the quality of the fish harvest based on the historical data of the original image Im and the fish farm number, thereby achieving the effect of food traceability.

10: Controllable light source calibration board 11: Color LED matrix display 121: Color LED matrix unit board 1210: LED component 122: Display drive module 13: Color block area 100: Fixed seat 20: Image acquisition device 200: Bracket 30: Remote host 40: Embankment 41: Fish pond 50: Mobile communication wireless router 60: Controllable steering device 61: Carrier 62: Motor 620: Rotating shaft 63: Motor controller 64: Housing P: Display parameter Im: Original image QR: Two-dimensional barcode S: Steering instruction

Figure 1: Block diagram of the field image remote monitoring system of the present invention. Figure 2: Schematic diagram of the present invention applied to a fish pond field. Figure 3: Block diagram of the field image remote monitoring system of the present invention, wherein the controllable light source calibration plate is a color light emitting diode matrix display. Figure 4: Schematic diagram of an original image captured by the imaging device in the present invention. Figure 5: Schematic diagram of another original image captured by the imaging device in the present invention. Figure 6: Block diagram of the field image remote monitoring system of the present invention. Figure 7: Block diagram of the field image remote monitoring system of the present invention, wherein the controllable light source calibration plate is arranged on the controllable steering device. Figure 8A: Schematic diagram of the present invention applied to a fish pond. Figure 8B: Schematic diagram of the original image captured by the imaging device in the scenario of Figure 8A. Figure 9A: Schematic diagram of the present invention applied to a fish pond. Figure 9B: Schematic diagram of the original image captured by the imaging device in the scenario of Figure 9A.

10: Controllable light source calibration board 20: Image acquisition device 30: Remote host P: Display parameters Im: Original image QR: Two-dimensional barcode

Claims (10)

A remote monitoring system for field images includes: a controllable light source color calibration board, which is set in a field to display a picture according to a display parameter, wherein the picture includes at least one color block area, wherein the display parameter includes the distribution position and color code of the at least one color block area; an imaging device, which shoots a target scene in the field and the controllable light source color calibration board to generate an original image, wherein the original image includes the target scene and the at least one color block area; and a remote host, which connects the controllable light source color calibration board and the imaging device, outputs the display parameter to the controllable light source color calibration board, and receives the original image output by the imaging device, so as to analyze the color difference between the display parameter and the at least one color block area in the original image and correct the color of the original image. The field image remote monitoring system as described in claim 1, wherein the image displayed by the controllable light source calibration plate according to the display parameter includes a two-dimensional barcode, the original image captured by the imaging device includes the two-dimensional barcode, and the remote host recognizes the two-dimensional barcode from the original image to obtain information. The field image remote monitoring system as described in claim 1 further comprises a controllable steering device for being set in the field, the controllable steering device comprises a carrier, a motor connected to the carrier, and a motor controller electrically connected to the motor, the controllable light source calibration plate is set on the carrier; the remote host is connected to the motor controller to output a steering command to the motor controller, and the motor controller drives the motor to operate according to the steering command, so that the carrier and the controllable light source calibration plate are turned. A field image remote monitoring system as described in any one of claims 1 to 3, wherein the controllable light source calibration board is a color light emitting diode (LED) matrix display, the color light emitting diode matrix display comprises at least one color LED matrix unit board and a display drive module electrically connected to the at least one color LED matrix unit board, each of the color LED matrix unit boards comprises a plurality of color LED elements arranged in a matrix. A field image remote monitoring system as described in any one of claim items 1 to 3, wherein the controllable light source calibration board is a liquid crystal display or an organic light emitting diode display. A remote monitoring system for fish pond images includes: a controllable light source color calibration board, which is set in a fish pond field to display a picture according to a display parameter, wherein the picture includes at least one color block area, wherein the display parameter includes the distribution position and color code of the at least one color block area; an imaging device, which shoots a fish pond in the fish pond field and the controllable light source color calibration board to generate an original image, wherein the original image includes the fish pond and the at least one color block area; and a remote host, which connects the controllable light source color calibration board and the imaging device, outputs the display parameter to the controllable light source color calibration board, and receives the original image output by the imaging device, so as to analyze the color difference between the display parameter and the at least one color block area of the original image and correct the color of the original image. As described in claim 6, the remote monitoring system for fish pond images, wherein the image displayed by the controllable light source calibration plate according to the display parameter includes a two-dimensional barcode, the original image captured by the imaging device includes the two-dimensional barcode, and the remote host recognizes the two-dimensional barcode from the original image to obtain a fish pond number. The fish pond image remote monitoring system as described in claim 6 further comprises a controllable steering device for being set in the fish pond area, the controllable steering device comprises a carrier, a motor connected to the carrier, and a motor controller electrically connected to the motor, the controllable light source calibration plate is set on the carrier; the remote host is connected to the motor controller to output a steering command to the motor controller, and the motor controller drives the motor to operate according to the steering command, so that the carrier and the controllable light source calibration plate are turned. A remote monitoring system for fish pond images as described in any one of claims 6 to 8, wherein the controllable light source calibration board is a color light emitting diode (LED) matrix display, the color light emitting diode matrix display comprises at least one color LED matrix unit board and a display drive module electrically connected to the at least one color LED matrix unit board, and each of the color LED matrix unit boards comprises a plurality of color LED elements arranged in a matrix. A remote fish pond image monitoring system as described in any one of claim items 6 to 8, wherein the controllable light source calibration board is a liquid crystal display or an organic light emitting diode display.