CN118354019A - Forestry pest monitoring method and system - Google Patents
Forestry pest monitoring method and system Download PDFInfo
- Publication number
- CN118354019A CN118354019A CN202410493917.3A CN202410493917A CN118354019A CN 118354019 A CN118354019 A CN 118354019A CN 202410493917 A CN202410493917 A CN 202410493917A CN 118354019 A CN118354019 A CN 118354019A
- Authority
- CN
- China
- Prior art keywords
- image
- capture device
- image frame
- encoder
- image capture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 111
- 238000000034 method Methods 0.000 title claims abstract description 41
- 241000607479 Yersinia pestis Species 0.000 title claims abstract description 22
- 230000005540 biological transmission Effects 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 7
- 230000001427 coherent effect Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 1
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 1
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
技术领域Technical Field
本发明是关于人机交互设备技术领域,特别是关于一种林业害虫监测方法及系统。The invention relates to the technical field of human-computer interaction equipment, and in particular to a forestry pest monitoring method and system.
背景技术Background technique
林业资源是非常重要的自然资源。为了提高林业资源保护效率,目前我国众多林场已经上线了林业害虫监测系统,该型系统主要包括图像捕捉设备(例如可见光摄像头或者红外摄像头)以及监测终端(例如,移动终端、平板电脑、台式计算机、笔记本计算机等)。目前上线的林业害虫监测系统使用的是通用的通信传输协议(例如LTE或者5G NR),所使用的硬件设备也是一些使用公知的软件的公知设备。经过我方研究发现,这类系统存在清晰度转换速度慢的问题。Forestry resources are very important natural resources. In order to improve the efficiency of forestry resource protection, many forest farms in my country have launched forestry pest monitoring systems. This type of system mainly includes image capture devices (such as visible light cameras or infrared cameras) and monitoring terminals (such as mobile terminals, tablet computers, desktop computers, laptops, etc.). The forestry pest monitoring system currently online uses a common communication transmission protocol (such as LTE or 5G NR), and the hardware equipment used is also some well-known equipment using well-known software. After our research, we found that this type of system has the problem of slow clarity conversion speed.
发明内容Summary of the invention
为实现上述目的,本发明提供了一种林业害虫监测方法,方法包括:To achieve the above object, the present invention provides a forestry pest monitoring method, the method comprising:
由图像捕捉设备获取林业监测图像,其中,林业监测图像包括多个图像帧,并且其中,图像捕捉设备具有第一编码器和第二编码器;Acquiring a forestry monitoring image by an image capture device, wherein the forestry monitoring image includes a plurality of image frames, and wherein the image capture device has a first encoder and a second encoder;
由第一编码器对多个图像帧中的第一图像帧进行编码,其中,经过第一编码器编码的第一图像帧具有第一清晰度以及第一图像帧标识符;Encoding a first image frame among the plurality of image frames by a first encoder, wherein the first image frame encoded by the first encoder has a first definition and a first image frame identifier;
由第二编码器对多个图像帧中的第一图像帧进行编码,其中,经过第二编码器编码的第一图像帧具有第二清晰度以及第二图像帧标识符;The first image frame among the plurality of image frames is encoded by a second encoder, wherein the first image frame encoded by the second encoder has a second definition and a second image frame identifier;
由图像捕捉设备接收监测终端发送的第一清晰度选择指令,其中,第一清晰度选择指令指示图像捕捉设备以第一清晰度向监测终端发送图像帧;The image capture device receives a first definition selection instruction sent by the monitoring terminal, wherein the first definition selection instruction instructs the image capture device to send an image frame to the monitoring terminal at a first definition;
在图像捕捉设备接收到第一清晰度选择指令之后,由图像捕捉设备将经过第一编码器编码的第一图像帧输入发送缓存器。After the image capture device receives the first definition selection instruction, the image capture device inputs the first image frame encoded by the first encoder into the sending buffer.
在一优选的实施方式中,方法还包括:In a preferred embodiment, the method further comprises:
在图像捕捉设备接收到第一清晰度选择指令之后,由图像捕捉设备接收监测终端发送的第二清晰度选择指令,其中,第二清晰度选择指令指示图像捕捉设备以第二清晰度向监测终端发送图像帧;After the image capture device receives the first definition selection instruction, the image capture device receives a second definition selection instruction sent by the monitoring terminal, wherein the second definition selection instruction instructs the image capture device to send an image frame to the monitoring terminal at a second definition;
在图像捕捉设备接收到第二清晰度选择指令之后,由图像捕捉设备将经过第二编码器编码的第一图像帧输入发送缓存器;After the image capture device receives the second definition selection instruction, the image capture device inputs the first image frame encoded by the second encoder into a sending buffer;
在图像捕捉设备将经过第二编码器编码的第一图像帧输入发送缓存器之后,由图像捕捉设备基于第一图像帧标识符以及第二图像帧标识符来判断发送缓存器中是否已经存在经过第一编码器编码的第一图像帧;After the image capture device inputs the first image frame encoded by the second encoder into the sending buffer, the image capture device determines whether the first image frame encoded by the first encoder already exists in the sending buffer based on the first image frame identifier and the second image frame identifier;
如果判断发送缓存器中已经存在经过第一编码器编码的第一图像帧,则由图像捕捉设备将发送缓存器中的经过第一编码器编码的第一图像帧删除。If it is determined that the first image frame encoded by the first encoder already exists in the sending buffer, the image capturing device deletes the first image frame encoded by the first encoder in the sending buffer.
在一优选的实施方式中,由图像捕捉设备基于第一图像帧标识符以及第二图像帧标识符来判断发送缓存器中是否已经存在经过第一编码器编码的第一图像帧包括如下步骤:In a preferred embodiment, the image capture device determines whether the first image frame encoded by the first encoder already exists in the sending buffer based on the first image frame identifier and the second image frame identifier, including the following steps:
由图像捕捉设备依次判断发送缓存器中的所有图像帧的图像帧标识符与第二图像帧标识符是否一致;The image capturing device sequentially determines whether the image frame identifiers of all the image frames in the sending buffer are consistent with the second image frame identifier;
如果图像捕捉设备判断发送缓存器中的经过第一编码器编码的第一图像帧的第一图像帧标识符与第二图像帧标识符一致,则图像捕捉设备判断发送缓存器中已经存在经过第一编码器编码的第一图像帧;If the image capture device determines that the first image frame identifier of the first image frame encoded by the first encoder in the sending buffer is consistent with the second image frame identifier, the image capture device determines that the first image frame encoded by the first encoder already exists in the sending buffer;
如果图像捕捉设备判断发送缓存器中的所有图像帧的图像帧标识符与第二标识符均不一致,则图像捕捉设备判断发送缓存器中不存在经过第一编码器编码的第一图像帧。If the image capture device determines that the image frame identifiers of all the image frames in the sending buffer are inconsistent with the second identifier, the image capture device determines that there is no first image frame encoded by the first encoder in the sending buffer.
在一优选的实施方式中,方法还包括:In a preferred embodiment, the method further comprises:
在图像捕捉设备将发送缓存器中的经过第一编码器编码的第一图像帧删除之后,由图像捕捉设备判断发送缓存器中除了经过第二编码器编码的第一图像帧之外是否还缓存有其它图像帧;After the image capture device deletes the first image frame encoded by the first encoder in the sending buffer, the image capture device determines whether other image frames are buffered in the sending buffer in addition to the first image frame encoded by the second encoder;
如果图像捕捉设备判断发送缓存器中还缓存有其它图像帧,则由图像捕捉设备进一步判断其它图像帧的帧数量是否大于门限值;If the image capture device determines that other image frames are buffered in the sending buffer, the image capture device further determines whether the number of the other image frames is greater than a threshold value;
如果图像捕捉设备进一步判断其它图像帧的帧数量小于门限值,则由图像捕捉设备删除其它图像帧;If the image capture device further determines that the number of frames of other image frames is less than the threshold value, the image capture device deletes the other image frames;
在图像捕捉设备删除其它图像帧之后,由图像捕捉设备将经过第二编码器编码的第一图像帧发送给监测终端。After the image capturing device deletes other image frames, the image capturing device sends the first image frame encoded by the second encoder to the monitoring terminal.
在一优选的实施方式中,方法还包括:In a preferred embodiment, the method further comprises:
如果图像捕捉设备进一步判断其它图像帧的帧数量大于门限值,则由图像捕捉设备将其它图像帧存储到专用存储器中;If the image capture device further determines that the number of frames of the other image frames is greater than the threshold value, the image capture device stores the other image frames in a dedicated memory;
在图像捕捉设备将其它图像帧存储到专用存储器中之后,由图像捕捉设备删除其它图像帧;After the image capture device stores the other image frames in the dedicated memory, the image capture device deletes the other image frames;
在图像捕捉设备删除其它图像帧之后,由图像捕捉设备将经过第二编码器编码的第一图像帧发送给监测终端。After the image capturing device deletes other image frames, the image capturing device sends the first image frame encoded by the second encoder to the monitoring terminal.
在一优选的实施方式中,方法还包括:In a preferred embodiment, the method further comprises:
由图像捕捉设备接收由监测终端发送的调取专用存储器中存储的图像帧的命令;The image capture device receives a command sent by the monitoring terminal to retrieve an image frame stored in the dedicated memory;
在图像捕捉设备接收到调取专用存储器中存储的图像帧的命令之后,由图像捕捉设备将专用存储器中存储的其它图像帧发送给监测终端。After the image capture device receives a command to retrieve an image frame stored in the dedicated memory, the image capture device sends other image frames stored in the dedicated memory to the monitoring terminal.
在一优选的实施方式中,方法还包括:In a preferred embodiment, the method further comprises:
如果判断发送缓存器中不存在经过第一编码器编码的第一图像帧,则由图像捕捉设备将经过第二编码器编码的第一图像帧存储到专用存储器中;If it is determined that the first image frame encoded by the first encoder does not exist in the sending buffer, the image capturing device stores the first image frame encoded by the second encoder in a dedicated memory;
由图像捕捉设备接收由监测终端发送的调取专用存储器中存储的图像帧的命令;The image capture device receives a command sent by the monitoring terminal to retrieve an image frame stored in the dedicated memory;
在图像捕捉设备接收到调取专用存储器中存储的图像帧的命令之后,由图像捕捉设备将专用存储器中存储的经过第二编码器编码的第一图像帧发送给监测终端。After the image capture device receives a command to retrieve an image frame stored in the dedicated memory, the image capture device sends the first image frame stored in the dedicated memory and encoded by the second encoder to the monitoring terminal.
本发明提供了一种林业害虫监测系统,系统包括用于进行以下操作的模块:The present invention provides a forestry pest monitoring system, the system comprising modules for performing the following operations:
由图像捕捉设备获取林业监测图像,其中,林业监测图像包括多个图像帧,并且其中,图像捕捉设备具有第一编码器和第二编码器;Acquiring a forestry monitoring image by an image capture device, wherein the forestry monitoring image includes a plurality of image frames, and wherein the image capture device has a first encoder and a second encoder;
由第一编码器对多个图像帧中的第一图像帧进行编码,其中,经过第一编码器编码的第一图像帧具有第一清晰度以及第一图像帧标识符;Encoding a first image frame among the plurality of image frames by a first encoder, wherein the first image frame encoded by the first encoder has a first definition and a first image frame identifier;
由第二编码器对多个图像帧中的第一图像帧进行编码,其中,经过第二编码器编码的第一图像帧具有第二清晰度以及第二图像帧标识符;The first image frame among the plurality of image frames is encoded by a second encoder, wherein the first image frame encoded by the second encoder has a second definition and a second image frame identifier;
由图像捕捉设备接收监测终端发送的第一清晰度选择指令,其中,第一清晰度选择指令指示图像捕捉设备以第一清晰度向监测终端发送图像帧;The image capture device receives a first definition selection instruction sent by the monitoring terminal, wherein the first definition selection instruction instructs the image capture device to send an image frame to the monitoring terminal at a first definition;
在图像捕捉设备接收到第一清晰度选择指令之后,由图像捕捉设备将经过第一编码器编码的第一图像帧输入发送缓存器。After the image capture device receives the first definition selection instruction, the image capture device inputs the first image frame encoded by the first encoder into the sending buffer.
在一优选的实施方式中,系统还包括用于进行以下操作的模块:In a preferred embodiment, the system further comprises a module for performing the following operations:
在图像捕捉设备接收到第一清晰度选择指令之后,由图像捕捉设备接收监测终端发送的第二清晰度选择指令,其中,第二清晰度选择指令指示图像捕捉设备以第二清晰度向监测终端发送图像帧;After the image capture device receives the first definition selection instruction, the image capture device receives a second definition selection instruction sent by the monitoring terminal, wherein the second definition selection instruction instructs the image capture device to send an image frame to the monitoring terminal at a second definition;
在图像捕捉设备接收到第二清晰度选择指令之后,由图像捕捉设备将经过第二编码器编码的第一图像帧输入发送缓存器;After the image capture device receives the second definition selection instruction, the image capture device inputs the first image frame encoded by the second encoder into a sending buffer;
在图像捕捉设备将经过第二编码器编码的第一图像帧输入发送缓存器之后,由图像捕捉设备基于第一图像帧标识符以及第二图像帧标识符来判断发送缓存器中是否已经存在经过第一编码器编码的第一图像帧;After the image capture device inputs the first image frame encoded by the second encoder into the sending buffer, the image capture device determines whether the first image frame encoded by the first encoder already exists in the sending buffer based on the first image frame identifier and the second image frame identifier;
如果判断发送缓存器中已经存在经过第一编码器编码的第一图像帧,则由图像捕捉设备将发送缓存器中的经过第一编码器编码的第一图像帧删除。If it is determined that the first image frame encoded by the first encoder already exists in the sending buffer, the image capturing device deletes the first image frame encoded by the first encoder in the sending buffer.
在一优选的实施方式中,由图像捕捉设备基于第一图像帧标识符以及第二图像帧标识符来判断发送缓存器中是否已经存在经过第一编码器编码的第一图像帧包括如下步骤:In a preferred embodiment, the image capture device determines whether the first image frame encoded by the first encoder already exists in the sending buffer based on the first image frame identifier and the second image frame identifier, including the following steps:
由图像捕捉设备依次判断发送缓存器中的所有图像帧的图像帧标识符与第二图像帧标识符是否一致;The image capturing device sequentially determines whether the image frame identifiers of all the image frames in the sending buffer are consistent with the second image frame identifier;
如果图像捕捉设备判断发送缓存器中的经过第一编码器编码的第一图像帧的第一图像帧标识符与第二图像帧标识符一致,则图像捕捉设备判断发送缓存器中已经存在经过第一编码器编码的第一图像帧;If the image capture device determines that the first image frame identifier of the first image frame encoded by the first encoder in the sending buffer is consistent with the second image frame identifier, the image capture device determines that the first image frame encoded by the first encoder already exists in the sending buffer;
如果图像捕捉设备判断发送缓存器中的所有图像帧的图像帧标识符与第二标识符均不一致,则图像捕捉设备判断发送缓存器中不存在经过第一编码器编码的第一图像帧。If the image capture device determines that the image frame identifiers of all the image frames in the sending buffer are inconsistent with the second identifier, the image capture device determines that there is no first image frame encoded by the first encoder in the sending buffer.
与现有技术相比,本发明具有如下有益效果:对于林业害虫监测而言,由于监测视频没有音频,而且出于监测的目的,图像帧的播放不连贯也不影响实现监测的目的,所以针对林业害虫监测系统而言,牺牲清晰度切换的速度来实现视频的连贯播放是不必要的。此外,林业害虫监测过程中,希望能够快速切换清晰度以保证监测的准确性,因此现有系统已经不能满足林业害虫监测的要求。但是遗憾的是,目前尚不存在专用于林业害虫监测的视频传输系统,因此针对林业害虫监测而言,目前无法提高清晰度切换的速度。本发明提出的方法旨在提高清晰度切换的速度。Compared with the prior art, the present invention has the following beneficial effects: for forest pest monitoring, since the monitoring video has no audio, and for the purpose of monitoring, the incoherent playback of the image frame does not affect the purpose of monitoring, so for the forest pest monitoring system, it is unnecessary to sacrifice the speed of clarity switching to achieve the coherent playback of the video. In addition, during the forest pest monitoring process, it is hoped that the clarity can be switched quickly to ensure the accuracy of monitoring, so the existing system can no longer meet the requirements of forest pest monitoring. Unfortunately, there is currently no video transmission system dedicated to forest pest monitoring, so for forest pest monitoring, it is currently impossible to increase the speed of clarity switching. The method proposed in the present invention aims to increase the speed of clarity switching.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是本发明的一个实施例的系统架构示意图。FIG1 is a schematic diagram of a system architecture according to an embodiment of the present invention.
图2是本发明的一个实施例的图像捕捉设备的逻辑框图。FIG. 2 is a logical block diagram of an image capture device according to an embodiment of the present invention.
图3是本发明的一个实施例的方法流程图。FIG. 3 is a flow chart of a method according to an embodiment of the present invention.
图4是本发明的一个示例性的发送缓存器中的图像帧的序列示图。FIG. 4 is a diagram showing a sequence of image frames in an exemplary sending buffer according to the present invention.
图5是本发明的另一个示例性的发送缓存器中的图像帧的序列示图。FIG. 5 is another exemplary sequence diagram of image frames in a sending buffer according to the present invention.
图6是本发明的另一个示例性的发送缓存器中的图像帧的序列示图。FIG. 6 is another exemplary sequence diagram of image frames in a sending buffer according to the present invention.
具体实施方式Detailed ways
下面结合附图,对本发明的具体实施方式进行详细描述,但应当理解本发明的保护范围并不受具体实施方式的限制。The specific implementation modes of the present invention are described in detail below in conjunction with the accompanying drawings, but it should be understood that the protection scope of the present invention is not limited by the specific implementation modes.
如背景技术中所述,目前的林业害虫监测系统存在清晰度转换速度慢的问题。具体分析如下:由于目前林业害虫监测系统使用的是公知的流媒体传输方法,所以其清晰度(也可以成为分辨率,目前主流的清晰度有240P、360P、720P以及1080P等)切换速度较慢。经过我方研究发现,清晰度切换速度慢的具体原因在于,目前的摄像头内部只有一套图像编码器,这一套图像编码器可以基于HEVC协议或者h.265协议或者任何公知的图像编码方式以某一个清晰度对每一帧图像进行编码,随后编码器将经过编码的图像帧输入到发射机链(transmitter chain)的发送缓存器中等待发送。当摄像头接收到监测终端发送的清晰度切换命令之后,前述编码器对尚未发送的图像帧以新的清晰度进行编码,随后编码器将以新的清晰度进行编码的图像帧输入发送缓存器等待发送。现有系统中,可以理解的是,发射机链必须按照先入先出的形式将缓存器中的其它图像帧发送完成,随后才能够发送该以新的清晰度进行编码的图像帧。因此,当前系统清晰度切换速度较慢的主要因素包括,编码器转换编码清晰度的时间,以及发射机链发送以旧的清晰度编码的图像帧的时间。以主流视频播放软件为例,一般清晰度切换的时间一般为5s以上(如果网络条件较差,该时间可能达到10s以上)。当前林业监测系统的清晰度切换时间也至少需要5s以上。当前视频清晰度切换方式对于娱乐视频软件而言是合适的,因为播放娱乐视频要求视频必须连贯(由于娱乐视频包括声音和图像,如果图像跳帧则声音也将不连续,所以播放娱乐视频要求视频必须连贯),因此对于娱乐视频软件而言,可以牺牲清晰度切换的速度来实现视频的连贯播放。但是对于林业害虫监测而言,由于监测视频没有音频,而且出于监测的目的,图像帧的播放不连贯也不影响实现监测的目的,所以针对林业害虫监测系统而言,牺牲清晰度切换的速度来实现视频的连贯播放是不必要的。此外,林业害虫监测过程中,希望能够快速切换清晰度以保证监测的准确性,因此现有系统已经不能满足林业监测的要求。但是遗憾的是,目前尚不存在专用于林业监测的视频传输系统,因此针对林业害虫监测而言,目前无法提高清晰度切换的速度。本发明提出的方法旨在提高清晰度切换的速度。As described in the background technology, the current forest pest monitoring system has the problem of slow resolution conversion speed. The specific analysis is as follows: Since the current forest pest monitoring system uses a well-known streaming media transmission method, its resolution (also known as resolution, the current mainstream resolutions are 240P, 360P, 720P and 1080P, etc.) switching speed is slow. After our research, we found that the specific reason for the slow resolution switching speed is that there is only one set of image encoders inside the current camera, and this set of image encoders can encode each frame of the image with a certain resolution based on the HEVC protocol or the h.265 protocol or any known image encoding method, and then the encoder inputs the encoded image frame into the sending buffer of the transmitter chain to wait for sending. When the camera receives the resolution switching command sent by the monitoring terminal, the aforementioned encoder encodes the image frame that has not yet been sent with the new resolution, and then the encoder inputs the image frame encoded with the new resolution into the sending buffer to wait for sending. In the existing system, it is understandable that the transmitter chain must send the other image frames in the buffer in a first-in-first-out manner before sending the image frame encoded with the new definition. Therefore, the main factors for the slow definition switching speed of the current system include the time for the encoder to convert the encoding definition and the time for the transmitter chain to send the image frame encoded with the old definition. Taking mainstream video playback software as an example, the time for general definition switching is generally more than 5s (if the network conditions are poor, the time may reach more than 10s). The definition switching time of the current forestry monitoring system also requires at least 5s. The current video definition switching method is suitable for entertainment video software, because playing entertainment videos requires that the video must be coherent (since entertainment videos include sound and images, if the image jumps frames, the sound will also be discontinuous, so playing entertainment videos requires that the video must be coherent), so for entertainment video software, the speed of definition switching can be sacrificed to achieve coherent video playback. However, for forest pest monitoring, since the monitoring video has no audio, and for the purpose of monitoring, the incoherent playback of the image frame does not affect the purpose of monitoring, it is unnecessary for the forest pest monitoring system to sacrifice the speed of clarity switching to achieve continuous video playback. In addition, during forest pest monitoring, it is hoped that the clarity can be quickly switched to ensure the accuracy of monitoring, so the existing system can no longer meet the requirements of forestry monitoring. Unfortunately, there is currently no video transmission system dedicated to forestry monitoring, so for forest pest monitoring, it is currently impossible to increase the speed of clarity switching. The method proposed in the present invention aims to increase the speed of clarity switching.
图1是本发明的一个实施例的系统架构示意图。本发明的系统可以包括一个或多个图像捕捉设备,图像捕捉设备用于获取监测图像,并将监测图像进行编码和发送,监测终端用于发送必要的命令(包括本发明所提出的命令以及其它公知的控制图像捕捉设备的命令,例如控制图像捕捉设备的角度的命令)来控制图像捕捉设备,并且监测终端可以将监测视频展示给科研人员。Fig. 1 is a schematic diagram of the system architecture of an embodiment of the present invention. The system of the present invention may include one or more image capture devices, the image capture devices are used to obtain monitoring images, encode and send the monitoring images, the monitoring terminal is used to send necessary commands (including the commands proposed by the present invention and other well-known commands for controlling the image capture devices, such as commands for controlling the angle of the image capture devices) to control the image capture devices, and the monitoring terminal can display the monitoring video to scientific researchers.
图2是本发明的一个实施例的图像捕捉设备的逻辑框图。本领域技术人员应该理解的是,图2仅示出了与本发明有关的器件,省略了公知的、且与本发明无关的器件(例如图像捕捉设备应该还具有模数转换器,发射机链中应当存在上变频、调制解调器、放大器、RF器件等,但是这些器件均是公知器件,且与本发明无关,故而没有详细描述)。本发明使用的编码器可以是现有的任何编码器,例如公知的基于HEVC协议对图像进行编码的编码器。本领域技术人员应该理解的是,只需要软件编写人员将本发明的方法编写成软件代码,随后当图像捕捉设备的处理器执行这些软件代码时,图像捕捉设备即可以执行本发明提出的方法。另外需要指出的是,当然也可以为第二编码器也配置一个发射机链,但是这样操作将导致清晰度切换速度变慢,因为在清晰度切换到第二清晰度之前,第二编码器的发射机链是不工作的,而第二编码器的发射机链从待机状态变为工作状态需要RF器件进行频率调谐等操作,这种操作将减慢清晰度切换的速度。所以本发明的设计是两个编码器共用一套发射机链。FIG2 is a logic block diagram of an image capture device according to an embodiment of the present invention. It should be understood by those skilled in the art that FIG2 only shows devices related to the present invention, and omits well-known devices that are not related to the present invention (for example, the image capture device should also have an analog-to-digital converter, and there should be up-conversion, modems, amplifiers, RF devices, etc. in the transmitter chain, but these devices are all well-known devices and are not related to the present invention, so they are not described in detail). The encoder used in the present invention can be any existing encoder, such as a well-known encoder for encoding images based on the HEVC protocol. It should be understood by those skilled in the art that only software writers need to write the method of the present invention into software codes, and then when the processor of the image capture device executes these software codes, the image capture device can execute the method proposed in the present invention. It should also be pointed out that, of course, a transmitter chain can also be configured for the second encoder, but such operation will result in a slower resolution switching speed, because before the resolution is switched to the second resolution, the transmitter chain of the second encoder is not working, and the transmitter chain of the second encoder changes from the standby state to the working state. The RF device needs to perform frequency tuning and other operations, which will slow down the resolution switching speed. Therefore, the design of the present invention is that two encoders share a set of transmitter chains.
实施例1Example 1
图3是本发明的一个实施例的方法流程图。本发明的方法包括如下步骤:FIG3 is a flow chart of a method according to an embodiment of the present invention. The method according to the present invention comprises the following steps:
步骤1:由图像捕捉设备获取林业监测图像,其中,林业监测图像包括多个图像帧,并且其中,图像捕捉设备具有第一编码器和第二编码器;Step 1: Acquire a forestry monitoring image by an image capture device, wherein the forestry monitoring image includes a plurality of image frames, and wherein the image capture device has a first encoder and a second encoder;
步骤2:由第一编码器对多个图像帧中的第一图像帧进行编码,其中,经过第一编码器编码的第一图像帧具有第一清晰度以及第一图像帧标识符;Step 2: encoding a first image frame among the plurality of image frames by a first encoder, wherein the first image frame encoded by the first encoder has a first definition and a first image frame identifier;
步骤3:由第二编码器对多个图像帧中的第一图像帧进行编码,其中,经过第二编码器编码的第一图像帧具有第二清晰度以及第二图像帧标识符;可以理解的是,第一清晰度与第二清晰度可以是任意数值,为了讨论的方便,本发明下文将第一清晰度假定为360P,第二清晰度假定为720P。另外可以理解的是,本发明的监测终端可以通过发送命令的方式将第一编码器对应的第一清晰度随时调整为其它清晰度,这一操作与背景技术中介绍的现有系统的操作(以及当前娱乐播放APP的操作)类似,在此不再赘述。但是如果通过发送命令的方式将第一编码器对应的第一清晰度随时调整为其它清晰度,则清晰度切换的速度则与现有技术类似。所以在使用本发明的系统时,推荐监测终端在图像捕捉设备开机上电时,预先将第一编码器对应的清晰度定义为360P(当然也可以定义为其它数值),将第二编码器对应的清晰度定义为720P,在监测过程中不再改变第一和第二编码器的配置,从而可以持续保持高速的清晰度切换。考虑到本发明是用于林业监测领域,所以将清晰度固定为两个清晰度是足够的。应当理解的是,不论监测终端选择哪一个清晰度,两个编码器均需要同步编码图像帧,但是最终发送的图像只是两个编码器编码的两个图像帧中的一个图像帧。在一个示例中,第一图像帧标识符可以是自然数,第二图像帧标识符可以是自然数;应当理解的是,在本发明中,每一帧图像需要顺序编号,例如开机上电之后,图像捕捉设备的第一编码器编码的第一帧图像的图像帧标识符是“1”,开机上电之后,图像捕捉设备的第二编码器编码的第一帧图像的图像帧标识符也是“1”(可以理解的是,第二编码器编码的第一帧图像与第一编码器编码的第一帧图像是完全相同的,因为这两者都是镜头捕捉的同一个图像),开机上电之后,图像捕捉设备的第一编码器编码的第二帧图像的图像帧标识符是“2”,开机上电之后,图像捕捉设备的第二编码器编码的第一帧图像的图像帧标识符也是“2”(也即第二编码器为图像帧添加图像帧标识符的操作与第一编码器完全相同),并以此类推。当然为了节省存储空间,并降低操作开销,图像帧标识符的自然数应当设置上限,例如可以设计图像帧标识符的自然数上限为500,也即开机上电之后,图像捕捉设备的第一编码器编码的第500帧图像的图像帧标识符是“500”,而图像捕捉设备的第一编码器编码的第501帧图像的图像帧标识符是“1”。当然,自然数的上限可以随意设置,但是作为原则,需要保证图像帧标识符归1之后,发送缓存器中的图像帧不可能仍然存在图像帧标识符为“1”的图像帧。此外,在一个示例中,当前步骤中,如果图像捕捉设备在预设时间内没有接收到第二清晰度选择指令,则第二编码器编码的第一图像帧并不会进入发送缓存器,此时可以有如下选择:例如可以将第二编码器编码的第一图像帧直接删除,还可以将第二编码器编码的第一图像帧存储到图像捕捉设备的存储器中,以备随后的使用;预设时间可以是预计第一编码器编码的第一图像帧已经被发送给监测终端的时间;Step 3: The first image frame among the plurality of image frames is encoded by the second encoder, wherein the first image frame encoded by the second encoder has a second definition and a second image frame identifier; it is understood that the first definition and the second definition can be any values. For the convenience of discussion, the present invention will assume the first definition to be 360P and the second definition to be 720P. It is also understood that the monitoring terminal of the present invention can adjust the first definition corresponding to the first encoder to other definitions at any time by sending a command. This operation is similar to the operation of the existing system introduced in the background technology (and the operation of the current entertainment playback APP), and will not be repeated here. However, if the first definition corresponding to the first encoder is adjusted to other definitions at any time by sending a command, the speed of definition switching is similar to that of the prior art. Therefore, when using the system of the present invention, it is recommended that the monitoring terminal define the definition corresponding to the first encoder as 360P (of course, it can also be defined as other values) in advance when the image capture device is powered on, and define the definition corresponding to the second encoder as 720P. The configuration of the first and second encoders will not be changed during the monitoring process, so that the high-speed definition switching can be maintained continuously. Considering that the present invention is used in the field of forestry monitoring, it is sufficient to fix the definition to two definitions. It should be understood that no matter which definition the monitoring terminal selects, the two encoders need to synchronously encode the image frame, but the image finally sent is only one of the two image frames encoded by the two encoders. In one example, the first image frame identifier can be a natural number, and the second image frame identifier can be a natural number; it should be understood that in the present invention, each frame of the image needs to be numbered sequentially, for example, after powering on, the image frame identifier of the first frame of the image encoded by the first encoder of the image capture device is "1", and after powering on, the image frame identifier of the first frame of the image encoded by the second encoder of the image capture device is also "1" (it can be understood that the first frame of the image encoded by the second encoder is exactly the same as the first frame of the image encoded by the first encoder, because both are the same image captured by the lens), after powering on, the image frame identifier of the second frame of the image encoded by the first encoder of the image capture device is "2", and after powering on, the image frame identifier of the first frame of the image encoded by the second encoder of the image capture device is also "2" (that is, the operation of the second encoder adding the image frame identifier to the image frame is exactly the same as the first encoder), and so on. Of course, in order to save storage space and reduce operating overhead, the natural number of the image frame identifier should be set with an upper limit. For example, the natural number upper limit of the image frame identifier can be designed to be 500, that is, after powering on, the image frame identifier of the 500th frame of the image encoded by the first encoder of the image capture device is "500", and the image frame identifier of the 501st frame of the image encoded by the first encoder of the image capture device is "1". Of course, the upper limit of the natural number can be set arbitrarily, but as a principle, it is necessary to ensure that after the image frame identifier returns to 1, there cannot still be image frames with an image frame identifier of "1" in the sending buffer. In addition, in one example, in the current step, if the image capture device does not receive the second definition selection instruction within the preset time, the first image frame encoded by the second encoder will not enter the sending buffer. At this time, the following options can be available: for example, the first image frame encoded by the second encoder can be directly deleted, and the first image frame encoded by the second encoder can also be stored in the memory of the image capture device for subsequent use; the preset time can be the time when the first image frame encoded by the first encoder is expected to have been sent to the monitoring terminal;
步骤4:由图像捕捉设备接收监测终端发送的第一清晰度选择指令,其中,第一清晰度选择指令指示图像捕捉设备以第一清晰度向监测终端发送图像帧;需要理解的是,第一清晰度选择指令仅指示图像捕捉设备使用第一清晰度向监测终端发送图像帧,而不能改变第一编码器对应的第一清晰度,例如,第一清晰度为360P,那么第一清晰度选择指令只能够指示图像捕捉设备使用360P向监测终端发送图像帧,而不能将360P调整为其它数值;Step 4: The image capture device receives a first definition selection instruction sent by the monitoring terminal, wherein the first definition selection instruction instructs the image capture device to send image frames to the monitoring terminal at the first definition. It should be understood that the first definition selection instruction only instructs the image capture device to send image frames to the monitoring terminal at the first definition, but cannot change the first definition corresponding to the first encoder. For example, if the first definition is 360P, the first definition selection instruction can only instruct the image capture device to send image frames to the monitoring terminal at 360P, but cannot adjust 360P to other values.
步骤5:在图像捕捉设备接收到第一清晰度选择指令之后,由图像捕捉设备将经过第一编码器编码的第一图像帧输入发送缓存器。Step 5: After the image capture device receives the first definition selection instruction, the image capture device inputs the first image frame encoded by the first encoder into the sending buffer.
实施例2Example 2
在实施例2中,方法还包括:In embodiment 2, the method further comprises:
在图像捕捉设备接收到第一清晰度选择指令之后,由图像捕捉设备接收监测终端发送的第二清晰度选择指令,其中,第二清晰度选择指令指示图像捕捉设备以第二清晰度向监测终端发送图像帧;如前述,第二清晰度选择指令仅指示图像捕捉设备使用第二清晰度向监测终端发送图像帧,而不能改变第二编码器对应的第二清晰度;After the image capture device receives the first definition selection instruction, the image capture device receives a second definition selection instruction sent by the monitoring terminal, wherein the second definition selection instruction instructs the image capture device to send image frames to the monitoring terminal at the second definition; as mentioned above, the second definition selection instruction only instructs the image capture device to send image frames to the monitoring terminal at the second definition, but cannot change the second definition corresponding to the second encoder;
在图像捕捉设备接收到第二清晰度选择指令之后,由图像捕捉设备将经过第二编码器编码的第一图像帧输入发送缓存器;应当理解的是,图像捕捉设备接收到第二清晰度选择指令指的是在预设时间内接收到第二清晰度选择指令;After the image capture device receives the second definition selection instruction, the image capture device inputs the first image frame encoded by the second encoder into the sending buffer; it should be understood that the image capture device receiving the second definition selection instruction means receiving the second definition selection instruction within a preset time;
在图像捕捉设备将经过第二编码器编码的第一图像帧输入发送缓存器之后,由图像捕捉设备基于第一图像帧标识符以及第二图像帧标识符来判断发送缓存器中是否已经存在经过第一编码器编码的第一图像帧;After the image capture device inputs the first image frame encoded by the second encoder into the sending buffer, the image capture device determines whether the first image frame encoded by the first encoder already exists in the sending buffer based on the first image frame identifier and the second image frame identifier;
如果判断发送缓存器中已经存在经过第一编码器编码的第一图像帧,则由图像捕捉设备将发送缓存器中的经过第一编码器编码的第一图像帧删除。应当理解的是,该操作是为了保证不会重复传输同一帧图像。If it is determined that the first image frame encoded by the first encoder already exists in the sending buffer, the image capture device deletes the first image frame encoded by the first encoder in the sending buffer. It should be understood that this operation is to ensure that the same frame of image is not transmitted repeatedly.
实施例3Example 3
在实施例3中,由图像捕捉设备基于第一图像帧标识符以及第二图像帧标识符来判断发送缓存器中是否已经存在经过第一编码器编码的第一图像帧包括如下步骤:In Embodiment 3, the image capturing device determines whether the first image frame encoded by the first encoder already exists in the sending buffer based on the first image frame identifier and the second image frame identifier, including the following steps:
由图像捕捉设备依次判断发送缓存器中的所有图像帧的图像帧标识符与第二图像帧标识符是否一致;结合图4-6,图4-6分别展示了发送缓存器中图像帧序列的三种可能性,在图4-6中,方向左是缓存器的头部,方向右是缓存器的尾部,以图4为例,图像帧A将被第一个发送,而图像帧B将被第二个发送。图4中展示了经过第一编码器编码的第一图像帧前后均有图像帧的示例,图5中展示了仅在经过第一编码器编码的第一图像帧之前有图像帧的示例,图6中展示了仅在经过第一编码器编码的第一图像帧之后有图像帧的示例,这三种情况均能够适用本发明提出的方法。依次判断发送缓存器中的所有图像帧的图像帧标识符与第二图像帧标识符是否一致的具体示例可以是(以图5为例),图像捕捉设备首先判断图像帧A的图像帧标识符是否与第二图像帧标识符一致,根据前面的实施例的描述,本发明不会存在图像帧A的图像帧标识符与第二图像帧标识符一致的情况(因为图像帧A与经过第二编码器编码的第一图像帧不是同一个图像),仅有可能存在对于同一个图像,两个编码器编码的两帧图像的图像标识符一致的情况。例如图像帧A的图像帧标识符是3,而第二图像帧标识符是6,则判断图像帧A的图像帧标识符与第二图像帧标识符不一致,随后图像捕捉设备再判断图像帧B的图像帧标识符是否与第二图像帧标识符一致,随后图像捕捉设备再判断图像帧C的图像帧标识符是否与第二图像帧标识符一致,以此类推;The image capture device sequentially determines whether the image frame identifiers of all the image frames in the sending buffer are consistent with the second image frame identifier; combined with Figures 4-6, Figures 4-6 respectively show three possibilities of sending the image frame sequence in the buffer. In Figures 4-6, the left direction is the head of the buffer, and the right direction is the tail of the buffer. Taking Figure 4 as an example, image frame A will be sent first, and image frame B will be sent second. Figure 4 shows an example in which there are image frames before and after the first image frame encoded by the first encoder, Figure 5 shows an example in which there are image frames only before the first image frame encoded by the first encoder, and Figure 6 shows an example in which there are image frames only after the first image frame encoded by the first encoder. These three situations are all applicable to the method proposed by the present invention. A specific example of sequentially determining whether the image frame identifiers of all image frames in the sending buffer are consistent with the second image frame identifier may be (taking FIG. 5 as an example), the image capture device first determines whether the image frame identifier of image frame A is consistent with the second image frame identifier. According to the description of the previous embodiment, the present invention will not have a situation where the image frame identifier of image frame A is consistent with the second image frame identifier (because image frame A and the first image frame encoded by the second encoder are not the same image). It is only possible that for the same image, the image identifiers of two frames of images encoded by two encoders are consistent. For example, if the image frame identifier of image frame A is 3, and the second image frame identifier is 6, it is determined that the image frame identifier of image frame A is inconsistent with the second image frame identifier, and then the image capture device determines whether the image frame identifier of image frame B is consistent with the second image frame identifier, and then the image capture device determines whether the image frame identifier of image frame C is consistent with the second image frame identifier, and so on;
如果图像捕捉设备判断发送缓存器中的经过第一编码器编码的第一图像帧的第一图像帧标识符与第二图像帧标识符一致,则图像捕捉设备判断发送缓存器中已经存在经过第一编码器编码的第一图像帧;If the image capture device determines that the first image frame identifier of the first image frame encoded by the first encoder in the sending buffer is consistent with the second image frame identifier, the image capture device determines that the first image frame encoded by the first encoder already exists in the sending buffer;
如果图像捕捉设备判断发送缓存器中的所有图像帧的图像帧标识符与第二标识符均不一致,则图像捕捉设备判断发送缓存器中不存在经过第一编码器编码的第一图像帧。If the image capture device determines that the image frame identifiers of all the image frames in the sending buffer are inconsistent with the second identifier, the image capture device determines that there is no first image frame encoded by the first encoder in the sending buffer.
实施例4Example 4
在实施例4中,方法还包括:In embodiment 4, the method further comprises:
在图像捕捉设备将发送缓存器中的经过第一编码器编码的第一图像帧删除之后,由图像捕捉设备判断发送缓存器中除了经过第二编码器编码的第一图像帧之外是否还缓存有其它图像帧;仍以图4-6为例,在删除经过第一编码器编码的第一图像帧之后,发送缓存器中还存在图像帧A-C(当然在该示例中假定在图像捕捉设备进行实施例3的操作以及删除经过第一编码器编码的第一图像帧的操作的过程中,图像帧A-C尚没有被发送),那么在该示例中,“除了经过第二编码器编码的第一图像帧之外的其它图像帧”就是图像帧A-C;After the image capture device deletes the first image frame encoded by the first encoder in the sending buffer, the image capture device determines whether other image frames are cached in the sending buffer in addition to the first image frame encoded by the second encoder; still taking Figures 4-6 as an example, after deleting the first image frame encoded by the first encoder, image frames A-C still exist in the sending buffer (of course, in this example, it is assumed that during the process of the image capture device performing the operation of Example 3 and deleting the first image frame encoded by the first encoder, image frames A-C have not been sent), then in this example, "other image frames in addition to the first image frame encoded by the second encoder" are image frames A-C;
如果图像捕捉设备判断发送缓存器中还缓存有其它图像帧,则由图像捕捉设备进一步判断其它图像帧的帧数量是否大于门限值;在一个示例中,该门限值可以由用户定义,用户可以根据能够容忍的画面跳帧的极限来定义门限值。例如用户认为监测视频中丢失5帧不会影响监测结果,则可以将该门限值设置为5;If the image capture device determines that there are other image frames cached in the sending buffer, the image capture device further determines whether the number of other image frames is greater than a threshold value; in one example, the threshold value can be defined by the user, and the user can define the threshold value based on the tolerable limit of frame skipping. For example, if the user believes that the loss of 5 frames in the monitoring video will not affect the monitoring result, the threshold value can be set to 5;
如果图像捕捉设备进一步判断其它图像帧的帧数量小于门限值,则由图像捕捉设备删除其它图像帧;可以理解的是,在图像捕捉设备删除其它图像帧之后,经过第二编码器编码的第一图像帧来到了发送缓存器的最靠前位置,也即随后就能够马上发送经过第二编码器编码的第一图像帧,这大大提高了系统切换清晰度的速度,如前所述,由于用户认为删除图像帧A-C不会影响监测结果,所以可以删除这几帧图像,再次需要说明的是,由于本发明是林业监测领域,所以与娱乐视频播放不同,本发明不需要考虑用户观看视频的连贯性,也不需要考虑音视频同步的问题,因此本发明设计了该实施例。经过我方保密测试,本发明提出的系统的清晰度切换时间平均只需要2s,在网络状况良好的情况下,最优切换时间能够达到1s以下。If the image capture device further determines that the number of frames of other image frames is less than the threshold value, the image capture device deletes the other image frames; it can be understood that after the image capture device deletes the other image frames, the first image frame encoded by the second encoder comes to the frontmost position of the sending buffer, that is, the first image frame encoded by the second encoder can be sent immediately afterwards, which greatly improves the speed of switching clarity of the system. As mentioned above, since the user believes that deleting image frames A-C will not affect the monitoring results, these frames of images can be deleted. It should be noted again that since the present invention is in the field of forestry monitoring, it is different from entertainment video playback. The present invention does not need to consider the continuity of the user's video viewing, nor does it need to consider the problem of audio and video synchronization. Therefore, the present invention designs this embodiment. After our confidentiality test, the clarity switching time of the system proposed by the present invention only takes an average of 2s. Under good network conditions, the optimal switching time can reach less than 1s.
在图像捕捉设备删除其它图像帧之后,由图像捕捉设备将经过第二编码器编码的第一图像帧发送给监测终端。After the image capturing device deletes other image frames, the image capturing device sends the first image frame encoded by the second encoder to the monitoring terminal.
实施例5Example 5
在实施例5中,方法还包括:In embodiment 5, the method further comprises:
如果图像捕捉设备进一步判断其它图像帧的帧数量大于门限值,则由图像捕捉设备将其它图像帧存储到专用存储器中;在一个示例中,专用存储器可以是图像捕捉设备的主存储器中单独划分的一块存储空间,该操作的优势在于降低了存储器寻址所需要的时间,图像捕捉设备可以直接在该专用存储器中寻找被删除的其它图像帧;If the image capture device further determines that the number of other image frames is greater than the threshold value, the image capture device stores the other image frames in a dedicated memory; in one example, the dedicated memory may be a separate storage space in the main memory of the image capture device. The advantage of this operation is that the time required for memory addressing is reduced, and the image capture device can directly search for the deleted other image frames in the dedicated memory;
在图像捕捉设备将其它图像帧存储到专用存储器中之后,由图像捕捉设备删除其它图像帧;After the image capture device stores the other image frames in the dedicated memory, the image capture device deletes the other image frames;
在图像捕捉设备删除其它图像帧之后,由图像捕捉设备将经过第二编码器编码的第一图像帧发送给监测终端。After the image capturing device deletes other image frames, the image capturing device sends the first image frame encoded by the second encoder to the monitoring terminal.
进一步的,方法还包括:由图像捕捉设备接收由监测终端发送的调取专用存储器中存储的图像帧的命令;在一个示例中,调取专用存储器中存储的图像帧的命令可以指示图像捕捉设备将专用存储器中存储的所有图像帧发送给监测终端,也可以指示图像捕捉设备将特定时间段内存储到专用存储器中的图像帧发送给监测终端;在图像捕捉设备接收到调取专用存储器中存储的图像帧的命令之后,由图像捕捉设备将专用存储器中存储的其它图像帧发送给监测终端。Furthermore, the method also includes: the image capture device receives a command sent by the monitoring terminal to retrieve image frames stored in the dedicated memory; in one example, the command to retrieve image frames stored in the dedicated memory can instruct the image capture device to send all image frames stored in the dedicated memory to the monitoring terminal, or can instruct the image capture device to send image frames stored in the dedicated memory within a specific time period to the monitoring terminal; after the image capture device receives the command to retrieve image frames stored in the dedicated memory, the image capture device sends other image frames stored in the dedicated memory to the monitoring terminal.
进一步的,方法还包括:如果判断发送缓存器中不存在经过第一编码器编码的第一图像帧,则由图像捕捉设备将经过第二编码器编码的第一图像帧存储到专用存储器中;由图像捕捉设备接收由监测终端发送的调取专用存储器中存储的图像帧的命令;在图像捕捉设备接收到调取专用存储器中存储的图像帧的命令之后,由图像捕捉设备将专用存储器中存储的经过第二编码器编码的第一图像帧发送给监测终端。Furthermore, the method also includes: if it is determined that the first image frame encoded by the first encoder does not exist in the sending buffer, the image capture device stores the first image frame encoded by the second encoder in a dedicated memory; the image capture device receives a command sent by the monitoring terminal to retrieve the image frame stored in the dedicated memory; after the image capture device receives the command to retrieve the image frame stored in the dedicated memory, the image capture device sends the first image frame encoded by the second encoder stored in the dedicated memory to the monitoring terminal.
实施例6Example 6
本发明提供了一种林业害虫监测系统,系统包括用于进行以下操作的模块:The present invention provides a forestry pest monitoring system, the system comprising modules for performing the following operations:
由图像捕捉设备获取林业监测图像,其中,林业监测图像包括多个图像帧,并且其中,图像捕捉设备具有第一编码器和第二编码器;Acquiring a forestry monitoring image by an image capture device, wherein the forestry monitoring image includes a plurality of image frames, and wherein the image capture device has a first encoder and a second encoder;
由第一编码器对多个图像帧中的第一图像帧进行编码,其中,经过第一编码器编码的第一图像帧具有第一清晰度以及第一图像帧标识符;Encoding a first image frame among the plurality of image frames by a first encoder, wherein the first image frame encoded by the first encoder has a first definition and a first image frame identifier;
由第二编码器对多个图像帧中的第一图像帧进行编码,其中,经过第二编码器编码的第一图像帧具有第二清晰度以及第二图像帧标识符;The first image frame among the plurality of image frames is encoded by a second encoder, wherein the first image frame encoded by the second encoder has a second definition and a second image frame identifier;
由图像捕捉设备接收监测终端发送的第一清晰度选择指令,其中,第一清晰度选择指令指示图像捕捉设备以第一清晰度向监测终端发送图像帧;The image capture device receives a first definition selection instruction sent by the monitoring terminal, wherein the first definition selection instruction instructs the image capture device to send an image frame to the monitoring terminal at a first definition;
在图像捕捉设备接收到第一清晰度选择指令之后,由图像捕捉设备将经过第一编码器编码的第一图像帧输入发送缓存器。After the image capture device receives the first definition selection instruction, the image capture device inputs the first image frame encoded by the first encoder into the sending buffer.
进一步的,系统还包括用于进行以下操作的模块:在图像捕捉设备接收到第一清晰度选择指令之后,由图像捕捉设备接收监测终端发送的第二清晰度选择指令,其中,第二清晰度选择指令指示图像捕捉设备以第二清晰度向监测终端发送图像帧;在图像捕捉设备接收到第二清晰度选择指令之后,由图像捕捉设备将经过第二编码器编码的第一图像帧输入发送缓存器;在图像捕捉设备将经过第二编码器编码的第一图像帧输入发送缓存器之后,由图像捕捉设备基于第一图像帧标识符以及第二图像帧标识符来判断发送缓存器中是否已经存在经过第一编码器编码的第一图像帧;如果判断发送缓存器中已经存在经过第一编码器编码的第一图像帧,则由图像捕捉设备将发送缓存器中的经过第一编码器编码的第一图像帧删除。Furthermore, the system also includes a module for performing the following operations: after the image capture device receives the first clarity selection instruction, the image capture device receives a second clarity selection instruction sent by the monitoring terminal, wherein the second clarity selection instruction instructs the image capture device to send image frames to the monitoring terminal with the second clarity; after the image capture device receives the second clarity selection instruction, the image capture device inputs the first image frame encoded by the second encoder into a sending buffer; after the image capture device inputs the first image frame encoded by the second encoder into the sending buffer, the image capture device determines whether the first image frame encoded by the first encoder already exists in the sending buffer based on the first image frame identifier and the second image frame identifier; if it is determined that the first image frame encoded by the first encoder already exists in the sending buffer, the image capture device deletes the first image frame encoded by the first encoder in the sending buffer.
进一步的,由图像捕捉设备基于第一图像帧标识符以及第二图像帧标识符来判断发送缓存器中是否已经存在经过第一编码器编码的第一图像帧包括如下步骤:由图像捕捉设备依次判断发送缓存器中的所有图像帧的图像帧标识符与第二图像帧标识符是否一致;如果图像捕捉设备判断发送缓存器中的经过第一编码器编码的第一图像帧的第一图像帧标识符与第二图像帧标识符一致,则图像捕捉设备判断发送缓存器中已经存在经过第一编码器编码的第一图像帧;如果图像捕捉设备判断发送缓存器中的所有图像帧的图像帧标识符与第二标识符均不一致,则图像捕捉设备判断发送缓存器中不存在经过第一编码器编码的第一图像帧。Furthermore, the image capture device determines whether a first image frame encoded by a first encoder already exists in a sending buffer based on a first image frame identifier and a second image frame identifier, including the following steps: the image capture device determines, in sequence, whether the image frame identifiers of all image frames in the sending buffer are consistent with the second image frame identifier; if the image capture device determines that the first image frame identifier of the first image frame encoded by the first encoder in the sending buffer is consistent with the second image frame identifier, the image capture device determines that a first image frame encoded by the first encoder already exists in the sending buffer; if the image capture device determines that the image frame identifiers of all image frames in the sending buffer are inconsistent with the second identifier, the image capture device determines that a first image frame encoded by the first encoder does not exist in the sending buffer.
应当理解的是,本发明的上述具体实施方式仅仅用于示例性说明或解释本发明的原理,而不构成对本发明的限制。因此,在不偏离本发明的精神和范围的情况下所做的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。此外,本发明所附权利要求旨在涵盖落入所附权利要求范围和边界、或者这种范围和边界的等同形式内的全部变化和修改例。It should be understood that the above specific embodiments of the present invention are only used to illustrate or explain the principles of the present invention, and do not constitute a limitation of the present invention. Therefore, any modifications, equivalent substitutions, improvements, etc. made without departing from the spirit and scope of the present invention should be included in the protection scope of the present invention. In addition, the appended claims of the present invention are intended to cover all changes and modifications that fall within the scope and boundaries of the appended claims, or the equivalent forms of such scope and boundaries.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410493917.3A CN118354019A (en) | 2024-04-24 | 2024-04-24 | Forestry pest monitoring method and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410493917.3A CN118354019A (en) | 2024-04-24 | 2024-04-24 | Forestry pest monitoring method and system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN118354019A true CN118354019A (en) | 2024-07-16 |
Family
ID=91817286
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410493917.3A Pending CN118354019A (en) | 2024-04-24 | 2024-04-24 | Forestry pest monitoring method and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118354019A (en) |
-
2024
- 2024-04-24 CN CN202410493917.3A patent/CN118354019A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20240364905A1 (en) | Video stream decoding method and apparatus, terminal device, and storage medium | |
CN102510541B (en) | Multi-screen interaction video and audio content switching method and media player | |
US11218667B2 (en) | Intelligent conference projection system | |
US5982360A (en) | Adaptive-selection method for memory access priority control in MPEG processor | |
US11172227B2 (en) | Video sending and receiving method, apparatus, and terminal thereof | |
CN102857738B (en) | The image display system that multi-screen controls, method and multi-screen control device | |
CN110430441B (en) | Cloud mobile phone video acquisition method, system, device and storage medium | |
CN110213598A (en) | A kind of video code conversion system, method and Related product | |
KR100890236B1 (en) | A method for capturing video data by utilizing a camera cell phone as a camera of a computer | |
WO2018103359A1 (en) | Video processing method and system | |
KR100790160B1 (en) | Method and device for shooting still images during movie recording | |
WO2019164753A1 (en) | Efficient streaming video for static video content | |
JP2001094987A (en) | Image data transmission method | |
CN115250356A (en) | Multi-camera switchable virtual camera of mobile phone | |
CN113225585A (en) | Video definition switching method and device, electronic equipment and storage medium | |
CN116052701B (en) | Audio processing method and electronic equipment | |
WO2023045551A1 (en) | Camera control method and system, electronic device and storage medium | |
Tang et al. | Design of Real-time video transmission system based on 5G network | |
CN118354019A (en) | Forestry pest monitoring method and system | |
CN114173183B (en) | Screen projection method and electronic equipment | |
CN114584782A (en) | Image sending method and device and electronic equipment | |
CN101137045B (en) | Video communication method, video service device and system | |
CN1168306C (en) | Video/audio signal recording and reproducing device and method | |
US20230090985A1 (en) | Video transmission method and device | |
CN117472304A (en) | Screen acquisition method and device, terminal equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |