CN105260381A

CN105260381A - Data maintenance method based on image recognition and data maintenance device based on image recognition

Info

Publication number: CN105260381A
Application number: CN201510569886.6A
Authority: CN
Inventors: 魏丽
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Baidu Online Network Technology Beijing Co Ltd; Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2015-09-08
Filing date: 2015-09-08
Publication date: 2016-01-20

Abstract

The invention provides a data maintenance method based on image recognition and a data maintenance device based on image recognition, wherein the data maintenance method comprises the following steps of performing character recognition on images; obtaining data identification information to be maintained at a text format according to the character recognition result; obtaining data to be maintained corresponding to the data identification information to be maintained; and adding the data to be maintained into a target data set. By using the technical scheme provided by the invention, the data maintenance operation can be simplified to a certain degree, so that the data maintenance efficiency is improved, and the data maintenance cost is reduced.

Description

Based on data maintaining method and the device of image recognition

Technical field

The present invention relates to network technology, especially relate to a kind of data maintaining method based on image recognition and the data maintaining apparatus based on image recognition.

Background technology

In cybertimes, data maintenance is very important.Data maintenance generally includes the contents such as data interpolation, data deletion and data syn-chronization.

In polytype subscriber equipmenies such as desk-top computer, mobile computer, intelligent mobile phone and panel computer, multiple application software is installed usually, and some application software often relate to user sets up the data maintaining operation such as list by hand, such as, the stock application software of installing in subscriber equipment can provide free stock list (can referred to as self-selected stock list) function usually; Usually record the stock (as user has the stock of purchase intention and the current stock etc. held) that user is paying close attention in free stock list, user can utilize its subscriber equipment (as intelligent mobile phone) by free stock list check easily its important indicator such as each stock price and amount of increase and amount of decrease paid close attention to; But, the data maintaining operation of current each stock application software to free stock list generally includes: function is added in the free stock list that user selects stock application software to provide, then input corresponding information (as stock code or stock name etc.), stock information corresponding for this information adds in free stock list by stock application software.

Inventor is realizing finding in process of the present invention, carrying out data maintaining operation often consumes more cost of labor by hand, such as, because different stock application software can be different in the function provided and information etc., therefore, user installs the stock application software (open an account stock trader's application software and the information class/forum's class application software etc. for auxiliary dealing decision-making as concluding the business) of 2 sections of even more moneys sometimes in its subscriber equipment; If user wishes that the free stock list of different stock application software has identical stock (as having identical stock code and stock name in the free stock list of many moneys stock application software), then user needs to add one by one in the free stock list of different stock application software for each stock.It can thus be appreciated that existing data maintaining operation awaits further simplification, to improve data maintenance efficiency, and reduce data maintenance cost.

Summary of the invention

The object of this invention is to provide a kind of data maintaining method based on image recognition and device.

According to one of them aspect of the present invention, a kind of data maintaining method based on image recognition is provided, and said method comprising the steps of: character recognition is carried out to image; According to character identification result obtain text formatting treat service data identification information; Treat described in acquisition service data identification information corresponding treat service data; Treat that service data is added in target data set by described.

According to wherein another aspect of the present invention, also provide a kind of data maintaining apparatus based on image recognition, and described device comprises: character recognition device, be suitable for carrying out character recognition to image; Mark acquisition device, be suitable for according to character identification result obtain text formatting treat service data identification information; Data acquisition facility, be suitable for obtain described in treat service data identification information corresponding treat service data; Data adding set, is suitable for treating that service data is added in target data set by described.

Compared with prior art, the present invention has the following advantages: the present invention is by carrying out character recognition to image, the character conversion of the picture format comprised in image can be become the character of text formatting, thus include in the picture picture format treat service data identification information when, what the present invention can obtain text formatting from character identification result treats service data identification information, by obtain text formatting treat treat service data corresponding to service data identification information, and will treat that service data is added in target data set, achieve, according to the content in image, data maintenance is carried out to target data set, it is such as the image of the free stock list in an application software at image, and target data set is when being combined into the free stock list in Another application software, the stock automatic synchronization that technical scheme provided by the invention can realize the free stock list of an application software to comprise is in the free stock list of Another application software, seen from the above description, technical scheme provided by the invention simplifies data maintaining operation to a certain extent, thus improves data maintenance efficiency, and reduces data maintenance cost.

Accompanying drawing explanation

By reading the detailed description done non-limiting example done with reference to the following drawings, other features, objects and advantages of the present invention will become more obvious:

Fig. 1 is the data maintaining method process flow diagram based on image recognition of the embodiment of the present invention one;

Fig. 2 is the data maintaining apparatus schematic diagram based on image recognition of the embodiment of the present invention three.

In accompanying drawing, same or analogous Reference numeral represents same or analogous parts.

Embodiment

Before in further detail exemplary embodiment being discussed, it should be mentioned that some exemplary embodiments are described as the process or method described as process flow diagram.Although operations is described as the process of order by process flow diagram, many operations wherein can be implemented concurrently, concomitantly or simultaneously.In addition, the execution sequence of operations can be rearranged.When its operation is complete, described process can be terminated, but can also have the additional step do not comprised in the accompanying drawings.Described process can correspond to method, function, code, subroutine, subroutine etc.

Alleged within a context " subscriber equipment " refers to the intelligent electronic device that can be performed the predetermined process such as numerical evaluation and/or logical calculated process by operation preset program or instruction, it can comprise processor and storer, the survival instruction that prestores in memory is performed to perform predetermined process process by processor, or perform predetermined process process by the hardware such as ASIC, FPGA, DSP, or combined by said two devices and realize.Subscriber equipment includes but not limited to desk-top computer, mobile computer, intelligent mobile phone and panel computer etc.

Described subscriber equipment can access network, and carries out information interaction with other equipment (as computer equipment) in network.Wherein, the network residing for described subscriber equipment includes but not limited to internet, wide area network, Metropolitan Area Network (MAN), LAN (Local Area Network), VPN etc.

It should be noted that, described subscriber equipment and network etc. are only citing, and other subscriber equipmenies that are existing or that may occur from now on or network, as being applicable to the present invention, within also should being included in scope, and are contained in this with way of reference.

The method (some of them are illustrated by process flow diagram) discussed in following literary composition can be implemented by hardware, software, firmware, middleware, microcode, hardware description language or its combination in any.When implementing by software, firmware, middleware or microcode, program code or code segment in order to implement necessary task can be stored in machine or computer-readable medium (such as storage medium).(one or more) processor can implement necessary task.

Concrete structure disclosed herein and function detail are only representational, and are the objects for describing exemplary embodiment of the present invention.But the present invention can carry out specific implementation by many replacement forms, and should not be construed as only being limited to the embodiments set forth herein.

Should be understood that, although may have been used term " first ", " second " etc. here to describe unit, these unit should not limit by these terms.These terms are used to be only used to a unit and another unit to distinguish.For example, when not deviating from the scope of exemplary embodiment, first module can be called as second unit, and second unit can be called as first module similarly.Here used term "and/or" comprise one of them or more any and all combinations of listed associated item.

Should be understood that, when a unit is called as " connection " or " coupling " to another unit, it can directly connect or be coupled to another unit described, or can there is temporary location.On the other hand, " when being directly connected " or " directly coupled " to another unit, then there is not temporary location when a unit is called as.Should explain in a comparable manner the relation be used between description unit other words (such as " and be in ... between " compared to " and be directly in ... between ", " with ... contiguous " compared to " and with ... be directly close to " etc.).

Here used term is only used to describe specific embodiment and be not intended to limit exemplary embodiment.Unless context refers else clearly, otherwise singulative used here " ", " one " are also intended to comprise plural number.It is to be further understood that, the existence of the feature that term used here " comprises " and/or " comprising " specifies to state, integer, step, operation, unit and/or assembly, and do not get rid of and there is or add other features one or more, integer, step, operation, unit, assembly and/or its combination.

Also it should be mentioned that and to replace in implementation at some, the function/action mentioned can according to being different from occurring in sequence of indicating in accompanying drawing.For example, depend on involved function/action, in fact the two width figure in succession illustrated can perform simultaneously or sometimes can perform according to contrary order substantially.

Below in conjunction with accompanying drawing, the present invention is described in further detail.

Embodiment one, data maintaining method based on image recognition.

Fig. 1 is the process flow diagram of the data maintaining method based on image recognition of the present embodiment, and the method shown in Fig. 1 mainly comprises step S100, step S110, step S120 and step S130.Method described in the present embodiment is normally performed in a user device, and the method described in the present embodiment can perform in the subscriber equipmenies such as desk-top computer, mobile computer, intelligent mobile phone and panel computer.Below each step in Fig. 1 is described respectively.

S100, character recognition is carried out to image.

Concrete, the image in the present embodiment can be called picture, sometimes also can be called photo.What usually include picture format in the image in the present embodiment treats service data identification information.Treat that service data identification information can be stock code, commercial product code, product type, book coding or song encode etc. in the present embodiment.In a field (as field of securities etc.), treat that service data identification information can illustrate an object by only table usually for one, certainly, the present embodiment is not got rid of one and is treated that service data identification information can indicate the possibility of multiple object simultaneously.

Image in the present embodiment is stored in subscriber equipment, and this image can be subscriber equipment is obtained and the image stored by multiple different mode, exemplify below several image the specific implementation that obtains by subscriber equipment.

First concrete example, subscriber equipment utilizes its camera function to take pictures to outside scenery, thus obtains image; Such as the recommendation stock list in the picture including free stock list of the current display of the screen of other subscriber equipmenies or advertising page or the recommendation stock list etc. in advertising screen are taken pictures, thus obtain the image treating service data identification information including picture format.

Second concrete example, subscriber equipment carries out screenshot capture by its screenshot capture function to the picture of its current display, thus obtains image; After such as, a stock application software in subscriber equipment is activated, the free stock list that display user safeguards in this stock application software, the content of current for screen display is saved as picture according to the screenshot capture order received by subscriber equipment, thus subscriber equipment obtains the image treating service data identification information including picture format.

3rd concrete example, subscriber equipment is copied the choice area territory in the current display frame of its screen by its copy function, thus obtains image; Such as, after the application software with image editing function in subscriber equipment is activated, the image including free stock list that display user selects, the content having selected the stock code one in free stock list to arrange at subscriber frame and after clicking the button being stored as new picture, the content of subscriber frame choosing is copied, and store as new picture, thus subscriber equipment obtains the image treating service data identification information including picture format.

4th concrete example, subscriber equipment receives the next view data of external transmission by its equipment room data-transformation facility, thus obtains image; Such as subscriber equipment is after access network, by carrying out information with the equipment (cloudlike coiling or server etc.) in network, can the picture that include stock recommendation list of downloaded stored in network, thus subscriber equipment obtains the image treating service data identification information including picture format; Such as subscriber equipment sets up wireless connections by Bluetooth technology etc. with other equipment again, and receive the picture that include free stock list of other equipment by these wireless connections transmission, thus subscriber equipment obtains the image treating service data identification information including picture format.

5th concrete example, subscriber equipment is scanned paper document or on-screen displays etc. by its scan function, thus obtains image; Such as, the paper that subscriber equipment air exercise is printed on stock recommendation list scans, thus subscriber equipment obtains the image treating service data identification information including picture format.

The acquisition pattern of the above-mentioned image only illustrated in several the present embodiment, the image in the present embodiment can also be adopt the image that obtains of other modes, the concrete acquisition pattern of the present embodiment not limited images.

Character recognition in the present embodiment also can be called Text region or pictograph identification etc., the present embodiment is by carrying out character recognition process to image, can be the character of text formatting by the character conversion of the picture format in image, namely converting of image file can be text by the present embodiment.Include in the picture picture format treat service data identification information when, what should include text formatting in the text that the present embodiment is obtained by character recognition treats service data identification information.

The present embodiment can adopt existing character recognition technologies to carry out character recognition process to image, as adopted OCR (OpticalCharacterRecognition, optical character identification) technology carries out character recognition process etc. to image, and the present embodiment does not limit the specific implementation of image being carried out to character recognition.

The present embodiment can carry out character recognition process to the full content in image, also only can carry out character recognition process to the partial content in image, as carried out character recognition process etc. to the picture material in the presumptive area of image.Presumptive area in the present embodiment can be that user dynamically arranges, as subscriber equipment display needs the image carrying out character recognition, and show character recognition region, user can make to need the content of carrying out character recognition to be positioned at character recognition region in image by enlarged image or the mode such as downscaled images or dragged image, now, this partial content entered in image in character recognition region is the presumptive area that user dynamically arranges; Presumptive area in the present embodiment also can be default setting; as when picture format treat that service data identification information is usually found in the region of side to the left in image, can be the left-half of image by presumptive area default setting or be positioned at leftmost 1/4th image sections of image etc.The present embodiment does not need the concrete set-up mode of the presumptive area of carrying out character recognition in limited images.

S110, according to character identification result obtain text formatting treat service data identification information.

Concrete, above-mentioned carry out not only including in the image of character recognition picture format treat service data identification information, when also including other characters of picture format, what often not only include text formatting in the character of the text formatting that the present embodiment is obtained by character recognition treats service data identification information, but also includes other characters of text formatting.Certainly, what also only may include text formatting in the character of text formatting that the present embodiment is obtained by character recognition treats service data identification information.No matter character identification result only comprises to need service data identification information, still comprise and need service data identification information and other characters, what extract correct text formatting all characters of the text formatting that the present embodiment all should obtain from character identification result treats service data identification information.

What the present embodiment can utilize coupling retrieval mode from character identification result, obtain text formatting treats service data identification information, specifically, the present embodiment carries out coupling retrieval respectively to each character string comprised in character identification result, then, the result retrieved according to each string matching obtains treats service data identification information; Such as, when not needing the control of user, automatically using the successful character string of all coupling retrievals in coupling result for retrieval as treating service data identification information; Again such as, under control of the user, using the successful character string of all coupling retrievals in coupling result for retrieval as treating service data identification information; Also such as, under control of the user, according to the selection of user using in the successful character string of all coupling retrievals in coupling result for retrieval by the character string selected as treating service data identification information.

Be described in detail for the implementation procedure of several examples more specifically to this step below.

First concrete example, first from character identification result, character string is extracted, in the present embodiment treat that service data identification information follows certain rule when, the present embodiment can carry out the extraction operation of character string according to this rule, as when treating that service data identification information is continuous print numeric string (as the having the stock code of predetermined length) with predetermined length, the present embodiment can search numeral from the starting position of character identification result character by character, after finding first digit, judge whether each character whether the continuous print character string from this numeral has in predetermined length and this continuous print character string is numeral, if this continuous print character string has predetermined length and each in this character string is numeral, then extract this character string, otherwise, continue to judge whether each character whether the continuous print character string from the second digit found has in predetermined length and this continuous print character string is numeral, by that analogy, until last character in character identification result, then, realize carrying out coupling search operaqtion to extracting the character string obtained by network, as mated retrieval request according to extracting the text string generation obtained, and send this coupling retrieval request by internet to the corresponding network equipment, retrieve in the information that the network equipment stores in this locality, whether mate with the local information stored to judge to mate in retrieval request the character string carried (as whether exact matching etc.), if the match is successful, then the network equipment returns to subscriber equipment and carries string matching and retrieve successful message, otherwise, the message carrying string matching retrieval failure information is returned to subscriber equipment, the present embodiment can when successfully extracting a character string from character identification result, mate retrieval request for this text string generation and send this coupling retrieval request to the corresponding network equipment, also can when extracting all character strings from character identification result, generate a coupling retrieval request respectively for each character string or be all text string generation one coupling retrieval request, and to send to the corresponding network equipment, after receiving the message that the coupling retrieval request of the network equipment for all character strings return, automatically all as text formatting, the successful all character strings of coupling retrieval are treated that service data identifies according to the information carried in the message received.

Second concrete example, first from character identification result, character string is extracted, in the present embodiment treat that service data identification information follows certain rule when, the present embodiment can carry out the extraction operation of character string according to this rule, as when treating that service data identification information is continuous print numeric string (as the having the stock code of predetermined length) with predetermined length, the present embodiment can search numeral from the starting position of character identification result character by character, after finding first digit, judge whether each character whether the continuous print character string from this numeral has in predetermined length and this continuous print character string is numeral, if this continuous print character string has predetermined length and each in this character string is numeral, then extract this character string, otherwise, continue to judge whether each character whether the continuous print character string from the second digit found has in predetermined length and this continuous print character string is numeral, by that analogy, until last character in character identification result, then, realize carrying out coupling search operaqtion to extracting the character string obtained by network, as mated retrieval request according to extracting the text string generation obtained, and send this coupling retrieval request by internet to the corresponding network equipment, retrieve in the information that the network equipment stores in this locality, whether mate with the local information stored to judge to mate in retrieval request the character string carried (as whether exact matching etc.), if the match is successful, then the network equipment returns to subscriber equipment and carries string matching and retrieve successful message, otherwise, the message carrying string matching retrieval failure information is returned to subscriber equipment, the present embodiment can when successfully extracting a character string from character identification result, mate retrieval request for this text string generation and send this coupling retrieval request to the corresponding network equipment, also can when extracting all character strings from character identification result, generate a coupling retrieval request respectively for each character string or be all text string generation one coupling retrieval request, and to send to the corresponding network equipment, after receiving the message that the network equipment returns for all character strings, determine the successful all character strings of coupling retrieval according to the information carried in the message received, and the successful all character strings of display coupling retrieval, as utilized the successful all text string generation lists of coupling retrieval, and show this list, other guide corresponding to character string can also be comprised in this list, as when character string is numeric string, the object title (as Chinese) etc. that character string characterizes in this list, can also be comprised, the other guide that character string shown in list is corresponding can be that the network equipment sends, if the network equipment is when generating corresponding message for coupling retrieval request, object title corresponding with it for the successful character string of coupling retrieval is carried in message together and sends to subscriber equipment, user is when confirming to carry out data interpolation operation according to all character strings (all character strings as in list) of display, the present embodiment can receive data maintenance order based on the operation of user (clicking " key adds " button etc. as user), afterwards, the successful all character strings of the coupling of display retrieval are treated service data identification information all as text formatting, when not receiving data maintenance order, the successful all character strings of the coupling of display retrieval all can not be treated service data identification information as text formatting.

3rd concrete example, first from character identification result, character string is extracted, in the present embodiment treat that service data identification information follows certain rule when, the present embodiment can carry out the extraction operation of character string according to this rule, as when treating that service data identification information is continuous print numeric string (as the having the stock code of predetermined length) with predetermined length, the present embodiment can search numeral from the starting position of character identification result character by character, after finding first digit, judge whether each character whether the continuous print character string from this numeral has in predetermined length and this continuous print character string is numeral, if this continuous print character string has predetermined length and each in this character string is numeral, then extract this character string, otherwise, continue to judge whether each character whether the continuous print character string from the second digit found has in predetermined length and this continuous print character string is numeral, by that analogy, until last character in character identification result, then, realize carrying out coupling search operaqtion to extracting the character string obtained by network, as mated retrieval request according to extracting the text string generation obtained, and send this coupling retrieval request by internet to the corresponding network equipment, retrieve in the information that the network equipment stores in this locality, whether mate with the local information stored to judge to mate in retrieval request the character string carried (as whether exact matching etc.), if the match is successful, then the network equipment returns to subscriber equipment and carries string matching and retrieve successful message, otherwise, the message carrying string matching retrieval failure information is returned to subscriber equipment, the present embodiment can when successfully extracting a character string from character identification result, mate retrieval request for this text string generation and send this coupling retrieval request to the corresponding network equipment, also can when extracting all character strings from character identification result, generate a coupling retrieval request respectively for each character string or be all text string generation one coupling retrieval request, and to send to the corresponding network equipment, after receiving the message that the network equipment returns for all character strings, determine the successful all character strings of coupling retrieval according to the information carried in the message received, and the successful all character strings of display coupling retrieval, as utilized the successful all text string generation lists of coupling retrieval, and show this list, other guide corresponding to character string can also be comprised in this list, as when character string is numeric string, the object title (as Chinese) etc. that character string characterizes in this list, can also be comprised, the other guide that character string shown in list is corresponding can be that the network equipment sends, if the network equipment is when generating corresponding message for coupling retrieval request, object title corresponding with it for the successful character string of coupling retrieval is carried in message together and sends to subscriber equipment, in addition, the present embodiment can all arrange selector switch (selector switch etc. as tick boxes form) for each character string, can select corresponding character string as treating that service data identifies to make user, when user have selected all character strings (all character strings as in list) of display or have selected the partial character string of display, user is when confirming that the character string selected according to it carries out data interpolation operation, the present embodiment can receive data maintenance order based on the operation of user (clicking " key adds " button etc. as user), afterwards, service data identification information will be treated by the character string selected as text formatting in the successful all character strings of the coupling of display retrieval, when not receiving data maintenance order, all service data identification information can not be treated as text formatting by the character string selected in the successful all character strings of coupling retrieval of display.

It should be noted that, above-mentioned three examples are all to be realized by network mating on the basis of retrieval, realize text formatting treat service data identification information be retrieved as that example is described, the present embodiment also can realize the acquisition treating service data identification information of text formatting on the basis of other coupling retrievals, as the information realization coupling retrieval that the present embodiment can store according to subscriber equipment this locality, and carry out follow-up operation according to this coupling result for retrieval, thus realize the acquisition treating service data identification information of text formatting; The specific implementation process of the acquisition of service data identification information for the treatment of that the basis of the information realization coupling retrieval stored by subscriber equipment this locality realizes text formatting is substantially the same with above-mentioned three examples exemplified, and describes in detail no longer one by one at this.

S120, obtain treat service data identification information corresponding treat service data.

Concrete, the present embodiment normally according to the data structure of target data set obtain treat service data identification information corresponding treat service data, thus the present embodiment get treat that service data has the data structure identical with target data set.The data structure of target data set can be default setting (as by application software default setting), also can be arranged by user (as user according to its data structure that combines of the curriculum offering target data paid close attention to).The present embodiment does not limit the concrete data structure treating service data and target data set.In addition, treating that service data can comprise and need service data identification information in the present embodiment.

Treat that one of service data and target data set concrete example is, when target data set is combined into free stock list, treat that service data identification information can for stock code, the data structure of target data set can comprise: stock code, stock name, today turnover and today amount of increase and amount of decrease etc.; Thus the present embodiment treats that service data also should comprise accessed by the data structure of target data set: stock code, stock name, today turnover and today amount of increase and amount of decrease etc.

The present embodiment normally by network obtain treat service data identification information corresponding treat service data, the data acquisition request of service data identification information is needed as subscriber equipment sends carrying to the corresponding network equipment, can comprise in this data acquisition request and need the data structure information of service data, subscriber equipment receives the response message that the corresponding network equipment returns, and from this response message obtain treat service data identification information corresponding treat service data.

In addition, it should be noted that, in S110, if the network equipment to subscriber equipment return carry string matching retrieve in successful message include character string corresponding until service data (namely the network equipment mate retrieve successfully time inquire about treat service data identification information corresponding treat service data, and return to subscriber equipment), now, this step can obtain from this message treat service data identification information corresponding treat service data.

S130, will treat that service data is added in target data set.

Concrete, the target data set in the present embodiment can be the forms such as table or storehouse.By when adding in target data set until service data, the present embodiment can perform pretreatment operation, as whether Already in checking treats service data in target data set, to avoid occurring data polyisomenism in target data set; For another example, the data layout of service data is treated in adjustment, to make to treat that service data can meet the relevant regulations etc. of target data set.In addition, when service data is many, can will treat that service data order is added in target data set, and the data of adding in target data set can be stored in the corresponding position of target data set after sequence.

When target data set is combined into free stock list, the present embodiment achieves the automatic maintenance to the data in free stock list.

Embodiment two, data maintaining method based on image recognition.

Be intelligent mobile phone below with subscriber terminal equipment, and target data set is combined into free stock list is example, the method for the present embodiment is described.

A money stock application software is installed in the intelligent movable phone of user, and has included tens stocks in the free stock list of A money stock application software; Afterwards, user has downloaded and installed B money stock application software again in its intelligent movable phone, and the free stock list of B money stock application software is empty at present; User wishes that the stock comprised in the free stock list of stock and the A money stock application software comprised in the free stock list of B money stock application software is identical.

First, user starts the free stock list interface of the A money stock application software of installing in its intelligent mobile phone; Then, user performs screenshotss operation, and this free stock list interface is kept in the picture set of intelligent mobile phone with the form of picture automatically; It should be noted that, the stock quantity comprised in free stock list is more, can not show completely in situation by a screen, and user can operate by sliding on screen and performing repeatedly screenshotss and obtains plurality of pictures.

Afterwards, the free stock list interface of the B money stock application software of installing in user's starter intelligent mobile phone, click " the recognition image interpolation self-selected stock " button in this interface, and choose the picture obtained above by screenshotss operation one by one, the picture that user chooses is transferred to B money stock application software, B money stock application software carries out character recognition to the picture received, and from character identification result, extract the numeric string with predetermined length; By network, B money stock application software can determine whether its numeric string extracted is stock code, B money stock application software can directly also utilize each numeric string being confirmed as stock code to obtain related data corresponding to each stock code respectively by the mode to network request packet according to the data structure of its free stock list, and adds in free stock list successively by the related data that each stock code is corresponding respectively; Thus the stock automatic synchronization that the free stock list of the stock that comprises of the free stock list achieving B money stock application software and A money stock application software comprises.

In above-mentioned implementation procedure, B money stock application software also can be defined as each numeric string of stock code and stock name corresponding to each numeric string to user's display, after user clicks " key adds " button, B money stock application software also utilizes each numeric string being confirmed as stock code to obtain related data corresponding to each stock code respectively by the mode to network request packet according to the data structure of its free stock list again.

In above-mentioned implementation procedure, B money stock application software can also be defined as each numeric string of stock code and stock name corresponding to each numeric string to user's display, and selector switch is set for each stock code, after user clicks " key adds " button, B money stock application software also utilizes the stock code by selecting to obtain related data corresponding to each stock code respectively by the mode to network request packet according to the data structure of its free stock list again.

Embodiment three, data maintaining apparatus based on image recognition.

The data maintaining apparatus based on image recognition in the present embodiment is arranged in subscriber equipment usually, as being arranged in the application software of subscriber equipment.The subscriber equipment of the present embodiment can be desk-top computer, mobile computer, intelligent mobile phone and panel computer etc.

The primary structure of the data maintaining apparatus based on image recognition of the present embodiment as shown in Figure 2.

In Fig. 2, the data maintaining apparatus based on image recognition of the present embodiment mainly comprises: character recognition device 200, mark acquisition device 210, data acquisition facility 220 and data adding set 230; Wherein, identify acquisition device 210 can comprise: character string obtains sub-device and mark obtains sub-device.

Below each device is described respectively.

Character recognition device 200 is mainly suitable for carrying out character recognition to image.

Concrete, the image that character recognition device 200 carries out character recognition can be called picture, sometimes also can be called photo.What character recognition device 200 carried out usually including in the image of character recognition picture format treats service data identification information, above-mentionedly treats that service data identification information can be stock code, commercial product code, product type, book coding or song encode etc.In a concrete field (as field of securities etc.), treat that service data identification information can illustrate an object by only table usually for one, certainly, the present embodiment is not got rid of one and is treated that service data identification information can indicate the possibility of multiple object simultaneously.

The image that character recognition device 200 carries out character recognition is stored in subscriber equipment usually, and this image can be subscriber equipment is obtained and the image stored by multiple different mode, image the object lesson that obtains by subscriber equipment as the description in above-mentioned embodiment of the method, be not repeated.

Character recognition performed by character recognition device 200 also can be called Text region or pictograph identification etc., the present embodiment carries out character recognition process by character recognition device 200 pairs of images, can be the character of text formatting by the character conversion of the picture format in image, namely converting of image file can be text by character recognition device 200.Include in the picture picture format treat service data identification information when, what should include text formatting in the text that character recognition device 200 is obtained by character recognition treats service data identification information.

Character recognition device 200 can adopt existing character recognition technologies to carry out character recognition process to image, as character recognition device 200 adopts OCR technology to carry out character recognition process etc. to image, the present embodiment not restricted character recognition device 200 pairs of images carries out the specific implementation of character recognition.

Character recognition device 200 can carry out character recognition process to the full content in image, also only character recognition process can be carried out to the partial content in image, as the picture material in the presumptive area of character recognition device 200 pairs of images carries out character recognition process etc.Presumptive area in the present embodiment can be that user dynamically arranges, and also can be default setting.

Mark acquisition device 210 be mainly suitable for according to character identification result obtain text formatting treat service data identification information.

Concrete, that carries out not only including in the image of character recognition picture format at character recognition device 200 treats service data identification information, when also including other characters of picture format, what often not only include text formatting in the character of the text formatting that character recognition device 200 is obtained by character recognition treats service data identification information, but also includes other characters of text formatting.Certainly, what also only may include text formatting in the character of text formatting that character recognition device 200 is obtained by character recognition treats service data identification information.No matter character identification result only comprises to need service data identification information, still comprise and need service data identification information and other characters, what extract correct text formatting all characters of the text formatting that mark acquisition device 210 all should obtain from character identification result treats service data identification information.

What mark acquisition device 210 can utilize coupling retrieval mode from character identification result, obtain text formatting treats service data identification information, specifically, the character string identified in acquisition device 210 obtains the character string that sub-device is mainly suitable for obtaining text formatting from character identification result; And the mark identified in acquisition device 210 obtain sub-device be mainly suitable for from the coupling result for retrieval of character string obtain treat service data identification information.Mark obtains sub-device and obtains to character string each character string that sub-device gets from character identification result and carry out coupling retrieval respectively, and then, the sub-device of mark acquisition obtains according to the result that each string matching is retrieved treats service data identification information; Such as, when not needing the control of user, mark obtains sub-device automatically using the successful character string of all coupling retrievals in coupling result for retrieval as treating service data identification information; Again such as, under control of the user, mark obtains sub-device using the successful character string of all coupling retrievals in coupling result for retrieval as treating service data identification information; Also such as, under control of the user, mark obtain sub-device according to the selection of user using in the successful character string of all coupling retrievals in coupling result for retrieval by the character string selected as treating service data identification information.

For several example more specifically, the operation that mark obtains the execution of sub-device is described in detail below.

First concrete example, mark obtains sub-device and comprises: the coupling sub-device of retrieval and the sub-device of the first mark; Coupling is wherein retrieved sub-device and is mainly suitable for carrying out coupling retrieval respectively to all character strings obtained, and the sub-device of the first mark that mark wherein obtains in sub-device is mainly suitable for the successful each character string of coupling retrieval all as treating that service data identifies.

First character string obtains sub-device and extract character string from character identification result, in the present embodiment treat that service data identification information follows certain rule when, character string obtains sub-device can carry out character string extraction operation according to this rule, as when treating that service data identification information is continuous print numeric string (as the having the stock code of predetermined length) with predetermined length, character string obtains sub-device can search numeral from the starting position of character identification result character by character, after finding first digit, character string obtains sub-device and judges whether each character whether the continuous print character string from this numeral has in predetermined length and this continuous print character string is numeral, if this continuous print character string has predetermined length and each in this character string is numeral, then character string obtains sub-device and extracts this character string, otherwise, character string obtains sub-device and continues to judge whether each character whether the continuous print character string from the second digit found has in predetermined length and this continuous print character string is numeral, by that analogy, until last character in character identification result, then, the sub-device of coupling retrieval realizes carrying out coupling search operaqtion to extracting the character string obtained by network, obtain according to character string the text string generation coupling retrieval request that sub-device extracts acquisition as mated the sub-device of retrieval, and send this coupling retrieval request by internet to the corresponding network equipment, retrieve in the information that the network equipment stores in this locality, whether mate with the local information stored to judge to mate in retrieval request the character string carried (as whether exact matching etc.), if the match is successful, then the network equipment returns to subscriber equipment and carries string matching and retrieve successful message, otherwise, the message carrying string matching retrieval failure information is returned to subscriber equipment, coupling retrieval sub-device can when character string obtain sub-device from character identification result, successfully extract a character string, mate retrieval request for this text string generation and send this coupling retrieval request to the corresponding network equipment, coupling retrieval sub-device also can when character string obtain sub-device from character identification result, extract all character strings, generate a coupling retrieval request respectively for each character string or be all text string generation one coupling retrieval request, and to send to the corresponding network equipment, after subscriber equipment receives the message that the network equipment returns for the coupling retrieval request of all character strings, coupling is automatically retrieved successful all character strings according to the information carried in the message received and is treated that service data identifies all as text formatting by the sub-device of the first mark.

Second concrete example, mark obtains sub-device and comprises: the sub-device of coupling retrieval, the first sub-device of display and the sub-device of the second mark; The sub-device of the first display wherein is mainly suitable for the successful each character string of display coupling retrieval; The sub-device of the second mark wherein is mainly suitable for when receiving data maintenance order, using each character string of display all as treating service data identification information.

First character string obtains sub-device and extract character string from character identification result, in the present embodiment treat that service data identification information follows certain rule when, character string obtains sub-device can carry out character string extraction operation according to this rule, as when treating that service data identification information is continuous print numeric string (as the having the stock code of predetermined length) with predetermined length, character string obtains sub-device can search numeral from the starting position of character identification result character by character, after finding first digit, character string obtains sub-device and judges whether each character whether the continuous print character string from this numeral has in predetermined length and this continuous print character string is numeral, if this continuous print character string has predetermined length and each in this character string is numeral, then character string obtains sub-device and extracts this character string, otherwise, character string obtains sub-device and continues to judge whether each character whether the continuous print character string from the second digit found has in predetermined length and this continuous print character string is numeral, by that analogy, until last character in character identification result, then, the sub-device of coupling retrieval realizes carrying out coupling search operaqtion to extracting the character string obtained by network, obtain according to character string the text string generation coupling retrieval request that sub-device extracts acquisition as mated the sub-device of retrieval, and send this coupling retrieval request by internet to the corresponding network equipment, retrieve in the information that the network equipment stores in this locality, whether mate with the local information stored to judge to mate in retrieval request the character string carried (as whether exact matching etc.), if the match is successful, then the network equipment returns to subscriber equipment and carries string matching and retrieve successful message, otherwise, the message carrying string matching retrieval failure information is returned to subscriber equipment, coupling retrieval sub-device can when character string obtain sub-device from character identification result, successfully extract a character string, mate retrieval request for this text string generation and send this coupling retrieval request to the corresponding network equipment, coupling retrieval sub-device also can when character string obtain sub-device from character identification result, extract all character strings, generate a coupling retrieval request respectively for each character string or be all text string generation one coupling retrieval request, and to send to the corresponding network equipment, after receiving the message that the network equipment returns for all character strings, the sub-device of the first display determines the successful all character strings of coupling retrieval according to the information carried in the message received, and display coupling retrieves successful all character strings, as the sub-device of the first display utilizes the successful all text string generation lists of coupling retrieval, and show this list, the sub-device of first display can also display string is corresponding in the list other guide, as when character string is numeric string, the sub-device of the first display can also the object title (as Chinese) etc. that characterizes of display string in lists, other guide corresponding to the character string in the first list of display shown by sub-device can be that the network equipment sends, if the network equipment is when generating corresponding message for coupling retrieval request, object title corresponding with it for the successful character string of coupling retrieval is carried in message together and sends to subscriber equipment, user is when confirming to carry out data interpolation operation according to all character strings (all character strings as in list) of display, the sub-device of second mark can receive data maintenance order based on the operation of user (clicking " key adds " button etc. as user), afterwards, the successful all character strings of the coupling of current display retrieval are treated service data identification information all as text formatting by the sub-device of the second mark, when not receiving data maintenance order, the successful all character strings of the coupling of current display retrieval can not be treated service data identification information as text formatting by the sub-device of the second mark.

3rd concrete example, mark obtains sub-device and comprises: the sub-device of coupling retrieval, the second sub-device of display and the sub-device of the 3rd mark; The sub-device of the second display wherein is mainly suitable for the successful each character string of display coupling retrieval, and arranges selector switch respectively for each character string; The sub-device of the 3rd mark wherein is mainly suitable for when receiving data maintenance order, according to selector switch using by the character string selected as treating service data identification information.

First character string obtains sub-device and extract character string from character identification result, in the present embodiment treat that service data identification information follows certain rule when, character string obtains sub-device can carry out character string extraction operation according to this rule, as when treating that service data identification information is continuous print numeric string (as the having the stock code of predetermined length) with predetermined length, character string obtains sub-device can search numeral from the starting position of character identification result character by character, after finding first digit, character string obtains sub-device and judges whether each character whether the continuous print character string from this numeral has in predetermined length and this continuous print character string is numeral, if this continuous print character string has predetermined length and each in this character string is numeral, then character string obtains sub-device and extracts this character string, otherwise, character string obtains sub-device and continues to judge whether each character whether the continuous print character string from the second digit found has in predetermined length and this continuous print character string is numeral, by that analogy, until last character in character identification result, then, the sub-device of coupling retrieval realizes carrying out coupling search operaqtion to extracting the character string obtained by network, obtain according to character string the text string generation coupling retrieval request that sub-device extracts acquisition as mated the sub-device of retrieval, and send this coupling retrieval request by internet to the corresponding network equipment, retrieve in the information that the network equipment stores in this locality, whether mate with the local information stored to judge to mate in retrieval request the character string carried (as whether exact matching etc.), if the match is successful, then the network equipment returns to subscriber equipment and carries string matching and retrieve successful message, otherwise, the message carrying string matching retrieval failure information is returned to subscriber equipment, coupling retrieval sub-device can when character string obtain sub-device from character identification result, successfully extract a character string, mate retrieval request for this text string generation and send this coupling retrieval request to the corresponding network equipment, coupling retrieval sub-device also can when character string obtain sub-device from character identification result, extract all character strings, generate a coupling retrieval request respectively for each character string or be all text string generation one coupling retrieval request, and to send to the corresponding network equipment, after receiving the message that the network equipment returns for all character strings, the sub-device of the second display determines the successful all character strings of coupling retrieval according to the information carried in the message received, and display coupling retrieves successful all character strings, as the sub-device of the second display utilizes the successful all text string generation lists of coupling retrieval, and show this list, the sub-device of second display can also display string is corresponding in the list other guide, as when character string is numeric string, the sub-device of the second display can also the object title (as Chinese) etc. that characterizes of display string in lists, other guide corresponding to the character string in the second list of display shown by sub-device can be that the network equipment sends, if the network equipment is when generating corresponding message for coupling retrieval request, object title corresponding with it for the successful character string of coupling retrieval is carried in message together and sends to subscriber equipment, in addition, the sub-device of the second display can all arrange selector switch (selector switch etc. as tick boxes form) for each character string, can select corresponding character string as treating that service data identifies to make user, when user have selected all character strings (all character strings as in list) of display or have selected the partial character string of display, user is when confirming that the character string selected according to it carries out data interpolation operation, the sub-device of 3rd mark can receive data maintenance order based on the operation of user (clicking " key adds " button etc. as user), afterwards, the sub-device of 3rd mark will be treated service data identification information by the character string selected as text formatting in the successful all character strings of the coupling of display retrieval, the sub-device of 3rd mark is not when receiving data maintenance order, the sub-device of 3rd mark can not will be treated service data identification information by the character string selected as text formatting in the successful all character strings of the coupling of current display retrieval.

It should be noted that, above-mentioned three examples are all realize mating on the basis of retrieval by network to obtain sub-device in mark, realize text formatting treat service data identification information be retrieved as that example is described, mark obtains the acquisition treating service data identification information that sub-device also can realize text formatting on the basis of other coupling retrievals, the information realization coupling retrieval that sub-device can store according to subscriber equipment this locality is obtained as identified, and carry out follow-up operation according to this coupling result for retrieval, thus realize the acquisition treating service data identification information of text formatting, obtain in mark the specific implementation process of the acquisition of service data identification information of the treating basis of sub-device by the information realization coupling retrieval of subscriber equipment this locality storage realizing text formatting substantially the same with above-mentioned three examples exemplified, describe in detail no longer one by one at this.

Data acquisition facility 220 be mainly suitable for obtaining treat service data identification information corresponding treat service data.

Concrete, data acquisition facility 220 normally according to the data structure of target data set obtain treat service data identification information corresponding treat service data, thus data acquisition facility 220 get treat that service data has the data structure identical with target data set.The data structure of target data set can be default setting (as by application software default setting), also can be arranged by user (as user according to its data structure that combines of the curriculum offering target data paid close attention to).The present embodiment does not limit the concrete data structure treating service data and target data set.In addition, service data that what data acquisition facility 220 got treat can comprise and needs service data identification information.

Data acquisition facility 220 normally by network obtain treat service data identification information corresponding treat service data, the data acquisition request of service data identification information is needed as data acquisition facility 220 sends carrying to the corresponding network equipment, can comprise in this data acquisition request and need the data structure information of service data, subscriber equipment receives the response message that the corresponding network equipment returns, data acquisition facility 220 obtain from this response message treat service data identification information corresponding treat service data.

In addition, it should be noted that, if the network equipment to subscriber equipment return carry string matching retrieve in successful message include character string corresponding treat that service data (that is, the network equipment mate retrieve successfully time inquire about treat service data identification information corresponding treat service data, and return to subscriber equipment), then data acquisition facility 220 can obtain from this message treat service data identification information corresponding treat service data.

Data adding set 230 is mainly suitable for treating that service data is added in target data set.

Concrete, the target data set in the present embodiment can be the forms such as table or storehouse.Data adding set 230 is by when adding in target data set until service data, data adding set 230 can perform pretreatment operation, as whether Already in data adding set 230 checking treats service data in target data set, to avoid occurring data polyisomenism in target data set; For another example, the data layout of service data is treated in data adding set 230 adjustment, to make to treat that service data can meet the relevant regulations etc. of target data set.In addition, when service data is many, data adding set 230 can will treat that service data order is added in target data set, and the data of adding in target data set can be stored in the corresponding position of target data set after sequence.

It should be noted that the present invention can be implemented in the assembly of software and/or software restraint, such as, each device of the present invention can adopt special IC (ASIC) or any other similar hardware device to realize.In one embodiment, software program of the present invention can perform to realize step mentioned above or function by processor.Similarly, software program of the present invention (comprising relevant data structure) can be stored in computer readable recording medium storing program for performing, such as, and RAM storer, magnetic or CD-ROM driver or flexible plastic disc and similar devices.In addition, steps more of the present invention or function can adopt hardware to realize, such as, as coordinating with processor thus performing the circuit of each step or function.

To those skilled in the art, obviously, the invention is not restricted to the details of above-mentioned one exemplary embodiment, and when not deviating from spirit of the present invention or essential characteristic, the present invention can be realized in other specific forms.Therefore, no matter from the viewpoint of which, all should regard embodiment as exemplary, and be nonrestrictive, scope of the present invention is limited by claims instead of above-mentioned explanation, therefore, all changes be intended in the implication of the equivalency by dropping on claim and scope are included in the present invention.Any Reference numeral in claim should be considered as the claim involved by limiting.In addition, obviously " comprising " one word do not get rid of other unit or step, odd number does not get rid of plural number.Multiple unit of stating in system claims or device also can be realized by software or hardware by a unit or device.The word such as first and second is used for representing title, and does not represent any particular order.

Although show and describe exemplary embodiment especially above, it will be appreciated by those skilled in the art that when not deviating from the spirit and scope of claims, can change to some extent in its form and details.

Claims

1. based on a data maintaining method for image recognition, wherein, the method comprises the following steps:

Character recognition is carried out to image;

According to character identification result obtain text formatting treat service data identification information;

Treat described in acquisition service data identification information corresponding treat service data;

Treat that service data is added in target data set by described.

2. method according to claim 1, wherein, described image comprises following any one:

By the image obtained of taking pictures;

By the image that screenshot capture obtains;

The image obtained by copying the choice area territory of on-screen displays;

Transmitted by equipment room data and the image received;

By the image that scanning obtains.

3. method according to claim 1, wherein, describedly to comprise the step that image carries out character recognition:

Character recognition is carried out to the content in the presumptive area in described image.

4. method according to claim 1, wherein, described according to character identification result obtain text formatting treat that the step of service data identification information comprises:

The character string of text formatting is obtained from character identification result;

Obtain from the coupling result for retrieval of described character string and treat service data identification information.

5. method according to claim 4, wherein, the described step obtaining the character string of text formatting from character identification result comprises:

The numeric string with predetermined length of text formatting is obtained from character identification result.

6. method according to claim 4, wherein, described acquisition from the coupling result for retrieval of described character string treats that the step of service data identification information comprises:

Coupling retrieval is carried out respectively to all character strings obtained;

Using the successful each character string of coupling retrieval all as treating that service data identifies.

7. method according to claim 4, wherein, described acquisition from the coupling result for retrieval of described character string treats that the step of service data identification information comprises:

The successful each character string of display coupling retrieval;

When receiving data maintenance order, using each character string of described display all as treating service data identification information.

8. method according to claim 4, wherein, described acquisition from the coupling result for retrieval of described character string treats that the step of service data identification information comprises:

The successful each character string of display coupling retrieval, and selector switch is set respectively for described each character string;

When receiving data maintenance order, according to described selector switch using by the character string selected as treating service data identification information.

9. the method according to claim 7 or 8, wherein, described character string comprises: numeric string; And the step of the successful each character string of described display coupling retrieval comprises:

Show the coupling successful each character string of retrieval and the object title that characterizes of each character string in the form of a list.

10. the method according to claim arbitrary in claim 1 to 8, wherein, described in treat that service data identification information comprises: stock code.

11. 1 kinds of data maintaining apparatus based on image recognition, wherein, comprising:

Character recognition device, is suitable for carrying out character recognition to image;

Mark acquisition device, be suitable for according to character identification result obtain text formatting treat service data identification information;

Data acquisition facility, be suitable for obtain described in treat service data identification information corresponding treat service data;

Data adding set, is suitable for treating that service data is added in target data set by described.

12. devices according to claim 11, wherein, described image comprises following any one:

By the image obtained of taking pictures;

By the image that screenshot capture obtains;

The image obtained by copying the choice area territory of on-screen displays;

Transmitted by equipment room data and the image received;

By the image that scanning obtains.

13. devices according to claim 11, wherein, described character recognition device is specifically suitable for:

14. devices according to claim 11, wherein, described mark acquisition device comprises:

Character string obtains sub-device, is suitable for the character string obtaining text formatting from character identification result;

Mark obtains sub-device, is suitable for obtaining from the coupling result for retrieval of described character string treating service data identification information.

15. devices according to claim 14, wherein, described character string obtains sub-device and is specifically suitable for:

16. devices according to claim 14, wherein, described mark obtains sub-device and comprises:

The sub-device of coupling retrieval, is suitable for carrying out coupling retrieval respectively to all character strings obtained;

The sub-device of first mark, is suitable for the successful each character string of coupling retrieval all as treating that service data identifies.

17. devices according to claim 14, wherein, described mark obtains sub-device and comprises:

The sub-device of first display, is suitable for the successful each character string of display coupling retrieval;

The sub-device of second mark, is suitable for when receiving data maintenance order, using each character string of described display all as treating service data identification information.

18. devices according to claim 14, wherein, described mark obtains sub-device and comprises:

The sub-device of second display, is suitable for the successful each character string of display coupling retrieval, and arranges selector switch respectively for described each character string;

The sub-device of 3rd mark, is suitable for when receiving data maintenance order, according to described selector switch using by the character string selected as treating service data identification information.

19. devices according to claim 17 or 18, wherein, described character string comprises: numeric string; And the described first sub-device of display or the sub-device of the second display are specifically suitable for:

20. according to claim 11 to the device described in arbitrary claim in 18, wherein, described in treat that service data identification information comprises: stock code.