CN104346613B

CN104346613B - Image processing apparatus and image processing method

Info

Publication number: CN104346613B
Application number: CN201410387805.6A
Authority: CN
Inventors: 宫本直知
Original assignee: Casio Computer Co Ltd
Current assignee: Casio Computer Co Ltd
Priority date: 2013-08-08
Filing date: 2014-08-08
Publication date: 2018-06-15
Anticipated expiration: 2034-08-08
Also published as: CN104346613A

Abstract

The image processing apparatus of the present invention has：Acquisition unit obtains the print image obtained by being imaged to the trace that attached code information in frame portion point；Frame image-region corresponding with the trace of above-mentioned frame portion point in the print image obtained by above-mentioned acquisition unit is determined as reading the reading area of above-mentioned code information by determination unit；Reading unit reads above-mentioned code information from the above-mentioned reading area determined by above-mentioned determination unit.

Description

Image processing apparatus and image processing method

Technical field

The present invention relates to a kind of image processing apparatus, image processing method and programs.

Background technology

It is the code information of the regularly arranged gained of pixel set to be currently known a kind of generate scheduled information coding Device (US8,186,594B2).

Code information such as being formed in paper in recording medium in the state of, pass through mobile phone, smart mobile phone etc. Photographic device imaged.Photographic device is implemented as the image information to the code information obtained by camera shooting at scheduled decoding Reason, obtains the original predetermined information represented by code information.

Invention content

In accordance with the invention it is possible to suitably detect frame portion point from the image obtained by camera shooting trace.

According to the embodiment of the present invention, it is a kind of image processing apparatus, which is characterized in that have：Acquisition unit takes Opposite frame portion point attached code information trace imaged obtained by print image；Determination unit, will be by above-mentioned Frame image-region corresponding with the trace of above-mentioned frame portion point in the print image that acquisition unit obtains is determined as reading above-mentioned generation The reading area of code information；Reading unit reads above-mentioned code from the above-mentioned reading area determined by above-mentioned determination unit Information.

According to the embodiment of the present invention, it is a kind of image processing method for having used image processing apparatus, at the image Reason method is characterised by comprising：Obtain the trace that opposite frame portion point attached code information imaged obtained by trace figure The acquisition step of picture；Frame image-region corresponding with the trace of above-mentioned frame portion point in the print image of the acquirement is determined as reading Take the determining step of the reading area of above-mentioned code information；The above-mentioned reading area determining from this reads the reading of above-mentioned code information Take step.

Description of the drawings

Fig. 1 is the block diagram of the Sketch for the mobile terminal for representing the first embodiment using the present invention.

Fig. 2 is the flow chart of an example of the action of the code reading process for the mobile terminal for representing Fig. 1.

Fig. 3 is the figure of the code reading process for definition graph 2.

Fig. 4 is the figure of an example of the image for the code reading process for showing schematically Fig. 2.

Fig. 5 is the figure of an example of the image for the code reading process for showing schematically Fig. 2.

Fig. 6 is the figure of an example of the image for the code reading process for showing schematically Fig. 2.

Fig. 7 is the figure of an example of the image for the code reading process for showing schematically Fig. 2.

Fig. 8 is the block diagram for the Sketch for representing the mobile terminal using second embodiment of the present invention.

Fig. 9 is the flow chart of an example of the action of the code reading process for the mobile terminal for representing Fig. 8.

Figure 10 is the figure of an example of the image for the code reading process for showing schematically Fig. 9.

Figure 11 is the figure of an example of the image for the code reading process for showing schematically Fig. 9.

Figure 12 is the block diagram for representing to apply the Sketch of the mobile terminal of third embodiment of the present invention.

Figure 13 is the flow chart of an example of the action of the code reading process for the mobile terminal for representing Figure 12.

Figure 14 is the figure of the code reading process for definition graph 13.

Figure 15 is the figure of an example of the image for the code reading process for showing schematically Figure 13.

Figure 16 is the figure of an example of the image for the code reading process for showing schematically Figure 13.

Specific embodiment

Hereinafter, for the present invention, the specific form of description of the drawings is used.But the range of invention is not limited to illustrated example Son.

Fig. 1 is the block diagram of the Sketch for the mobile terminal 100 for representing the first embodiment using the present invention.

As shown in Figure 1, mobile terminal 100 has central control 1, memory 2, image pickup part 3, imaging control part 4, image Data generating section 5, code process portion 6, action processing unit 7, display unit 8, display control unit 9, voice communication portion 10, communication control Portion 11, operation inputting part 12 etc..

In addition, central control 1, memory 2, image pickup part 3, imaging control part 4, image data generating section 5, code process Portion 6, action processing unit 7, display control unit 9, voice communication portion 10 and communication control unit 11 are connected via bus 13.

In addition, mobile terminal 100 as photographic device, mobile phone, PHS (personal handy phone system) in moving body such as leading to The compositions such as movement station, the PDA (personal digital assistant) used in letter net.

Central control 1 controls each portion of mobile terminal 100.Specifically, central control 1 has control mobile terminal The CPU (central processing unit, illustration omitted) in 100 each portion, the various processing routines according to mobile terminal 100 (save sketch map Show) carry out various control actions.

Memory 2 is formed such as by DRAM (dynamic RAM).In addition, memory 2 has temporary storage The work of buffer storage, the central control 1 of the data handled by central control 1 and code process portion 6 etc. etc. etc. Memory, the program storage for storing the various programs related with the function of the mobile terminal 100 and data etc. (all save sketch map Show).

Image pickup part 3 images the trace Si for the seal S on recording medium P that impresses (with reference to Fig. 3 A).

Seal S is being formed with polygon (example for trace Si to be remained around predetermined labels on recording medium P Such as square) frame, be formed to encode scheduled information with the regularly arranged of pixel set in the frame The frame portion that the code information Sc of gained is attached to trace Si is divided on Sw.

Trace Si is being formed in print face by the way that seal S impresses on recording medium P to remain on recording medium P Frame portion corresponding with the frame of polygon is remained around watermark image Sp and divides Sw.

Frame portion divide Sw be attached with it is multiple by scheduled information with pixel set it is regularly arranged encoded obtained by generation Code information Sc.That is, frame portion divide Sw roughly equal length it is multiple while Sa ... at least two while Sa, Sa on it is attached respectively Added with code information Sc.Specifically, generally square frame portion divide Sw 4 side Sa ... on, using diagonal as base Standard becomes line and is symmetrically attached with identical code information Sc respectively on such direction.That is, it is embedded with multiplely on trace Si Code information Sc.In addition, the frame portion of square divides 4 corners of Sw to be attached with the predetermined shape (example for detecting vertex C respectively Such as square) mark Sm.

For example, since being separated the position of predetermined space relative to the mark Sm in precalculated position, it is attached in a predetermined direction Added with code information Sc so that divide the extending direction of each Sa when the width direction substantial middle side of Sa is along this of Sw in frame portion (vertical direction substantially vertical with width direction).

Here, according to scheduled coding form (such as Reed Solomon code, Golay code etc.) to original predetermined information (such as URL etc.), which is encoded, obtains code information Sc.Such as code information Sc is regularly arranged pixel with scheduled dimension It is worth the set of the set of the white pixel of " 1 " and the black pixel of pixel value " 0 ".

In addition, in the present embodiment, it is assumed that when seal S is impressed on recording medium P, do not having substantially uniformly It impresses in the state of exerting a force in the entire surface in print face.Thus, for example the frame portion of trace Si divides a part of Sw (such as to scheme The part of downside in 4A) expansion, a part (such as part of the upper left side in Fig. 4 A) of trace Si, which generates, to be lacked in vain.

In addition, image pickup part 3 has camera lens part 3a and electro-photographic portion 3b.

Camera lens part 3a is made of Zoom lens, the first-class a plurality of lenses of focus lamp.

Electro-photographic portion 3b is such as the image as CCD (charge coupling device), CMOS (complementary metal oxide semiconductor) Sensor is formed, and the optical image for the various camera lenses for having passed through camera lens part 3a is transformed to the picture signal of two dimension.

Although in addition, illustration omitted, image pickup part 3 can also have the aperture of the amount for the light that adjustment passes through camera lens part 3a.

Imaging control part 4 controls camera shooting of the image pickup part 3 to subject.That is, imaging control part 4 has the timing of illustration omitted Generator, driver etc..In addition, imaging control part 4 is scanned drive by timing generator, driver to electro-photographic portion 3b It is dynamic, the picture signal of two dimension is transformed to by electro-photographic portion 3b optical images in each predetermined period, from the electro-photographic Picture frame image is read in the imaging area of portion 3b one by one and is output to image data generating section 5.

In addition, imaging control part 4 carries out AF (automatic focusing), AE (automatic exposure processing), AWB (automatic white balance) Etc. the imaging conditions of subjects adjustment control.

Image data generating section 5 for from electro-photographic portion 3b transmit come frame image the analogue value signal to RGB Each color component suitably adjust gain after, sampling holding is carried out by sampling hold circuit (illustration omitted), passes through A/D Converter (illustration omitted) is transformed to numerical data, by color treatments circuit (illustration omitted) handle comprising pixel interpolating And after the color treatments including γ correcting process, the luminance signal Y of digital value and colour difference signal Cb, Cr (YUV numbers are generated According to).

Then, the yuv data of each frame image generated is in turn output to memory 2 by image data generating section 5, is deposited Storage is in the memory 2.

Code process portion 6 has image acquiring section 6a, binaryzation portion 6b, straight line presumption unit 6c, frame test section 6d, information and reads Take portion 6e.

In addition, each portion in code process portion 6 is for example made of scheduled logic circuit, but the structure is an example, and It is without being limited thereto.

Image acquiring section 6a successively obtains the photographed images Ia obtained by the trace Si that camera shooting is impressed on recording medium P (with reference to Fig. 4).

That is, image acquiring section 6a obtains photographed images (print image) Ia, it is scheduled to code information Sc is attached to The frame portion with preset width around watermark image Sp divides the trace Si of gained on Sw to be imaged.Specifically, image takes Portion 6a is obtained to image trace Si by image pickup part 3 from the acquirement of memory 2 and pass through the photographed images Ia that image data generating section 5 generates Predetermined resolution image data duplication.

Binaryzation portion 6b generates the first binary image Ib (with reference to Fig. 4 b).

That is, binaryzation portion 6b is directed to the image data (yuv data) by the image acquiring section 6a photographed images Ia obtained Luminance component Y, implement according to scheduled threshold value carry out binaryzation binary conversion treatment (such as ecad binary conversion treatment etc.), Generate the image data of the first binary image Ib.

In addition, binaryzation portion 6b generates the second binary image Id (with reference to Fig. 6 C).That is, binaryzation portion 6b, which is directed to, passes through frame The luminance component Y of the image data (yuv data) of image Ic, real after the mapping transformation of the mapping transformation portion d2 generations of test section 6d The binary conversion treatment (such as ecad binary conversion treatment etc.) that binaryzation is carried out according to scheduled threshold value is applied, generates the second binaryzation The image data of image Id.

In addition, above-mentioned binary conversion treatment is well known technology, therefore detailed description is omitted herein.

Straight line presumption unit 6c forms the polygonal with seal S in the photographed images Ia obtained by image acquiring section 6a The corresponding frame portion of frame of shape divides the lateral profile of Sw, estimates the straight line L of predetermined number corresponding with the angle number of the frame of polygon. Specifically, straight line presumption unit 6c has profile determining section c1 and straight line determining section c2.

Profile determining section c1 determines that the frame portion with trace Si divides the convex closure region of the corresponding polygon of the lateral profile of Sw A1。

That is, profile determining section c1 determines the outside for dividing Sw with the frame portion of photographed images Ia obtained by image acquiring section 6a The convex closure region A1 of the corresponding polygon of profile (with reference to Fig. 4 C).

Specifically, profile determining section c1 for example obtains corresponding with the photographed images Ia generated by binaryzation portion 6b The image data of one binary image Ib implements convex closure processing, thus directed towards being present in preset range to the image data The set of the black pixel of pixel value " 0 " calculates the multiple line segments that will be connected between the pixel for forming outermost profile respectively.By This, the black pixel of pixel value " 0 " being present in preset range becomes the state surrounded by multiple line segments, is made of these line segments Polygon region become there is no recess portion convex closure region A.At this moment, profile determining section c1 make in binary image into Range for process object changes, and multiple convex closure region A are consequently formed.

Then, profile determining section c1 formation multiple convex closure region A ... in, the convex closure region A of area maximum is true It is set to the convex closure region A1 for dividing the corresponding polygon (such as hexagonal configuration) of the lateral profile of Sw with the frame portion of trace Si.

In addition, the content of above-mentioned convex closure processing is an example, however it is not limited to this, it suitably can arbitrarily change. In addition, convex closure region A is well known technology, therefore detailed description is omitted herein.

Straight line determining section c2 determines to form divides the corresponding block diagrams of Sw to make a reservation for as the lateral profile of Wa with the frame portion of trace Si The straight line L of number (with reference to Fig. 6 A).

That is, straight line determining section c2 passes through the profile determining section c1 polygons (such as hexagonal configuration) determined according to composition Multiple (such as 6) vertex B of convex closure region A1 ... position, determine to form block diagram as predetermined of the lateral profile of Wa Several straight line (such as 4 straight lines for the lateral profile for forming square) L.Specifically, straight line determining section c2 is according to passing through structure Multiple straight line L into arbitrary 2 vertex B, B of the convex closure region A1 of polygon ... in each straight line L and polygon At least one party in relativeness between the number of the pixel of convex closure region A1 overlappings and adjacent straight line L, determines to form frame The straight line L of the predetermined number of the lateral profile of image Wa.

That is, straight line determining section c2 is passing through convex closure region A1 of the composition by the profile determining section c1 polygons determined Arbitrary 2 vertex B, B multiple straight line L ... in, determine form polygon convex closure region A1 multiple pixels overlapping Straight line L of the number more than predetermined value, straight line L is determined as forming block diagram as the straight line L of the lateral profile of Wa.

Specifically, the convex closure of polygon that straight line determining section c2 is for example determined for composition by profile determining section c1 The pixel of region A1 implements the straight-line detection processing based on RANSAC methods, thereby determines that form block diagram straight as the lateral profile of Wa Line L.For example, straight line determining section c2 from form convex closure region A1 6 vertex B ... middle selection arbitrary 2 vertex B, B, will be The straight line L that these 2 vertex B, B are connected is determined as forming straight line L of the block diagram as the lateral profile of the square of Wa Candidate (candidate straight line L).Then, straight line determining section c2 is calculated and is formed and convex closure area for identified all candidate straight line L Candidate straight line L of the pixel number calculated more than predetermined value is determined as forming frame by the pixel number of multiple pixels overlapping of domain A1 The straight line L of the lateral profile of image Wa.Generation with trace Si is for example lacked to white a part of corresponding candidate straight line as a result, Candidate straight line Lc other than La, relatively short candidate straight line Lb is determined as forming straight line L (ginseng of the block diagram as the lateral profile of Wa According to Fig. 5 A).

In addition, the straight-line detection processing of RANSAC methods is well known technology, therefore omit detailed description herein.

In addition, straight line determining section c2 is passing through convex closure region A1 of the composition by the profile determining section c1 polygons determined Arbitrary 2 vertex B, B multiple straight line L ... in, determine the frame with adjacent straight line L angulations and polygon The roughly equal straight line L of interior angle, the pixel Chong Die with the convex closure region A1 of polygon into the pixel for forming straight line L The high straight line L of the evaluation of estimate calculated is determined as forming block diagram as Wa by additional weight and the evaluation of estimate for calculating each straight line L The straight line L of lateral profile.

Specifically, straight line determining section c2 is for example determined and angle formed by adjacent straight line L for whole candidate straight line L The degree candidate straight line Ld roughly equal with the interior angle (90 °) of the frame of the square of seal S.Then, straight line determining section c2 is to composition The pixel additional weight Chong Die with the convex closure region A1 of polygon in the pixel of identified candidate's straight line Ld, according to predetermined Calculation formula calculate the evaluation of estimate of each candidate straight line L.For example, trace Si block diagram as a part (such as Fig. 5 B of Wa In downside part) in the case of expansion, if straight line determining section c2 from 3 vertex B of the part ... middle selection is arbitrary 2 vertex B, B and determine candidate straight line L, then become determine 3 candidate straight line L ... state.Then, straight line determining section C2 for these 3 candidate straight line L ... each calculate respectively in the adjacent candidate straight line L in each end (in Fig. 5 B In, for the candidate straight line Lc of left and right 2 represented with double dot dash line) angulation, determine that calculated angle is substantially equal to 90 ° of candidate straight line L (in figure 5B, the candidate straight line Ld to be represented with chain-dotted line).And then straight line determining section c2 is forming institute In the pixel of determining candidate straight line L, determine that the pixel Chong Die with the convex closure region A1 of polygon (such as in figure 5B, is The pixel of left and right ends portion side), to identified pixel additional weight, according to scheduled calculation formula Calculation Estimation value.

Then, straight line determining section c2 is compared the evaluation of estimate of each candidate straight line L calculated, and evaluation of estimate is highest Candidate straight line Ld is determined as forming block diagram as the straight line L of the lateral profile of Wa.For example, do not have with the candidate straight line Ld that chain-dotted line represents Have as along the shape at the edge of the convex closure region A1 of polygon, but the pixel of left and right ends portion side and polygon is convex Region A1 overlappings are wrapped, therefore evaluation of estimate is determined as forming block diagram as Wa than other the candidate straight line Ld high being represented by dashed line The straight line L of lateral profile.

In this way, straight line presumption unit 6c, in photographed images Ia (the first binary image Ib), presumption is formed with seal S just The corresponding block diagram of rectangular frame as the lateral profile of Wa 4 straight line L ....Specifically, straight line presumption unit 6c is by top pair Straight line L1, following line correspondence L2, left side line correspondence L3 and the right line correspondence L4 is answered to be estimated as upper and lower with square The corresponding straight line L in each side of left and right (with reference to Fig. 6 A).

Frame test section 6d is detected by the straight line L of the predetermined number deduced by straight line presumption unit 6c the trace Si's formed The block diagram of photographed images Ia is as Wa.Specifically, frame test section 6d has vertex determining section d1, mapping transformation portion d2.

Vertex determining section d1 determines vertex C of the block diagram as Wa of photographed images Ia (with reference to Fig. 6 B).

That is, vertex determining section d1 is predetermined by what is intersected between the straight line L of the predetermined number determined by straight line determining section c2 The point C of number is determined as the vertex C of the frame portion minute Sw (block diagram is as Wa) of trace Si.Specifically, vertex determining section d1 is being imaged In image Ia, by by straight line determining section c2 determine composition lateral profile 4 straight line L ... in adjacent straight line L between 4 points that are intersecting and being formed are determined as vertex C of the block diagram as Wa.At this moment, for 4 straight line L ... in it is mutually mutually disjoint Between straight line L (such as top line correspondence L1 and left side line correspondence L3 etc.), vertex determining section d1 is by making at least one party's Intersection point is obtained to predetermined direction extension in straight line L.

Then, frame test section 6d detects photographed images according to the vertex C of the predetermined number determined by vertex determining section d1 The block diagram of Ia is as Wa.That is, frame test section 6d by the region detection using 4 points determining as vertex C as the frame portion of trace Si Divide Sw (block diagram is as Wa).

In addition, vertex determining section d1 can also be according to marking pattern corresponding with the mark Sm of trace Si in photographed images Ia As the coordinate position of Ma, the vertex C of determination block part Sw (block diagram is as Wa).

That is, for example as shown in Figure 7 A, it, should in the case where exudation has occurred in a part (such as upper right portion) of trace Si A part can become the black picture element of pixel value " 0 " in binaryzation, it is possible to can not be suitably from the camera shooting figure of trace Si Block diagram is formed as the straight line L of the lateral profile of Wa as Ia is estimated.Therefore, on print face, (the predetermined model near mark Sm is utilized In enclosing) there is a situation where the vertex of the frame of polygon, vertex determining section d1 considers the sign image Ma in photographed images Ia Coordinate position, the vertex C of determination block image Wa.

Specifically, vertex determining section d1 for example prepares pattern image Pa corresponding with the shape for indicating Sm (with reference to figure 7B), the characteristic information of pattern image Pa (such as SIFT (Scale-Invariant Features Transform are utilized：Ruler Spend invariant features transformation) characteristic quantity), determined in photographed images Ia comprising the sign image Ma similar with pattern image Pa Region.Then, determining section d1 in vertex is in photographed images Ia, from the preset range on the basis of the coordinate position of sign image Ma The vertex C of interior determination block image Wa.Determining section d1 in vertex can determine to correspond to from the part for the exudation that trace Si has occurred as a result, Block diagram as the vertex C of Wa, the block diagram of photographed images Ia can be suitably detected by frame test section 6d as Wa (with reference to Fig. 7 C).

Mapping transformation portion d2 carries out the mapping transformation processing of image Ic (with reference to Fig. 6 B) after generation mapping transformation.

That is, vertex Cs of the mapping transformation portion d2 according to the predetermined number determined by vertex determining section d1, for passing through image The photographed images Ia that acquisition unit 6a is obtained carries out mapping transformation processing, generates image Ic after the mapping transformation of polygon.Specifically Say that mapping transformation portion d2 calculates the block diagram for the square shape for having shape crooked determined by vertex determining section d1 as Wa in ground 4 vertex C ... coordinate position become square 4 vertex C ... coordinate position coordinate transform formula.So Afterwards, mapping transformation portion d2 is according to the coordinate transform formula calculated, the photographed images Ia implementation mapping transformation processing to trace Si, Generation and the frame portion of trace Si divide the corresponding block diagrams of Sw to be transformed to image Ic after square mapping transformation as the shape of Wa.

Then, (take the photograph by image Ic after the mapping transformation generated by mapping transformation portion d2 by polygon by frame test section 6d As image) in, the frame portion for detecting square corresponding with the frame of seal S divides Sw (block diagram is as Wa).

In addition, above-mentioned mapping transformation processing is well known technology, detailed description is omitted herein.

Information reading part 6e is read out processing, i.e., original scheduled information is read from code information Sc.

That is, the frame portion of information reading part 6e from the photographed images Ia of the trace Si detected by frame test section 6d divide Sw Scheduled information is read in code information Sc in (block diagram is as Wa).Specifically, information reading part 6e by mapping from being become Change portion d2 generation mapping transformation after the corresponding second bianry image Id of image Ic block diagram as being read in the code information Sc in Wa Take scheduled information.

For example, information reading part 6e, in the second binary image Id, detection forms what is detected by frame test section 6d Block diagram, will be the predetermined shape connected between the intermediate point at these 2 edges as substantially parallel 2 edge of Wa The line of (such as square etc.) is determined as the reading area D of code information Sc (with reference to Fig. 6 C).Then, information reading part 6e is from reading The precalculated position (such as left etc.) of region D is taken to start to be scanned along predetermined direction, determines pixel value " 1 " respectively Coordinate position present in the set of the black pixel of the set and pixel value " 0 " of white pixel.Information reading part 6e is directed to and determines White pixel set and black pixel set arrangement, implement corresponding with the coding mode of code information Sc decoding process, Read the original scheduled information (such as URL etc.) represented by code information Sc.

At this moment, information reading part 6e each regions corresponding to each side Sa for dividing Sw with frame portion in reading area D carry out Reading process.That is, with divide with frame portion the corresponding number (such as 4 times) of the number of the side Sa of Sw read from code information Sc it is former The scheduled information to begin.Here, frame portion divides each side Sa of Sw to be attached identical code information Sc respectively, therefore information is read Portion 6e can also for example be configured to detect original scheduled information more than at 2 and read out it is multiple in the case of, sentence The scheduled information can suitably be read by being set to.

In addition, above-mentioned reading process is well known technology, therefore detailed description is omitted herein.

Processing unit 7 is acted according to the original predetermined information of the code information Sc read by information reading part 6e to perform Scheduled action.

That is, situation of the action processing unit 7 in the scheduled information that more than predetermined number is had read by information reading part 6e Under, control the execution of processing corresponding with the scheduled information.Specifically, URL for example is being had read as scheduled information In the case of, action processing unit 7 controls communication control unit 11, accesses the specific webpage of internet as defined in acquired URL. Then, action processing unit 7 refers to according to the execution of preset various processing (such as playback of specific sound, image etc.) Show, control display control unit 9, voice communication portion 10 etc. make it perform various processing.

Display unit 8, according to the vision signal from display control unit 9, will pass through such as being formed by liquid crystal display panel The image (such as live image etc.) of the camera shooting gained of image pickup part 3 is shown on display picture.

Display control unit 9 carry out it is following control, that is, read and be stored temporarily in the image data of display in memory 2 simultaneously So that it is shown on display unit 8.

Specifically, display control unit 9 has VRAM (Video Random Access Memory：Video Random Access Memory), VRAM controllers, digital video code etc..In addition, digital video code is under the control of central control 1 It reads and is stored in from memory 2 with scheduled playback frame rate (such as 30fps) reading from VRAM via VRAM controllers Luminance signal Y and colour difference signal Cb, Cr in VRAM (illustration omitted) generate vision signal based on these data and are output to Display unit 8.

It is given birth to for example, display control unit 9 will be imaged by image pickup part 3 and imaging control part 4 and pass through image data generating section 5 Into multiple frame images ... with scheduled frame rate of display on one side gradually update, one side fact is shown on display unit 8.

The external user of external equipment that voice communication portion 10 is connect with via communication network N is conversed.

Specifically, voice communication portion 10 has microphone 10a, loud speaker 10b, data conversion section 10c etc..In addition, language Sound communication unit 10 talks about sound progress A/D conversion process by data conversion section 10c to the sending for user inputted from microphone 10a, Words voice data will be sent to be output to central control 1, and under the control of central control 1, by 10c pairs of data conversion section The voice datas such as voice data of answering for exporting and inputting from communication control unit 11 carry out D/A conversion process, defeated from loud speaker 10b Go out.

Communication control unit 11 carries out the transmitting-receiving of data via communication network N and communication antenna 11a.

That is, communication antenna 11a can be carried out with the mobile terminal 100 in the communication with wireless base station (illustration omitted) Scheduled communication mode (such as W-CDMA (the Wideband Code Division Multiple Access used：Broadband code Point multiple access) mode, GSM (Global System for Mobile Communications：Global system for mobile communications；Registration Trade mark) mode etc.) corresponding data transmitting-receiving antenna.In addition, communication control unit 11 is according to corresponding with scheduled communication mode Communication protocol, by the communication channel that is set in the communication mode between wireless base station via communication antenna 11a into The transmitting-receiving of row data.That is, communication control unit 11 is according to the indication signal for exporting and inputting from central control 1, to communication counterpart External equipment carry out the receipts of the transmitting-receiving of sound in the call with the external user of the external equipment and the data of Email Hair.

In addition, the structure of communication control unit 11 is an example, however it is not limited to this, it suitably can arbitrarily change, such as It although illustration omitted, can also be configured to load wireless LAN module, can be accessed via access point (Access Point) logical Communication network N.

Communication network N be, for example, via wireless base station, gateway server (illustration omitted) etc. by mobile terminal 100 with it is external The communication network of equipment connection.

In addition, communication network N is, for example, the communication network constructed using industrial siding and existing common public circuit, it can Using various line forms such as LAN (LAN), WAN (wide area network).In addition, telecommunication network N for example including telephone wire road network, The various communication network network diagrams such as isdn line road network, industrial siding, mobile radio communication, telecommunication satellite circuit, CATV line networks, IP network, VoIP(Voice over Internet Protocol：Internet ready phones) gateway, Internet Service Providers etc..

Operation inputting part 12 is used to input various instructions to terminal body.

Specifically, the photography that operation inputting part 12 has subject indicates relevant tripper, pattern and function etc. The transmitting-receiving of incoming call and Email etc. of selection instruction relevant cursor key and decision button up and down, phone hold Row indicates relevant communication association button, the input of text indicates the various buttons such as relevant digital keys and mark button (all Illustration omitted).

If in addition, by the various buttons of user's operation, operation inputting part 12 to central control 1 export with it is operated The corresponding operation instruction of button.Central control 1 makes each portion according to the operation instruction for exporting and inputting from operation inputting part 12 Perform scheduled action (such as the camera shooting of subject, transmitting-receiving etc. of the incoming call of phone, Email).

In addition, operation inputting part 12 can both have the touch screen being integrally provided with display unit 8, it can also be according to user Predetermined operation to touch screen exports operation instruction corresponding with the predetermined operation to central control 1.

Then, the code reading process of mobile terminal 100 is illustrated with reference to Fig. 2~Fig. 7.

Fig. 2 is the flow chart of an example of the action for representing code reading process.

Moreover, it is assumed that the trace Si imaged by following code reading process is such as the record by affixing one's seal in postcard The precalculated position of medium P (with reference to Fig. 3 A).In addition, it is assumed that each side Sa of Sw is divided to be attached respectively is identical for the frame portion of trace Si Code information Sc.

As shown in Fig. 2, first, if camera shooting instruction is had input to the predetermined operation of operation inputting part 12 according to user, Imaging control part 4 makes image pickup part 3 image trace Si, and image data generating section 5 generates the camera shooting figure transmitted from electro-photographic portion 3b As image data (the step S1 of Ia；With reference to Fig. 3 B).

Then, the yuv data of the photographed images Ia of generation is output to memory 2 by image data generating section 5, is stored in this In memory 2.

In addition, in order to easily image trace Si in the state of closer square, display control unit 9 can also make to show Show the display of portion 8 guiding display corresponding with the shape of trace Si.

Then, the image acquiring section 6a in code process portion 6 obtains what is generated by image data generating section 5 from memory 2 Image data (such as brightness data) (step S2 of the scheduled resolution ratio of photographed images Ia；With reference to Fig. 4 A).Then, binaryzation Portion 6b is directed to be implemented to carry out binaryzation with scheduled threshold value by the image data of the image acquiring section 6a photographed images Ia obtained Binary conversion treatment, the image data (step S3) of the first binary image Ib of generation (with reference to Fig. 4 B).

Then, the profile determining section c1 of straight line presumption unit 6c is to the first binary image Ib for being generated by binaryzation portion 6b Image data implement convex closure processing, thereby determine that the convex closure region A1 of polygon corresponding with the lateral profile that frame portion divides Sw (with reference to Fig. 4 C) (step S4).Specifically, profile determining section c1 is in the multiple convex closure regions formed by convex closure processing A ... in, the convex closure region A of area maximum is determined as to divide the lateral profile of Sw corresponding polygonal with the frame portion of trace Si The convex closure region A1 of shape (such as hexagonal configuration).

Then, straight line determining section c2 is by forming by the convex closure region A1's of the profile determining section c1 polygons determined Multiple straight line L of arbitrary 2 vertex B ... in, the number that multiple pixels of the convex closure region A1 of polygon are overlapped will be formed Straight line L more than predetermined value is determined as forming divides the corresponding block diagrams of Sw as the straight line L (step S5) of the lateral profile of Wa with frame portion. Specifically, straight line determining section c2 from form convex closure region A1 6 vertex B ... middle selection arbitrary 2 vertex B, B, will be even The straight line L that these 2 vertex B, B are formed is met to be determined as forming candidate straight line L of the block diagram as the lateral profile of the square of Wa.So Afterwards, straight line determining section c2 is in identified candidate straight line L, by the pixel Chong Die with the multiple pixels for forming convex closure region A1 Candidate straight line L of the number more than predetermined value is determined as forming block diagram as the straight line L of the lateral profile of Wa.

Then, straight line determining section c2 is passing through the more of arbitrary 2 vertex B, B of the convex closure region A1 for forming polygon A straight line L ... in, consider with adjacent straight line L angulations and determine to form block diagram as the straight line L of the lateral profile of Wa (step S6).Specifically, straight line determining section c2 is determined and angle formed by adjacent candidate straight line L for all candidate straight line L The roughly equal candidate straight line L of interior angle (90 °) of degree and the frame of the square of seal S, the convex closure region A1 couple with polygon The pixel additional weight of overlapping calculates the evaluation of estimate of each candidate straight line L according to scheduled calculation formula.Then, straight line determines Portion c2 is compared the evaluation of estimate of each candidate straight line L calculated, and the highest candidate straight line L of evaluation of estimate is determined as to form frame The straight line L of the lateral profile of image Wa.

In addition, the determining processing of the straight line L of step S5, the sequence of determining processing of straight line L of step S6 are an examples, It is not limited to this, such as may be reversed.

Then, the vertex determining section d1 of frame test section 6d forms the pre- of lateral profile by what is determined by straight line determining section c2 The point of predetermined number for determining to intersect between the straight line L of number is determined as the vertex C (steps of the frame portion minute Sw (block diagram is as Wa) of trace Si Rapid S7).At this moment, vertex determining section d1 it is also contemplated that the coordinate position of sign image Ma in photographed images Ia determine block diagram As the vertex C of Wa (with reference to Fig. 7 A~Fig. 7 C).

Then, frame test section 6d is determined according to vertex determining section d1 as a result, determining whether to determine block diagram as 4 of Wa Vertex C (step S8).If it is determined that here, determine 4 vertex C (step S8s of the block diagram as Wa；It is), then mapping transformation portion D2 by determine 4 vertex C ... coordinate position on the basis of, to photographed images Ia carry out mapping transformation processing (step S9).Specifically, mapping transformation portion d2 calculate the block diagram with the crooked square shape of shape as Wa 4 vertex C ... Coordinate position become square 4 vertex C ... coordinate position as coordinate transform formula, according to what is calculated Coordinate transform formula implements the photographed images Ia of trace Si mapping transformation processing, and the block diagram of generation trace Si is as the shape of Wa Be transformed to square mapping transformation after image Ic.

In addition, if it is judged to not determining 4 vertex C (step S8s of the block diagram as Wa in step s 8；It is no), center The CPU of control unit 1 skips later processing, terminates the code reading process.

Then, frame test section 6d in image Ic, is detected and seal S after the mapping transformation generated by mapping transformation portion d2 The frame portion of the corresponding square of frame divide Sw (block diagram is as Wa) (step S10).Then, binaryzation portion 6b is to passing through mapping transformation portion D2 and the image data of image Ic is implemented to carry out the binary conversion treatment of binaryzation with scheduled threshold value after the mapping transformation that generates, it is raw Into the image data (step S11) of the second binary image Id.

Then, information reading part 6e carries out following reading process, i.e., is reflected from what is generated by mapping transformation portion d2 The frame portion for penetrating the corresponding second binary image Id of image Ic after converting divides the code information Sc readings in Sw (block diagram is as Wa) pre- Fixed information (step S12).Specifically, information reading part 6e determines the read area of square in the second binary image Id Domain D is scanned along predetermined direction since the precalculated position of reading area D (such as left etc.), determines respectively Coordinate position present in the set of the set of the white pixel of pixel value " 1 " and the black pixel of pixel value " 0 ".Then, information is read Portion 6e is taken to implement decoding process to the arrangement of the set of identified white pixel and the set of black pixel, is read by code information Sc The original scheduled information (such as URL etc.) represented.

Then, whether information reading part 6e judgements are had read for more times from code information Sc original predetermined by reading process Information (step S13).

If it is determined that here, repeatedly have read original scheduled information (step S13；It is), then information reading part 6e It is judged to suitably reading the scheduled information, action processing unit 7 is according to the scheduled letter read by information reading part 6e Breath (such as URL etc.) performs scheduled action (such as accessing internet, reset to determining sound, image) (step S14)。

On the other hand, if being judged to not reading original scheduled information (step S13 repeatedly in step s 13； It is no), then the CPU of central control 1 skips the processing of step S14, terminates the code reading process.

As described above, mobile terminal 100 according to the present embodiment is more around opposite scheduled watermark image Sp The frame portion of angular shape (such as square) divide the Sw extracode information trace Si that Sc is formed imaged obtained by photographed images In Ia, form frame portion corresponding with the frame of polygon and divide the Sw lateral profiles of (block diagram is as Wa), presumption and the frame of polygon The corresponding predetermined number of angle number straight line L, detect the frame of photographed images Ia being made of the straight line L of the predetermined number deduced Image Wa, therefore by using block diagram is formed as the straight line L of the predetermined number of the lateral profile of Wa, can suitably detect camera shooting The block diagram of image Ia is as Wa.That is, for example trace Si oozed out and lack it is white and can not suitably detection block image Wa top In the case of point C, block diagram can be also made up of presumption as the straight line L of the predetermined number of the lateral profile of Wa, utilizes straight line L Suitably detect that frame portion divides Sw from photographed images Ia (block diagram is as Wa).

In addition, determine the area for dividing the corresponding polygon of the lateral profile of Sw (block diagram is as Wa) with the frame portion of photographed images Ia Domain (convex closure region A1), according to composition determine multiple vertex B in the region of polygon ... position, determine form Block diagram can utilize the straight line L of predetermined number that determines as the straight line L of the predetermined number of the lateral profile of Wa, from taking the photograph As suitably detecting block diagram as Wa in image Ia.Specifically, on arbitrary 2 tops for having passed through the region for forming polygon Multiple straight line L of point B, B ... in, the number for the pixel being overlapped according to the region of each straight line L and polygon and adjacent straight At least one party in relativeness between line L can determine and form block diagram as the straight line of the predetermined number of the lateral profile of Wa L。

That is, passed through form polygon region arbitrary 2 vertex B, B multiple straight line L ... in, determine Straight line L of the number of multiple pixels overlapping in the region of polygon more than predetermined value is formed, straight line L is determined as to form frame The straight line L of the lateral profile of image Wa, therefore it is contemplated that block diagram is formed as the candidate straight line of the straight line L of the lateral profile of Wa Overlapping degree between multiple pixels in the region of L and composition polygon suitably determines to form block diagram as the outboard wheel of Wa Wide straight line L.

In addition, passed through form polygon region arbitrary 2 vertex B, B multiple straight line L ... in, really The fixed straight line L roughly equal with the interior angle of the frame of adjacent straight line L angulations and polygon, to composition straight line L's The pixel additional weight Chong Die with the region of polygon in pixel, calculates the evaluation of estimate of each straight line L, is commented what is calculated Costly straight line L is determined as forming block diagram as the straight line L of the lateral profile of Wa, therefore it is contemplated that forms block diagram as Wa Relativeness between the candidate straight line L of the straight line L of lateral profile suitably determines to form block diagram straight as the lateral profile of Wa Line L.

In addition, by form frame portion divide Sw (block diagram is as Wa) lateral profile predetermined number straight line L between intersect it is pre- The point for determining number is determined as vertex C of the block diagram as Wa, according to the vertex C for the predetermined number determined, detects photographed images Ia's Block diagram as Wa, therefore can utilize form block diagram as the predetermined number of the lateral profile of Wa straight line L between intersect predetermined Several points (vertex C) suitably detects the block diagram of photographed images Ia as Wa.At this moment, according in photographed images Ia and polygonal The coordinate position of the corresponding sign image Ma of mark Sm of the predetermined shape in the corner of the frame of shape, the vertex C of determination block image Wa, It, also being capable of suitably determination block image even the photographed images Ia obtained by thus being imaged to the trace Si oozed out The vertex C of Wa can suitably detect the block diagram of photographed images Ia as Wa.

And then according to the vertex C for the predetermined number determined, mapping transformation processing is carried out to photographed images Ia, generation is more The photographed images (image Ic after mapping transformation) of angular shape, detection are corresponding with the frame of the photographed images Ia of the polygon generated Block diagram as Wa, even therefore to have occurred exudation, lack white trace Si imaged obtained by photographed images Ia, also can Using form block diagram as the predetermined number of the lateral profile of Wa straight line L between the point (vertex C) of predetermined number that intersects it is appropriate Ground carries out mapping transformation processing, as a result, can suitably detect the block diagram of polygon as Wa.

In addition, the code information Sc that can divide from the frame portion of photographed images Ia in Sw (block diagram is as Wa) suitably read it is predetermined Information.At this moment, it is read from the photographed images Ia of trace Si for Sw being divided to attached identical multiple code information Sc to frame portion In the case of predetermined information more than predetermined number, the execution of processing corresponding with the scheduled information is controlled, therefore is passed through In advance to frame portion divide Sw multiple embedded multiple code information Sc ..., can steadily be read from code information Sc original Scheduled information can be appropriately performed processing corresponding with the scheduled information read out.

In addition, present invention is not limited to the embodiments described above, it can be in the range of the main contents for not departing from the present invention Carry out the change of various improvement and design.

Hereinafter, illustrate the second embodiment of mobile terminal 100.

Fig. 8 is the block diagram of the Sketch for the mobile terminal 200 for representing second embodiment.

As shown in figure 8, the code process portion 206 of the mobile terminal 200 of second embodiment is in addition to having image acquiring section Other than 6a, binaryzation portion 6b, straight line presumption unit 6c, frame test section 6d and information reading part 6e, it is also equipped with pixel number reduction portion 6f。

In addition, the structure of the mobile terminal 200 of second embodiment on the point other than following detailed description with above-mentioned reality The mobile terminal 100 for applying mode is roughly the same, omits detailed description.

Pixel number reduction portion 6f carries out following pixel number reduction processing, that is, reduces and be present in the background of photographed images Ia Pixel number.

That is, pixel number reduction portion 6f carries out following processing, i.e., so that the number for the pixel being present in background relative to First binary image Ib corresponding with the photographed images Ia obtained by image acquiring section 6a is relatively reduced.Specifically, Trace Si is affixed one's seal in the identical recording medium of color, pattern, but such as the situation on the line lattice N of notebook of affixing one's seal Under (with reference to Figure 10 A), it is possible to can not suitably be estimated by straight line presumption unit 6c and form frame portion and divide that Sw's (block diagram is as Wa) is outer The straight line L of side profile.

Therefore, pixel number reduction portion 6f obtains the picture number of the first binary image Ib by binaryzation portion 6b generations According to implementation makes after the processing of white pixel and black pixel inversion (reference Figure 10 B), to carry out being present in the first binary picture for removing As Ib background in the expansion process of the small pixel set of ratio predetermined value and shrink process (with reference to Figure 10 C etc.).For example, pixel Number reduction portion 6f are in the process object of (with reference to Figure 10 B) for the black white reverse image Ie as the first binary image Ib Each pixel implements after the expansion process for the pixel for increasing by 1 circle (reference Figure 10 C), implements the contraction place for divesting the pixel of 2 circles Reason (with reference to Figure 11 A) then, is implemented to increase the expansion process of 1 circle pixel (with reference to Figure 11 B).Become as a result, and be present in the one or two The state that pixel number in the background of value image Ib is relatively reduced relative to block diagram is formed as the pixel number of Wa, pushes away in straight line When determining straight line L of the portion 6c presumptions composition block diagram as the lateral profile of Wa, seek to mitigate the pixel being present in the background of trace Si Influence.

Then, straight line presumption unit 6c is carried out in pixel number reduction portion 6f in treated the first binary image Ib, presumption Form the corresponding frame portion of the square frame with seal S divide Sw (block diagram is as Wa) lateral profile 4 straight line L ... after, frame The block diagram of test section 6d detection photographed images Ia is as Wa (with reference to Figure 11 C).

Then, the code reading process of the mobile terminal 200 of second embodiment is illustrated with reference to Fig. 9.

Fig. 9 is the flow chart of an example of the action for representing code reading process.

In addition, the code reading process of the mobile terminal 200 of second embodiment is on the point other than following detailed description It is roughly the same with the code reading process of the mobile terminal 100 of the above embodiment, omit detailed description.

As shown in figure 9, code process portion 206 is similary with the code reading process of the mobile terminal 100 of the above embodiment, Carry out each processing of step S1~S3, the image data of the first binary image Ib of generation (with reference to Fig. 4 B).

Pixel number reduction portion 6f carries out pixel reduction processing (step to the image data of the first binary image Ib generated Rapid S21).Specifically, pixel number reduction portion 6f makes the implementation of the image data of the first binary image Ib white pixel and black After the processing of pixel inversion, expansion process and shrink process are carried out, makes the picture being present in the background of the first binary image Ib Prime number divides the pixel number of Sw (block diagram is as Wa) relatively to reduce relative to frame portion is formed.

Then, profile determining section c1 pixel number is reduced treated the first binary image Ib image data implement it is convex Packet processing thereby determines that convex closure region A1 (with reference to Fig. 4 C) (step of polygon corresponding with the lateral profile that frame portion divides Sw S4)。

Then, code process portion 206 is similary with the code reading process of the mobile terminal 100 of the above embodiment, carries out Each processing later step S4, carry out form frame portion divide Sw (block diagram is as Wa) lateral profile straight line L detection (step S5, S6), frame portion divides the detection (step S10) of Sw (block diagram is as Wa), the reading (step S12) from the scheduled information of code information Deng.

Therefore, according to the mobile terminal of second embodiment 200, the picture being present in into enforcement in the background of photographed images Ia The processing that relatively reduces of number of element, in photographed images Ia after this treatment, presumption forms frame portion and divides Sw (block diagram is as Wa) Lateral profile predetermined number straight line L, therefore do not affix one's seal in the identical recording medium of color, pattern in trace Si, But in the case of for example affixing one's seal on the notebook with line lattice N, pass through the picture for making to be present in the background of photographed images Ia The number of element relatively reduces, and can also mitigate the influence for being present in the pixel in the background of photographed images Ia, suitably estimate Block diagram is formed as the straight line L of the lateral profile of Wa.

In addition, in the above-described embodiment, straight line determining section c2 is passing through the convex closure region A1's of composition polygon Multiple straight line L of arbitrary 2 vertex B, B ... in, with each straight line L and convex closure region A1 of polygon pixels being overlapped On the basis of the both sides of relativeness between number and adjacent straight line L, determine that form block diagram makes a reservation for as the lateral profile of Wa The straight line L of number, but can also be only using either side as benchmark.

And then in the above-described embodiment, the shape of Sw is divided to be set as square, but an only example frame portion, not It is limited to this, such as can also is the polygon other than square.

In addition, in the above-described embodiment, each side Sa of Sw is divided to add identical code respectively to the frame portion of trace Si and believed Breath Sc, but an example, however it is not limited to this, such as mutually different code information Sc can also be added.In this case, may be used To increase the amount for being embedded into code information (original scheduled information) Sc that frame portion divides Sw.

And then in the above-described embodiment, as image processing apparatus, mobile terminal 100,200 is illustrated, but one Example, however it is not limited to this, as long as being capable of the execution of the detection process of controller chassis part Sw (block diagram is as Wa), then can suitably appoint Meaning change.

In addition to this, in the above-described embodiment, it is configured to the control in the central control 1 of mobile terminal 100 (200) Under, it is used as acquisition unit, presumption by being driven by image acquiring section 6a, straight line presumption unit 6c, frame test section 6d to realize The function of unit, detection unit, but it is not limited to this, can also be configured to scheduled by being performed by the CPU of central control 1 Program etc. is realized.

That is, by storage program is stored in comprising acquirement processing procedure, presumption processing procedure, the program of detection process process In program storage.It is played it is then possible to make the CPU of central control 1 as following unit by obtaining processing procedure Function, that is, obtain the photographed images Ia obtained by being imaged to the trace Si of seal S, and wherein seal S has formed scheduled print Around polygon frame so that attached to trace Si scheduled information coding is regularly arranged for pixel set Code information Sc.CPU alternatively, it is also possible to make central control 1 by estimating processing procedure is used as following unit and plays work( Can, i.e., in the photographed images Ia of acquirement, the lateral profile that frame portion corresponding with the frame of polygon divides Sw is formed, is estimated and more The straight line L of the corresponding predetermined number of angle number of the frame of angular shape.Alternatively, it is also possible to make central control by detection process process 1 CPU divides the unit of Sw by the straight line L of the predetermined number deduced the frame portions of photographed images Ia formed as detection and plays Function.

Equally, for outline specifying unit, straight line determination unit, vertex determination unit, generation unit, reading unit, place Unit, pixel number reduction unit are managed, can also be configured to perform scheduled program etc. by the CPU of central control 1 to realize.

And then as storing for performing the computer-readable medium of the above-mentioned program respectively handled, in addition to ROM, Other than hard disk etc., the movable-types recording mediums such as nonvolatile memories, the CD-ROM such as flash memory can be also applied.Separately Outside, also using medium of the carrier wave (Carrier wave) as the data that program is provided via scheduled communication line.

Then, for third embodiment of the present invention, description of the drawings concrete form is used.But the range of invention is simultaneously It is not limited to illustrative example.

Figure 12 is the block diagram for representing to apply the Sketch of the mobile terminal 300 of an embodiment of the invention.

As shown in figure 12, the code process portion 206 of the mobile terminal 300 of third embodiment is in addition to having image acquiring section Other than 6a, binaryzation portion 6b and information reading part 6e, it is also equipped with edge detection portion 6g, parallel edge extraction unit 6h, read area Domain determining section 6i.

In addition, the structure of the mobile terminal 300 of third embodiment on the point other than following detailed description with above-mentioned reality The mobile terminal 100 for applying mode is roughly the same, omits detailed description.

Edge detection portion 6g detects the edge E of print image.

That is, edge detection portion 6g is from binary image Ib corresponding with the photographed images Ia obtained by image acquiring section 6a Detect multiple edge E.Specifically, such as edge detection portion 6g is directed to the binary image Ib by binaryzation portion 6b generations Image data using scheduled differential filter (such as Laplce's filter etc.) carry out differential calculation, detection brightness value, Color and concentration have place jumpy as edge E.Then, edge detection portion 6g generates side according to the edge E detected The image data of edge image Ic (with reference to Figure 15 C).

In addition, the content of above-mentioned edge detection process is an example, however it is not limited to this, it suitably can arbitrarily change.

Parallel edge extraction unit 6h extracts parallel 2 edges E, E out.

That is, parallel edge extraction unit 6h the multiple edge E detected by edge detection portion 6g ... in, extraction with Frame portion divides substantially parallel 2 edge E, the E at the roughly equal interval of the width of Sw.Specifically, parallel edge extraction unit 6h For edge image Ic, in turn apply to predetermined direction (such as to inferior) since precalculated position (such as left etc.) Parallel edge filter F, extraction is with 2 substantially parallel edges E, the E for dividing the roughly equal interval of the width of Sw with frame portion (with reference to Figure 16 A and Figure 16 B).

Parallel edge filter F is added at predetermined spaced intervals with scheduled length (such as 20 pixels) with pre- fixed width Spend 2 edge inspection areas Fa, Fa of (such as 5 pixels).By the way that the interval of these 2 edge inspection areas Fa, Fa is adjusted For the interval for dividing the width of Sw roughly equal with frame portion, thus parallel edge extraction unit 6h extracted out from edge image Ic with Frame portion divides substantially parallel 2 edge E, the E at the roughly equal interval of the width of Sw.At this moment, parallel edge extraction unit 6h makes 2 Edge inspection area Fa, Fa thus draws out around center Fc rotation predetermined angulars (such as 90 °) and divides Sw corresponding parallel with frame portion 2 edges E, E.

In addition, in Figure 16 A and Figure 16 B, only amplification represents a part for the left of edge image Ic.

In addition, the use of the content of the processing of above-mentioned parallel edge filter F is an example, however it is not limited to this, Neng Goushi Local arbitrary change.For example, it is also possible to prepare to change 2 edge inspection areas Fa, Fa width and rotation angle it is multiple Filter is as parallel edge filter F, and respectively using these whole parallel edge filter Fs, extraction divides Sw pairs with frame portion Parallel 2 edge E, the E answered.

Reading area determining section 6i determines the reading area A of code information Sc.

That is, reading area determining section 6i according to the substantially parallel 2 edge E extracted out by parallel edge extraction unit 6h, E determines the reading area A of code information Sc in photographed images Ia.Specifically, reading area determining section 6i schemes with camera shooting As in the corresponding binary image Ib of Ia, by the corresponding area of line between the intermediate point connecting substantially parallel 2 edges E, E Domain (region corresponding with the region of the inside of 2 edges E, E) is determined as reading area A.

For example, substantially parallel 2 edge E, E that reading area determining section 6i will be extracted out by parallel edge extraction unit 6h Intermediate point between connect and determine the line of predetermined shape (such as square etc.), make determined by line and binary image Ib is corresponded to, and the reading area A of code information Sc is thus determined in binary image Ib (with reference to Figure 16 C).

Information reading part 6e read from code information Sc the reading process of original scheduled information.

That is, information reading part 6e is read in the reading area A determined by reading area determining section 6i from code information Sc Take scheduled information.Specifically, information reading part 6e is in binary image Ib corresponding with photographed images Ia, according to presence The pixel value (code information Sc) of pixel in reading area A reads scheduled information.For example, information reading part 6e is from reading The precalculated position (such as left) of region A starts to be scanned along predetermined direction, determines the white picture of pixel value " 1 " respectively Coordinate position present in the set of the set of element and the black pixel of pixel value " 0 ".Information reading part 6e is for identified white The arrangement of the set of pixel and the set of black pixel, implements decoding process corresponding with the coding mode of code information Sc, reads The original scheduled information (such as URL etc.) represented by code information Sc.

At this moment, information reading part 6e each regions corresponding to each side Sa for dividing Sw with frame portion in reading area A carry out Reading process.That is, it is read with dividing the corresponding number (such as 4 times) of the number of the side Sa of Sw with frame portion from code information Sc original Scheduled information.Here, frame portion divides each side Sa of Sw to be attached identical code information Sc, therefore information reading part respectively 6e can also for example be configured to detect original scheduled information more than at 2 and read out it is multiple in the case of, judgement Can suitably to read the scheduled information.

Original scheduled information of the processing unit 7 according to the code information Sc read by information reading part 6e is acted, is held The scheduled action of row.

That is, situation of the action processing unit 7 in the scheduled information that more than predetermined number is had read by information reading part 6e Under, control the execution of processing corresponding with the scheduled information.Specifically, URL for example is being had read as scheduled information In the case of, action processing unit 7 controls communication control unit 11, accesses the specific webpage of internet as defined in the URL being obtained. Then, action processing unit 7 refers to according to the execution of preset various processing (such as playback of specific sound, image etc.) Show, control display control unit 9 and voice communication portion 10 etc., it is made to perform various processing.

Display unit 8, will be by taking the photograph according to the vision signal from display control unit 9 such as being formed by LCD panel As the image (such as live image etc.) of the camera shooting of portion 3 gained is shown on display picture.

For example, display control unit 9 will be imaged with scheduled frame rate of display by image pickup part 3 and imaging control part 4 on one side And pass through multiple frame images that image data generating section 5 generates ... be gradually updated one side fact and be shown in display unit 8 On.

That is, communication antenna 11a can be carried out with the mobile terminal 300 in the communication with wireless base station (illustration omitted) Scheduled communication mode (such as W-CDMA (the Wideband Code Division Multiple Access used：Broadband code Point multiple access) mode, GSM (Global System for Mobile Communications：Global system for mobile communications；Registration Trade mark) mode etc.) corresponding data transmitting-receiving antenna.In addition, communication control unit 11 is according to corresponding with scheduled communication mode Communication protocol, by the communication channel that is set in the communication mode between wireless base station via communication antenna 11a into The transmitting-receiving of row data.That is, communication control unit 11 is according to the indication signal for exporting and inputting from central control 1, to communication counterpart External equipment carry out the transmitting-receiving of sound in the call with the external user of the external equipment, Email data receipts Hair.

Communication network N is, for example, that mobile terminal 300 is set via wireless base station, gateway server (illustration omitted) etc. with outside The communication network of standby connection.

Specifically, the photography that operation inputting part 12 has subject indicates relevant tripper, pattern and function etc. The relevant cursor key up and down of selection instruction, decision button, the call incoming of phone and Email transmitting-receiving etc. Execute instruction relevant communication association button, the input of text indicates the various buttons such as relevant digital keys and mark button (all illustration omitted).

If in addition, by the various buttons of user's operation, operation inputting part 12 to central control 1 export with it is operated The corresponding operation instruction of button.Central control 1 makes each portion according to the operation instruction for exporting and inputting from operation inputting part 12 Perform scheduled action (such as the camera shooting of subject, transmitting-receiving etc. of the call incoming of phone, Email).

Then, the code reading process of mobile terminal 300 is illustrated with reference to Figure 13~Figure 16.

Figure 13 is the flow chart of an example of the action for representing code reading process.

Moreover, it is assumed that it is situated between by the trace Si that following code reading process images such as the record by affixing one's seal in postcard The precalculated position of matter P (with reference to Figure 14 A).In addition, it is assumed that each side Sa of Sw is divided to be attached respectively is identical for the frame portion of trace Si Code information Sc.

As shown in figure 13, first, if having input camera shooting instruction to the predetermined operation of operation inputting part 12 according to user, Imaging control part 4 makes image pickup part 3 image trace Si, and image data generating section 5 generates the camera shooting figure transmitted from electro-photographic portion 3b As image data (the step S1 of Ia；With reference to Figure 14 B).

In addition, in order to easily image trace Si in the state of closer square, display control unit 9 can also make display The display of portion 8 guiding display corresponding with the shape of trace Si.

Then, the image acquiring section 6a in code process portion 6 obtains what is generated by image data generating section 5 from memory 2 Image data (such as brightness data) (step S2 of the scheduled resolution ratio of photographed images Ia；With reference to Figure 15 A).Then, two-value Change portion 6b is directed to be implemented to carry out two-value with scheduled threshold value by the image data of the image acquiring section 6a photographed images Ia obtained The binary conversion treatment of change, the image data (step S3) of generation binary image Ib.

Then, edge detection portion 6g detects multiple edge E out of binary image Ib that generated by binaryzation portion 6b, Generate the image data (step S4) of edge image Ic (with reference to Figure 15 C).

Then, parallel edge extraction unit 6h is directed to the image data of edge image Ic, from scheduled position (such as the upper left corner Portion etc.) start sequentially to apply parallel edge filter F, extract 2 substantially parallel edge E, E (step S5 out；With reference to Figure 16 A With Figure 16 B).

Then, reading area determining section 6i will pass through parallel edge extraction unit 6h pumpings in binary image Ib with connecting The corresponding region of line between the intermediate point of substantially parallel 2 edge E, E gone out is determined as the reading area A of code information Sc (step S6).

Then, information reading part 6e carries out the read area determined by reading area determining section 6i in binary image Ib The reading process (step S7) of scheduled information is read in the A of domain from code information Sc.Specifically, information reading part 6e is from conduct The precalculated position (such as left etc.) of the reading area A of the line of predetermined shape starts to be scanned along predetermined direction, point Not Que Ding pixel value " 1 " white pixel set and pixel value " 0 " black pixel set present in coordinate position.Then, Information reading part 6e implements decoding process for the arrangement of the set of identified white pixel and the set of black pixel, reads by generation The original scheduled information (such as URL etc.) that code information Sc is represented.

In addition, in order to more efficiently into the reading process of row information reading part 6e, it can also be right before the reading process Binary image Ib carry out frame portion divide Sw it is outer be formed as square as mapping transformation handle.

Then, whether information reading part 6e judgements are had read for more times from code information Sc original predetermined by reading process Information (step S8).

If it is determined that here, repeatedly have read original scheduled information (step S8；It is), then information reading part 6e sentences The scheduled information can suitably be read by being set to, and action processing unit 7 is according to the scheduled information read by information reading part 6e (such as URL etc.) performs scheduled action (such as accessing internet, the playback of sound, image being determined) (step S9).

On the other hand, if being judged to not reading original scheduled information (step S8 repeatedly in step s 8；It is no), Then the CPU of central control 1 skips the processing of step S9, terminates the code reading process.

As described above, mobile terminal 300 according to the present embodiment, to having around scheduled watermark image Sp The frame portion of preset width divide the Sw extracode information trace Si that Sc is formed imaged obtained by photographed images Ia binaryzation Image Ib detects multiple edge E, according to from multiple edge E ... middle extraction divides the width of Sw roughly equal with frame portion Substantially parallel 2 edge E, the E at interval determine the reading area A of code information Sc, in the reading in binary image Ib Scheduled information is read from code information Sc in the A of region, therefore by using the frame portion for affixing one's seal trace Si on recording medium P Divide the edge shape of Sw, reading area A existing for code information Sc can be suitably determined in binary image Ib.That is, Frame portion is divided there are code information Sc on the inside of Sw, therefore 2 edges E, E for dividing Sc by determining the frame portion, also can be suitably Determine the reading area A of the code information Sc in binary image Ib.Specifically, in binary image Ib, it will be with 2 sides The corresponding region in region of the inside of edge E, E, the line more specifically with will be connected between the intermediate point of 2 edges E, E Corresponding region is determined as reading area A, therefore reading area A can be more suitably determined in photographed images Ia.

Read original scheduled information from code information Sc in reading area A as a result, therefore can be suitably Scheduled information is read from photographed images Ia.

In addition, it is read from the photographed images Ia of trace Si for Sw being divided to attached identical multiple code information Sc to frame portion In the case of scheduled information more than predetermined number, the execution of control processing corresponding with the scheduled information, therefore lead to After in advance to frame portion divide Sw multiple embedded multiple code information Sc ..., can steadily be read from code information Sc original Scheduled information, processing corresponding with the scheduled information read out can be appropriately performed.

As long as that is, can from photographed images Ia determination block part Sw, and read information from determining frame portion point, then frame portion Divide the determining method of Sw can also be arbitrary method.

For example, in the above-described embodiment, frame template image corresponding with the frame of scheduled polygon can also be prepared, By the matching between frame template image and photographed images Ia come determination block part Sw.

In addition, it for example in the above-described embodiment, as the reading area A of code information Sc, illustrates and in camera shooting figure The corresponding region of line that will be connected between the intermediate point of substantially parallel 2 edges E, E in picture Ia (binary image Ib), A but example, however it is not limited to this, as long as region corresponding with the region of the inside of substantially parallel 2 edges E, E, then It suitably can arbitrarily change.

In addition, in the above-described embodiment, the shape of Sw is divided to be set as square, but an only example frame portion, not It is limited to this, as long as with preset width, then suitably can arbitrarily changes.That is, frame portion divides the shape of Sw for example can also be just Polygon other than rectangular can also be circular.

And then in the above-described embodiment, each side Sa of Sw is divided to add identical code respectively to the frame portion of trace Si to believe Breath Sc, but an example, however it is not limited to this, such as mutually different code information Sc can also be added, it in this case, can To increase the amount for being embedded into code information (original scheduled information) Sc that frame portion divides Sw.

And then in the above-described embodiment, as image processing apparatus, mobile terminal 300 is illustrated, but an example Son, however it is not limited to this, as long as being capable of the execution of the reading process of control routine information Sc, then suitably can arbitrarily change.

In addition to this, in the above-described embodiment, it is configured under the control of the central control 1 of mobile terminal 300, leads to It crosses by image acquiring section 6a, edge detection portion 6g, parallel edge extraction unit 6h, reading area determining section 6i, information reading part 6e It is driven to realize as acquisition unit, detection unit, extract unit, determination unit, the function of reading unit out, but and unlimited In this, can also be configured to realize by performing scheduled program etc. by the CPU of central control 1.

It obtains processing procedure that is, will include, detection process process, pump-and-treat system process, determine processing procedure, reading process The program of process is stored in the program storage of storage program.It is then possible to make central control 1 by obtaining processing procedure CPU functioned as following unit, that is, obtain the print image obtained by being imaged to trace Si, wherein the trace It is set of pixels that frame portions with preset width of the Si around scheduled watermark image Sp, which divides Sw to add scheduled information coding, The regularly arranged code information Sc closed is formed.Furthermore it is possible to the CPU for making central control 1 by detection process process is used as The unit of multiple edge E is detected from the print image of acquirement and is functioned.Furthermore it is possible in being made by pump-and-treat system process Centre control unit 1 CPU functioned as following unit, i.e., the multiple edge E detected ... in, extraction and frame Substantially parallel 2 edge E, the E at the roughly equal interval of the width of part Sw.Furthermore it is possible to by determining that processing procedure makes The CPU of central control 1 is functioned as following unit, i.e., according to the 2 of extraction edges E, E, in print image Determine the reading area A of code information Sc.Furthermore it is possible to the CPU for making central control 1 by reading process process is used as true The unit of scheduled information is read from code information Sc and function in fixed reading area A,

Equally, for processing unit, can also be configured to by the CPU of central control 1 perform scheduled program etc. come It realizes.

Claims

1. a kind of image processing apparatus, which is characterized in that have：

Acquisition unit obtains the trace obtained by being imaged to the trace that attached code information in the frame portion point for forming trace Image；

Determination unit, by frame corresponding with the trace of above-mentioned frame portion point in the print image obtained by above-mentioned acquisition unit Image-region is determined as reading the reading area of above-mentioned code information；

Reading unit reads above-mentioned code information from the above-mentioned reading area determined by above-mentioned determination unit,

Above-mentioned determination unit has：

Detection unit detects multiple edges from the print image obtained by above-mentioned acquisition unit；

It extracts unit out, in the multiple edges detected by above-mentioned detection unit, extracts out big with the width of above-mentioned frame portion point Substantially parallel 2 edge at equal interval is caused, wherein

According to 2 edges extracted out by above-mentioned extraction unit, the reading of above-mentioned code information is determined in above-mentioned print image Region,

Above-mentioned reading unit is read predetermined in the above-mentioned reading area determined by above-mentioned determination unit from above-mentioned code information Information.

2. image processing apparatus according to claim 1, which is characterized in that

Above-mentioned determination unit is in above-mentioned print image, by region corresponding with the region of inside clamped with above-mentioned 2 edges It is determined as above-mentioned reading area.

3. image processing apparatus according to claim 1, which is characterized in that

In the width direction substantial middle side of above-mentioned frame portion point along the vertical direction affix substantially vertical with the width direction State code information,

Above-mentioned determination unit is in above-mentioned print image, by the corresponding area of line between the intermediate point connecting above-mentioned 2 edges Domain is determined as above-mentioned reading area.

4. image processing apparatus according to claim 1, which is characterized in that

Identical multiple above-mentioned code informations are added to above-mentioned frame portion point,

It is also equipped with：Processing unit, in the situation for the scheduled information that more than predetermined number is had read by above-mentioned reading unit Under, control the execution of processing corresponding with the information.

5. image processing apparatus according to claim 1, which is characterized in that

Above-mentioned determination unit has：

Scavenging valve in the print image obtained by above-mentioned acquisition unit, forms the lateral profile of above-mentioned frame portion point, pushes away The straight line of fixed predetermined number corresponding with the angle number of the frame of polygon；

Detection unit detects the above-mentioned trace figure being made of the straight line of the predetermined number deduced by above-mentioned scavenging valve The above-mentioned frame portion of picture point.

6. image processing apparatus according to claim 5, which is characterized in that

Above-mentioned scavenging valve has：

Outline specifying unit determines the lateral profile of the above-mentioned frame portion of print image point with being obtained by above-mentioned acquisition unit The region of corresponding polygon；

Straight line determination unit, the multiple vertex in the region of polygon determined according to composition by above-mentioned outline specifying unit Position, determine to form the straight line of the predetermined number of the lateral profile of above-mentioned frame portion point.

7. image processing apparatus according to claim 6, which is characterized in that

Above-mentioned straight line determination unit passed through form determined by above-mentioned outline specifying unit arbitrary the 2 of the region of polygon In multiple straight lines on a vertex, according to the number of the pixel of the region of each straight line and above-mentioned polygon overlapping and adjacent straight line Between relativeness at least one party, determine to form the straight line of the predetermined number of the lateral profile of above-mentioned frame portion point.

8. image processing apparatus according to claim 7, which is characterized in that

Above-mentioned straight line determination unit is also in times for having passed through the region of polygon that composition is determined by above-mentioned outline specifying unit It anticipates in multiple straight lines on 2 vertex, the number for determining to form multiple pixels overlapping in the region of above-mentioned polygon compares predetermined value The straight line is determined as forming the straight line of the lateral profile of above-mentioned frame portion point by more straight lines.

9. image processing apparatus according to claim 7, which is characterized in that

Above-mentioned straight line determination unit is also in times for having passed through the region of polygon that composition is determined by above-mentioned outline specifying unit It anticipates in multiple straight lines on 2 vertex, the interior angle of the frame of determining and adjacent straight line angulation and above-mentioned polygon is substantially Equal straight line, the pixel additional weight Chong Die with the region of above-mentioned polygon into the pixel for forming the straight line calculate The evaluation of estimate of each straight line, the high straight line of the evaluation of estimate calculated is determined as forming above-mentioned frame portion point lateral profile it is straight Line.

10. image processing apparatus according to claim 6, which is characterized in that

Above-mentioned detection unit has：Vertex determination unit, by the straight of the predetermined number determined by above-mentioned straight line determination unit The point of the predetermined number intersected between line is determined as the vertex of above-mentioned frame portion minute, wherein

According to the vertex of predetermined number determined by above-mentioned vertex determination unit, the above-mentioned frame portion of above-mentioned print image is detected Point.

11. image processing apparatus according to claim 10, which is characterized in that

Above-mentioned trace forms the mark of predetermined shape in the corner of the frame of above-mentioned polygon,

Above-mentioned vertex determination unit determines corresponding with above-mentioned mark also in the print image obtained by above-mentioned acquisition unit The position of sign image according to the position of identified above-mentioned sign image, determines the vertex of above-mentioned frame portion point.

12. image processing apparatus according to claim 11, which is characterized in that

It is also equipped with：First generation unit, according to the vertex of predetermined number determined by above-mentioned vertex determination unit, to passing through The print image that above-mentioned acquisition unit obtains carries out mapping transformation processing, generates the print image of polygon,

Above-mentioned detection unit detects corresponding with the frame of the print image of polygon generated by above-mentioned first generation unit Frame portion point.

13. image processing apparatus according to claim 5, which is characterized in that

It is also equipped with：Reading unit, out of the above-mentioned print image detected by above-mentioned detection unit above-mentioned frame portion point Scheduled information is read in above-mentioned code information.

14. image processing apparatus according to claim 1, which is characterized in that

Multiple above-mentioned code informations are added on the frame of the polygon of above-mentioned trace,

Have：Processing unit, in the feelings for the above-mentioned scheduled information that more than predetermined number is had read by above-mentioned reading unit Under condition, the execution of processing corresponding with the scheduled information is controlled.

15. image processing apparatus according to claim 5, which is characterized in that

It is also equipped with：Pixel number reduces unit, and to the print image obtained by above-mentioned acquisition unit, carrying out processing makes to be present in The number relative reduction of pixel in the background of the print image,

Above-mentioned scavenging valve is reduced in above-mentioned pixel number in unit treated print image, estimates the straight of above-mentioned predetermined number Line.

16. a kind of image processing method for having used image processing apparatus, which is characterized in that including：

Obtain the acquirement of the print image obtained by being imaged to the trace that attached code information in the frame portion point for forming trace Step；

Frame image-region corresponding with the trace of above-mentioned frame portion point in the print image of the acquirement is determined as reading above-mentioned generation The determining step of the reading area of code information；

The above-mentioned reading area determining from this reads the read step of above-mentioned code information,

Include the following steps in above-mentioned determining step：

Detecting step detects multiple edges from the print image obtained by above-mentioned acquisition step；

Extract step out, in the multiple edges detected by above-mentioned detecting step, the width that extraction divides with above-mentioned frame portion is substantially Substantially parallel 2 edge at equal interval, wherein

According to 2 edges extracted out by above-mentioned extraction step, the reading of above-mentioned code information is determined in above-mentioned print image Region,

Above-mentioned read step is read predetermined in the above-mentioned reading area determined by above-mentioned determining step from above-mentioned code information Information.