CN102903142A - Method for realizing three-dimensional augmented reality - Google Patents
Method for realizing three-dimensional augmented reality Download PDFInfo
- Publication number
- CN102903142A CN102903142A CN2012103981429A CN201210398142A CN102903142A CN 102903142 A CN102903142 A CN 102903142A CN 2012103981429 A CN2012103981429 A CN 2012103981429A CN 201210398142 A CN201210398142 A CN 201210398142A CN 102903142 A CN102903142 A CN 102903142A
- Authority
- CN
- China
- Prior art keywords
- dimensional
- card
- picture
- dimensional model
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a method for realizing a three-dimensional augmented reality. The bottleneck that the number of bi-dimensional read pictures of the conventional augmented reality is broken; graphical picture pixels and color information of a marker are respectively read twice, so that a mapping relation between a virtual object and a real object is quickly and accurately constructed; patterns on the marker are attractive; and under any lighting condition, the information of the marker can be normally read. The method comprises the following steps of: initializing multimedia equipment and a photography device, and connecting the multimedia equipment and the photography device with a relevant three-dimensional model; acquiring a video frame of the marker through the photography device, wherein the marker is a picture or a card, and the patterns on the marker are fully colored; reading the video frame, and retrieving a corresponding virtual three-dimensional model in a three-dimensional database; positioning the virtual three-dimensional model and a coordinate axis of the video frame; and calling the retrieved virtual three-dimensional model, synthesizing the virtual three-dimensional model and the video frame, and outputting the video frame to a display for displaying.
Description
Technical field
The present invention relates to three-dimensional modeling and augmented reality field, relate in particular to a kind of method that realizes three-dimensional enhanced reality.
Background technology
Augmented reality, it is a kind of technology that combines the Computer Subjects such as image recognition is followed the trail of, motion-captured, virtual reality, with virtual three-dimensional model animation, video, literal, the real-time Overlapping display of picture digital information in real scene, and realize the human-computer interaction technology of the innovation of nature interaction with real object or user, be widely used in every field, hold a colored card such as the user, by reading of camera, present actual situation that the 3-D view corresponding with the pattern on the card and colour picture merge mutually in the display in conjunction with presenting.
In the prior art, pattern on the two dimensional image that camera head reads comprises two-dimensional visualization coding and multicolour pattern, it is complicated that the augmented reality module of tradition multicolour pattern reads the image content pixel, so larger to program and camera identification load, substantially can only realize that single picture reads, substantially can not finish many picture operations, saying nothing of has been a large amount of pictures.
The two-dimensional visualization coding is a kind of coding pattern that is similar to bar code, and this visual coding can be used as the unique identification of mark.Camera on the multimedia equipments such as computing machine, mobile phone and panel computer can detect the mark with the two-dimensional visualization coding.
But there is following defective in above-mentioned two-dimension code read mode:
Two-dimension code arranges in picture to be identified or the position on the card and shared size need to affect the pattern picture of picture or card vivid, particularly for some mark that the aesthetic measure of pattern is relatively paid close attention to, for example game card;
Augmented reality reads according to the simple pixel graphics of two-dimension code, realize the most basic image recognition, although this mode fast recognition, but, when the picture number that will read large (general about 200), game card for example, read the large figure of amount like this, can cause reading images chaotic, slow in reacting makeing mistakes, its causes of mistake:
Two-dimension code is the dot matrix image information take pixel as unit, array pattern is relatively single, the mode of the multidigit permutation and combination that adopts is distinguished two-dimension code, this has just had higher requirement to the recognition capability of identification equipment, in addition because for example restriction of the size of card (8.3x6.3cm) own, the two-dimension code size is unsuitable excessive, so in the situation that the identification of camera medium and long distance will produce and obscure or can't read, this moment, two-dimension code was unsuitable for the Application and Development of augmented reality;
What the conventional two-dimensional code adopted in addition is black and white identification, recognition speed is fast under normal circumstances owing to color value contrast maximum (white R:255B:255G:255 black R:0G:0B:0) although it is so, but relatively high to printing sheets and environmental requirement, if under high light affects first, can change color numerical value (variation of black under the high light), cause the problem that to identify.
Summary of the invention
The problem to be solved in the present invention provides a kind of method that realizes three-dimensional enhanced reality, is used for setting up fast and accurately the mapping relations between the actual situation object when identifying a large amount of colour pictures or card.
Technical scheme of the present invention is as follows:
A kind of method that realizes three-dimensional enhanced reality comprises the steps:
A: initialization multimedia equipment, the camera head that connects on it connect with the three-dimensional model of being connected;
B: obtain the frame of video of mark by camera head, described mark is picture or card, and the pattern on it is full color;
C: described frame of video is read, obtain colour picture or card relevant information, thereby retrieve virtual three-dimensional model corresponding in the three-dimensional modeling data storehouse, the three-dimensional model in the described three-dimensional modeling data storehouse utilizes dimensional Modeling Technology, color drawing for curved surface of body technology and pinup picture technology to finish;
D: the coordinate axis to virtual three-dimensional model and frame of video positions;
E: the virtual three-dimensional model that will retrieve accesses with frame of video and synthesizes, and finishes the actual situation combination, and outputs to display and show.
Preferably, among the described step C described frame of video is read, comprise that secondary reads process, read for the first time the graph outline information on colour picture or the card, finish the preliminary search location, read the graphic color information on colour picture or the card for the second time, final affirmation location.
Preferably, the mark among the described step B is before printing, and the pattern on it passes through following processing procedure:
Reduce picture size fast to guarantee that data speed is transferred on the backstage; Pattern is carried out subject content refine, remove unnecessary lines; Strengthen saturation degree and the contrast of image; The obfuscation imaging surface; Picture to image carries out pixelation, to improve reading speed.
Preferably, the pattern among the described step B on colour picture or the card is full-color 240,000 looks, comprises personage, scene and stage property.
Preferably, described three-dimensional model comprises the three dimensional character model corresponding with personage, scene and stage property on picture or the card, three-dimensional scene models and three-dimensional prop model, wherein each personage's three-dimensional model is lower than 2000, and each three-dimensional scene models or three-dimensional prop model are lower than 1000.
What preferably, read that graph outline information on colour picture or the card utilizes the described first time is the multidimensional gradient method.
Beneficial effect of the present invention is: broken through traditional augmented reality two-dimension code and read the few bottleneck that to get of number of pictures, in augmented reality, by reading respectively graphic picture pixel and the colouring information of mark for twice, set up fast and accurately the mapping relations between the actual situation object; And the pattern on the mark is attractive in appearance, does not have the distinguishing mark part of the whole pattern layout of unnecessary impact; And under any light condition, can both normally read the information of mark.
Description of drawings
Fig. 1 is process flow diagram of the present invention;
Fig. 2 is the design sketch after card example of the present invention discolors;
Fig. 3 is that the line exterior feature that card example of the present invention carries out obtaining after profile extracts is schemed;
Fig. 4 is that card example of the present invention carries out the color design sketch in when identification;
Fig. 5 is the overlay chart after card example of the present invention carries out twi-read.
Embodiment
Below in conjunction with accompanying drawing preferred embodiment of the present invention is made brief description.
As shown in Figure 1, exemplary application of the present invention needs to realize identifying fast and accurately a large amount of card information in the card field of play;
A kind of method that realizes three-dimensional enhanced reality comprises the steps:
10: initialization multimedia equipment, the camera head that connects on it connect with the three-dimensional model of being connected;
Multimedia equipment is optimized, makes camera head under fuzzy state, still can read fast the coordinate of mark card, can load in a large number color image information by initialization;
In step 10 front, in line with optimizing first the theory of identifying behind the figure, the mark card that is identified is before being printed to playing cards, and the pattern of card passes through the processing procedure of following steps:
The picture size that reduces card is fast to guarantee that data speed is transferred on the backstage;
Card is carried out picture optimization, original painting is carried out subject content refine, remove unnecessary lines;
The card color is optimized, strengthens saturation degree and the contrast of image;
The imaging surface of obfuscation card is intended to accurate blurred picture, can improve the camera fuzzy diagnosis to the interval degree of clear identification;
Picture to card carries out pixelation, to improve reading speed;
After the image effect figure of the card that finally obtains discolors how shown in 2;
20: obtain the frame of video of mark by camera head, described mark is that 200 patterns are full-color 240,000 looks, comprises the card of personage, scene and stage property;
When reading card, card can be placed in the cassette tape and read, and camera is in the situation that low pixel still obtains fast reading speed;
30: described frame of video is read, obtain the relevant information of card, thereby retrieve virtual three-dimensional model corresponding in the three-dimensional modeling data storehouse;
Wherein, comprise the three-dimensional drawing technology of utilizing in the described three-dimensional modeling data storehouse, color drawing for curved surface of body technology and pinup picture technology finish with card on the personage, the three dimensional character model that scene or stage property are corresponding, three-dimensional scene models and three-dimensional prop model, taked low accuracy model and high precision to draw the mode of pinup picture, face number and fixed-point number to model are strictly controlled, wherein each personage's three-dimensional model is lower than 2000, each three-dimensional scene models or three-dimensional prop model are lower than 1000, guaranteeing under the three-dimensional model condition attractive in appearance, to the minimizing of large limit the database committed memory the space and greatly improved the speed that reads;
Because because discrete error can appear in the camera mass discrepancy, cause reading confusion or read stack, described frame of video read comprise following two steps:
31 first steps read the line original text of the pattern of frame of video, by line manuscript base district, tentatively distinguish card information, confirm which the card information that is that reads;
Be specially: the pattern to frame of video carries out level and smooth and binary conversion treatment, carry out afterwards detection and the extraction of pattern edge, obtain the string diagram of pattern on the card, specifically adopt Gauss in the multidimensional gradient method-Laplace operator algorithm to carry out Image Edge-Detection and extraction; The processing that image before for example Fig. 2 being discolored carries out above-mentioned steps obtains string diagram for example shown in Figure 3;
32 second steps read the graphic color information of frame of video, are 320,000 wide colour gamut read modes because color reads employing, so even also can guarantee the accuracy that reads in the process reading of a large amount of cards;
Be specially: the pixel of pattern is classified according to color, and the method that color classification is commonly used has linear color threshold method, nearest-neighbor method and threshold vector method; Afterwards, the pixel of adjacent same color is linked to be color lump, color lump is identified, calculate the method realize target coupling of similarity according to colouring information; Image when the image before for example Fig. 2 being discolored carries out color identification as shown in Figure 4;
By eclipse effect after twice identification, as shown in Figure 5, card is identified, and corresponding three-dimensional model in the accurate location model database;
40: the coordinate axis to virtual three-dimensional model and frame of video positions;
50: the virtual three-dimensional model that will retrieve accesses with frame of video and synthesizes, and finishes the actual situation combination, and outputs to display and show.
Above one embodiment of the present of invention are had been described in detail, but described content only is preferred embodiment of the present invention, can not be considered to be used to limiting practical range of the present invention.All equalizations of doing according to the present patent application scope change and improve etc., all should still belong within the patent covering scope of the present invention.
Claims (6)
1. a method that realizes three-dimensional enhanced reality is characterized in that: comprise the steps:
A: initialization multimedia equipment, the camera head that connects on it connect with the three-dimensional model of being connected;
B: obtain the frame of video of mark by camera head, described mark is picture or card, and the pattern on it is full color;
C: described frame of video is read, obtain colour picture or card relevant information, thereby retrieve virtual three-dimensional model corresponding in the three-dimensional modeling data storehouse, the three-dimensional model in the described three-dimensional modeling data storehouse utilizes dimensional Modeling Technology, color drawing for curved surface of body technology and pinup picture technology to finish;
D: the coordinate axis to virtual three-dimensional model and frame of video positions;
E: the virtual three-dimensional model that will retrieve accesses with frame of video and synthesizes, and finishes the actual situation combination, and outputs to display and show.
2. the method for realization three-dimensional enhanced reality according to claim 1, it is characterized in that: among the described step C described frame of video is read, comprise that secondary reads process, read for the first time the graph outline information on colour picture or the card, finish the preliminary search location, read for the second time the graphic color information on colour picture or the card, final affirmation location.
3. the method for realization three-dimensional enhanced reality according to claim 1 is characterized in that: the mark among the described step B is before printing, and the pattern on it is through following processing procedure:
Reduce picture size fast to guarantee that data speed is transferred on the backstage; Pattern is carried out subject content refine, remove unnecessary lines; Strengthen saturation degree and the contrast of image; The obfuscation imaging surface; Picture to image carries out pixelation, to improve reading speed.
4. the method for realization three-dimensional enhanced reality according to claim 1, it is characterized in that: the pattern among the described step B on colour picture or the card is full-color 240,000 looks, comprises personage, scene and stage property.
5. the method for realization three-dimensional enhanced reality according to claim 4, it is characterized in that: described three-dimensional model comprises the three dimensional character model corresponding with personage, scene and stage property on picture or the card, three-dimensional scene models and three-dimensional prop model, wherein each personage's three-dimensional model is lower than 2000, and each three-dimensional scene models or three-dimensional prop model are lower than 1000.
6. the method for realization three-dimensional enhanced reality according to claim 2 is characterized in that: what the graph outline information on colour picture or the card of reading the described first time was utilized is the multidimensional gradient method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012103981429A CN102903142A (en) | 2012-10-18 | 2012-10-18 | Method for realizing three-dimensional augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012103981429A CN102903142A (en) | 2012-10-18 | 2012-10-18 | Method for realizing three-dimensional augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102903142A true CN102903142A (en) | 2013-01-30 |
Family
ID=47575354
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012103981429A Pending CN102903142A (en) | 2012-10-18 | 2012-10-18 | Method for realizing three-dimensional augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102903142A (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104143125A (en) * | 2014-01-24 | 2014-11-12 | 中国建筑第四工程局有限公司 | Engineering project visualization system management method |
| CN105358225A (en) * | 2013-04-30 | 2016-02-24 | Kabam公司 | System and method for enhanced video of game playback |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
| CN105844979A (en) * | 2015-12-15 | 2016-08-10 | 齐建明 | Augmented reality book, and education system and method based on augmented reality book |
| CN106200960A (en) * | 2016-07-07 | 2016-12-07 | 深圳市大熊动漫文化有限公司 | The content display method of electronic interactive product and device |
| CN106600669A (en) * | 2016-12-22 | 2017-04-26 | 郑州正电电子技术有限公司 | Device based on variable-color fluorescent drawing board and augmented reality, and operation method |
| CN106875461A (en) * | 2015-12-10 | 2017-06-20 | 青岛华正信息技术有限公司 | One kind is tinted plane picture 3D model transformation systems and method |
| WO2017173918A1 (en) * | 2016-04-06 | 2017-10-12 | 北京小小牛创意科技有限公司 | 3d virtual environment generating method and device |
| CN107320955A (en) * | 2017-06-23 | 2017-11-07 | 武汉秀宝软件有限公司 | A kind of AR venue interface alternation method and system based on multi-client |
| CN107680105A (en) * | 2017-10-12 | 2018-02-09 | 北京奇虎科技有限公司 | Video data real-time processing method and device, computing device based on virtual world |
| CN107680170A (en) * | 2017-10-12 | 2018-02-09 | 北京奇虎科技有限公司 | View synthesis method and device based on virtual world, computing device |
| CN107862096A (en) * | 2017-12-08 | 2018-03-30 | 快创科技（大连）有限公司 | A kind of company information AC system based on AR augmented realities |
| CN108986191A (en) * | 2018-07-03 | 2018-12-11 | 百度在线网络技术（北京）有限公司 | Generation method, device and the terminal device of figure action |
| CN109903261A (en) * | 2019-02-19 | 2019-06-18 | 北京奇艺世纪科技有限公司 | A kind of image processing method, device and electronic equipment |
| CN110858376A (en) * | 2018-08-22 | 2020-03-03 | 阿里巴巴集团控股有限公司 | Service providing method, device, system and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101593271B (en) * | 2009-06-26 | 2011-09-28 | 上海久娱网络科技有限公司 | System for identifying figures in card game machine |
| US20120083325A1 (en) * | 2010-09-30 | 2012-04-05 | Heatherly Christopher W | Systems and methods to provide augmented reality for a board game |
| US20120122528A1 (en) * | 2010-11-15 | 2012-05-17 | Bally Gaming, Inc. | System and method for augmented reality gaming using a mobile device |
-
2012
- 2012-10-18 CN CN2012103981429A patent/CN102903142A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101593271B (en) * | 2009-06-26 | 2011-09-28 | 上海久娱网络科技有限公司 | System for identifying figures in card game machine |
| US20120083325A1 (en) * | 2010-09-30 | 2012-04-05 | Heatherly Christopher W | Systems and methods to provide augmented reality for a board game |
| US20120122528A1 (en) * | 2010-11-15 | 2012-05-17 | Bally Gaming, Inc. | System and method for augmented reality gaming using a mobile device |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105358225B (en) * | 2013-04-30 | 2019-03-05 | Kabam公司 | The system and method for enhancing video for game video-recording and playback |
| CN105358225A (en) * | 2013-04-30 | 2016-02-24 | Kabam公司 | System and method for enhanced video of game playback |
| CN104143125A (en) * | 2014-01-24 | 2014-11-12 | 中国建筑第四工程局有限公司 | Engineering project visualization system management method |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
| CN106875461A (en) * | 2015-12-10 | 2017-06-20 | 青岛华正信息技术有限公司 | One kind is tinted plane picture 3D model transformation systems and method |
| CN105844979A (en) * | 2015-12-15 | 2016-08-10 | 齐建明 | Augmented reality book, and education system and method based on augmented reality book |
| WO2017173918A1 (en) * | 2016-04-06 | 2017-10-12 | 北京小小牛创意科技有限公司 | 3d virtual environment generating method and device |
| US10740963B2 (en) | 2016-04-06 | 2020-08-11 | Beijing Xiaoxiaoniu Creative Technologies Ltd | 3D virtual environment generating method and device |
| CN106200960A (en) * | 2016-07-07 | 2016-12-07 | 深圳市大熊动漫文化有限公司 | The content display method of electronic interactive product and device |
| CN106600669A (en) * | 2016-12-22 | 2017-04-26 | 郑州正电电子技术有限公司 | Device based on variable-color fluorescent drawing board and augmented reality, and operation method |
| CN107320955A (en) * | 2017-06-23 | 2017-11-07 | 武汉秀宝软件有限公司 | A kind of AR venue interface alternation method and system based on multi-client |
| CN107320955B (en) * | 2017-06-23 | 2021-01-29 | 武汉秀宝软件有限公司 | AR venue interface interaction method and system based on multiple clients |
| CN107680170A (en) * | 2017-10-12 | 2018-02-09 | 北京奇虎科技有限公司 | View synthesis method and device based on virtual world, computing device |
| CN107680105A (en) * | 2017-10-12 | 2018-02-09 | 北京奇虎科技有限公司 | Video data real-time processing method and device, computing device based on virtual world |
| CN107862096A (en) * | 2017-12-08 | 2018-03-30 | 快创科技（大连）有限公司 | A kind of company information AC system based on AR augmented realities |
| CN108986191A (en) * | 2018-07-03 | 2018-12-11 | 百度在线网络技术（北京）有限公司 | Generation method, device and the terminal device of figure action |
| CN110858376A (en) * | 2018-08-22 | 2020-03-03 | 阿里巴巴集团控股有限公司 | Service providing method, device, system and storage medium |
| CN109903261A (en) * | 2019-02-19 | 2019-06-18 | 北京奇艺世纪科技有限公司 | A kind of image processing method, device and electronic equipment |
| CN109903261B (en) * | 2019-02-19 | 2021-04-09 | 北京奇艺世纪科技有限公司 | Image processing method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102903142A (en) | Method for realizing three-dimensional augmented reality | |
| CN108062776B (en) | Camera Attitude Tracking method and apparatus | |
| CN103503030B (en) | Image processing device for specifying depth of object present in real space by performing image processing, stereoscopic viewing device, and integrated circuit | |
| CN100470452C (en) | Method and system for implementing three-dimensional enhanced reality | |
| JP5778967B2 (en) | Information processing program, information processing method, information processing apparatus, and information processing system | |
| CN101923791A (en) | Method for learning Chinese by combining reality enhancing technique and plane reading material | |
| US20110164815A1 (en) | Method, device and system for content based image categorization field | |
| JP2006523067A (en) | How to display an output image on an object | |
| US8847974B2 (en) | Display processing apparatus | |
| JP5756322B2 (en) | Information processing program, information processing method, information processing apparatus, and information processing system | |
| US20110055696A1 (en) | Globe container | |
| CN107992188A (en) | Virtual reality exchange method, device and system | |
| CN106056992A (en) | Ar augmented reality teaching system | |
| CN103268714A (en) | Reading video pen, method for utilizing reading video pen to read book, and book for reading video pen | |
| CN110336973A (en) | Information processing method and its device, electronic equipment and medium | |
| CN107077739A (en) | Use the three dimensional indicia model construction and real-time tracking of monocular camera | |
| CN111951333A (en) | Automatic six-dimensional attitude data set generation method, system, terminal and storage medium | |
| WO2023272495A1 (en) | Badging method and apparatus, badge detection model update method and system, and storage medium | |
| CN201374082Y (en) | Augmented reality system based on image unique point extraction and random tree classification | |
| JP2013502634A (en) | Apparatus and method for identifying objects using morphological coding | |
| CN114170409A (en) | Method for automatically judging display label of three-dimensional model | |
| CN115482285A (en) | Image alignment method, device, equipment and storage medium | |
| CN108305210B (en) | Data processing method, device and storage medium | |
| Höll et al. | Monocular lsd-slam integration within ar system | |
| CN115104078A (en) | System and method for enhanced remote collaboration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130130 |