CN106200960A - The content display method of electronic interactive product and device - Google Patents
The content display method of electronic interactive product and device Download PDFInfo
- Publication number
- CN106200960A CN106200960A CN201610537894.7A CN201610537894A CN106200960A CN 106200960 A CN106200960 A CN 106200960A CN 201610537894 A CN201610537894 A CN 201610537894A CN 106200960 A CN106200960 A CN 106200960A
- Authority
- CN
- China
- Prior art keywords
- user terminal
- card
- virtual
- coordinate
- dimensional model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses content display method and the device of a kind of electronic interactive product, the method includes: after electronic interactive product starts, and user terminal opens camera head；User terminal is configured with this camera head；User terminal captures the destination object of electronic interactive product by camera head, and destination object includes object in kind and stereo scene, and stereo scene is the scene built in 3D solid book；User terminal obtains the virtual three-dimensional model of object in kind；User terminal superposition virtual three-dimensional model and stereo scene；User terminal shows the content after superposition on display interface.By present invention reduces development cost, reducing resource bag, enhance the sense of reality of display picture.
Description
Technical field
The present invention relates to augmented reality field, in particular to the content display side of a kind of electronic interactive product
Method and device.
Background technology
Traditional child's early education product, mainly has all kinds of infant book, early education flash, VCD, DVD class and point to read
Machine, Story machine etc., but the said goods is generally only the content pushing its product to child, and child is more passively to receive phase
Closing content, be difficult to be actively engaged in the study of this product, therefore, there is interactive low shortcoming in these products, causes children
Youngster's autonomic learning degree is relatively low.
In order to improve the interactive of early education product, occur in that augmented reality (Augmented Reality is called for short AR) early education
Product, it can change traditional early education teaching mould the information three-dimensional of plane, virtual Information application to real world
Formula, improves cognitive interest and the study initiative of child.
But AR early education product is because three-dimensional to be reached shows and interaction at present, it has to store substantial amounts of dependency number
According to, such as contextual data etc., meanwhile, these three-dimensionals show and interactive also needing to possesses stronger model of place structure knowledge,
Requirement to developer and system is the highest.Resource bag for this three-dimensional interaction early education product needed is relatively big and develops into
This higher problem, the most not yet proposes effective solution.
Summary of the invention
In view of this, the purpose of the embodiment of the present invention is to provide a kind of content display method for electronic interactive product
And device is to reduce development cost, to reduce resource bag, strengthen picture sense of reality simultaneously.
To achieve these goals, the technical scheme that the embodiment of the present invention uses is as follows:
First aspect, embodiments provides the content display method of a kind of electronic interactive product, including: work as electronics
After interactive product starts, user terminal opens camera head；Wherein, user terminal is configured with this camera head；User terminal leads to
Crossing camera head and capture the destination object of electronic interactive product, destination object includes object in kind and stereo scene, its neutral body
Scene is the scene built in 3D solid book；User terminal obtains the virtual three-dimensional model of object in kind；User terminal superposition is empty
Quasi-3-dimensional model and stereo scene；User terminal shows the content after superposition on display interface.
In conjunction with first aspect, embodiments provide the first possible embodiment of first aspect, wherein, when
Time above-mentioned object in kind is card object corresponding to electronic interactive product, user terminal by by card object with prestore
The mode that card designs is compared, determines the card designs that card object is corresponding；User terminal is according to the card designs determined
Transfer the virtual three-dimensional model of card object.
In conjunction with the first possible embodiment of first aspect, embodiments provide the second of first aspect
Possible embodiment, wherein, user terminal by the way of card object is compared with the card designs prestored,
Determine that the card designs that card object is corresponding includes: user terminal extracts the identification code of card object；User terminal contrast card
The identification code of the card designs prestored in the identification code of object and user terminal；Identification code and card figure when card object
When the identification code of case is consistent, determine that card designs is the card designs that card object is corresponding.
In conjunction with first aspect, embodiments provide the third possible embodiment of first aspect, wherein, use
Family terminal obtains the virtual three-dimensional model of object in kind and includes: when object in kind is the entity in user terminal local environment,
User terminal determines the above-mentioned entity the first coordinate under template coordinate system, and template coordinate system is with the center of entity as initial point；With
Family terminal obtains the second coordinate under camera coordinate system according to the first coordinate transform；User terminal obtains according to the second coordinate transform
The 3rd coordinate under screen coordinate system；User terminal is according to the virtual three-dimensional model of the 3rd Coordinate generation material object object.
In conjunction with first aspect, embodiments provide the 4th kind of possible embodiment of first aspect, wherein, use
Family terminal captures new destination object by camera head；The destination object that this is new is superimposed upon current display interface by user terminal
Display content on；User terminal, when the screenshotss receiving user operate, carries out screenshotss guarantor to the display content of display interface
Deposit.
Second aspect, the embodiment of the present invention also provides for the content display of a kind of electronic interactive product, including: start mould
Block, after starting when electronic interactive product, opens camera head；Wherein, camera head configures on the subscriber terminal；Capture mould
Block, for being captured the destination object of electronic interactive product by camera head, destination object includes object in kind and stereo scene,
Wherein, the scene that stereo scene is built in being 3D solid book；Acquisition module, for obtaining the virtual three-dimensional model of object in kind；
Laminating module, for superposition virtual three-dimensional model and stereo scene；Display module, for showing superposition after on display interface
Content.
In conjunction with second aspect, embodiments provide the first possible embodiment of second aspect, wherein, obtain
Delivery block includes: contrast unit, for when object in kind is card object corresponding to electronic interactive product, by by card pair
As the mode compared with the card designs prestored, determine the card designs that card object is corresponding；Transfer unit, be used for
The virtual three-dimensional model of card object is transferred according to the card designs determined.
In conjunction with the first possible embodiment of second aspect, embodiments provide the second of second aspect
Possible embodiment, wherein, contrast unit includes: identification code extracts subelement, for extracting the identification code of card object；Mark
Know code contrast subunit, the mark of the card designs prestored in the identification code contrasting card object and user terminal
Code；Determine subelement, for when the identification code of card object is consistent with the identification code of card designs, determine that this card designs is
The card designs that this card object is corresponding.
In conjunction with second aspect, embodiments provide the third possible embodiment of second aspect, wherein, obtain
Delivery block includes: the first coordinate determines unit, for when object in kind is the entity in user terminal local environment, determining this
The entity the first coordinate under template coordinate system, template coordinate system is with the center of entity as initial point；Second coordinate determines unit, uses
In the second coordinate obtained according to the first coordinate transform under camera coordinate system；3rd coordinate determines unit, for according to second
Coordinate transform obtains the 3rd coordinate under screen coordinate system；Signal generating unit, for the void according to the 3rd Coordinate generation material object object
Quasi-3-dimensional model.
In conjunction with second aspect, embodiments provide the 4th kind of possible embodiment of second aspect, also include:
New object handling module, for capturing new destination object by camera head；New object laminating module, for by new target
Object is superimposed upon in the display content of current display interface；Screen capture module, during for operating at the screenshotss receiving user, to aobvious
Show that the display content at interface carries out screenshotss preservation.
The content display method of electronic interactive product that the embodiment of the present invention provides and device, by capture object in kind and
Stereo scene, and obtain the virtual three-dimensional model of object in kind, be added in real time use by virtual three-dimensional model and stereo scene
The display interface of family terminal, this stereo scene is 3D solid book Scene, therefore by this virtual three-dimensional model and this 3D solid book
In scene combine, it is not necessary to simulation, storage scenarios model the most in advance, thus reduce the one-tenth of exploitation
Originally, reduce resource bag, simultaneously because this scene is the stereo scene in 3D solid book, enhance the sense of reality of display picture,
Bring the complete new experience of vision.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by embodiment required use attached
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, and it is right to be therefore not construed as
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to according to this
A little accompanying drawings obtain other relevant accompanying drawings.
Fig. 1 shows the structured flowchart of the user terminal that the embodiment of the present invention provides；
Fig. 2 shows the schematic flow sheet of the content display method of the electronic interactive product that the embodiment of the present invention 1 provides；
Fig. 3 shows the coordinate transform signal of the content display method of the electronic interactive product that the embodiment of the present invention 2 provides
Figure；
Fig. 4 shows the structured flowchart of the content display of the electronic interactive product that the embodiment of the present invention 3 provides.
Detailed description of the invention
The content display method of the electronic interactive product that the embodiment of the present invention is provided and device, user terminal is preferably and moves
Dynamic terminal unit, such as, can include smart mobile phone, panel computer, E-book reader, Wearable mobile terminal etc..User is eventually
End is provided with at least one application program (APP), provides the user service.
Fig. 1 shows the structured flowchart of a kind of user terminal that can be applicable in the embodiment of the present invention.As it is shown in figure 1, use
Family terminal includes that memorizer 102, storage control 104, one or more (only illustrating one in figure) processor 106, peripheral hardware connect
Mouth 108, photographing module 110, audio-frequency module 112, Touch Screen 114 etc..These assemblies pass through one or more communication bus/letter
Number mutual communication of line 116.Being appreciated that the structure shown in Fig. 1 is only signal, user terminal may also include than shown in Fig. 1 more more
Many or less assembly, or there is the configuration different from shown in Fig. 1.Each assembly shown in Fig. 1 can use hardware, soft
Part or a combination thereof realize.
The content display method of the electronic interactive product that the embodiment of the present invention proposes and device, be applicable to Android behaviour
Make the platforms such as system, iOS operating system, Windows Phone operating system.
Below in conjunction with accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Ground describes, it is clear that described embodiment is only a part of embodiment of the present invention rather than whole embodiments.Generally exist
Can arrange and design with various different configurations with the assembly of the embodiment of the present invention that illustrates described in accompanying drawing herein.Cause
This, be not intended to limit claimed invention to the detailed description of the embodiments of the invention provided in the accompanying drawings below
Scope, but it is merely representative of the selected embodiment of the present invention.Based on embodiments of the invention, those skilled in the art are not doing
The every other embodiment obtained on the premise of going out creative work, broadly falls into the scope of protection of the invention.
It should also be noted that similar label and letter represent similar terms, therefore, the most a certain Xiang Yi in following accompanying drawing
Individual accompanying drawing is defined, then need not it be defined further and explains in accompanying drawing subsequently.Meanwhile, the present invention's
In description, term " first ", " second " etc. are only used for distinguishing and describe, and it is not intended that indicate or hint relative importance.
Embodiment 1
Fig. 2 shows the flow process of the content display method of a kind of electronic interactive product that first embodiment of the invention provides
Figure.It should be noted that, the content display method of the electronic interactive product of the present invention not concrete with Fig. 2 and the following stated
Order is for limiting.Should be appreciated that in other embodiments, the order of the method wherein part steps can phase according to actual needs
Interchangeable, or part steps therein can also omit or delete.
Below the idiographic flow of the content display method to electronic interactive product shown in Fig. 2 is described in detail.The party
Method comprises the steps:
Step S110, user terminal opens camera head.
After the electronic interactive product on user terminal starts, user terminal opens camera head, this user interaction product
Being mounted application program (APP) on user terminal, this APP can download or be pre-installed in this user from the Internet
In terminal.User terminal can be the mobile device such as smart mobile phone or panel computer, and the present embodiment is said as a example by smart mobile phone
Bright, this smart mobile phone is configured with camera head, as a example by photographic head, it is possible to achieve the shooting to entity.
Step S120, user terminal captures the destination object of electronic interactive product by camera head.
After user terminal opens camera head, this camera head is directed at destination object, so that this destination object to be taken
Scape, now this destination object shows on the display interface of user terminal.Destination object includes object in kind and stereo scene, should
Stereo scene is the scene built in 3D solid book.At 3D solid book after opening, various stereo scene can be represented.Above-mentioned solid
Scene shows in real time on the display interface of user terminal.Owing to this stereo scene is that 3D solid book is built, therefore need not
Writing simulation, storage scenarios model in electronic interactive product A PP in advance, the convenient user of volume reducing APP downloads
Use, reduce development cost simultaneously.
Step S130, user terminal obtains the virtual three-dimensional model of object in kind.
After camera head captures object in kind, obtain the virtual three-dimensional model of this material object object.When this material object is to liking
During card object corresponding to electronic interactive product, user terminal is right by card object and the card designs prestored being carried out
The mode of ratio, determines the card designs that card object is corresponding.Then according to the card designs determined transfers the virtual of card object
Threedimensional model.Above-mentioned card object is the card completed in advance, and card can have been drawn various pattern, the most various dynamic
Thing, the cartoon pattern of plant, for child's early teaching and learning；Above-mentioned card designs is stored in advance in electronic interactive product A PP, with
Pattern one_to_one corresponding on card, is also previously stored with and this card designs virtual three-dimensional model one to one in APP.When
When user terminal contrast card object is to mate with the result of card designs, transfer the virtual three-dimensional mould that this card designs is corresponding
Type, and shown on the display interface of user terminal.
User terminal contrast card object can be in the following ways with card designs:
First user terminal extracts the identification code of card object；Secondly contrast in identification code and the user terminal of card object
The identification code of the card designs prestored；When the identification code of card object is consistent with the identification code of card designs, determine card
Sheet pattern is the card designs that card object is corresponding.
Above-mentioned identification code can also be unique characteristic point of pattern in card object.User terminal passes through series of algorithms
Pattern is extracted characteristic point record by (such as: SURF, ORB, FERN etc.).When camera head scanning scene around, can extract week
The characteristic point of enveloping field scape the pattern characteristics point with record are compared.If the characteristic point scanned and the pattern characteristics of record
The number of matches of point exceedes threshold value, then confirm that camera head scans this pattern.
After user terminal gets the virtual three-dimensional model of object in kind, this camera head can move, it is not necessary to protects
Hold alignment object in kind.
Step S140, user terminal superposition virtual three-dimensional model and stereo scene.
User terminal has captured scene that 3D solid book builds as stereo scene in the step s 120, in step S130
Middle user terminal has obtained the virtual three-dimensional model of object in kind, is now folded with stereo scene by above-mentioned virtual three-dimensional model
Add.
Step S150, user terminal shows the content after superposition on display interface.
The virtual three-dimensional model of superposition in step S140 and stereo scene are shown on display interface.Actually used
In, after getting the virtual three-dimensional model of object in kind, camera head need not keep alignment object in kind, now display interface
On shown this virtual three-dimensional model, mobile subscriber terminal or adjust the position of virtual three-dimensional model on display interface, from
And adjust the relative position of virtual three-dimensional model and stereo scene, it is achieved preferably Overlapping display effect.
In this electronic interactive product A PP of user terminal, also there is the function interactive with virtual three-dimensional model, such as point
Hit, move, rotate above-mentioned virtual three-dimensional model；Each threedimensional model can also be configured corresponding audio file, including ambient sound
Pleasure, action audio etc., enhance product and the interactive of child and the interest of use, excite cognitive interest and the study of child
Initiative, allows study become more funny and relaxed.
The method that the present embodiment provides is after the above step, it is also possible to include that screenshotss preserve step.
After completing the above-mentioned virtual three-dimensional model Overlapping display with stereo scene, it is also possible to increasing new target pair
As, the newest entity object.User terminal captures new destination object by camera head；User terminal is by this new target
Object is superimposed upon in the display content of current display interface；User terminal is when the screenshotss receiving user operate, to display circle
The display content in face carries out screenshotss preservation.
Above-mentioned entity object can be the child using this electronic interactive product, this child is clapped by camera head
Take the photograph, as stated above with virtual three-dimensional model and stereo scene Overlapping display at display interface, this interface carried out screenshotss preservation,
Enhance the sense of participation during use and interactive.
Method in above-described embodiment 1, by virtual three-dimensional model electronic interactive product A PP obtained and reality
The stereo scene that 3D solid book is built combines, and virtual object and real environment are added to same display circle in real time
Face, it is not necessary to simulation, storage scenarios model in advance in APP, thus reduces the cost of exploitation, reduces resource bag, simultaneously
Owing to this scene is the stereo scene in 3D solid book, enhance the sense of reality of display picture, bring the complete new experience of vision.
Embodiment 2
In the method for embodiment 1, user terminal obtains the virtual three-dimensional model of object in kind and can also use with lower section
Formula:
When object in kind is the entity in user terminal local environment, user terminal determines that above-mentioned entity is at template coordinate
The first coordinate under Xi, template coordinate system is with the center of entity as initial point；User terminal is imaged according to the first coordinate transform
The second coordinate under machine coordinate system；User terminal obtains the 3rd coordinate under screen coordinate system according to the second coordinate transform；User
Terminal is according to the virtual three-dimensional model of the 3rd Coordinate generation material object object.
As it is shown on figure 3, on be first put in reality by entity position, be equivalent to determine in a reality scene
Plane, use the plane of coordinate axes Xm Yu Ym restriction in shown in plane on the basis of this plane, such as Fig. 3, wherein A represents this
Entity shape on this plane.By photographic head, entity is identified and attitude assessment (Pose Estimation), and really
Its position fixed, is then referred to as Marker Coordinates i.e. template coordinate system by the coordinate system that its center is initial point, in Fig. 3
The coordinate system of shown leftmost side Xm, Ym, Zm composition, it is thus achieved that this entity coordinate in template coordinate system.Become from template coordinate system
Changing to real screen coordinate system needs first rotary flat to move on to camera coordinate system (Camera Coordinates), obtains shooting
Coordinate in machine coordinate system, the coordinate system of middle as shown in Figure 3 Xc, Yc, Zc composition.Map from camera coordinate system the most again
To screen coordinate system, the coordinate system of right side Xd, Yd composition, completes the drafting of virtual three-dimensional model as shown in Figure 3.
In the mode of the virtual three-dimensional model of above-mentioned acquisition material object object, use the three-dimensional of generation real-time to entity
Model, therefore need not preprogramming and develops the virtual three-dimensional model of various card designs, it is not required that deposit in advance in APP
Storage, thus save development cost and reduce the volume of APP resource bag.
Embodiment 3
The method provided corresponding to above-described embodiment, the embodiment of the present invention additionally provides the content of a kind of electronic interactive product
Display device, sees Fig. 4, and this device includes: start module 11, handling module 12, acquisition module 13, laminating module 14, display
Module 15.
Start module 11, after starting when electronic interactive product, open camera head.
After the electronic interactive product on user terminal starts, user terminal opens camera head, this user interaction product
Being mounted application program (APP) on user terminal, this APP can download or be pre-installed in this user from the Internet
In terminal.User terminal can be the mobile device such as smart mobile phone or panel computer, and the present embodiment is said as a example by smart mobile phone
Bright, this smart mobile phone is configured with camera head, as a example by photographic head, it is possible to achieve the shooting to entity.
Handling module 12, for capturing the destination object of electronic interactive product by camera head.
After user terminal opens camera head, this camera head is directed at destination object, so that this destination object to be taken
Scape, now this destination object shows on the display interface of user terminal.Destination object includes object in kind and stereo scene, should
Stereo scene is the scene built in 3D solid book.At 3D solid book after opening, various stereo scene can be represented.Above-mentioned solid
Scene shows in real time on the display interface of user terminal.Owing to this stereo scene is that 3D solid book is built, therefore need not
Writing simulation, storage scenarios model in electronic interactive product A PP in advance, the convenient user of volume reducing APP downloads
Use, reduce development cost simultaneously.
Acquisition module 13, for obtaining the virtual three-dimensional model of object in kind.
After camera head captures object in kind, obtain the virtual three-dimensional model of this material object object.
Acquisition module 13 includes: contrast unit, for when object in kind is card object corresponding to electronic interactive product,
By the way of being contrasted with the card designs prestored by card object, determine the card designs that card object is corresponding；
Transfer unit, for transferring the virtual three-dimensional model of card object according to the card designs determined.
Above-mentioned card object is the card completed in advance, and card can have been drawn various pattern, the most various dynamic
Thing, the cartoon pattern of plant, for child's early teaching and learning；Above-mentioned card designs is stored in advance in electronic interactive product A PP, with
Pattern one_to_one corresponding on card, is also previously stored with and this card designs virtual three-dimensional model one to one in APP.When
When user terminal contrast card object is to mate with the result of card designs, transfer the virtual three-dimensional mould that this card designs is corresponding
Type, and shown on the display interface of user terminal.
Contrast unit contrast card object can be in the following ways with card designs:
First the identification code of card object is extracted；Secondly the identification code of contrast card object prestores in user terminal
The identification code of card designs；When the identification code of card object is consistent with the identification code of card designs, determine that card designs is
The card designs that card object is corresponding.
Above-mentioned identification code can also be unique characteristic point of pattern in card object.User terminal passes through series of algorithms
Pattern is extracted characteristic point record by (such as: SURF, ORB, FERN etc.).When camera head scanning scene around, can extract week
The characteristic point of enveloping field scape the pattern characteristics point with record are compared.If the characteristic point scanned and the pattern characteristics of record
The number of matches of point exceedes threshold value, then confirm that camera head scans this pattern.
After user terminal gets the virtual three-dimensional model of object in kind, this camera head can move, it is not necessary to protects
Hold alignment object in kind.
Laminating module 14, for superposition virtual three-dimensional model and stereo scene.
Capture scene that 3D solid book builds as stereo scene in handling module 12, obtained at acquisition module 13
The virtual three-dimensional model of object in kind, now above-mentioned virtual three-dimensional model is superposed by laminating module 14 with stereo scene.
Display module 15, the content after showing superposition on display interface.
The virtual three-dimensional model of laminating module 14 superposition and stereo scene are shown on display interface.Actually used
In, after getting the virtual three-dimensional model of object in kind, camera head need not keep alignment object in kind, now display interface
On shown this virtual three-dimensional model, mobile subscriber terminal or adjust the position of virtual three-dimensional model on display interface, from
And adjust the relative position of virtual three-dimensional model and stereo scene, it is achieved preferably Overlapping display effect.
In this electronic interactive product A PP of user terminal, also there is the function interactive with virtual three-dimensional model, such as point
Hit, move, rotate above-mentioned virtual three-dimensional model；Each threedimensional model can also be configured corresponding audio file, including ambient sound
Pleasure, action audio etc., enhance product and the interactive of child and the interest of use, excite cognitive interest and the study of child
Initiative, allows study become more funny and relaxed.
The device that the present embodiment provides can also include: new object handling module, new for being captured by camera head
Destination object；New object laminating module, for being superimposed upon the display content of current display interface by new destination object；Screenshotss
Module, during for operating at the screenshotss receiving user, carries out screenshotss preservation to the display content of display interface.
After completing the above-mentioned virtual three-dimensional model Overlapping display with stereo scene, it is also possible to increasing new target pair
As, the newest entity object.New object handling module captures new destination object by camera head；New object laminating module
The destination object that this is new is superimposed upon in the display content of current display interface；When the screenshotss receiving user operate, screenshotss
Module carries out screenshotss preservation to the display content of display interface.
Above-mentioned entity object can be the child using this electronic interactive product, this child is clapped by camera head
Take the photograph, as stated above with virtual three-dimensional model and stereo scene Overlapping display at display interface, this interface carried out screenshotss preservation,
Enhance the sense of participation during use and interactive.
Device in above-described embodiment 3, by just this virtual three-dimensional model scene side of combination in this 3D solid book
Formula reduces the cost of exploitation, reduces resource bag, simultaneously because this scene is the stereo scene in 3D solid book, enhances aobvious
Show the sense of reality of picture.
In said apparatus, acquisition module can be formed by with lower unit, specifically includes: the first coordinate determines unit, uses
In when object in kind is the entity in user terminal local environment, determine this entity the first coordinate under template coordinate system,
Template coordinate system is with the center of entity as initial point；Second coordinate determines unit, for obtaining video camera according to the first coordinate transform
The second coordinate under coordinate system；3rd coordinate determines unit, for obtaining the under screen coordinate system according to the second coordinate transform
Three coordinates；Signal generating unit, for the virtual three-dimensional model according to the 3rd Coordinate generation material object object.
First, on the position being put in reality by entity, be equivalent to determine the plane in a reality scene, so
By photographic head, entity is identified and attitude assessment (Pose Estimation) afterwards, and determines its position, then will wherein
The heart is that the coordinate system of initial point is referred to as Marker Coordinates i.e. template coordinate system, it is thus achieved that this entity is in template coordinate system
Coordinate.First rotary flat is needed to move on to camera coordinate system (Camera from template coordinate system transformation to real screen coordinate system
Coordinates), obtain the coordinate in camera coordinate system, be mapped to screen coordinate system from camera coordinate system the most again, complete
Become the drafting of virtual three-dimensional model.
During the virtual three-dimensional model of above-mentioned acquisition material object object, use the three-dimensional of generation real-time to entity
Model, therefore need not preprogramming and develops the virtual three-dimensional model of various card designs, it is not required that deposit in advance in APP
Storage, thus save development cost and reduce the volume of APP resource bag.
In sum, the content display method of the electronic interactive product that the embodiment of the present invention provides and device, by real time
Ground superposition virtual three-dimensional model and the 3D solid book Scene in reality, reduce the cost of exploitation, reduce resource bag, strengthen
The sense of reality of display picture.
Flow chart and structured flowchart in accompanying drawing show the method for multiple embodiments, device and calculating according to the present invention
Architectural framework in the cards, function and the operation of machine program product.In this, each square frame in flow chart or block diagram can
To represent a module, program segment or a part for code, a part for described module, program segment or code comprises one or many
The executable instruction of the individual logic function for realizing regulation.It should also be noted that some as replace realization in, in square frame
The function marked can also occur to be different from the order marked in accompanying drawing.Such as, two continuous print square frames actually may be used
To perform substantially in parallel, they can also perform sometimes in the opposite order, and this is depending on involved function.It is also noted that
, the combination of the square frame in each square frame in block diagram and/or flow chart and block diagram and/or flow chart, can be with performing
The function of regulation or the special hardware based system of action realize, or can be with specialized hardware and computer instruction
Combination realizes.
In several embodiments provided herein, it should be understood that disclosed method and apparatus, can be passed through other
Mode realize.Device embodiment described above is only schematically, such as, the division of described unit, the most only one
Kind of logic function divides, and actual can have other dividing mode when realizing, the most such as, multiple unit or assembly can in conjunction with or
Person is desirably integrated into another system, or some features can be ignored, or does not performs.Another point, shown or discussed is mutual
Between coupling or direct-coupling or communication connection can be the INDIRECT COUPLING by some communication interfaces, device or unit or logical
Letter connects, and can be electrical, machinery or other form.
It addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it is also possible to
It is that unit is individually physically present, it is also possible to two or more unit are integrated in a unit.
If described function is using the form realization of SFU software functional unit and as independent production marketing or use, permissible
It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is the most in other words
The part contributing prior art or the part of this technical scheme can embody with the form of software product, this meter
Calculation machine software product is stored in a storage medium, including some instructions with so that a computer equipment (can be individual
People's computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention.
And aforesaid storage medium includes: USB flash disk, portable hard drive, read only memory (ROM, Read-Only Memory), random access memory are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic disc or CD.
The above, the only detailed description of the invention of the present invention, but protection scope of the present invention is not limited thereto, and any
Those familiar with the art, in the technical scope that the invention discloses, can readily occur in change or replace, should contain
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should described be as the criterion with scope of the claims.
Claims (10)
1. the content display method of an electronic interactive product, it is characterised in that including:
After electronic interactive product starts, user terminal opens camera head；Wherein, described user terminal is configured with described shooting
Device；
Described user terminal captures the destination object of described electronic interactive product, described destination object bag by described camera head
Including object in kind and stereo scene, wherein, described stereo scene is the scene built in 3D solid book；
Described user terminal obtains the virtual three-dimensional model of described object in kind；
Virtual three-dimensional model described in described user terminal superposition and described stereo scene；
Described user terminal shows the content after superposition on display interface.
Method the most according to claim 1, it is characterised in that described user terminal obtains virtual the three of described object in kind
Dimension module includes:
When described object in kind is card object corresponding to described electronic interactive product, described user terminal is by by described card
The mode that sheet object is compared with the card designs prestored, determines the card designs that described card object is corresponding；
Described user terminal transfers the virtual three-dimensional model of described card object according to the described card designs determined.
Method the most according to claim 2, it is characterised in that described user terminal by by described card object with in advance
The mode that the card designs of storage is compared, determines that the card designs that described card object is corresponding includes:
Described user terminal extracts the identification code of described card object；
The card designs prestored in the identification code of the described user terminal described card object of contrast and described user terminal
Identification code；
When the identification code of described card object is consistent with the identification code of described card designs, determine that described card designs is described
The card designs that card object is corresponding.
Method the most according to claim 1, it is characterised in that described user terminal obtains virtual the three of described object in kind
Dimension module includes:
When described object in kind is the entity in described user terminal local environment, described user terminal determines that described entity exists
The first coordinate under template coordinate system, described template coordinate system is with the center of described entity as initial point；
Described user terminal obtains the second coordinate under camera coordinate system according to described first coordinate transform；
Described user terminal obtains the 3rd coordinate under screen coordinate system according to described second coordinate transform；
Described user terminal is according to the virtual three-dimensional model of object in kind described in described 3rd Coordinate generation.
Method the most according to claim 1, it is characterised in that described method also includes:
Described user terminal captures new destination object by described camera head；
Described new destination object is superimposed upon in the display content of presently described display interface by described user terminal；
Described user terminal, when the screenshotss receiving user operate, carries out screenshotss guarantor to the display content of described display interface
Deposit.
6. the content display of an electronic interactive product, it is characterised in that including:
Start module, after starting when electronic interactive product, open camera head；Wherein, described camera head is arranged in use
In the terminal of family；
Handling module, for capturing the destination object of described electronic interactive product, described destination object by described camera head
Including object in kind and stereo scene, wherein, described stereo scene is the scene built in 3D solid book；
Acquisition module, for obtaining the virtual three-dimensional model of described object in kind；
Laminating module, for virtual three-dimensional model described in superposition and described stereo scene；
Display module, the content after showing superposition on display interface.
Device the most according to claim 6, it is characterised in that described acquisition module includes:
Contrast unit, for when described object in kind is card object corresponding to described electronic interactive product, by by described
The mode that card object is compared with the card designs prestored, determines the card designs that described card object is corresponding；
Transfer unit, for transferring the virtual three-dimensional model of described card object according to the described card designs determined.
Device the most according to claim 7, it is characterised in that described contrast unit includes:
Identification code extracts subelement, for extracting the identification code of described card object；
Identification code contrast subunit, the card prestored in the identification code contrasting described card object and described user terminal
The identification code of sheet pattern；
Determine subelement, for when the identification code of described card object is consistent with the identification code of described card designs, determine institute
Stating card designs is the card designs that described card object is corresponding.
Device the most according to claim 6, it is characterised in that described acquisition module includes:
First coordinate determines unit, for when described object in kind is the entity in described user terminal local environment, determining
The described entity the first coordinate under template coordinate system, described template coordinate system is with the center of described entity as initial point；
Second coordinate determines unit, for obtaining the second coordinate under camera coordinate system according to described first coordinate transform；
3rd coordinate determines unit, for obtaining the 3rd coordinate under screen coordinate system according to described second coordinate transform；
Signal generating unit, for the virtual three-dimensional model according to object in kind described in described 3rd Coordinate generation.
Device the most according to claim 6, it is characterised in that described device also includes:
New object handling module, for capturing new destination object by described camera head；
New object laminating module, for being superimposed upon the display content of presently described display interface by described new destination object；
Screen capture module, during for operating at the screenshotss receiving user, carries out screenshotss guarantor to the display content of described display interface
Deposit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610537894.7A CN106200960A (en) | 2016-07-07 | 2016-07-07 | The content display method of electronic interactive product and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610537894.7A CN106200960A (en) | 2016-07-07 | 2016-07-07 | The content display method of electronic interactive product and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106200960A true CN106200960A (en) | 2016-12-07 |
Family
ID=57473798
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610537894.7A Pending CN106200960A (en) | 2016-07-07 | 2016-07-07 | The content display method of electronic interactive product and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106200960A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106934693A (en) * | 2017-03-06 | 2017-07-07 | 浙江传媒学院 | The ceramic tile selection method and system shown in VR scenes based on AR product models |
| CN107038759A (en) * | 2017-03-13 | 2017-08-11 | 深圳市创想天空科技股份有限公司 | Learning detection method and device based on AR |
| CN107085592A (en) * | 2017-03-02 | 2017-08-22 | 深圳市创想天空科技股份有限公司 | Early education method and device based on cognitive card |
| CN107370736A (en) * | 2017-07-20 | 2017-11-21 | 上海观谷科技有限公司 | Business interaction method and device |
| CN107861629A (en) * | 2017-12-20 | 2018-03-30 | 杭州埃欧哲建设工程咨询有限公司 | A kind of practice teaching method based on VR |
| CN108022306A (en) * | 2017-12-30 | 2018-05-11 | 华自科技股份有限公司 | Scene recognition method, device, storage medium and equipment based on augmented reality |
| CN108509086A (en) * | 2018-02-11 | 2018-09-07 | 合肥市科技馆 | A kind of buffet interaction systems based on multimedia interaction |
| CN108733931A (en) * | 2018-05-24 | 2018-11-02 | 奥克斯空调股份有限公司 | Circuit design and processing technology output method and device |
| CN109215402A (en) * | 2018-10-18 | 2019-01-15 | 广州嘉影软件有限公司 | Chemical experiment method and system on book based on AR |
| CN109471533A (en) * | 2018-11-09 | 2019-03-15 | 深圳职业技术学院 | A kind of VR/AR teaches indoor student's end system and its application method |
| CN109636918A (en) * | 2018-11-20 | 2019-04-16 | 上海玄彩美科网络科技有限公司 | A kind of method and apparatus that AR is shown |
| CN111679768A (en) * | 2020-04-30 | 2020-09-18 | 上海趣致网络科技股份有限公司 | Virtual interaction method and device for realizing 3D (three-dimensional) scanning of mobile phone terminal |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102903142A (en) * | 2012-10-18 | 2013-01-30 | 天津戛唛影视动漫文化传播有限公司 | Method for realizing three-dimensional augmented reality |
| CN104134229A (en) * | 2014-08-08 | 2014-11-05 | 李成 | Real-time interaction reality augmenting system and method |
| CN104837003A (en) * | 2015-04-03 | 2015-08-12 | 深圳市亿思达科技集团有限公司 | Holographic three-dimensional display mobile terminal and method used for vision correction |
| CN104899920A (en) * | 2015-05-25 | 2015-09-09 | 联想(北京)有限公司 | Image processing method, image processing device and electronic device |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
-
2016
- 2016-07-07 CN CN201610537894.7A patent/CN106200960A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102903142A (en) * | 2012-10-18 | 2013-01-30 | 天津戛唛影视动漫文化传播有限公司 | Method for realizing three-dimensional augmented reality |
| CN104134229A (en) * | 2014-08-08 | 2014-11-05 | 李成 | Real-time interaction reality augmenting system and method |
| CN104837003A (en) * | 2015-04-03 | 2015-08-12 | 深圳市亿思达科技集团有限公司 | Holographic three-dimensional display mobile terminal and method used for vision correction |
| CN104899920A (en) * | 2015-05-25 | 2015-09-09 | 联想(北京)有限公司 | Image processing method, image processing device and electronic device |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107085592A (en) * | 2017-03-02 | 2017-08-22 | 深圳市创想天空科技股份有限公司 | Early education method and device based on cognitive card |
| CN106934693A (en) * | 2017-03-06 | 2017-07-07 | 浙江传媒学院 | The ceramic tile selection method and system shown in VR scenes based on AR product models |
| CN107038759A (en) * | 2017-03-13 | 2017-08-11 | 深圳市创想天空科技股份有限公司 | Learning detection method and device based on AR |
| CN107370736A (en) * | 2017-07-20 | 2017-11-21 | 上海观谷科技有限公司 | Business interaction method and device |
| CN107861629A (en) * | 2017-12-20 | 2018-03-30 | 杭州埃欧哲建设工程咨询有限公司 | A kind of practice teaching method based on VR |
| CN108022306A (en) * | 2017-12-30 | 2018-05-11 | 华自科技股份有限公司 | Scene recognition method, device, storage medium and equipment based on augmented reality |
| CN108509086A (en) * | 2018-02-11 | 2018-09-07 | 合肥市科技馆 | A kind of buffet interaction systems based on multimedia interaction |
| CN108509086B (en) * | 2018-02-11 | 2021-06-08 | 合肥市科技馆 | Buffet interactive system based on multimedia interaction |
| CN108733931A (en) * | 2018-05-24 | 2018-11-02 | 奥克斯空调股份有限公司 | Circuit design and processing technology output method and device |
| CN109215402A (en) * | 2018-10-18 | 2019-01-15 | 广州嘉影软件有限公司 | Chemical experiment method and system on book based on AR |
| CN109471533A (en) * | 2018-11-09 | 2019-03-15 | 深圳职业技术学院 | A kind of VR/AR teaches indoor student's end system and its application method |
| CN109471533B (en) * | 2018-11-09 | 2021-09-07 | 深圳职业技术学院 | Student end system in VR/AR classroom and use method thereof |
| CN109636918A (en) * | 2018-11-20 | 2019-04-16 | 上海玄彩美科网络科技有限公司 | A kind of method and apparatus that AR is shown |
| CN111679768A (en) * | 2020-04-30 | 2020-09-18 | 上海趣致网络科技股份有限公司 | Virtual interaction method and device for realizing 3D (three-dimensional) scanning of mobile phone terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106200960A (en) | The content display method of electronic interactive product and device | |
| CN110363133B (en) | Method, device, equipment and storage medium for sight line detection and video processing | |
| CN110716645A (en) | Augmented reality data presentation method and device, electronic equipment and storage medium | |
| CN107622524A (en) | Display methods and display device for mobile terminal | |
| CN106023692A (en) | AR interest learning system and method based on entertainment interaction | |
| CN107018336A (en) | The method and apparatus of image procossing and the method and apparatus of Video processing | |
| CN112933606B (en) | Game scene conversion method and device, storage medium and computer equipment | |
| CN112950751B (en) | Gesture action display method and device, storage medium and system | |
| KR20220093342A (en) | Method, device and related products for implementing split mirror effect | |
| CN107798932A (en) | A kind of early education training system based on AR technologies | |
| CN111311756A (en) | Augmented reality AR display method and related device | |
| CN106713896A (en) | Static image multimedia presentation method, device and system | |
| CN105874783A (en) | Techniques for frame repetition control in frame rate up-conversion | |
| CN109035415B (en) | Virtual model processing method, device, equipment and computer readable storage medium | |
| CN206741428U (en) | Support with reflective mirror | |
| CN106571072A (en) | Method for realizing children education card based on AR | |
| CN108416832A (en) | Display methods, device and the storage medium of media information | |
| CN106648098A (en) | User-defined scene AR projection method and system | |
| CN108961375A (en) | A kind of method and device generating 3-D image according to two dimensional image | |
| CN113160231A (en) | Sample generation method, sample generation device and electronic equipment | |
| CN114153548A (en) | Display method and device, computer equipment and storage medium | |
| CN112308977A (en) | Video processing method, video processing apparatus, and storage medium | |
| CN111840999A (en) | Game education method based on three-dimensional object graph recognition | |
| CN108182249A (en) | Text query method, apparatus and computer readable storage medium | |
| CN104900094A (en) | Method and device for realizing writing simulation in terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161207 |