[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

KR20220169754A - Mixed Reality Sensory Learning Device using a three-dimensional puzzle - Google Patents

Mixed Reality Sensory Learning Device using a three-dimensional puzzle Download PDF

Info

Publication number
KR20220169754A
KR20220169754A KR1020210080235A KR20210080235A KR20220169754A KR 20220169754 A KR20220169754 A KR 20220169754A KR 1020210080235 A KR1020210080235 A KR 1020210080235A KR 20210080235 A KR20210080235 A KR 20210080235A KR 20220169754 A KR20220169754 A KR 20220169754A
Authority
KR
South Korea
Prior art keywords
puzzle
dimensional
dimensional puzzle
mixed reality
reality
Prior art date
Application number
KR1020210080235A
Other languages
Korean (ko)
Inventor
최은지
서상철
Original Assignee
최은지
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 최은지 filed Critical 최은지
Priority to KR1020210080235A priority Critical patent/KR20220169754A/en
Publication of KR20220169754A publication Critical patent/KR20220169754A/en

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/02Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F9/00Games not otherwise provided for
    • A63F9/06Patience; Other games for self-amusement
    • A63F9/12Three-dimensional jig-saw puzzles
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • G09B19/10Modelling
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F9/00Games not otherwise provided for
    • A63F9/06Patience; Other games for self-amusement
    • A63F9/12Three-dimensional jig-saw puzzles
    • A63F2009/1296Manufacturing of three-dimensional puzzle elements

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Tourism & Hospitality (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Computer Hardware Design (AREA)
  • Economics (AREA)
  • Computer Graphics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present invention relates to a mixed reality experience-type learning device using a three-dimensional puzzle, in which a user assembles a three-dimensional object, provided as a three-dimensional puzzle product, with a mixed reality viewer, installs an application from a QR code marked on the product with a smartphone, and is able to learn three-dimensional content by seeing a three-dimensional object after mounting the assembled mixed reality viewer. The present invention provides the mixed reality experience-type learning device using the three-dimensional puzzle, comprising: a puzzle set composed of a plurality of blocks made in various shapes that can be assembled with the three-dimensional puzzle; and a VR viewer set composed of a head mount that can be assembled with the three-dimensional puzzle and a VR lens coupled to the head mount, wherein a QR code attached to the puzzle set is recognized with a portable terminal, an application for a predetermined augmentation or virtuality is downloaded and activated, and the portable terminal is mounted to the head mount constituting the VR viewer set so that a virtual reality or an augmented reality corresponding to the puzzle set can be experienced. The mixed reality experience-type learning device using the three-dimensional puzzle according to the present invention, if executed, can improve concentration by enabling a user to assemble a three-dimensional puzzle and experience, in real-time, a virtual reality or an augmented reality in relation to the three-dimensional puzzle and can be expected to be greatly helpful in increasing creativity since the user can learn various information in relation to a corresponding three-dimensional puzzle.

Description

입체퍼즐을 이용한 혼합현실 체감형 학습 교구{Mixed Reality Sensory Learning Device using a three-dimensional puzzle}Mixed Reality Sensory Learning Device using a three-dimensional puzzle}

본 발명은 입체퍼즐을 이용한 혼합현실 체감형 학습 교구에 관한 것으로, 사용자가 입체퍼즐 상품으로 제공되는 입체물과 혼합현실 뷰어를 조립하고, 스마트폰으로 상품에 표기된 QR코드로부터 앱을 설치한다음, 조립된 혼합현실 뷰어를 장착 후 입체물을 보는 것으로 입체적 콘텐츠 학습이 가능하도록 한 입체퍼즐을 이용한 혼합현실 체감형 학습 교구에 관한 것이다. The present invention relates to a mixed reality tangible learning tool using a three-dimensional puzzle, in which a user assembles a three-dimensional object and a mixed reality viewer provided as a three-dimensional puzzle product, installs an app from a QR code marked on the product with a smartphone, and then assembles It relates to a mixed reality tangible learning tool using a three-dimensional puzzle that enables three-dimensional content learning by viewing three-dimensional objects after mounting a mixed reality viewer.

본 발명에서 제공하는 체감형 학습 교구의 혼합현실 뷰어를 통해 입체물에 대한 증강현실 기반의 부가정보를 볼 수 있으며, 가상현실 기반의 몰입공간을 통해 입체물 관련 또다른 시공간 정보를 다양하게 체험할 수 있다. Through the mixed reality viewer of the tangible learning tool provided by the present invention, augmented reality-based additional information on three-dimensional objects can be viewed, and other spatial and temporal information related to three-dimensional objects can be experienced in various ways through virtual reality-based immersion space. .

3D 입체퍼즐은 여러 가지 형태의 수많은 조각들을 맞추어 하나의 완성품으로 만드는 놀이용품의 대표적인 콘텐츠로 로봇, 공룡, 곤충, 동물 등 다양한 형태의 퍼즐이 있으며, 각 나라의 랜드마크(탑, 빌딩, 사원, 유적지 등)를 활용한 콘텐츠도 지속적으로 증가되고 있는 추세이다. 3D 3D puzzles are representative contents of play products that are made by combining numerous pieces of various shapes into one finished product. Historical sites, etc.) is also on the rise.

그런데, 시중에 판매되고 있는 입체퍼즐은 제품 완성 이후 흥미 감소 및 방치되는 등 일회성 콘텐츠로 전략하는 단점이 많으며, 입체퍼즐 대상물에 대한 표지의 기본 정보 외에 제공하는 정보가 제한적이다. However, three-dimensional puzzles sold on the market have many disadvantages in that they are strategyd as one-time contents, such as loss of interest and neglect after completion of the product, and information provided other than basic information on the cover of the object of the three-dimensional puzzle is limited.

따라서, 사용자가 하나의 3D 입체퍼즐 상품 구매를 통해 퍼즐 제작과 AR·VR 등의 혼합현실 정보를 제공할 수 있는 학습 교구를 개발할 필요성이 있다. Therefore, there is a need to develop a learning tool that can provide mixed reality information such as puzzle production and AR/VR through the purchase of a single 3D puzzle product.

키프리스를 통하여 기존 특허를 검색하면, ‘증강 현실 기반의 3차원 조립 퍼즐을 제공하는 방법 및 단말’, ‘증강현실 기반의 체감형 퍼즐 학습 교구’, ‘퍼즐 조립 기반 증강현실 서비스 제공 시스템’ 등의 특허가 ‘입체퍼즐’ 용어로 검색되기는 하지만, 대부분 증강현실 기술을 사용하여 퍼즐의 완성 여부를 판단거나, 완성시 관련된 콘텐츠를 증강하는 방식에 불과하였다. If you search for existing patents through Keyprise, you can find 'a method and terminal for providing a 3D assembly puzzle based on augmented reality', 'a tangible puzzle learning tool based on augmented reality', 'a system for providing augmented reality service based on puzzle assembly', etc. 's patents are searched with the term '3D puzzle', but most of them use augmented reality technology to determine whether or not the puzzle is completed, or to augment related content upon completion.

즉, 종래 특허에는 완성된 입체물에 대한 다양한 정보를 연동시키기 위해 증강현실과 가상현실 콘텐츠를 모두 포함하는 서비스 사례가 없다는 것을 알 수 있다. That is, it can be seen that there is no case of a service including both augmented reality and virtual reality contents in order to link various information about a completed three-dimensional object in a conventional patent.

특히, 가상현실 콘테츠를 체험하기 위해서는 몰입환경이 필요한데, 이를 위해 입체퍼즐과 같이 조립할 수 있는 VR뷰어를 제공하는 서비스 형태가 개시되어 있지 않다는 것을 알 수 있었다.In particular, in order to experience virtual reality contents, an immersion environment is required, and for this purpose, it was found that a service form providing a VR viewer that can be assembled like a three-dimensional puzzle has not been disclosed.

1. 특허출원 제10-2016-0087809호, 발명의 명칭 : 증강/가상현실 융합 퍼즐 지구본1. Patent Application No. 10-2016-0087809, Title of Invention: Augmented/Virtual Reality Fusion Puzzle Globe 2. 특허출원 제10-2017-0083070호, 발명의 명칭 ; 퍼즐 완성형 증강현실 시스템 및 그 어플리케이션, 오브젝트 및 전자기기2. Patent Application No. 10-2017-0083070, Title of Invention; Puzzle-complete augmented reality system and its applications, objects and electronic devices 3. 특허출원 제10-2019-0077849호, 발명이 명칭 : 퍼즐 조립 기반 증강현실 서비스 제공 시스템3. Patent Application No. 10-2019-0077849, Title of Invention: Puzzle assembly-based augmented reality service providing system 4. 특허출원 제10-2013-0153367호, 발명의 명칭 : 증강현실 기반의 체감형 퍼즐 학습 교구4. Patent Application No. 10-2013-0153367, Title of Invention: Augmented Reality-based tangible puzzle learning tool

본 발명은 사용자가 입체퍼즐 상품으로 제공되는 입체물과 혼합현실 뷰어를 조립하고, 스마트폰으로 상품에 표기된 QR코드로부터 앱을 설치한다음, 조립된 혼합현실 뷰어를 장착 후 입체물을 보는 것으로 입체적 콘텐츠 학습이 가능하도록 한 입체퍼즐을 이용한 혼합현실 체감형 학습 교구를 제안하고자 한다. In the present invention, a user assembles a three-dimensional object provided as a three-dimensional puzzle product and a mixed reality viewer, installs an app from a QR code marked on the product with a smartphone, and then learns three-dimensional content by viewing the three-dimensional object after mounting the assembled mixed reality viewer. We would like to propose a mixed reality tangible learning tool using a three-dimensional puzzle that makes this possible.

본 발명에서 제안하는 기술적 사사인 입체퍼즐을 이용한 혼합현실 체감형 학습 교구는,The mixed reality tangible learning tool using the three-dimensional puzzle, which is a technical subject proposed in the present invention,

입체퍼줄로 조립 가능한 다양한 형태로 이루어지는 복수개의 블록으로 구성되는 퍼즐세트와,A puzzle set composed of a plurality of blocks made of various shapes that can be assembled with a three-dimensional puzzle set;

입체퍼즐로 조립 가능한 헤드 마운트와 상기 헤드 마운트에 결합되는 VR용 렌즈로 구성되는 VR 뷰어 세트를 구비하며, A VR viewer set composed of a head mount that can be assembled with a three-dimensional puzzle and a VR lens coupled to the head mount,

상기 퍼즐 세트에 부착된 QR 코드를 휴대 단말기로 인식시켜 소정의 증강 또는 가상용 앱을 다운로드받아 활성화시킨 후, 상기 휴대 단말기를 상기 VR 뷰어 세트를 구성하는 상기 헤드 마운트에 장착시켜 상기 퍼즐세트에 대응하는 가상 현실 또는 증강 현실을 체감할 수 있도록 한다.After recognizing the QR code attached to the puzzle set with a portable terminal and downloading and activating a predetermined augmented or virtual app, the portable terminal is mounted on the head mount constituting the VR viewer set to correspond to the puzzle set. to experience virtual reality or augmented reality.

본 발명에 따른 입체퍼즐을 이용한 혼합현실 체감형 학습 교구을 실시하는 경우, 입체퍼즐 조립 작업과 함께 해당 입체퍼즐과 연관된 가상 현실 또는 증강 현실을 실시간으로 체험할 수 있도록 하여 집중력을 개선시킴은 물론 해당 입체퍼즐과 관련된 다양한 정보를 학습할 수 있기 때문에 창의력 증진에도 큰 도움이 될 것으로 기대한다.In the case of implementing the mixed reality tangible learning teaching aid using the three-dimensional puzzle according to the present invention, the three-dimensional puzzle assembling work and the virtual reality or augmented reality associated with the three-dimensional puzzle can be experienced in real time, thereby improving concentration and improving the three-dimensional Since you can learn various information related to puzzles, it is expected to be of great help in promoting creativity.

도 1은 본 발명에서 제안하는 입체퍼즐을 이용한 혼합현실 체감형 학습 교구의 조립 과정을 보여주는 도면이다.
도 2는 본 발명에서 제안하는 입체퍼즐을 이용한 혼합현실 체감형 학습 교구를 사용하여 가상 현실 또는 증강현실을 체험하는 상황을 보여주는 도면이다.
도 3은 본 발명에서 제안하는 입체퍼즐을 이용한 혼합현실 체감형 학습 교구의 동작 기능을 설명하는 도면이다.
1 is a diagram showing an assembly process of a mixed reality tangible learning aid using a three-dimensional puzzle proposed in the present invention.
2 is a diagram showing a situation in which virtual reality or augmented reality is experienced using a mixed reality tangible learning tool using a three-dimensional puzzle proposed in the present invention.
Figure 3 is a diagram explaining the operation function of the mixed reality tangible learning teaching tool using the three-dimensional puzzle proposed in the present invention.

이하, 도면 등을 참조하여 본 발명에서 제안하는 입체퍼즐을 이용한 혼합현실 체감형 학습 교구의 기술적 사상에 대하여 설명하기로 한다. Hereinafter, the technical idea of the mixed reality tangible learning tool using the three-dimensional puzzle proposed in the present invention will be described with reference to drawings and the like.

도 1은 본 발명에서 제안하는 입체퍼즐을 이용한 혼합현실 체감형 학습 교구의 조립 과정을 보여주는 도면이다. 1 is a diagram showing an assembly process of a mixed reality tangible learning aid using a three-dimensional puzzle proposed in the present invention.

도시된 바와 같이, 본 발명에서는 입체퍼즐 상품을 제공한다. As shown, the present invention provides a three-dimensional puzzle product.

입체퍼즐 상품은 통상의 입체퍼즐 상품과 마찬가지로 하드보드 재질로 이루어지며, 본 발명의 입체퍼즐 상품은 퍼즐 세트와, VR 뷰어 세트로 구성된다. The three-dimensional puzzle product is made of a hardboard material like a normal three-dimensional puzzle product, and the three-dimensional puzzle product of the present invention is composed of a puzzle set and a VR viewer set.

퍼즐 세트는 입체퍼즐 조립용이고, VR 뷰터 세트는 VR 뷰어 조립용이다. The puzzle set is for assembling three-dimensional puzzles, and the VR viewer set is for assembling a VR viewer.

보다 구체적으로 설명하면, 본 발명에서 제안하는 기술적 사사인 입체퍼즐을 이용한 혼합현실 체감형 학습 교구는, 입체퍼줄로 조립 가능한 다양한 형태로 이루어지는 복수개의 블록으로 구성되는 퍼즐세트와, 입체퍼즐로 조립 가능한 헤드 마운트와 상기 헤드 마운트에 결합되는 VR용 렌즈로 구성되는 VR 뷰어 세트를 구비한다. More specifically, the mixed reality tangible learning teaching aid using three-dimensional puzzles, which are technical subjects proposed in the present invention, includes a puzzle set composed of a plurality of blocks made of various shapes that can be assembled with three-dimensional puzzles, and three-dimensional puzzles that can be assembled. A VR viewer set composed of a head mount and a VR lens coupled to the head mount is provided.

본 발명에 잇어서, 상기 퍼즐 세트에 부착된 QR 코드를 휴대 단말기로 인식시켜 소정의 증강 또는 가상용 앱을 다운로드받아 활성화시킨 후, 상기 휴대 단말기를 상기 VR 뷰어 세트를 구성하는 상기 헤드 마운트에 장착시켜 상기 퍼즐세트에 대응하는 가상 현실 또는 증강 현실을 체감할 수 있도록 한다.In the present invention, after recognizing the QR code attached to the puzzle set with a portable terminal, downloading and activating a predetermined augmented or virtual app, the portable terminal is mounted on the head mount constituting the VR viewer set It is possible to experience virtual reality or augmented reality corresponding to the puzzle set.

참고로, 소정 앱을 다운받기 위한 QR 코드는 입체퍼즐 상품의 포장지나 VR 뷰어 세트 등에 표시되어 있어도 가능할 것이다. For reference, a QR code for downloading a predetermined app may be displayed on a wrapping paper of a three-dimensional puzzle product or a VR viewer set.

도 2는 본 발명에서 제안하는 입체퍼즐을 이용한 혼합현실 체감형 학습 교구를 사용하여 가상 현실 또는 증강현실을 체험하는 상황을 보여주는 도면이다. 2 is a diagram showing a situation in which virtual reality or augmented reality is experienced using a mixed reality tangible learning tool using a three-dimensional puzzle proposed in the present invention.

사용자는 퍼즐 세트를 이용하여 입체퍼즐 모형을 제작하고, 헤드 마운트 기능이 있는 VR 뷰어 세트에 사용자가 소지하고 있는 휴대 단말기를 장착한 후 헤드에 착용한 후 해당 입체퍼즐 상품과 연관되어 있는 정보를 가상 현실 또는 증강 현실 속에서 체험할 수 있다. A user creates a three-dimensional puzzle model using a puzzle set, mounts a portable terminal owned by the user on a VR viewer set with a head-mount function, wears it on the head, and displays information related to the three-dimensional puzzle product virtually. It can be experienced in real or augmented reality.

도 3은 본 발명에서 제안하는 입체퍼즐을 이용한 혼합현실 체감형 학습 교구의 동작 기능을 설명하는 도면이다.Figure 3 is a diagram explaining the operation function of the mixed reality tangible learning teaching tool using the three-dimensional puzzle proposed in the present invention.

도 3에 도시된 바와 같이, 본 발명에서는 가상 현실과 증강 현실 콘텐즈를 함께 제공하여 혼합현실 체감형 콘텐츠를 제공한다, As shown in FIG. 3, in the present invention, virtual reality and augmented reality content are provided together to provide mixed reality tangible content.

본 발명에서 제안하는 혼합현실 체감형 학습 교구 서비스의 기술 내용은 다음과 같다. The description of the mixed reality tangible learning aid service proposed in the present invention is as follows.

① 3D 입체퍼즐 Object Tracking Module① 3D Puzzle Object Tracking Module

3D 입체퍼즐 모형이 증강현실 체험을 유발하는 매개체의 역할을 할 수 있도록 Object Tracking Module이 제공된다. An Object Tracking Module is provided so that the 3D puzzle model can play the role of a medium that triggers the augmented reality experience.

휴대 단말기에 설치된 앱이 실행되면, 증강현실 환경에서 사용자가 VR 뷰어로 3D 입체퍼즐 모형을 응시함에 따라, 오브젝트 트레킹 모듈이 휴대 단말기인 스마트폰 카메라를 통해 입력되는 영상을 분석하여 3D 입체모형을 인식하면 3D 입체퍼즐 모형 주변에 선택가능한 UI가 생성되도록 하였다.When the app installed on the mobile terminal is executed, as the user stares at the 3D 3D puzzle model with the VR viewer in the augmented reality environment, the object tracking module analyzes the video input through the mobile terminal smartphone camera to recognize the 3D 3D model. Then, a selectable UI was created around the 3D three-dimensional puzzle model.

② 사용자 시선추적 Interaction Module② User Eye Tracking Interaction Module

본 보듈은 사용자가 별도의 컨트롤러 없이, 사용자의 시선추적만으로 손쉽게 상호작용을 유발할 수 있는 사용자 시선추적 Interaction Module이다.This module is a user gaze tracking interaction module that allows the user to easily trigger an interaction only by tracking the user's gaze without a separate controller.

본 발명에서는 화면의 정중앙에 Crosshair icon을 배치하여 이를 사용자가 응시하는 곳으로 지정하고 추적을 할 수 있도록 하였다In the present invention, the Crosshair icon is placed in the center of the screen so that the user can designate it as a place to gaze and trace it.

Crosshair icon은 상호작용이 가능한 UI 또는 가상객체 등에 사용자 시선이 접근할 때만 나타나도록 하여, 불필요할 때 시선을 가리는 상황을 개선시킬 수 있다. The crosshair icon appears only when the user's gaze approaches an interactive UI or virtual object, thereby improving the situation in which the user's gaze is obscured when unnecessary.

한편, 본 발명에서는 사용자의 시선이 모형에 접근하면 Crosshair 아이콘이 나타나고, 3D 입체퍼즐모형 주변의 UI위에 2초간 머물게 되면 소정의 관련 메뉴를 실행할 수 있도록 구성하였다On the other hand, in the present invention, the crosshair icon appears when the user's gaze approaches the model, and when the user stays on the UI around the 3D puzzle model for 2 seconds, a predetermined related menu can be executed.

③ ARㆍVR Switching Module③ AR/VR Switching Module

본 모듈은 3D 입체퍼즐 모형으로부터 유발된 증강현실환경에서 사용자의 선택에 의해 가상현실 환경으로 연동되기 위한 ARㆍVR Switching Module이다. This module is an AR/VR Switching Module for interworking with the virtual reality environment by the user's choice in the augmented reality environment derived from the 3D three-dimensional puzzle model.

사용자의 시선이 VR 아이콘을 2초간 응시하면, 관련된 360도 가상현실 장면이 호출되어 사용자가 공간이동하는 듯한 효과를 연출시킬 수 있다. When the user's gaze gazes at the VR icon for 2 seconds, a related 360-degree virtual reality scene is called, creating an effect as if the user is moving in space.

이상에서 설명한 바와 같이, 본 발명에서 제안하는 입체퍼즐을 이용한 혼합현실 체감형 학습 교구을 사용하면, 스토리를 담고 있는 입체 퍼즐의 역사적인 유물, 유적지 및 지역의 다양한 랜드마크를 제작할 수 있고, 이 입체퍼즐을 매개체로 혼합현실 콘텐츠를 연동함으로써 흥미와 정보제공을 동시에 만족할 수 있는 체험형 교구를 즐길 수 있다. As described above, if the mixed reality tangible learning tool using the three-dimensional puzzle proposed in the present invention is used, it is possible to produce historical artifacts, historic sites, and various local landmarks of the three-dimensional puzzle containing the story, and this three-dimensional puzzle By linking mixed reality contents as a medium, you can enjoy experiential teaching aids that can satisfy interest and information at the same time.

특히 별도의 컨트롤러 없이 사용자에게 서비스 제공이 가능하여 미취학 아동 및 스마트 기기 사용에 어려움을 겪는 노년층도 쉽게 사용이 가능하며, 사용자가 AR과 VR 환경을 선택적으로 선택할 수 있는 기능을 통해 AR환경에서는 입체물에 대한 부가 정보를 제공하고, VR에서는 360도 가상현실 씬을 호출하여 입체물 관련 시공간 정보를 제공할 수도 있다. In particular, since the service can be provided to users without a separate controller, preschool children and the elderly who have difficulty using smart devices can use it easily, and through a function that allows users to selectively select AR and VR environments, AR environments can be used for three-dimensional objects. In VR, a 360-degree virtual reality scene may be called and space-time information related to a three-dimensional object may be provided.

따라서, 본 발명에 따른 입체퍼즐을 이용한 혼합현실 체감형 학습 교구을 실시하는 경우, 입체퍼즐 조립 작업과 함께 해당 입체퍼즐과 연관된 가상 현실 또는 증강 현실을 실시간으로 체험할 수 있도록 하여 집중력을 개선시킴은 물론 해당 입체퍼즐과 관련된 다양한 정보를 학습할 수 있기 때문에 창의력 증진에도 큰 도움이 될 것으로 기대한다.Therefore, when performing the mixed reality tangible learning teaching aid using the three-dimensional puzzle according to the present invention, it is possible to experience the virtual reality or augmented reality related to the three-dimensional puzzle in real time together with the assembly work of the three-dimensional puzzle to improve concentration as well as Since it is possible to learn various information related to the three-dimensional puzzle, it is expected to be of great help in enhancing creativity.

Claims (1)

입체퍼즐을 이용한 혼합현실 체감형 학습 교구에 있어서,
입체퍼줄로 조립 가능한 다양한 형태로 이루어지는 복수개의 블록으로 구성되는 퍼즐세트와,
입체퍼즐로 조립 가능한 헤드 마운트와 상기 헤드 마운트에 결합되는 VR용 렌즈로 구성되는 VR 뷰어 세트를 구비하며,
상기 퍼즐 세트에 부착된 QR 코드를 휴대 단말기로 인식시켜 소정의 증강 또는 가상용 앱을 다운로드받아 활성화시킨 후, 상기 휴대 단말기를 상기 VR 뷰어 세트를 구성하는 상기 헤드 마운트에 장착시켜 상기 퍼즐세트에 대응하는 가상 현실 또는 증강 현실을 체감할 수 있도록 한 입체퍼즐을 이용한 혼합현실 체감형 학습 교구.
In a mixed reality tangible learning tool using a three-dimensional puzzle,
A puzzle set composed of a plurality of blocks made of various shapes that can be assembled with a three-dimensional puzzle set;
A VR viewer set composed of a head mount that can be assembled with a three-dimensional puzzle and a VR lens coupled to the head mount,
After recognizing the QR code attached to the puzzle set with a portable terminal and downloading and activating a predetermined augmented or virtual app, the portable terminal is mounted on the head mount constituting the VR viewer set to correspond to the puzzle set. A mixed reality tangible learning tool using a three-dimensional puzzle that allows you to experience virtual reality or augmented reality.
KR1020210080235A 2021-06-21 2021-06-21 Mixed Reality Sensory Learning Device using a three-dimensional puzzle KR20220169754A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020210080235A KR20220169754A (en) 2021-06-21 2021-06-21 Mixed Reality Sensory Learning Device using a three-dimensional puzzle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020210080235A KR20220169754A (en) 2021-06-21 2021-06-21 Mixed Reality Sensory Learning Device using a three-dimensional puzzle

Publications (1)

Publication Number Publication Date
KR20220169754A true KR20220169754A (en) 2022-12-28

Family

ID=84538078

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020210080235A KR20220169754A (en) 2021-06-21 2021-06-21 Mixed Reality Sensory Learning Device using a three-dimensional puzzle

Country Status (1)

Country Link
KR (1) KR20220169754A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013153367A (en) 2012-01-26 2013-08-08 Fujitsu Ltd Transmission device and delay measurement method
KR20160087809A (en) 2014-12-02 2016-07-22 닛토덴코 가부시키가이샤 Method of producing optical film and manufacturing device
KR20170083070A (en) 2014-11-13 2017-07-17 에이알엠 리미티드 Context sensitive barrier instruction execution
KR20190077849A (en) 2017-12-26 2019-07-04 오스템임플란트 주식회사 Method for generating tooth arrangement data used for designing clear aligner, apparatus, and recording medium thereof

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013153367A (en) 2012-01-26 2013-08-08 Fujitsu Ltd Transmission device and delay measurement method
KR20170083070A (en) 2014-11-13 2017-07-17 에이알엠 리미티드 Context sensitive barrier instruction execution
KR20160087809A (en) 2014-12-02 2016-07-22 닛토덴코 가부시키가이샤 Method of producing optical film and manufacturing device
KR20190077849A (en) 2017-12-26 2019-07-04 오스템임플란트 주식회사 Method for generating tooth arrangement data used for designing clear aligner, apparatus, and recording medium thereof

Similar Documents

Publication Publication Date Title
Yuen et al. Augmented reality: An overview and five directions for AR in education
US11775130B2 (en) Guided retail experience
US9076345B2 (en) Apparatus and method for tutoring in convergence space of real and virtual environment
CN102981616A (en) Identification method and identification system and computer capable of enhancing reality objects
KR102358997B1 (en) The service platform for multi-user supporting extended reality experience
Mitsuhara et al. Using Digital Game, Augmented Reality, and Head Mounted Displays for Immediate-Action Commander Training.
JP6683864B1 (en) Content control system, content control method, and content control program
CN106648038A (en) Method and apparatus for displaying interactive object in virtual reality
CN105184858A (en) Method for augmented reality mobile terminal
JP2022500795A (en) Avatar animation
Kounlaxay et al. Design of Learning Media in Mixed Reality for Lao Education.
KR101638550B1 (en) Virtual Reality System using of Mixed reality, and thereof implementation method
Chen et al. Virtual, Augmented and Mixed Reality: Interaction, Navigation, Visualization, Embodiment, and Simulation: 10th International Conference, VAMR 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA, July 15-20, 2018, Proceedings, Part I
Kim et al. Evaluation of an HMD-based multisensory virtual museum experience for enhancing sense of presence
CN110389664B (en) Fire scene simulation analysis device and method based on augmented reality
Loijens et al. What is augmented reality?
KR101770188B1 (en) Method for providing mixed reality experience space and system thereof
KR20220169754A (en) Mixed Reality Sensory Learning Device using a three-dimensional puzzle
Rodrigue et al. Mixed reality simulation with physical mobile display devices
Popov et al. Virtual reality as educational technology
Anoffo et al. Virtual reality experience for interior design engineering applications
Huang Virtual reality/augmented reality technology: the next chapter of human-computer interaction
Schönauer et al. Physical object interaction in first responder mixed reality training
Chifor et al. Immersive Virtual Reality application using Google Cardboard and Leap Motion technologies.
Martin Augmented reality

Legal Events

Date Code Title Description
E902 Notification of reason for refusal
E601 Decision to refuse application