KR20100058843A - Method and system for teaching hangeul using augmented reality - Google Patents

Abstract

PURPOSE: A method and a system for teaching Hangeul using augmented reality are provided to enhance visual and auditory learning of a user through augmented reality, thereby improving education effect. CONSTITUTION: A pattern processor recognizes Hangul letter relevant to sensed pattern(S204). A contents output unit outputs multimedia contents relevant to the recognized Hangul letter to the second position(S206). If sensed third pattern instructs output of a sound, the system outputs a sound relevant to the Hangul letter(S208,S210). If sensed forth pattern instructs output of phonetic sign, the system output phonetic sing relevant to the Hangul letter(S212,S214).

Description

Hangul teaching method and system using augmented reality {METHOD AND SYSTEM FOR TEACHING HANGEUL USING AUGMENTED REALITY}

The present invention relates to a Korean language teaching method and system using augmented reality, and more particularly to a Korean language teaching method and system that can enhance the educational effect by increasing the degree of participation of a real user visually and aurally using augmented reality technology. It is about.

Augmented Reality (Augmented Reality) is to create a new world by combining the real world that the user sees with the virtual world with additional information. The augmented reality system that combines the real environment and the virtual environment has been researched and developed mainly in the United States and Japan since the late 1990s. Augmented reality, a concept that complements the real world with the virtual world, uses a virtual environment made of computer graphics, but the main role is the real environment. Computer graphics play a role in providing additional information necessary for the real environment. By registering the 3D virtual image with the live image that the user sees, it means that the distinction between the real environment and the virtual screen is blurred. Virtual reality technology immerses the user in the virtual environment and cannot see the real environment. However, augmented reality technology, which is a mixture of real and virtual objects, provides a better sense of reality by allowing the user to see the real environment.

On the other hand, the language education environment has been maintained as a text-oriented environment for many years. In other words, it's a lagging way in the modern digital age. The direction of modern technology is evolving not just from the transmission of information, but also from the demands of visual, auditory and mutual communication, which opens up a new chapter in the acquisition of knowledge in education. Although the teaching method using multimedia has existed in the past, there is a limit to the actual user's participation only by acting as a keyboard or mouse operation. In order to supplement these limitations and better language learning, the present invention proposes a teaching method applying augmented reality.

Hangul is one of the most interesting languages. Hangul is a combination of consonants and vowels. Characters are determined by a combination of at least two or three consonants and vowels. Because of this pattern, the user can create various characters. Foreigners may have difficulty learning Hangul because these combination languages are not used well in other languages. So we propose a Hangul language teaching system using augmented reality to overcome this problem.

Accordingly, an object of the present invention is to provide a method and system for teaching Korean that can enhance the educational effect by increasing the degree of participation of a real user visually and aurally using augmented reality technology.

The objects of the present invention are not limited to the above-mentioned objects. Other objects and advantages of the invention will be more clearly understood by the following description.

In order to achieve the above object, the present invention provides a method for teaching Korean using augmented reality, comprising: detecting a pattern of a first position indicated by a specific guide frame, comparing the detected pattern with a Korean character pattern in a database; Recognizing the Hangul characters corresponding to the sensed pattern, and outputting the content corresponding to the recognized Hangul characters to a second location.

In addition, the present invention is a Hangul teaching system using augmented reality, the pattern detecting unit for detecting the pattern of the first position, the database for storing the Hangul character pattern, the pattern detected by the pattern detection unit and the Hangul in the database And a pattern processing unit for recognizing a Hangul character corresponding to the detected pattern by comparing a letter pattern, and a content output unit for outputting content corresponding to the recognized Hangul character.

The present invention also provides a language teaching method using augmented reality, the method comprising: detecting a pattern of a first position displayed by a specific guide frame, comparing the detected pattern with a letter pattern in a database to correspond to the detected pattern Recognizing a character to be described, and outputting the content corresponding to the recognized character in a second position is another feature.

According to the present invention, by using the augmented reality technology can increase the degree of the actual user to participate in the learning visually and auditory to increase the educational effect. In addition, the present invention can improve the effect of education by inducing the interest of the learner by providing a variety of multimedia content associated with the learning character. In addition, the present invention has the advantage of being able to learn a variety of letters with only a small number of patterns because it directly makes a letter pattern by a combination of small patterns.

The above objects, features, and advantages will be described in detail with reference to the accompanying drawings, whereby those skilled in the art may easily implement the present invention. In describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a Hangul teaching system according to an embodiment of the present invention. As illustrated, the Hangul teaching system 100 includes a pattern detector 102, a pattern processor 104, a database 106, and a content output unit 108. In the present exemplary embodiment, the first position 112 and the second position 114 exist on the desk 110 together, but are determined according to the type of the pattern detecting unit 102 and the content output unit 108.

The pattern detector 102 detects a pattern in the first position 112 displayed in the specific guide frame. The pattern detecting unit 102 is generally implemented as a web camera, but may also be implemented as a touch screen. The database 106 stores multimedia content related to the Hangul character pattern.

The pattern processor 104 compares the pattern detected by the pattern detector 102 with the Hangul character pattern in the database 106 to recognize the Hangul characters corresponding to the detected pattern and to read related multimedia contents from the database 106. To the content output unit 108.

The content output unit 108 outputs the multimedia content provided from the database 106 to the second location 114 via the pattern processing unit 104. The specific configuration of the content output unit 108 is determined according to the type of multimedia content to be output. The second location 114 is generally located on a flat panel display such as an LCD, but if the content output unit 108 is a projector, the second location 114 may be located on a desk, a wall, a floor, or a head-mounted display. May be

2 is a flowchart illustrating a Hangul teaching method according to an embodiment of the present invention.

First, the pattern of the first position 112 displayed by the specific guide frame is detected through the pattern detecting unit 102 (S202). The pattern of the first position 112 is generated by a combination of a predetermined number of subpatterns. The lower pattern is preferably a consonant or a vowel of the Hangul. To reduce the number of markers, a character recognition approach can be used beyond the current pattern matching approach. You can also use character recognition approaches, such as neural network recognition.

Next, the pattern processing unit 104 compares the detected pattern with the Hangul character pattern in the database 106 to recognize the Hangul characters corresponding to the detected pattern, and the multimedia content corresponding to the recognized Hangul characters from the database 106. The information is read and provided to the content output unit 108 (S204).

Next, the content output unit 108 outputs the multimedia content corresponding to the recognized Korean character to the second position 114 (S206). The multimedia content may be an image, a 3D object, a video, animation, or the like. Here, the 3D object may be an object corresponding to the recognized Korean character or a completed character.

Next, by detecting the pattern of the third position (not shown) for determining whether to output the sound (S208), if the detected pattern of the third position indicates the output of the sound outputs the sound corresponding to the recognized Hangul characters (S210). The controller detects a pattern of a fourth position (not shown) for determining whether to output the pronunciation symbol (S212), and if the detected pattern of the fourth position indicates the output of the pronunciation symbol, the phonetic symbol corresponding to the recognized Korean character Outputs (S214).

Hangul teaching system according to the present invention can be driven only if a general PC and low-cost image camera, so anyone can easily install and use even infrastructure existing in the home or school scene. Hangul teaching according to the present invention can be said to be a very sensational process involving both visual and auditory aspects in learning a new language. Hangul has a more complicated structure when expressing letters compared to English and presents an interesting alternative to dealing with consonants and vowels that are unique to Hangeul. Recognition of characters by the completion of consonants and vowels, the corresponding characters are represented as 3D objects and the corresponding sounds are output. Furthermore, it presents a more educational environment by representing related objects in three dimensions by the completion of letters.

In the following, we will look into the needs and functions of the Hangul language teaching system. The system is capable of recognizing and expressing many characters. By default, "ga" must be registered as a marker "ga" in the system, but in actual use it is used as two markers "a" and "ㅏ". 3 illustrates a method of using and registering a marker. As shown in Figure 3, when registering the letter "ga" in the Hangul teaching system according to the present invention is registered in the form 4, but when the pattern detection unit 102 recognizes the letter "ga" Recognize it by placing two of the first and second two on the white part.

Of course, the combination of the two markers in this case can be "high", "me", "almost", etc., so all possible cases should be stored as markers. For example, rotating the letter "ㄱ" 90 degrees has the same shape as "ㄴ". In addition, rotate the letter "ㅏ" 180 degrees, the same shape as "ㅓ". You need these different types of markers, and you need a normal webcam to recognize them. This not only significantly reduces the number of markers needed to express the language, but also provides a background for the instructor to learn a lot of letters, even in the form of small letters.

4 illustrates a method of using and registering a marker when using English. You can learn the word "we" with two markers, "w" and "e". 5 illustrates a method of using and registering a marker when using Japanese. You can learn the word "あ い" with two markers "あ" and "い".

FIG. 6 is a view for explaining a kind of button 4 for outputting the sound of a character and a button 5 for supporting the pronunciation of the sound as a phonetic symbol. If you put the markers corresponding to consonants and vowels at "1", the character shape is expressed as a three-dimensional object at "2", and when you hide "4" by hand, the sound of the pronunciation is output to the speaker. do. And if you hide "5" by hand, the English phonetic symbol of the letter is expressed in "3". This can be done by the pattern matching method supported by ARToolKit, and it can be helpful for auditory language learning because you can hear the pronunciation of the character by covering the "sound" part "4" with your hand.

7A to 7B show a demo screen expressing "I" using "a" and "과". 7A is an initial screen. Figure 7b is to rotate the "b" 180 degrees to make "b" and "b" using "" "to represent. In this case, "I" appears as a correct handwriting at position "2" in FIG. In this case, as shown in FIG. 7C, when the portion labeled "SIGN" is covered with a paper cup, an English phonetic symbol "NA" is displayed. Finally, as shown in FIG. 7D, when "SOUND" is covered, a sound is generated and a music symbol object is displayed in the sense.

8A and 8B illustrate the case where "ger" is made of "a" and "ㅏ". 9A and 9B illustrate a three-dimensional model and image representation associated with a given word. 9A and 9B illustrate an example of expressing an image photograph and a 3D model associated with a text when the input text has a meaning. The Hangul teaching system shows three-dimensional models and photographs that have characters and meanings, so that users can easily associate them with each other and learn the meaning as well as the typeface.

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and various substitutions, modifications, and changes are possible in the art without departing from the technical spirit of the present invention. It will be clear to those of ordinary knowledge.

1 is a block diagram of a Hangul teaching system according to an embodiment of the present invention.

2 is a flowchart illustrating a Hangul teaching method according to an embodiment of the present invention.

Figure 3 illustrates the use and registration method of the marker according to the present invention.

4 illustrates a method of using and registering a marker when using English.

5 illustrates a method of using and registering a marker when using Japanese.

FIG. 6 is a diagram for explaining a button for outputting a sound of a character and a button for supporting a sound as a phonetic symbol.

7A to 7B show a demo screen expressing "I" using "a" and "과".

8A and 8B illustrate the case where "ger" is made of "a" and "ㅏ".

9A and 9B illustrate an example of expressing an image photograph and a 3D model associated with an input character when it has a meaning.

Claims (10)

In the Hangul teaching method using augmented reality, Detecting the pattern of the first location indicated by the particular guide frame; Comparing the detected pattern with a Hangul character pattern in a database and recognizing a Hangul character corresponding to the detected pattern; Outputting the content corresponding to the recognized Korean character to a second location; Hangul teaching method comprising a. The method of claim 1, The pattern of the first position is a Hangul teaching method, characterized in that generated by the combination of a predetermined number of lower patterns. The method of claim 2, The lower pattern is Hangul consonant method, characterized in that the consonants or vowels of Hangul. The method of claim 1, The content is Hangul teaching method, characterized in that one of the image, three-dimensional object, video, animation. The method of claim 4, wherein The 3D object is a Hangul teaching method, characterized in that the object corresponding to the recognized Hangul letters or completed letters. The method of claim 1, Detecting a pattern of the third location; Outputting a sound corresponding to the recognized Korean character according to the detected pattern of the third position; Hangul teaching method characterized in that it further comprises. The method of claim 1, Detecting a pattern of a fourth position; Outputting a phonetic symbol corresponding to the recognized Korean character according to the detected pattern of the fourth position; Hangul teaching method characterized in that it further comprises. In the Hangul teaching system using augmented reality, A pattern detecting unit detecting a pattern of the first position; A database that stores Korean character patterns, A pattern processor for comparing the pattern detected by the pattern detector with a Hangul character pattern in the database to recognize a Hangul character corresponding to the detected pattern; Content output unit for outputting the content corresponding to the recognized Hangul characters Hangul teaching system comprising a. The method of claim 8, The pattern detecting unit is a Hangul teaching system, characterized in that the camera or touch screen. In the language teaching method using augmented reality, Detecting the pattern of the first location indicated by the particular guide frame; Comparing the detected pattern with a letter pattern in a database and recognizing a letter corresponding to the detected pattern; Outputting the content corresponding to the recognized character to a second location; Language teaching method comprising a.

Images