Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.
The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.
1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.
Hereinafter, the components will be described in order.
The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .
The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules 1100 may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.
The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.
The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.
The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).
For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.
The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.
The mobile communication module 112 may comprise at least one of a base station, an external terminal, and a server on a mobile communication network such as Global System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.
The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.
The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112).
The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.
The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.
Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [
The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.
The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.
The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a button 136 and a touch sensor (static pressure / static electricity) 137 located on the front, back, or side of the mobile terminal 100, and may include a keypad, A dome switch, a jog wheel, a jog switch, and the like.
The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. Examples of the sensing unit 140 include a gyroscope sensor, an acceleration sensor, and a geomagnetic sensor.
For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.
The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .
The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.
The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.
Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.
There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.
(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.
The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.
If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.
The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.
Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.
Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually contacting the pointer on the touch screen may be referred to as "contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.
The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.
The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.
The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the audio output module 152 may be a type of the alarm unit 153. The display unit 151 and the audio output module 152 may be connected to the display unit 151 or the audio output module 152, .
The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.
In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact of an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.
The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.
The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia).
In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.
The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.
The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.
The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.
When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.
The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [
The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.
The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.
The battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of an interface 170 through which an external charger for supplying power for charging the battery is electrically connected.
The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.
According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.
According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [
FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.
The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.
The body of the mobile terminal 100 includes a casing 101, 102, In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102.
In some cases, electronic components may be mounted on the surface of the rear case 102 as well. Electronic components mounted on the surface of the rear case 102 include a battery, a USIM card, a memory card, and the like which are detachable by the user. At this time, the rear case 102 may further include a rear cover 103 for covering the surface thereof. When the rear cover 103 is removed, the surface of the rear case 102 is exposed.
As shown in FIG. 2, when the rear cover 103 is coupled, only a part of the side surface of the rear case 102 may be exposed. When the size of the rear cover 103 is reduced, Some may also be exposed. And an opening 103 'for exposing the camera 121' or the sound output unit 152 'to the outside when the rear cover 103 covers the entire rear surface of the rear case 102.
The cases 101, 102 and 103 may be formed by injection molding of synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).
The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal cases 101 and 102.
The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [
The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.
The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 inputs a command such as adjustment of the sound output from the sound output unit 152 And the third operation unit 133 can receive a command such as switching to the touch recognition mode of the display unit 151 or the like.
3 is a rear perspective view of the portable terminal shown in FIG.
3, when the front case 101 and the rear case 102 of the mobile terminal 100 are coupled to each other, one side of the mobile terminal 100 is provided with a receiving groove (not shown) 104 may be formed. 3 illustrates that the receiving groove 104 is formed on the lower side of the mobile terminal 100. However, it is needless to say that the receiving groove 104 may be formed in a direction different from the illustrated example. Although not shown, an electrode for supplying power from the power supply unit 190 to the electronic pen 300 may be positioned on the inner side of the receiving groove 104. The electrode formed on the inner surface of the receiving groove 104 may be used to supply power to the power supply unit 360 of the electronic pen 300 by abutting against the charging terminal 362 of the electronic pen 300. [ The electrode may be used to transmit data stored in the memory 330 of the electronic pen 300 to the mobile terminal 100 when the electronic pen 300 includes the memory 330. [ The data transfer may be via the electrode as well as via separate electrical contact means. In this case, the receiving groove 104 has a separate electrical contact means on its inner surface.
Further, the camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2), and may be a camera having different pixels from the camera 121.
For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.
A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.
An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.
In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.
A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.
The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type for the display unit 151. [ In this case, if the display unit 151 is configured to output the time information on both sides (i.e., in the directions of both the front and back sides of the mobile terminal), the time information can be recognized through the touch pad 135 do. The information output on both sides may be all controlled by the touch pad 135. [
Meanwhile, the display for exclusive use of the touch pad 135 may be separately installed, so that the touch screen may be disposed in the rear case 102 as well.
The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.
Next, the electronic pen 300 that can be used in the mobile terminal 100 according to the present invention will be described in detail.
4 is a block diagram of an electronic pen according to the present invention. 4, the electronic pen 300 includes a sensing unit 310 for sensing contact with the mobile terminal 100, a wireless communication unit 320 for performing wireless communication with the mobile terminal 100, A memory 330 for storing data received from the electronic pen 100, and a controller 340 for controlling the overall operation of the electronic pen 300. In addition, the electronic pen 300 includes a user input unit 350 for receiving user input, a power supply unit 360 for supplying power necessary for operation of the respective components of the electronic pen 300, and an electronic pen 300 And a display unit 370 for displaying the setting of the handwriting color when the handwriting is input to the touch screen 151. [
The sensing unit 310 senses the presence or absence of contact between the electronic pen 300 and the touch screen of the mobile terminal 100, specifically, the mobile terminal 100, and generates a sensing signal for controlling the operation of the electronic pen 300. [ . The sensing unit 310 for sensing contact with the touch screen may include at least one of a pressure sensor and a magnetic sensor. The pressure sensor is for measuring the pressure when the electronic pen 300 is brought into contact with the touch screen and the pressure when the touch screen is contacted. The magnetic sensor is for sensing a contact touch and a proximity touch between the electronic pen 300 and the touch screen. Specifically, the magnetic sensor can distinguish whether the electronic pen 300 is touched or approximated to the touch screen based on the change of the magnetic field. In the present invention, the sensing unit 310 may include at least one of a pressure sensor and a magnetic sensor in order to determine whether or not the touch screen is in contact with and proximity to the touch screen. However, And it can be used for detecting whether or not the touch is proximity. However, when the electronic pen 300 does not need to perform the sensing of whether or not the electronic pen 300 is in contact or proximity touch, that is, The sensing unit 310 of the electronic pen 300 may not include the pressure sensor and the magnetic sensor.
The sensing unit 310 may further include an optical sensor capable of sensing a color of an object displayed on the touch screen 151 in proximity to or in contact with the pen point of the electronic pen 300. Further, the optical sensor may be a scan sensor capable of performing an image scanning function.
The wireless communication unit 320 is for performing wireless communication with the mobile terminal 100. The wireless communication between the electronic pen 300 and the mobile terminal 100 may be performed through a short distance communication. The short distance communication technology may be Bluetooth, Radio Frequency Identification (RFID) , Infrared data association (IrDA), ultra wideband (UWB), ZigBee, and Near Field Communication (NFC). Among these, the NFC has an advantage that it can perform wireless communication with the mobile terminal 100 without performing a pairing process.
The memory 330 is for storing various data necessary for the operation of the electronic pen 300, and the memory 330 may include a control area and a data area. The control area is an area for storing a program for operation of the electronic pen 300, and the data area may be an area for storing data received from the outside. In particular, the data area may be an area for storing information on the color sensed through the sensing unit 310 of the electronic pen 300 or an image.
The user input unit 350 generates input data for controlling the operation of the electronic pen 300. The user input unit 350 may include a button or a touch sensor (static pressure / static electricity) exposed to the outside of the electronic pen 300.
The display unit 370 displays the operating state of the electronic pen 300. [ The operating state of the electronic pen 300 may indicate whether the data area is empty or whether data is being transmitted or received through the wireless communication unit. The display unit 370 for displaying the operating state of the electronic pen 300 may include at least one of a light emitting module such as an LED (Light Emitting Module) and a display module. When the display unit 370 includes a light emitting module, the control unit 340 can express various operating states of the electronic pen 300 based on whether or not the light emitting module emits light, luminosity, color, light emitting area, and the like. When the display unit 370 includes a display module, the control unit 340 may output the operating state of the electronic pen 300 to the display module. In the case of the electronic pen 300 performing the color changing function and color setting function according to the present invention, when handwriting is input to the mobile terminal 100 through the electronic pen 300, The display unit 370 can display the handwriting color so that the user of the electronic pen 300 knows the color of the written handwriting. To this end, the display unit 370 may include at least one of the first display units 371 and 372 and the second display unit 373. [ The electronic pen 300 may include a first display portion 371 inside the pen tip with a light emitting module so that the user can recognize the color of the handwriting. The first display portion may include an inner portion 372 of the user input portion 350, As shown in FIG. If there is a plurality of colors for the electronic pen 300 or there is an image scanned through the sensing unit 310, the second display unit 373 may be provided as a display module for displaying the scanned image.
The control unit 340 controls the overall operation of the electronic pen 300. The control unit 340 performs control and processing for wireless communication with the mobile terminal 100 and can determine an operation mode of the electronic pen 300 based on an external input input through the user input unit 350. [
For example, the control unit 340 may control the electronic pen 300 to be set to either the normal mode or the data transmission / reception mode based on whether the user input unit is receiving an external input. When the electronic pen 300 is touched to the touch screen 151 of the mobile terminal 100 while the electronic pen 300 is set to the normal mode, Or a handwriting input along the touch trajectory of the electronic pen 300 may be displayed. For example, when the electronic pen 300 touches an icon for executing a specific application displayed on the touch screen 151, the specific application can be executed through the mobile terminal 100. [ As another example, when the electronic pen 300 set in the normal mode with the mobile terminal 100 set in the handwriting input mode is touched on the touch screen, the handwriting 100 is provided with a handwriting An input may be output. Herein, the handwriting input mode is one of the settings provided for drawing a handwriting on the touch screen. When the handwriting input mode is set to the handwriting input mode, the control unit 180 of the mobile terminal 100 generates a touch input locus So that the handwriting can be drawn. Setting of the mobile terminal 100 in the handwriting input mode has already been well known in the art, so a detailed description thereof will be omitted.
Meanwhile, when handwriting input is performed through the electronic pen 300 in the handwriting input mode of the mobile terminal, when an input for changing a hue of input handwriting or setting a hue is detected through the user input unit 350 The control unit 340 of the electronic pen 300 may transmit the color change command or the color setting command to the mobile terminal 100 through the wireless communication unit 320. [ In this case, the control unit 180 of the mobile terminal 100 may control the handwriting to be drawn with the color changed by the color change command along the handwriting input trace on the touch screen, You can add a color setting of.
Alternatively, if the electronic pen 300 is touched to the touch screen while the electronic pen 300 is set to the data transmission / reception mode, the control unit 340 determines whether the data area of the memory 330 is empty And may receive data from the mobile terminal 100 or control the data stored in the data area to be transmitted to the mobile terminal 100. [ The control unit 340 may control the wireless communication unit to receive data from the mobile terminal 100 and may control the wireless communication unit 320 to transmit data to the mobile terminal 100. [
The power supply unit 360 serves to supply power necessary for operation of the components of the electronic pen 300. The power supply unit 360 may include a rechargeable battery. When the electronic pen 300 is inserted into the receiving groove 104 of the mobile terminal 100 illustrated in FIG. 2, the battery may be charged with power supplied from the power supply unit 190 of the mobile terminal 100.
5 is an exemplary view for explaining the outline of the electronic pen according to an embodiment of the present invention. Referring to FIG. 5, the electronic pen 300 may include a head part 510 and a body part 520. The head part 510 is a part for contacting the touch screen of the mobile terminal 100 and the body part 520 is a part for the user to grasp the electronic pen 300. [ Electronic parts constituting the electronic pen 300 may be mounted on the body part 520 of the electronic pen 300.
In order to improve the touch accuracy of the electronic pen 300, the cross sectional area of the head portion 510 may be gradually reduced toward the tip, in order to improve the touch accuracy. That is, the electronic pen 300 may have a pen point portion, and one end of the electronic pen 300 may have a sharp shape, thereby providing an experience of using the pen to the user. In addition, the sensing unit 310 may be positioned on the tip of the pen unit located at one end of the head unit 510 to detect whether the electronic pen 300 touches the touch screen. The sensing unit 310 may include an optical sensor and a scan sensor as described above. In addition, the head unit 510 may be configured to allow the user to know what color of the handwriting that has been set in advance to be output through the touch screen 151 of the mobile terminal 100 during handwriting input through the electronic pen 300 A display portion 370 for displaying a handwriting color may be positioned. In particular, the display unit 370 may include a first display unit 371 positioned at the pen point of the head unit 510. [
The display unit 370 and the user input unit 350 of the electronic pen 300 may be located in the body 520. 5, the user input unit 350 may be embodied as a button on the opposite side of the head portion of the body portion 520. [ However, as in the example shown in FIG. 5, the user input unit does not necessarily have to be positioned at the opposite end of the head unit 510, but may be located on the surface of the body unit 520. The user input unit 350 is not limited to one button as shown in FIG. 5, and may be implemented as one or more buttons depending on the functions of the mobile terminal 100 and the electronic pen 300. In addition, the user input unit 350 may be implemented in the form of a touch sensor on the surface of the body 520, as another example of the button type.
Particularly, in the case of the display unit 370, the first display unit 371 may be additionally provided inside the button portion 372 of the body portion 520, in addition to being located at the head portion 510. On the surface of the body part 520 is displayed another display part 370 in addition to the first display part 371 and 372 for the color of handwriting output when the handwriting through the electronic pen 300 is input to the touch screen 151 And a second display portion 373 for displaying the setting. The second display unit 373 may display a predetermined color through the touch input or the electronic pen 300 at the mobile terminal 100 or may display a color or an image set through the scanning using the scan sensor .
The body 520 may further include a charging terminal 362 for charging the battery of the power supply unit 360. When the electronic pen 300 is inserted into the receiving groove 104 of the mobile terminal 100, the power supply unit 360 supplies power from the power supply unit 190 of the mobile terminal 100 through the charging terminal 362 Can receive. The charging terminal 362 may be engaged with the head portion 510 and not the body portion 520 of the electronic pen 300 as occasion demands.
The electronic pen 300 described in the present invention may be inserted into the receiving groove 104 of the mobile terminal 100 and may be stored in an external form separate from the mobile terminal 100. For convenience of explanation, the mobile terminal 100 is assumed to include at least one of the components shown in FIG. 1, and the electronic pen 300 is assumed to include at least one of the components shown in FIG. 4 do.
In addition, since the mobile terminal 100 according to the present invention can be implemented more easily when the display unit 151 is a touch screen, it is assumed that the display unit 151 is a touch screen.
In the present invention, the electronic pen 300 'touches' the mobile terminal 100 may include not only touching the electronic pen 300 and the mobile terminal 100, but also touching the electronic pen 300 and the mobile terminal 100 .
The color change instruction is a command for changing the color of handwriting output on the touch screen 151 in response to the handwriting input to the user of the electronic pen 300 when the handwriting input is performed from the user to the touch screen 151. [ Quot; is an instruction to change according to an input through the input unit 350. [ Hereinafter, the difference between the conventional mobile terminal and the mobile terminal 100 using the electronic pen 300 receiving the color change command will be described.
Conventionally, when a user performs handwriting input on the touch screen 151 of the mobile terminal 100 using the electronic pen 300, the color of the handwriting output on the touch screen 151 in correspondence with the input is determined To do so, the user had to set a single color before the handwriting input. That is, when a user selects a black color in a color setting window displayed on the touch screen in response to a user command before handwriting input and performs handwriting input, a predetermined color, for example, In order to output the handwriting input in red color, the user has to perform handwriting input after selecting the red color in the color setting window again. Alternatively, when the mobile terminal 100 enters the handwriting input mode described above, if a default value for color is preset so that a specific color is output when a user performs handwriting input with the electronic pen 300, The user has to perform the handwriting input after selecting the other color in the color setting window. That is, in order to change the desired output color, the user inputs a user command to display a color setting window each time during writing or before starting, and thereafter, another user command for color changing is input through the color setting window There was an inconvenience.
However, the user can solve the inconvenience according to the color change command of the present invention. 5, when the user of the electronic pen 300 presses the button 350 when the user input unit 350 of the electronic pen 300 is provided as a button on one end of the electronic pen 300 The control unit 340 of the electronic pen 300 senses the signal to generate a signal and transmits the signal to the mobile terminal 100 through the wireless communication unit 320. When the wireless communication unit 110 of the mobile terminal 100 receives the signal and transmits the received signal to the control unit 180, the control unit 180 can sense the transmission signal as a color change command. Accordingly, when the control unit 180 detects a color change command during or before the handwriting, the color of handwriting output to the touch screen 151 in response to the handwriting input of the user can be easily changed without selecting a color in a separate setting window.
The following description is an example of the case where the color change command is inputted through the electronic pen 300. When a first handwriting input is performed from the user to the touch screen 151 of the mobile terminal 100 through the electronic pen 300, the first handwritten input of the plurality of colors, preset in the mobile terminal 100 or the electronic pen 300, The first handwriting may be output on the touch screen 151. [ At this time, the color change command may be inputted from the user before the second handwriting input is performed from the user in the state where the first handwriting is displayed in the first color on the touch screen. In this case, when the second handwriting input is performed by the user after the input of the color change command, the hue of the second handwriting corresponding to the second handwriting may be changed to a second color different from the first color among the predetermined plurality of hues have. Specifically, when a user inputs a black color character on the touch screen 151 using the electronic pen 300 and inputs a color change command to select a red color, the user separately sets a color setting window The character input after the black character displayed on the touch screen 151 may be displayed in red without selecting the red color.
The color of the handwriting scheduled to be output when the first handwriting input is performed is input to the mobile terminal 100 before the first handwriting input is performed on the touch screen 151 of the mobile terminal 100 via the electronic pen 300 100) or a plurality of colors preset in the electronic pen 300, or a color set to a default value. At this time, the user can know the color through information provided from the electronic pen 300 or the mobile terminal 100, and a color change command can be inputted from the user when the user wants to change the color. When a first handwritten input is made by the user after the input of the color change command, the handwriting color corresponding to the handwritten color is different from the color set in any one of the predetermined plurality of colors or set to a default value . ≪ / RTI > Specifically, when a user inputs the handwriting by using the electronic pen 300, the user can know in advance a hue (hereinafter referred to as a first color) to be output to the touch screen 151, When the user inputs the color change command and inputs the handwriting in a color different from the first color (hereinafter, referred to as a second color) among a plurality of colors preset in the mobile terminal 100 or the electronic pen 300 You can change the color to be output. Thereafter, when the user inputs the handwriting, the touch screen 151 outputs the displayed handwriting color as a second color.
In the present invention, the "color setting command" refers to a command for setting a color of a handwriting to be output on the touch screen 151 in response to the handwriting input when a handwriting input is performed on the touch screen 151 from a user. The color set by the color setting command may be one or more colors, and the setting color may be added to the color setting command even if there is already a setting for one or more colors. The user or the control unit 180 can determine the number of setting colors that can be added according to the color setting command. For example, when the user or the control unit 180 determines that four colors can be preset, if the control unit 180 detects the setting for the fifth color, the setting for the first preset color is canceled .
For example, the user may set the color through the color setting window of the mobile terminal 100. For example, In this case, when the handwriting input is performed by the user, the control unit 180 determines that there is no preset for the mobile terminal 100 whether the color of handwriting output to the touch screen 151 corresponds to the handwriting input, or In the case of setting a color to be output in addition to a preset, if the color setting is input to the color setting window from the user, it can be recognized that the color setting command is inputted.
Another example of the color setting command is a case where the color of a specific object is sensed from the sensing unit 310 of the electronic pen 300. [ For example, the control unit 340 of the electronic pen 300 may display not only the color of a specific object displayed on the touch screen 151 of the mobile terminal 100 but also other devices such as a monitor and a TV through the sensing unit 310 You can sense the color of all objects, such as color, color displayed on paper in addition to electronic devices. In this way, when the controller 180 detects the color sensing of the sensing unit 310, it can recognize that the color setting command is input. Alternatively, if a predetermined type of input is detected from the user through the user input unit 350 after the color sensing of the sensing unit 310 is detected, the controller 180 can be regarded as a color setting command. The predetermined type of input may be a method in which the user presses a button that is the user input unit 350. [ However, the preset method may be different from the input method for the color change command. For example, when the user input unit 350 is provided in the form of a button, the control unit 340 of the electronic pen 300 recognizes the button as a color change instruction when the button is pressed for a predetermined time or less, If the button is pressed beyond a predetermined time, it can be detected by the color setting command. A detailed description of the color setting command through the sensing unit 310 of the electronic pen 300 will be described with reference to FIG. 9, Will be described later.
The term "color of the electronic pen 300" in the present invention means the color of the electronic pen 300 when the handwriting through the electronic pen 300 is input to the mobile terminal 100 capable of recognizing the input of the electronic pen 300, Quot; refers to the color of the handwriting that can be obtained. The color of the electronic pen 300 may be set in the electronic pen 300 by the color setting command. Accordingly, the color set to the color of the electronic pen 300 may be a plurality of colors. When a plurality of hues are set to the colors of the electronic pen 300, the second display unit 373 of the electronic pen 300 may display the plurality of hues set by the area. Therefore, the color of the electronic pen 300 may be added or changed. When the color setting command is inputted through the electronic pen, the color of the electronic pen 300 is accumulated in the order of input. The color of the electronic pen 300 is set to be accumulated, which means that the old color is the color of the latter order among the colors of the electronic pen 300, and the color of the electronic pen 300 is the color of the priority order. The description of the priority among these colors will be described in detail with reference to FIG. 7 (b). When the controller 180 detects a color setting command for a new color, the controller 180 can control the setting of the oldest preset color to be released.
The present color of the electronic pen 300 in the present invention means that when a plurality of colors are set in the electronic pen 300, a new color setting command or a new color change command is not input from the user, Refers to the color of the handwriting displayed through the touch screen 151 when handwriting is input to the touch screen. In addition, since the color change command can be inputted through the electronic pen 300, the current color of the electronic pen 300 can be changed. The current color of the electronic pen 300 can be confirmed through the colors displayed on the first display portions 371 and 372 of the electronic pen 300 among the plurality of colors. In addition, the current color of the electronic pen 300 may be the first color displayed among the plurality of colors listed in the second display portion 373 of the electronic pen 300. That is, when a specific color is displayed on the first display units 371 and 372 or the first display is displayed among the plurality of colors displayed on the second display unit 373, The control unit 180 may control the touch screen 151 to display the handwriting in the specific color. However, in order to check the current color of the electronic pen 300, not all of the first display portions 371 and 372 necessarily display the current color of the electronic pen 300. Also, the second display unit 373 does not necessarily display all the colors set on the electronic pen 300, and can display only the current color of the electronic pen 300. [ Furthermore, the current color of the electronic pen 300 may not be displayed in some cases.
Specifically, the control unit 180 of the mobile terminal 100 can determine whether the first display units 371 and 372 and the second display unit 373 are displayed in color, in consideration of the power source of the electronic pen 300 and the surrounding environment. For example, when the remaining power of the electronic pen 300 falls within a predetermined range, or when the control unit 180 of the mobile terminal 100 detects the ambient illuminance detected through the sensing unit 310 of the electronic pen 300 It is possible to control the color of the first display unit 371 and the second display unit 373 to be displayed. In the case of the second display unit 373, only the current color among the plurality of colors set in the electronic pen 300 can be controlled to be displayed.
In some cases, the first display portions 371 and 372 and the second display portion 373 may not display the color of the electronic pen 300 when the remaining power is very small. In this case, the control unit 180 displays the current color information of the electronic pen 300 in a specific area of the touch screen 151, so that the user can know the current color of the electronic pen 300 and use it.
Whether or not the display unit 370 (the first display units 371 and 372 and the second display unit 373) of the electronic pen 300 displays colors may be determined by user setting.
The control unit 180 of the mobile terminal 100 or the control unit 340 of the electronic pen 300 can control the color of the electronic pen 300, A color change command or a color setting command. That is, the display unit 370 (the first display units 371 and 372 and the second display unit 373) of the electronic pen 300 displays the current color of the electronic pen 300 and the current color as a color change command, It does not perform the operation of setting the color, but the color set to confirm the change through the command. When the controller 340 of the electronic pen 300 detects a color change command even if the power of the electronic pen 300 is insufficient and the color of the electronic pen 300 is not displayed on the display unit 350, can be changed.
FIG. 6A is a flowchart of a mobile terminal for detecting a color change command according to an exemplary embodiment of the present invention, FIG. 7 is a view for explaining a color setting command sensed by a mobile terminal, FIG. And Fig. FIG. 11A is an exemplary diagram illustrating a procedure of displaying a color on the second display unit of the electronic pen according to the color change command.
7A, 7B and 7C illustrate a process of setting colors of the electronic pen 300 displayed on the touch screen 151 of the mobile terminal 100 according to the present invention. Fig. The color of the electronic pen 300 may be set at least before the start of handwriting or during handwriting, and here, the case of presetting the color before handwriting is described first. If the color of the electronic pen 300 is preset, the control unit 180 controls the touch screen 151 so that the handwriting is output in a predetermined color on the touch screen 151 do. 7A is an example of an environment setting screen of the mobile terminal 100 in which the color of the electronic pen 300 can be selected. 7A, the mobile terminal 100 according to the present invention recognizes handwriting input through the electronic pen 300 and outputs it through the touch screen 151. In the configuration window, the electronic pen 300 (Item 700). ≪ / RTI > Although the color selection item 700 is shown as an example of the item in FIG. 7A, the item may include not only a color selection but also various types of lines for providing line type, thickness, And may include a sub-item for selecting a writing tool. When the touch input or the input of the electronic pen 300 is detected in the color selection item 700, the control unit 180 determines whether the color setting window 705 of the electronic pen 300 shown in FIG. (151). The color setting window 705 is hereinafter referred to as a first color setting window to distinguish it from the color setting window in FIG. 10 (a). Referring to FIG. 7 (b), the user can select a plurality of colors as preset colors through the first color setting window. That is, when the user selects the dictionary color setting through the first color setting window, the controller 180 can recognize the dictionary color setting command. In this case, in order to use the electronic pen 300 simply, the color of the electronic pen 300 may be set to one color. For example, when the color of the electronic pen 300 is set for only one color, when the user does not perform any other operation, when the handwriting is input via the electronic pen 300, Can be displayed. In order not to obscure the gist of the invention, the description of the present specification will explain a case where there are at least two color settings.
The user can select a plurality of colors through the first color setting window. Whenever one color is selected from the user, the controller 180 visually selects the selected color and the unselected color through the touch screen 151 It is possible to control so that a check box in which whether or not each color is selected can be displayed so as to be distinguishable, and it is possible to control so that the setting order is sequentially displayed according to the selection order of each color.
For example, as shown in FIG. 7 (b), when the color Yellow 710 is selected by the touch input from the user in the color setting window displayed on the touch screen 151 and Red 720 is selected, The pen 300 is set to the yellow color, and then the red color is set. In addition, when Black (730) and Green (740) are selected, the previously set yellow color, red color followed by black color and green color are additionally set in order. At this time, the color setting order is displayed in the first color setting window on the touch screen 151 in a set order of yellow 1, red 2, black 3, and green 4. The control unit 180 may recognize that an input for selecting the color of the electronic pen 300 in the first color setting window through the touch screen 151 is input as a color setting command . Since the touch screen 151 can sense the input of the electronic pen 300, the control unit 180 determines that the touch input for the color setting is input through the electronic pen 300 to the first color Even if it is done in the setting window, it can be recognized that the color setting command is inputted.
A plurality of colors displayed on the second display portion 373 of the electronic pen 300 may be displayed on the head portion of the electronic pen 300 501) to the body part (520).
7 (c), when the yellow color 710, the red color 720, the black color 730, and the green color 740 are sequentially set in the first color setting window, The red color 720, the black color 730, and the green color 740 are sequentially displayed on the respective regions of the second display portion 373 of the electronic pen 300 . The control unit 180 controls the wireless communication unit 110 to transmit information on the setting of the first color setting window to the wireless communication unit 320 of the electronic pen 300, (340). The control unit 340 of the electronic pen 300 can control the display unit 370 according to the information under the control of the control unit 180 of the mobile terminal 100. [ The control unit 340 of the electronic pen 300 controls the first display unit 371 and the second display unit 372 of the display unit 370 to display the hue of the electronic pen 300 in the set hue. For example, if a separate color change command is not input, the first color (710) of the set colors may be displayed on the first display units 371 and 372. Also, under the control of the control unit 180, the control unit 340 controls the second display unit 373 to display the colors in the set order. 7C, the colors of the yellow penis 710, the red pen 720, and the black pen 720 are arranged in the order of the colors from the head part 510 of the electronic pen 300 toward the body part 520 730) and the green color (740) are displayed on the second display portion (373).
On the other hand, since the user can display the current color of the electronic pen 300 in the first display unit, the second display unit can be configured to display only the other colors. In other words, for example, when the yellow color 710 is displayed on the first display units 371 and 372, the second display unit 373 displays the red color 720, the black color 730, and the green color 740 Can be displayed.
A description will be given of a case where handwriting input using the electronic pen 300 is performed on the touch screen 151 after the color of the electronic pen 300 is set as described above with reference to FIG.
The first handwriting through the electronic pen 300 is input on the touch screen 151 after a plurality of colors are set on the electronic pen 300 as in the process of setting the colors of the electronic pen 300 of FIG. The control unit 180 detects the first handwriting input and controls the first handwriting so that the first handwriting is output as the currently set hue of the electronic pen 300 among the hues of the set electronic pen 300 S610). Referring to FIG. 8A, a curved first handwriting input is performed through the electronic pen 300 on the touch screen 151. FIG. The curved first handwriting color 800 (hereinafter referred to as a first color) output to the touch screen 151 corresponding to the curved handwriting input is the current color of the electronic pen 300. Whether the current color of the electronic pen 300 is the first color 800 or not may be determined based on the colors displayed on the first display portions 371 and 372 or the second display portion 373 . When four colors are set as the hue of the electronic pen 300, colors can be displayed in the order set in the areas ①, ②, ③, ④ of the second display unit 373 as shown in the figure. The area where the color of the electronic pen 300 is displayed is not limited to four areas as shown in FIG. Next, when the curved first handwriting is displayed on the touch screen 151 as the first color 800, when the user inputs a color change command from the user, the controller 180 can sense the command (S620 ). When the user input unit 350 of the electronic pen 300 is provided as a button on one end of the electronic pen 300, the control unit 180 can detect the color change command each time the user presses the button (S620).
The control unit 180 controls the current color of the electronic pen 300 to change every time the color change command is detected. 8 (a), when the first handwriting is displayed on the touch screen with the first hue, the control unit 180 determines the current color change of the electronic pen 300 when the controller 180 detects the color change command Will be described with reference to Fig. 8 (b). When the control unit 180 detects the color change command, the controller 180 determines whether the current color of the electronic pen 300 is the first color among the colors set in the electronic pen 300 in the first color 800, To be changed to the next color. When the user presses the button of the electronic pen 300 once, the color change command recognized from the control unit 340 of the electronic pen 300 is transmitted to the control unit 180 through the wireless communication unit 110 of the mobile terminal 100 . At this time, the control unit 180 may control the first display units 371 and 372 of the electronic pen 300 to display the current color of the changed electronic pen 300. In addition, the control unit 180 can control the current color of the changed electronic pen 300 to be displayed in the area (1) of the second display unit 373. In this case, the controller 180 can control the color 800 before the color change command is input to be displayed in the area 4 of the second display unit 373. [ That is, when the color change command is sensed, the controller 180 controls the color displayed in the region ① of the second display unit 373 before the color change command is input to be displayed in the region ①, Controls that the previously displayed color is displayed in the area ④. Also, the controller 180 controls the colors displayed in the areas 3 and 4 before the color change command to be displayed in the areas 2 and 3, respectively.
For example, the yellow color 710, the red color 720, the black color 730, and the green color 740 are sequentially displayed in the first color setting window as shown in FIG. 7 (b) The control unit 180 displays the yellow color 710, the red color 720, and the black color 730 in the respective regions of the second display unit 373 of the electronic pen 300 as shown in FIG. 7 (c) ), And the green color (740) are sequentially displayed. Referring to FIG. 11A, the second display unit 373 according to the above setting is shown in FIG. 11A. When the user presses the button of the electronic pen 300 once, the controller 180 sets the set color to red (720), black (730), and green (740) as shown in (b) And the yellow color 710 are sequentially displayed on the second display portion 373. When the user again presses the button of the electronic pen 300 with the second display portion 373 in the state of (b) of Fig. 11A, the control portion 180 determines whether the color of the second display portion 373 is c), and the user can control the second display unit 373 to display the hue of the second display unit 373 as shown in (d) of FIG. 11 by pressing the button again. However, the controller 180 may control the second display unit 373 to display only the current color of the electronic pen 300 according to the remaining power capacity of the electronic pen 300 or the user setting. That is, the controller 180 may control the display of the color only in the region 1 & cir & of the second display portion 373 of the electronic pen 300 of FIG. For example, if the current color of the electronic pen 300 displayed in the area ① of the second display unit 373 is yellow 710, if the user presses the button of the electronic pen 300, (720). ≪ / RTI >
When the control unit 180 detects the color change instruction and the current color of the electronic pen 300 is changed and the second handwritten through the electronic pen 300 is input on the touch screen 151, And controls the second handwriting to be output as the currently set color of the changed electronic pen 300 among the hues of the set electronic pen 300 in response to the second handwriting input. 8 (b), when the user inputs a second handwriting of a straight line type under a curved first handwriting indicated by a first color on the touch screen 151, the second handwriting is input to the electronic pen 300 The second color 810, which is the current color of the second color 810.
If the control unit 180 does not detect the input of the color change command, the controller 180 notifies the touch screen 151 of the additional color change command via the electronic pen 300, The additional handwriting is controlled to be displayed in the same color as the hue 800.
FIG. 6B is a flowchart of a mobile terminal that detects a color setting command according to an exemplary embodiment of the present invention. FIG. 9 is a diagram illustrating a method of setting a color through an electronic pen according to an exemplary embodiment of the present invention. 10 is an exemplary diagram for explaining a method of setting a color in a specific app according to an embodiment of the present invention. FIG. 11B is an exemplary diagram for explaining how the order in which the colors are displayed on the display unit of the electronic pen is changed by the color setting command.
When the yellow color 710, the red color 720, the black color 730, and the green color 740 are sequentially set to the color of the electronic pen 300 in the first color setting window as shown in FIG. 7 (b) , The control unit 180 determines which color of the set color to output the handwriting on the touch screen 151 in response to the handwriting input. As described above, the controller 180 can set a plurality of colors to the colors of the electronic pen 300 in the set order. The control unit 180 may assign a priority order among the colors of the electronic pen 300 according to the set order and may determine the color of the highest priority as the current color of the electronic pen 300. [ That is, the color having the highest priority in the above example is the yellow color 710. Although only the case where the color setting command is inputted through the first color setting window as shown in FIG. 7 (b) is described in the above example, the color setting of the electronic pen 300 may be performed in a different manner, The controller 180 can recognize that the color setting command is input. The control unit 180 can determine the priority among the colors to be set even if the color setting is performed in a manner different from that shown in FIG. 7 (b). Particularly, even when the color is additionally set according to the second scheme in the state where the color setting according to the first scheme exists, the priority among the colors set in different schemes can be determined, The current color of the pen 300 can be determined. Hereinafter, a method of setting the color of the electronic pen 300 in a manner other than the method of setting the color of the electronic pen 300 through the first color setting window will be described with reference to FIGS. 9 and 10. FIG.
6A and FIG. 9. 9A, a setting window for various settings for the electronic pen 300 such as color and pen type of the electronic pen 300 is displayed on the touch screen 151. In FIG. The color of the electronic pen 300 may be set to one or more colors of various colors displayed on the touch screen 151 through the electronic pen 300. [ 9A is an illustration for explaining a case where the set color is the color of the object displayed on the touch screen 151. The color set to the color of the electronic pen 300 described in this embodiment is a touch screen 151). ≪ / RTI > If the user sets a specific color to the color of the electronic pen 300 through the electronic pen 300, the control unit 180 can recognize that the first color setting command is input (S640).
9A, when the pen point portion of the electronic pen 300 touches a specific hue 910 displayed on the touch screen 151, the control unit 180 recognizes the hue displayed on the contacted portion The color of the electronic pen 300 can be set. The control unit 180 recognizes a color setting command for a color displayed on the touch screen in contact with the electronic pen 300 and transmits the color setting command to the electronic pen 300 through the wireless communication unit 110, ) Color is the same as the case where the color setting command is input to the mobile terminal 100 through the color setting window described above, the following description will be made of a case in which the color setting command is input in a different manner .
The electronic pen 300 includes a pen tip portion at one end of the head portion 510, and the sensing portion 310 may be positioned inside the pen tip portion. The sensing unit 310 may include an optical sensor, which may sense a color 910 of an object in contact or proximity to the sensor. The optical sensor may be a scan sensor for scanning a contact or proximity object. When the sensing unit 310 of the electronic pen 300 senses the color 910 through the optical sensor, the control unit 180 recognizes the color as a color setting command for the color 910. That is, when the color of the electronic pen 300 is sensed, the control unit 180 of the mobile terminal 100 can recognize that the color setting command of the electronic pen 300 is inputted. The control unit 180 sets the color to the color of the electronic pen 300 and controls the first and second display units 371 and 372 and the second display unit 373 of the electronic pen 300 to display the set color can do. In addition, if the controller 180 recognizes the color setting command, the controller 180 sets the color 910 as a priority (S650). Accordingly, even if there is already preset a different color for the color of the electronic pen 300, if the first color command for the color 910 is sensed, (300).
In Fig. 9 (a), an area on the second display portion 373 of the electronic pen 300 is listed from region (1) to region (4). And the hue of the electronic pen 300 may be displayed in each area. If the control unit 180 recognizes the above-described color setting command, the color of the electronic pen 300 displayed in the area 1, area 2, and area 3 before the control unit 180 recognizes the color setting command is the area 2 , The area ③, the area ④, and the color 910 is displayed in the area ①. On the other hand, when the second display unit 373 has an area in the back of the area 4 (in the direction of the button 350), the color displayed in the area 4 before the control unit 180 recognizes the color setting command Can be displayed. If the second display unit 373 does not have the additional area, the color displayed in the area ④ before the color setting command is recognized by the controller 180 is not displayed, and the controller 180 displays the information about the non- The memory 330 of the electronic pen 300 can be controlled. As a result, the control unit 180 controls the color unit 910 to display the color 910 as the current color of the electronic pen 300 by the color setting command, so that the same function as the color change command is performed by the color setting command . If the control unit 180 recognizes the first color setting command, the color 910 is set to the current color of the electronic pen 300, even if the color of the electronic pen 300 is not set to any other color.
The sensing for the hue 910 may be performed through various input operations. That is, the electronic pen 300 includes a button used for inputting a user's color change command to the user input unit 350, an input for performing sensing of the color 910 by the sensing unit 310 of the electronic pen 300 When the user presses the separate button, the sensing unit 310 of the electronic pen 300 senses the color 910, and when the color 910 senses the color 910, The control unit 180 recognizes the color as a color setting command and sets the color 910 to the current color of the electronic pen 300. When the button used for inputting the color change command is pressed for more than a predetermined time, the sensing unit 310 of the electronic pen 300 detects the color 910, And when the color 910 is sensed, the control unit 180 can recognize the color as a color setting command. In this case, if the pen tip portion of the electronic pen 300 touches a specific object while the button is pressed for a predetermined time or longer, the control unit 180 determines that the sensing unit 310 of the electronic pen 300 It is possible to control the color to be sensed. The controller 180 recognizes the pen tip portion of the electronic pen 300 as a color setting command for the electronic pen 300 when the pen tip portion of the electronic pen 300 touches a specific object for a predetermined time or more have.
Referring to FIG. 9B, the left side of FIG. 9B shows a state where the second display unit 373 displays an existing set color before the first color setting command is inputted to the electronic pen 300 And an electronic pen 300 according to an embodiment of the present invention. The second display portion 373 displays the color 1 (901), the color 2 (903), and the color 3 (903) set to the color of the electronic pen 300. The colors are different colors, and color 1 (901), color 2 (903), and color 3 (905) have priority in order of colors of the electronic pen 300. 9 (a), when the controller 180 detects a first color setting command for the hue 910, the controller 180 controls the head unit 510 of the electronic pen 300 520 direction (920) so that the display area of the hue displayed on the second display unit 373 of the electronic pen 300 is displayed differently. That is, when a new setting for the hue 910 is input to the electronic pen 300, the hue 910 becomes the current hue of the electronic pen 300, And the existing setting colors are displayed by moving backward (in the direction of the button 350) by one space in the area of the second display unit 373 which has been displayed.
9B shows a state in which the second display unit 373 displays the newly set color 910 before the existing set color after the first color setting command is inputted to the electronic pen 300 Fig. 2 is a view showing an electronic pen 300 according to the present invention. The second display unit 373 displays the color 1 (901), the color 2 (903), and the color 3 (903) after the color 910 set to the color of the electronic pen 300. The color 910 has the highest priority before the color 1 (901), the color 2 (903), and the color 3 (903) in the color of the electronic pen 300.
10A is an exemplary diagram illustrating a method of setting a color of the electronic pen 300 in a specific application or an Internet window in addition to the first color setting window of the mobile terminal 100. [ The specific application or the Internet window is a program or a web page that provides a handwriting environment using the electronic pen 300 on the touch screen 151. The program or the web page itself includes various settings for the electronic pen 300 Can be provided. The control unit 180 may control the second color setting window provided by the program or the web page to be displayed through the touch screen 151. [ The second color setting window means a setting window except for a setting window provided as a basic menu of the mobile terminal, such as the first color setting window 705 of FIG. The color setting method of FIG. 10 (a) may be the method described in FIG. 7 (b) or the method described in FIG. 7B, the user can set the color of the electronic pen 300 in the first color setting window using the electronic pen 300 instead of the touch input, Recognizes a color setting command for the color 1010 displayed on the touch screen touching the pen 300 and transmits the color setting command to the electronic pen 300 through the wireless communication unit 110, (1010). When the user sets the color 1010 to the color of the electronic pen 300 through the electronic pen 300, the control unit 180 may recognize that the first color setting command is input (S640).
9, when the sensing unit 310 of the electronic pen 300 senses the color 1010 through the optical sensor or the scan sensor, the control unit 180 transmits the color 1010 to the color sensor 1010, As a color setting command. That is, when the color of the electronic pen 300 is sensed, the control unit 180 of the mobile terminal 100 recognizes that the first color setting command is inputted to the electronic pen 300 (S640). The control unit 180 sets the color to the color of the electronic pen 300 and controls the first and second display units 371 and 372 and the second display unit 373 of the electronic pen 300 to display the set color can do. In addition, if the controller 180 recognizes the color setting command, the controller 180 sets the color 1010 as a priority (S650). When the control unit 180 recognizes the above-described color setting command, the color of the electronic pen 300 displayed in the areas?,?, And? Before the color setting command is recognized is? (3) and (4), and the color (1010) is displayed in the area (1). On the other hand, when the second display unit 373 has an area in the back of the area 4 (in the direction of the button 350), the color displayed in the area 4 before the control unit 180 recognizes the color setting command Can be displayed. If the second display unit 373 does not have the additional area, the color displayed in the area ④ before the color setting command is recognized by the controller 180 is not displayed, and the controller 180 displays the information about the non- The memory 330 of the electronic pen 300 can be controlled. As a result, the controller 180 controls the coloring unit 1010 to display the color 1010 as the current color of the electronic pen 300 by the color setting command, so that the same function as the color changing command is performed by the color setting command . Therefore, even if there is already preset a different color for the color of the electronic pen 300, if the first color command for the color 1010 is sensed, (300). If the control unit 180 recognizes the first color setting command, the color 1010 is set to the current color of the electronic pen 300, even though the color of the electronic pen 300 is not set to any other color.
10B, the left diagram of FIG. 10B shows a state where the second display unit 373 displays an existing set color before the first color setting command is inputted to the electronic pen 300 And an electronic pen 300 according to an embodiment of the present invention. The second display portion 373 displays the color 1 (910) and the color 2 (1003) set to the color of the electronic pen 300. The colors are different colors, and the color 1 (910) and the color 2 (1003) have priority in order of colors of the electronic pen 300. The color 1 910 is a color set to the current color of the electronic pen 300 by the color setting method of FIG. 9 (a) before the color setting method of FIG. 10 (a). 10 (a), when the controller 180 detects a first color setting command for the hue 1010, the controller 180 controls the second display unit 373 of the electronic pen 300 So that the displayed colors are displayed in different display regions. That is, when a new setting for the hue 910 is input to the electronic pen 300, the hue 910 becomes the current hue of the electronic pen 300, And the existing set colors are displayed by moving backward (in the direction of the body part 520 from the head part 510) one by one in the area of the second display part 373 which has been displayed.
10 (b), the second display unit 373 displays the newly set color 910 before the existing set color after the first color setting command is inputted to the electronic pen 300 Fig. 2 is a view showing an electronic pen 300 according to the present invention. The second display unit 373 displays the color 1 (910) and the color 2 (1003) after the color 1010 set to the color of the electronic pen 300. The color 1010 has the highest priority before the color 1 (910) and the color 2 (1003) in the color of the electronic pen 300. On the other hand, in the description of FIG. 10, if a program providing a handwriting environment using the electronic pen 300 on the touch screen 151 or a specific application such as a web page or an Internet window is terminated, It is possible to control the color setting of the electronic pen 300 through the window to be released.
In the description of FIG. 10, the set color 1010 of FIG. 10 has a priority over the color 910 of the electronic pen 300 set by the color setting method described with reference to FIG. 9, It is also possible to set the current color of the electronic pen 300 such that the opposite case 910 has priority over the color 1010 according to the user setting.
Although the color setting of the electronic pen 300 by the color setting command described above in FIGS. 9 and 10 is independent of the color setting of the electronic pen 300 of FIG. 7, in the description of FIG. 7, The color of the electronic pen 300 according to the color setting method of FIGS. 9 and 10 may be set before or after the setting through the first color setting window of the electronic pen 300 according to the color setting method described with reference to FIG. And the color of the second color is higher than that of the second color. In the case of the color setting method of Figs. 9 and 10, each method has a priority order of the latest setting colors. For example, when the color of the electronic pen 300 is set to yellow according to the method of FIG. 9 and then a red color is set, the control unit 180 sets the red color to the current color of the electronic pen 300 It is decided by color. However, in the case of the method of FIG. 7, the color set in advance becomes the color of the electronic pen 300. For example, in a state where the color of the electronic pen 300 is set to yellow (710) by the method of FIG. 7 (setting through the first color setting window), the color of the electronic pen 300 When the color 910 is set, the color of the electronic pen 300 follows the order of the color 910 and the yellow color 710 in FIG. 9 according to the priority. When the control unit 180 detects that the red color 720 is set to the color of the electronic pen 300 again in the manner of FIG. 7, the color of the electronic pen 300 is changed to the color 910), yellow color (710), and red color (720). That is, the colors of the electronic pen 300 are given priority in the set order among the set colors according to the method of FIG.
Referring again to FIG. 6B, as described above with reference to FIGS. 9 and 10, the controller 180 detects the first color setting command, sets the color to a priority order, and then determines whether a second color setting command is detected (S660). The second color setting command is a command for setting a color different from the first color to the current color of the electronic pen 300 in the same process as the first color setting command. Accordingly, when the controller 180 detects the second color setting command, the second color is set to the highest color among the colors set in the electronic pen 300 (S650). In this case, when the handwriting is inputted to the touch screen 151 through the electronic pen 300, the control unit 180 controls the handwriting to be displayed in the second color on the touch screen 151 (S670 ). On the other hand, if the controller 180 does not detect the second color setting, the state in which the first color set by the first color setting command is set to the color of the highest priority is maintained. When a handwriting is input to the touch screen 151 through the electronic pen 300, the control unit 180 controls the handwriting to be displayed in the first color on the touch screen 151 in operation S670.
Referring to FIG. 11B, when the color of the electronic pen 300 is set through the first color setting window in FIG. 7, the color display of the second display portion 373 of the electronic pen 300 is shown in FIG. Respectively. A yellow color 710, a red color 720, a black color 730, and a green color 740 are sequentially displayed on the second display portion 373 in (a) of FIG. 11B. When the user senses a specific color 910 displayed on the touch screen 151 through the electronic pen 300 as shown in FIG. 9A, the control unit 180 recognizes the specific color 910 as a color setting command , And sets the color (910) to the current color of the electronic pen (300). Accordingly, the control unit 180 controls the second display unit 373 in the order of the hue 910, the yellow color 710, the red color 720, and the black color 730 as shown in FIG. 11B (b) So that the display can be controlled. 11A, when the user senses a specific color 1010 displayed on the second color setting window on the touch screen 151 through the electronic pen 300 as shown in FIG. 10A, The control unit 180 recognizes the color as a color setting command and sets the color 1010 to the current color of the electronic pen 300. [ Accordingly, the controller 180 controls the second display unit 373 in the order of the color 1010, the yellow color 710, the red color 720, and the black color 730 as shown in FIG. 11B (c) So that the display can be controlled.
On the other hand, when the second display unit 373 is in a state as shown in Fig. 11B (b), when the user presses a second button (not shown) on the touch screen 151 When the specific color 1010 displayed in the color setting window is sensed, the control unit 180 recognizes the specific color 1010 as a color setting command and sets the color 1010 as the current color of the electronic pen 300. 11 (d), the controller 180 determines that the color 1010 sensed in FIG. 10 (a) is higher than the color 910 sensed in FIG. 9 (a) (373). However, the controller 180 may control the second display unit 373 to display only the current color of the electronic pen 300 according to the remaining power capacity of the electronic pen 300 or the user setting. That is, the controller 180 can control the display of colors only in the region < 1 > of the second display portion 373 of the electronic pen 300 of Fig. For example, if the current color of the electronic pen 300 displayed in the area ① of the second display unit 373 is yellow 710, if the user senses a specific color through the electronic pen 300, And is displayed in the specific color.
FIG. 12 is an exemplary view for explaining an image scanning method using an electronic pen according to an embodiment of the present invention, FIG. 13 is a view for explaining a method of using a scanned image in a mobile terminal according to an embodiment of the present invention, . In the present embodiment, the color display unit 373 may include an image display device such as a display unit 370 of the electronic pen 300 to display an image in addition to colors.
Referring to FIG. 12A, the controller 180 may control the touch screen 151 to display a specific image 1200. The specific image 1200 may be created by the user through the electronic pen 300 or may be an image stored in the memory 160 or an image transmitted from the outside to the mobile terminal 100 via the wireless communication unit 110 . When the sensing unit 310 of the electronic pen 300 comes into contact with or approaches the ecology in which the image 1200 is displayed on the touch screen 151, the control unit 180 displays the image 1200 through the electronic pen 300 You can sense the selected one. At this time, when the contact or proximity time lasts for a predetermined time or more, or when the control unit 180 detects that the image 1200 is selected by the electronic pen 300 simultaneously with the operation of the user input unit 350 , And controls the image (1200) to be scanned through the scan sensor of the sensing unit (310). The second display portion 373 of the electronic pen 300 may include regions (1) through (4) for displaying the color of the electronic pen 300, and may display a color or a scanned image set before the scanning. When the image 1200 is scanned through the electronic pen 300 as described above, the controller 180 can control the image 1200 to be displayed in the area of the second display unit 373. [ In particular, the controller 180 may control the second display unit 373 to display the image 1200 in a thumbnail format, and the controller 180 may display the scanned image 1200 in a thumbnail format on the second display unit 373 in the region < RTI ID = 0.0 > 1, < / RTI > If there is a color or a scanned image set before the scanning, the controller 180 controls the image 1200 to be displayed in a thumbnail format in the region 1, and the previously set color or scanning image is transmitted to the head 510 ) To the body part 520 direction (1210) by one space.
For example, referring to FIG. 12 (b), the left side of FIG. 12 (b) shows the yellow color 710 and the red color 720 of the preset electronic pen 300 as the colors of the second display portion 373 ). When the user scans the image 1200 as shown in FIG. 12 (a), the controller 180 displays a thumbnail image of the image 1200 on the second display unit as shown in the right side of FIG. 12 (b) 1220 may be displayed.
12B, the controller 180 can control the thumbnail image 1220 to be displayed in the region 1, and further, to the region 1 and region 2 before the scanning, The displayed yellow color 710 and red color 720 can be controlled to be displayed in the area 2 and the area 3, respectively.
13, (a) shows the image 1200 using the electronic pen 300 after the image 1200 is scanned through the electronic pen 300 in the description of FIG. 12, Will be described. The control unit 180 can control the second display unit 373 to display the thumbnail image 1220 when the electronic pen 300 scans the image 1200. Accordingly, The user can confirm the image to be input through the thumbnail image 1220 shown in FIG. The control unit 180 may control the touch screen 151 to display the execution screen of the application when the user inputs an activation of the application capable of inputting the image 1200. [ When the user touches or brings the sensing unit 310 of the electronic pen 300 into contact with or approaches the touch screen 151 as shown in FIG. 13 (a) The control unit 150 may sense the contact or the proximity to control the paste operation of the image 1200 to be performed on the touch screen 151. The pasting operation is an operation for allowing the image 1200 to be input to the application. In the case where a separate input such as handwriting, color, or the like can be input to the execution screen of the application through the electronic pen 300, the control unit 180 controls the touch or proximity It is possible to control the paste operation to be performed not only when the operation is detected but also when an operation (e.g., pressing of a button) on the user input unit 350 of the electronic pen 300 is simultaneously detected. In this case, if only the contact or proximity action is detected, the control unit 180 can recognize it as a separate input instead of the pasting. Referring to FIG. 13 (b), the controller 180 may control the image 1200 to be displayed on the touch screen 151 in response to the paste input. The control unit 180 may control the image 1200 to be displayed on the touch screen 151 when the contact or proximity of the electronic pen 300 is released on the touch screen 151. [ In addition, the controller 180 may control the image 1200 to be displayed on the touch screen 151 when the contact or proximity state is maintained for a predetermined time or longer. When the user input unit 350 of the electronic pen 300 is provided in the form of a button and the input of the button is released, the control unit 180 displays the image 1200 on the touch screen 151 .
The control unit 180 may control the application that can display the image 1200 to be executed when the sensing unit 310 of the electronic pen 300 touches or approaches the touch screen 151. [ For example, unlike FIG. 13A, when a home screen screen is displayed on the touch screen 151 or an app irrespective of the operation of inputting the image 1200 is being executed, The electronic pen 300 detects that the electronic pen 300 touches or approaches the touch screen 151 and activates the application for inputting the image 1200 and controls the touch screen 151 to display the execution screen of the application have.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. , And are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention may be practiced without departing from the scope of the invention disclosed herein.