KR20110095746A - Content control device and method - Google Patents

Abstract

The present invention relates to a content control apparatus and a method for synchronizing a paper book and an electronic book. To this end, the content control device according to the present invention includes a camera for photographing a paper book; A controller for receiving additional information corresponding to the photographed paper book and matching the received additional information with the photographed paper book; The display unit may display the matched additional information and the paper book.

Description

Content control device and method thereof {CONTENT CONTROL APPARATUS AND METHOD THEREOF}

The present invention relates to a content control device and a method thereof.

In general, the content control device controls various contents such as a video, a photo, and map data according to an input signal input by a user.

SUMMARY OF THE INVENTION An object of the present invention is to provide a content control apparatus and method thereof capable of synchronizing paper books and electronic books.

Another object of the present invention is to provide a content control apparatus and method for allowing a user to check additional information related to the paper book only by photographing the paper book.

According to an aspect of the present invention, there is provided a content control apparatus comprising: a camera for photographing a paper book; A controller for receiving additional information corresponding to the photographed paper book and matching the received additional information with the photographed paper book; The display unit may display the matched additional information and the paper book.

As an example related to the present invention, when the book synchronization key is selected, the controller may recognize the subject photographed by the camera as the paper book.

As an example related to the present invention, the additional information may be additional information recorded in an electronic book corresponding to the paper book.

As an example related to the present invention, the additional information may be at least one of mark, memo, music, and / or video link information recorded in the electronic book.

As an example related to the present invention, the paper book may further include a communication unit for transmitting to a server, wherein the control unit may receive additional information corresponding to the paper book from the server through the communication unit.

As an example related to the present invention, the paper book may be a specific page of the paper book, and the additional information may be additional information included in a specific page of the electronic book corresponding to the specific page.

As an example related to the present invention, the server receives a specific page of a paper book input from the communication unit, recognizes letters and / or numbers included in the received specific page, and an area in which the recognized characters exist. Is divided into a character area, the area in which the recognized number exists is divided into a number area, the number area is located at the top or bottom of the recognized character area, the number present in the number area is a single number The single number can be regarded as the page number of the paper book.

As an example related to the present invention, the server retrieves a page of an electronic book that matches the characters of the page number from previously stored electronic books, and transmits the additional information included in the found page to the controller through the communication unit. Can transmit

As an example related to the present invention, the paper book may be a table of contents page or a front page of the paper book, and the additional information may be additional information included in a body page of an electronic book corresponding to a body page of the paper book.

As an example related to the present invention, the control unit receives a specific page of the paper book, recognizes letters and / or numbers included in the received specific page, and divides an area in which the recognized characters exist into a text area. And dividing an area in which the recognized number exists into a number area, wherein the number area is located at the top or the bottom of the recognized character area, and the single number is recalled when the number in the number area is a single number. It can be regarded as a page number of a paper book.

As an example related to the present invention, the controller searches a page of an electronic book that matches the characters of the page number from previously stored electronic books, and matches the additional information included in the searched page with the photographed paper book. The matched additional information and paper book may be displayed on the display unit.

As an example related to the present invention, the control unit searches a page of an electronic book that matches the characters of the page number from previously stored electronic books, and displays the searched page and the additional information included in the searched page on the display unit. I can display it.

As an example related to the present invention, the control unit searches an electronic book corresponding to the paper book based on the contents page of the paper book and the page number of the paper book, and corresponds to the page number from the searched electronic book. A page may be searched and the searched page may be displayed on the display unit.

As an example related to the present invention, the controller recognizes characters of a table of contents page of the paper book, retrieves an electronic book matching the recognized characters from prestored electronic books, and searches the pages from the retrieved electronic books. The page corresponding to the number may be searched and the searched page may be displayed on the display unit.

As an example related to the present invention, the controller may generate a message requesting the page number when the contents page is photographed through the camera and a book synchronization key is selected, and display the generated message on the display unit. have.

As an example related to the present invention, the controller searches an electronic book corresponding to the paper book based on the front page of the paper book and the page number of the paper book, and corresponds to the page number from the searched electronic book. A page may be searched and the searched page may be displayed on the display unit.

As an example related to the present invention, the controller recognizes an image and a text of a front page of the paper book, retrieves an electronic book matching the recognized image and text from prestored electronic books, and retrieves the retrieved electronic book. A page corresponding to the page number can be retrieved from and displayed on the display unit.

As an example related to the present invention, the control unit may generate a message requesting the page number when the front page is photographed through the camera and a book synchronization key is selected, and display the generated message on the display unit. have.

As an example related to the present disclosure, the controller may display the photographed paper book in a first area of the display unit, and display a message requesting a page number of the paper book in a second area of the display unit.

According to another aspect of the present invention, there is provided a method of controlling a content, the method including: receiving a paper book photographed through a camera; Receiving additional information corresponding to the photographed paper book and matching the received additional information with the photographed paper book; The matching additional information and paper book may be displayed on a display unit.

Content control apparatus and method according to embodiments of the present invention, there is an effect that the user can confirm the additional information related to the paper book through the communication network only by photographing the paper book.

Content control apparatus and method according to embodiments of the present invention, there is an effect that the user can synchronize the paper book and the electronic book only by photographing the paper book.

Content control apparatus and method according to embodiments of the present invention, there is an effect that the user can quickly check the additional information associated with the paper book only by photographing the paper book.

Content control apparatus and method according to embodiments of the present invention, there is an effect that the user can quickly synchronize the paper book and the electronic book only by photographing the paper book.

Content control apparatus and method according to embodiments of the present invention, there is an effect that can easily and accurately search the electronic book corresponding to the paper book through the content page and page number of the paper book.

Content control apparatus and method according to embodiments of the present invention, there is an effect that can easily and accurately search the electronic book corresponding to the paper book through the front page and page number of the paper book.

1 is a block diagram illustrating a configuration of a mobile communication terminal to which a content control device according to embodiments of the present invention is applied.
2 is a diagram illustrating a proximity touch process of a mobile communication terminal.
3 is a block diagram illustrating a vehicle navigation system to which a content control device according to embodiments of the present invention is applied.
4 is a block diagram illustrating a configuration of a telematics terminal to which a content control device according to embodiments of the present invention is applied.
5 and 6 are schematic diagrams showing a schematic configuration of a video conference system (video call system) to which a content control device according to embodiments of the present invention is applied.
7 is a block diagram showing a content control device according to a first embodiment of the present invention.
8 is an exemplary diagram illustrating a process of synchronizing a paper book and an electronic book according to the first embodiment of the present invention.
9 is a flowchart illustrating a content control method according to a first embodiment of the present invention.
10 is an exemplary view showing a page of a paper book photographed according to the first embodiment of the present invention.
11 is an exemplary diagram showing additional information matched with a paper book photographed according to the first embodiment of the present invention.
12 is a flowchart illustrating a content control method according to a second embodiment of the present invention.
13 is a flowchart illustrating a content control method according to a third embodiment of the present invention.
14 is an exemplary view showing a table of contents page and a message according to a third embodiment of the present invention.
15 is an exemplary view showing a page number according to a third embodiment of the present invention.
16 is a flowchart illustrating a content control method according to a fourth embodiment of the present invention.
17 is an exemplary view showing a front page and a message according to a fourth embodiment of the present invention.
18 is an exemplary view showing a page number according to a fourth embodiment of the present invention.

Hereinafter, preferred embodiments of a content control apparatus and method capable of synchronizing a paper book and an electronic book and enabling a user to check additional information related to the paper book by simply photographing the paper book are shown in FIGS. 1 to 18. of It demonstrates with reference.

1 is a block diagram illustrating a configuration of a mobile communication terminal 100 to which a content control device according to embodiments of the present invention is applied. The mobile communication terminal (mobile phone) 100 may be implemented in various forms. For example, the mobile communication terminal 100 includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), and the like.

As shown in FIG. 1, the mobile communication terminal 100 includes a wireless communication unit 110, an A / V (Audio / Video) input unit 120, a user input unit 130, a sensing unit 140, and an output unit 150. ), A memory 160, an interface unit 170, a controller 180, a power supply unit 190, and the like. Not all components of the mobile communication terminal 100 shown in FIG. 1 are essential components, and the mobile communication terminal 100 may be implemented by more components than those shown in FIG. The mobile communication terminal 100 may also be implemented by components.

The wireless communication unit 110 includes one or more components for performing wireless communication between the mobile communication terminal 100 and a wireless communication system or wireless communication between the mobile communication terminal 100 and a network in which the mobile communication terminal 100 is located. It may include. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a pre-generated broadcast signal and / or broadcast related information and transmits the same to the mobile communication terminal 100. . The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112. The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be built in or external to the mobile communication terminal 100. Here, wireless Internet technologies include wireless LAN (WLAN), Wi-Fi, WiBro, WiMAX, World Interoperability for Microwave Access (WMAX), HSDPA (High Speed Downlink Packet Access), and the like. Can be used.

The short range communication module 114 means a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The position information module 115 is a module for checking or obtaining the position of the mobile terminal (it is possible to check the position of the vehicle when the mobile terminal is mounted on the vehicle). One example is the Global Position System (GPS) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite. As the location information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The A / V input unit 120 is for inputting an audio signal or a video signal, and the A / V input unit 120 includes a camera 121 and a microphone 122. May be included. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be configured according to the configuration of the mobile terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. In the call mode, the processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the mobile terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151, this may be referred to as a touch screen.

The sensing unit 140 may be an open / closed state of the mobile communication terminal 100, a location of the mobile communication terminal 100, a user contact presence, a bearing of the mobile communication terminal 100, an acceleration / deceleration of the mobile communication terminal 100, and the like. As described above, the current state of the mobile communication terminal 100 is sensed to generate a sensing signal for controlling the operation of the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in the form of a slide phone, whether the slide phone is opened or closed may be sensed. In addition, the sensing unit 140 is responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The interface unit 170 serves as an interface with all external devices connected to the mobile communication terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores a variety of information for authenticating the usage rights of the mobile communication terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile communication terminal 100 through a port. The interface unit 170 receives data from an external device or receives power to transmit the data to each component inside the mobile communication terminal 100 or transmit data within the mobile communication terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 includes a display unit 151, an audio output module 152, an alarm unit 153, and the like. This may be included.

The display unit 151 displays and outputs information processed by the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile communication terminal 100 is in a video call mode or a photographing mode, the mobile communication terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to an implementation form of the mobile communication terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile communication terminal 100.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 outputs the touch screen. In addition to the device can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

In addition, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch. When there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can determine which area of the display unit 151 is touched.

Hereinafter, the proximity sensor 141 of the mobile communication terminal 100 will be described with reference to FIG. 2.

2 is a diagram illustrating a proximity touch process of the mobile communication terminal 100. Proximity-touch in the present invention means that the pointer is approached a predetermined distance away from the screen without actually touching the screen.

The proximity sensor 141 may be disposed in the inner region of the mobile communication terminal 100 surrounded by the touch screen or near the touch screen. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using mechanical force by using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life and higher utilization than a contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as "Proximity Touch", and the touch The act of actually touching the pointer on the screen is called "Contact Touch". The position of the proximity touch with the pointer on the touch screen means a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

In addition, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). do. Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile communication terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile communication terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may vibrate the mobile terminal through a vibration means. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile communication terminal 100 through the vibration means in response to the key signal input. The user can recognize the occurrence of the event through the vibration as described above. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

The haptic module 154, in addition to the vibration, the pin arrangement to move vertically with respect to the contact skin surface, the blowing force or suction force of the air through the injection or inlet, the grazing to the skin surface, the contact of the electrode (eletrode), the stimulation such as electrostatic force Various tactile effects can be produced, such as the effects of the heat-absorbing effect and the effect of reproducing a sense of cold using the elements capable of absorbing heat or heat.

The haptic module 154 may not only deliver the haptic effect through direct contact, but may also be implemented to allow the user to feel the haptic effect through a muscle sense such as a finger or an arm. The haptic module 154 may be provided with two or more according to the configuration aspect of the telematics terminal. The haptic module 154 may be provided where the contact with the user is frequent in the vehicle. For example, it may be provided in a steering wheel, a shift gear lever, a seat seat, and the like.

The memory 160 may store a program for processing and controlling the controller 180 and temporarily stores input / output data (for example, map data, phonebook, message, still image, video, etc.). It can also perform a function for.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory). Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. In addition, the mobile communication terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores various information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and universal user authentication. And a module (Universal Subscriber Identity Module (USIM)). In addition, the device equipped with the identification module (hereinafter referred to as an identification device) may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile terminal 100 through a port. The interface unit 170 may receive data from an external device or receive power and transmit the data to each component inside the mobile terminal 100 or transmit data within the mobile terminal 100 to an external device.

The interface unit 170 may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input by the user from the cradle. It may be a passage through which a signal is transmitted to the mobile terminal 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile communication terminal 100. For example, the controller 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on a touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The functions of the components applied to the mobile communication terminal 100 may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. Hardware implementations include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPCs), and controllers (FPGAs). It may be implemented using at least one of controllers, micro-controllers, microprocessors, electrical units for performing functions, etc. In some cases such embodiments are implemented by the controller 180. In a software implementation, embodiments such as a procedure or function may be implemented with a separate software module that performs at least one function or operation Software code may be written in a software application written in a suitable programming language. Software code is also stored in the memory 160 and controlled. It may be executed by the unit 180.

The voice recognition module 182 recognizes the voice spoken by the user and performs a corresponding function according to the recognized voice signal.

The navigation session 300 applied to the mobile communication terminal 100 displays a driving route on map data.

On the other hand, the content control device applied to the mobile communication terminal 100 according to the embodiments of the present invention, the camera 121 for photographing the subject; When the book synchronization key is selected by the user, the photographed subject is recognized as a paper book, the recognized paper book is transmitted to the server through the communication unit 110, and an addition corresponding to the paper book is received from the server. A controller (180) for receiving information (editing information) and matching (overlapping) the received additional information with the photographed paper book; And a display (display section) 151 for displaying the matched information on the screen.

3 is a block diagram illustrating a vehicle navigation system to which a content control device according to embodiments of the present invention is applied.

As shown in Fig. 3, the vehicle navigation system includes an information providing center 30 which provides traffic information and various data (for example, programs, executable files, etc.); Telematics, which is mounted in a vehicle, receives traffic information through a long range wireless communication network 20 and / or a short range wireless communication network, and provides a road guidance service based on the GPS signal received through the satellite 10 and the traffic information. It consists of a terminal 200.

Hereinafter, the configuration of the telematics terminal 200 to which the content control device according to the embodiments of the present invention is applied will be described with reference to FIG. 4.

4 is a block diagram illustrating a configuration of a telematics terminal 200 to which a content control device according to embodiments of the present invention is applied.

As shown in FIG. 4, the telematics terminal 200 includes a control unit (for example, a central processing unit, a CPU) 212 for controlling the telematics terminal 200 as a whole, a memory 213 for storing various kinds of information, and The main board 210 includes a key controller 211 for controlling various key signals and an LCD controller 214 for controlling a liquid crystal display (LCD).

The memory 213 stores map information (map data) for displaying road guidance information on a digital map. In addition, the memory 213 stores a traffic information collection control algorithm for inputting traffic information according to a road situation in which the vehicle is currently driving, and information for controlling the algorithm.

The main board 210 is assigned with a unique device number for a code division multiple access (CDMA) module 206, which is a mobile communication terminal embedded in a vehicle, for locating a vehicle, tracking a driving route from a starting point to a destination, and the like. GPS module 207 for receiving a GPS signal or transmitting traffic information collected by a user as a GPS (Global Positioning System) signal, a CD deck (CD Deck) 208 for reproducing a signal recorded on a compact disk (CD) ), A gyro sensor 209 and the like. The CDMA module 206 and the GPS module 207 transmit / receive signals through the antennas 204 and 205.

In addition, the broadcast receiving module 222 is connected to the main board 210 and receives a broadcast signal through the antenna 223. The main board 210 includes a display unit (201) under the control of the LCD control unit 214 through the interface board 203, a front board 202 under the control of the key control unit 211, and a vehicle. The camera 227 for capturing the inside and / or the outside is connected. The display unit 201 displays various video signals and text signals, and the front board 202 is provided with buttons for inputting various key signals, and the main board 210 provides a key signal corresponding to a user-selected button. To provide. In addition, the display unit 201 includes a proximity sensor and a touch sensor (touch screen) of FIG. 2.

The front board 202 may include a menu key for directly inputting traffic information, and the menu key may be configured to be controlled by the key controller 211.

The audio board 217 is connected to the main board 210 and processes various audio signals. The audio board 217 includes a microcomputer 219 for controlling the audio board 217, a tuner 218 for receiving a radio signal, a power supply unit 216 for supplying power to the microcomputer 219, and various voices. It consists of a signal processor 215 for processing a signal.

In addition, the audio board 217 is composed of a radio antenna 220 for receiving a radio signal, and a tape deck 221 for reproducing an audio tape. The audio board 217 may further configure a voice output unit (for example, an amplifier) 226 for outputting a voice signal processed by the audio board 217.

The voice output unit (amplifier) 226 is connected to the vehicle interface 224. That is, the audio board 217 and the main board 210 are connected to the vehicle interface 224. The vehicle interface 224 may be connected to a hands-free 225a for inputting a voice signal, an airbag 225b for occupant safety, a speed sensor 225c for detecting the speed of the vehicle, and the like. The speed sensor 225c calculates a vehicle speed and provides the calculated vehicle speed information to the central processing unit 212.

The navigation session 300 applied to the telematics terminal 200 generates road guide information based on map data and vehicle current location information, and notifies the user of the generated road guide information.

The display unit 201 detects a proximity touch in the display window through a proximity sensor. For example, the display unit 201 detects the position of the proximity touch when the pointer (for example, a finger or a stylus pen) is in close proximity, and displays the position information corresponding to the detected position. Output to the control unit 212.

The voice recognition device (or voice recognition module) 301 recognizes a voice spoken by the user and performs a corresponding function according to the recognized voice signal.

The navigation session 300 applied to the telematics terminal 200 displays a driving route on map data, and a predetermined distance from a blind spot where the position of the mobile communication terminal 100 is included in the driving route. Automatically establishes a wireless network with a terminal (e.g., a vehicle navigation device) mounted on a nearby vehicle and / or a mobile communication terminal carried by a nearby pedestrian through wireless communication (e.g., a short range wireless communication network). As a result, position information of the surrounding vehicle is received from the terminal mounted on the surrounding vehicle, and position information of the surrounding pedestrian is received from the mobile communication terminal carried by the surrounding pedestrian.

On the other hand, the content control device applied to the telematics terminal 200 according to the embodiments of the present invention, the camera 227 for photographing the subject; When the book synchronization key is selected by the user, the photographed subject is recognized as a paper book, the recognized paper book is transmitted to the server through the communication unit 206, and an addition corresponding to the paper book is received from the server. A control unit 212 for receiving information (editing information) and matching the received additional information with the photographed paper book; The display unit 201 displays the matched information on the screen.

5 and 6 are schematic diagrams showing a schematic configuration of a video conference system (video call system) to which a content control device according to embodiments of the present invention is applied.

As shown in FIG. 5, the video conferencing system includes a plurality of video conferencing terminals 300 and a communication network 400 connecting the plurality of video conferencing terminals 300 in a wired / wireless communication manner.

As shown in FIG. 6, the video conference terminal 300 includes a communication unit 501, an input unit 502, a storage unit 503, a control unit 504, a display unit 505, and an audio output unit 506. It is made, including. Not all components of the video conferencing terminal 300 shown in FIG. 6 are essential components, and the video conferencing terminal 300 may be implemented by more components than those shown in FIG. The video conferencing terminal 300 may also be implemented by components.

The video conferencing terminal 300 transmits / receives video and / or audio data and control signals and the like to at least one video conferencing terminal included in the video conferencing system by a predetermined communication protocol.

The plurality of video conferencing terminals 300 included in the video conferencing system may be terminals using a homogeneous protocol or may be configured of terminals using a heterogeneous protocol.

A plurality of video conferencing terminals 300 included in the video conferencing system include recommendations of multi-party video conferencing (including H.323, etc.) of ITU Telecommunication Standardization Sector (ITU-T) and Internet Engineering Task Force (IETF). (Including Session Initiation Protocol), jointly proposed by ITU-T and IETF (including MEGACO (Media Gateway Control), H.248, etc.), or MGCP (Media Gateway Control Protocol). Regardless of the video conference is possible.

The video conferencing terminal 200 includes a video conferencing terminal, a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a notebook computer, and a WiBro. (Wibro) terminal, IPTV (Internet Protocol Television), Telematics terminal and the like.

The communication unit 501 transmits and receives audio and video data between the video conference terminal 300 and any external video conference terminal.

The communication unit 501 is a wired / wireless communication between a plurality of video conferencing terminals 300 included in a video conferencing system or wired / wireless communication between the video conferencing terminal 300 and a network in which the video conferencing terminal 300 is located. It may include one or more components to perform the.

The communication unit 501 communicates with an external terminal through the communication network 00 based on a unique IP address preset in the video conferencing terminal 300 (or randomly set).

The communication unit 501 transmits / receives a radio signal with at least one of a base station, an external terminal (including a video conference terminal, a mobile terminal, and the like) and a server on the communication network 400. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

The communication unit 501 may include a module for wireless Internet access or a module for short range communication. Here, wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi, WiBro, WiMAX, World Interoperability for Microwave Access (Wimax), HSDPA (High Speed Downlink Packet Access), and the like. In addition, as a short-range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used. .

The input unit 502 generates input data for the user to control the operation of the video conference terminal 300.

The input unit 502 receives a command or a control signal by an operation such as receiving a button operation by a user or touching / scrolling a displayed screen.

The input unit 502 may include a key pad, a dome switch, a touch pad (static pressure / capacitance), a touch screen, a jog wheel, a jog switch, a jog shuttle, and the like. Can be configured.

The input unit 502 may include at least one microphone (not shown), a camera (not shown), or the like for receiving an audio signal or a video signal. The microphone receives an external sound signal in a call mode, a recording mode, a voice recognition mode, a video conference mode, and processes the external audio signal into electrical voice data. In addition, the processed voice data may be output through the voice output unit 506 or converted into a form transmittable to an external terminal through the communication unit 501 and output. In addition, the microphone may be implemented with various noise removal algorithms for removing noise generated in the process of receiving an external sound signal.

Further, the camera processes image frames such as still images or moving images obtained by the image sensor in a video call mode, a shooting mode, a video conference mode, and the like. That is, the corresponding image data obtained by the image sensor is decoded in accordance with each standard according to a codec. The processed image frame may be displayed on the display unit 505 under the control of the controller 504. The image frame processed by the camera may be stored in the storage unit 503 or transmitted to the outside (including any video conference terminal included in the video conference system) through the communication unit 501.

The storage unit 503 may store a program for processing and controlling the control unit 504, and input / output data (for example, phone book, message, still image, video, audio data, etc.) You can also perform a function for temporary storage of.

The storage unit 503 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The storage unit 503 may include a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (eg, SD or XD memory). Etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EPEROM), programmable read-only memory (PROM), It may include at least one storage medium of a magnetic memory, a magnetic disk, and an optical disk.

The storage unit 503 stores data and programs necessary for operating the video conferencing terminal 300 and / or video conferencing system.

The storage unit 503 stores various user interfaces (UIs) and / or graphical user interfaces (GUIs).

The storage unit 503 may include video codec setting information (including video / audio / codec setting information) of a corresponding terminal, call standard setting information (H.323, SIP, MGCP, and INAP (Intelligent Network Application Protocol). , ISUP (ISUP, ISDN user part), TCAP (transmission control application part), MEGACO, H.248, V.35 / RS-449 / RS-530 configuration information, International Services Digital Network (ISDN), call preference information Network configuration information (including Network Address Translation (NAT), Domain Name Service (DNS), IP address, QoS information, streaming information, Simple Network Management Protocol (SNMP), etc.), Various management information including security setting information (including firewall setting information, etc.) is stored.

The storage unit 503 may include sharing information on at least one or more application programs included in the video conferencing terminal 300, setting menu information (or sharing information) about at least one or more files related to the application program, and Stores shared information about any file.

The storage unit 503 may store sharing information of an external terminal transmitted from any external terminal under the control of the controller 504.

The controller 504 controls the overall operation of the video conference terminal 300. For example, the controller 504 performs related control and processing for voice call, data communication, video call, video conference, and the like.

The controller 504 may include a multimedia module (not shown) for multimedia playback. The multimedia module may be implemented in the controller 504 or may be implemented separately from the controller 504.

The controller 504 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on a touch screen as text and an image, respectively.

The controller 504 generates a message for transmitting management information of a corresponding terminal to an arbitrary (or specific) video conference terminal externally connected through the communication network 400, and generates the generated management information transmission request message. Is transmitted to any external video conferencing terminal via the communication network (400).

The controller 504 may include the video among the at least one router included in the communication network 300 that connects the video conferencing terminal 300 and at least one external arbitrary (or specific) video conferencing terminal. For a router closest to the conference terminal 300 (or any router that stores management information of the at least one external video conference terminal), a message for transmitting management information of the corresponding terminal is generated, and The generated management information transmission request message is transmitted to the router closest to the video conference terminal 300.

The controller 504 controls the storage unit 503 to store management information transmitted from any external video conference terminal or management information transmitted from a router closest to the video conference terminal 300. .

The controller 504 parses management information transmitted from any external video conference terminal or management information transmitted from a router closest to the video conference terminal 300, and parses the management information. Controls the display unit 505 to display information including at least one video codec setting information, call standard setting information, network setting information, and security setting information.

The control unit 504 resets the management information displayed on the display unit 505 based on the input value input from the input unit 502 under the control of the user.

The control unit 504 stores the reset management information in the storage unit 503.

The controller 504 transmits the reset management information to the external video conferencing terminal and / or the router closest to the video conferencing terminal 300 through the communication network 400.

When the controller 504 receives a management information transmission request message of the video conference terminal 300 from any external video conference terminal, the video conference terminal 300 previously stored in the storage unit 503. Management information is transmitted to any external video conferencing terminal.

When the controller 504 receives the reset management information from any external video conference terminal, the controller 504 resets (or stores) the management information previously stored in the storage unit 503 based on the received reset management information. , Update).

When the controller 504 receives the management information transmission request message of the video conference terminal 300 from the router closest to the video conference terminal 300, the video conferencing terminal previously stored in the storage unit 303. The management information of 300 is transmitted to the router closest to the video conferencing terminal 300.

When the control unit 504 receives the reset management information from the router closest to the video conferencing terminal 300, the control unit 504 stores the management information previously stored in the storage unit 503 based on the received reset management information. Reset.

The controller 504 may process the video and / or audio information transmitted from the external terminal by a predetermined signal when the video conferencing system and at least one external terminal included in the video conferencing system are operating. 505 and / or audio output unit 506.

The controller 504 is configured to process a predetermined signal and / or audio information input through the input unit 502 when the video conferencing system and at least one external terminal included in the video conferencing system are operating. And transmit the signal-processed video and / or audio information to at least one video conferencing terminal connected to the video conferencing system via the communication network 400. In addition, the controller 504 may output the signal-processed image and / or audio information to the display unit 505 and / or the audio output unit 506.

The control unit 504 is a specific program (application, files related to the application, any file) provided in the video conferencing terminal for any (or specific) video conferencing terminal connected to the video conferencing system. Generating a message for the request for sharing information transmission, and transmitting the generated sharing information transmission request message (or a setting menu information transmission request message) to the arbitrary video conference terminal through the communication network 400.

The controller 504 outputs, through the display unit 505 and / or the voice output unit 506, the sharing information transmitted from the video conference terminal in response to the sharing information transmission request message. The shared information is reset based on an input value input from the user through 502 and stored in the storage unit 503.

The control unit 504 transmits the reset sharing information to the arbitrary video conferencing terminal.

When the control unit 504 receives a transmission request message for the shared information previously stored in the storage unit 503 from any (or specific) video conference terminal connected to the video conference system, the storage unit 503 Share information previously stored in the < RTI ID = 0.0 >

The controller 504 receives the reset sharing information from the arbitrary video conferencing terminal and stores the received reset sharing information in the storage unit 503. In this case, the storage unit 503 may update previously stored sharing information with the received reset shared information, or may store the received reset shared information separately from the previously stored sharing information.

The controller 504 executes a specific application program or file included in the video conferencing terminal 300 based on the received reset information, and displays the display unit 505 and / or the audio output unit 506. You can also control the output via). Here, the control unit 504 executes a specific application program or file included in the video conferencing terminal 300 on the basis of the shared information previously stored in the storage unit 503, and thus the display unit 505 and / or It may be controlled to output through the voice output unit 506.

The display unit 505 outputs image information included in a signal subjected to predetermined signal processing under the control of the control unit 504.

The display unit 505 displays management information including at least one video codec setting information, call standard setting information, network setting information, and security setting information output by the control unit 504. Here, the display unit 505 may be configured to receive an input from a user by using a touch screen method.

When displaying the management information, the display unit 505 may display various contents such as various menu screens by using a user interface and / or a graphic user interface previously stored in the storage unit 503. Here, the content displayed on the display unit 505 includes a menu screen including various text or image data and data such as icons, list menus, combo boxes, and the like.

The display unit 505 may include a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display ( It may include at least one of a flexible display, a 3D display.

The display unit 505 may include a haptic module (not shown). The haptic module generates various tactile effects that a user can feel. Vibration is a representative example of the haptic effect generated by the haptic module. The intensity and pattern of vibration generated by the haptic module can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to vibration, the haptic module may be effected by stimulation such as pin arrangement vertically moving with respect to the contact skin surface, jetting force or suction force of air through the injection or inlet, grazing to the skin surface, contact of the electrode, electrostatic force, and the like. And a variety of tactile effects such as an effect of reproducing a sense of cold using a heat absorbing or heat generating element.

The haptic module may not only deliver the haptic effect through direct contact, but may also be implemented to allow the user to feel the haptic effect through a muscle sense such as a finger or an arm. In addition, the haptic module may be provided with at least one, depending on the configuration of the video conferencing terminal 200.

The voice output unit 506 outputs voice information included in a signal subjected to predetermined signal processing by the control unit 504. Here, the voice output unit 506 may be a speaker.

The audio output unit 506 outputs audio data received from the communication unit 501 or stored in the storage unit 503 in a video conference mode, a call mode, a recording mode, and the like.

The video conference terminal 300 may further include an interface unit (not shown) that serves as an interface with all external devices connected to the video conference terminal 300. For example, the interface unit includes a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, and audio I / O. (Input / Output) port, video I / O (Input / Output) port, earphone port, and the like. Here, the identification module is a chip that stores various information for authenticating the use right of the video conferencing terminal 300, and includes a user identification module (UIM), a subscriber identify module (SIM), and a general user. It may include an authentication module (Universal Subscriber Identity Module (USIM)). In addition, the device equipped with the identification module may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the video conference terminal 300 through a port. Such an interface unit may receive data from an external device or receive power to transfer the data to each component inside the video conferencing terminal 300 or to transmit the data inside the video conferencing terminal 300 to an external device.

The interface unit may be a passage through which power from the cradle is supplied to the video conferencing terminal 300 when the video conferencing terminal 300 is connected to an external cradle, or various command signals input from the cradle by a user. May be a passage that is transmitted to the video conferencing terminal 300. Various command signals or power input from the cradle may be operated as signals for recognizing that the video conferencing terminal 300 is correctly mounted on the cradle.

The communication network 400 connects the plurality of video conferencing terminals 300 to each other.

The communication network 400 includes a bridge, a gateway, a router, a hub, and the like.

The router includes management information of each of a plurality of video conferencing terminals connected through the communication network 400. That is, it includes management information including video codec setting information, call standard setting information, network setting information, and security setting information of each of the plurality of video conferencing terminals connected through the communication network 400.

When the router receives a management information transmission request message from any video conferencing terminal 300 connected to the video conferencing system, the router transmits management information previously stored in the router to the video conferencing terminal 300.

When the router receives the reset management information from any video conferencing terminal 300 connected to the video conferencing system, the router updates the management information previously stored in the router with the received reset management information, or receives the received management information. The reset management information is transmitted to a specific video conference terminal (specific video conference terminal except for any of the video conference terminals) connected to the video conference system.

On the other hand, the content control device applied to the video conferencing terminal 300 according to the embodiments of the present invention, the camera for photographing the subject; When the book synchronization key is selected by the user, the photographed subject is recognized as a paper book, the recognized paper book is transmitted to the server through the communication unit 501, and an addition corresponding to the paper book is received from the server. A control unit 504 for receiving information (editing information) and matching the received additional information with the photographed paper book; And a display unit 505 for displaying the matched information on the screen.

Hereinafter, an apparatus and method for controlling content according to a first embodiment of the present invention will be described with reference to FIGS. 7 to 11. Content control device and method according to the first embodiment of the present invention is applied not only to the mobile communication terminal 100, the telematics terminal 200, video conferencing terminal, but also equipped with a camera (smart phone), camera Laptop computer with digital camera, digital broadcasting terminal with camera, personal digital assistants with camera, portable multimedia player with camera, desktop computer with camera, camera It may also be applied to a television, a video player equipped with a camera, and the like.

7 is a block diagram showing a content control device according to a first embodiment of the present invention.

As shown in Fig. 7, the content control apparatus according to the first embodiment of the present invention includes a camera 602 for photographing a subject; When the book synchronization key is selected by the user, the photographed subject is recognized as a paper book, the recognized paper book is transmitted to the server 700 through the communication unit 604, and from the server 700 A control unit 601 for receiving additional information (edit information) corresponding to a paper book and matching (overlapping) the received additional information with the photographed paper book; The display unit 603 displays the matched information on the screen. The storage unit 605 stores the photographed paper book.

Hereinafter, the operation of the content control device according to the first embodiment of the present invention will be described with reference to FIG.

First, the camera 602 photographs a subject at the request of a user, and outputs the photographed subject to the controller 601.

The controller 601 generates a book synchronization key when the subject is photographed, and displays the generated book synchronization key on the display unit 603. The book synchronization key is a key for synchronizing an e-book and a paper book, and is a mark written in the e-book (for example, an important line displayed by a user (underlined display)). Matching notes (e.g., important content (written content) recorded by the user), music and / or video link information (e.g., music information or video information linked by the user) to the paper book It means for the key.

The controller 601 recognizes the photographed subject as a paper book when the book synchronization key is selected by the user, and outputs the recognized paper book to the communication unit 604.

The communication unit 604 transmits the recognized paper book to the server 700 through a wireless communication network or a wired communication network.

The server 700 receives a paper book input from the communication unit 604 and recognizes letters, numbers, and the like included in the received paper book. Here, since the letters, numbers, and the like may be recognized through various known applications, the detailed description thereof will be omitted.

In addition, the server 700 divides the region in which the recognized characters exist into a character region, divides the region in which the recognized number exists into a numeric region, and the numeric region is the top of the recognized character region or When a number located at the bottom and existing in the number area is a single number, the single number is regarded as a page number of the paper book. For example, a page number of a general paper book is printed at the top or bottom of a book content so that the numeric area is located at the top or bottom of the recognized character area, and when the number present in the numerical area is a single number, The number is regarded as the page number of the paper book.

The server 700 retrieves electronic books that match the characters of the page number (characters in the recognized character area) from previously stored electronic books. That is, the server 700 retrieves a page (page of the electronic book) matching the characters of the page number (characters in the recognized character area) from the prestored electronic books, and retrieves the retrieved page (electronic book). Page) is transmitted to the communication unit 604 via the wireless or wired communication network. Here, the searched page (page of the e-book) may include an important line (underlined) displayed by the user, a memo (for example, important content recorded by the user), music and / or video link information (for example, Additional information (information edited by the user) such as music information or moving picture information linked by the user. The server 700 may transmit only the additional information excluding the searched page to the communication unit 604 through the wireless communication network or the wired communication network.

The communication unit 604 receives the additional information (edit information) from the server 700, and outputs the received additional information to the control unit 601.

The controller 601 matches the received additional information with the photographed paper book (page of a paper book), and outputs the matched information (page and additional information) to the display unit 603. For example, the controller 601 recognizes the text size of the photographed paper book, and matches the received additional information with the recognized text size. That is, the controller 601 assumes that the text size of the page of the recognized paper book is 12 points and that the additional information is underlined and memo information, so that the underlined and memo information matches the 12 points. The additional information and the page may be matched by enlarging or reducing the size of the information.

The display unit 603 displays the matched information (page and additional information) on the screen. On the other hand, the controller 601 may receive an electronic book (for example, a page of the electronic book) including the additional information, and display the received electronic book on the display unit 603 together with the additional information. have.

8 is an exemplary diagram illustrating a process of synchronizing a paper book and an electronic book according to the first embodiment of the present invention.

As shown in Fig. 8, the control unit 601 applied to the smart phone 8-1 or the smart book is the paper book 8-2 (for example, paper). Page 25 of the book) and the photographed paper book 802 is transmitted to the server 700.

The server 700 receives the paper book 8-2 (for example, page 25 of the paper book) input from the smart phone 8-1, and sends the received paper book 8-2 to the received paper book 8-2. Recognize embedded letters, numbers, etc. The server 700 divides a region in which recognized characters exist into a character region, divides a region in which the recognized number exists into a numeric region, and the numeric region is located at the top or the bottom of the recognized character region. When the number 8-3 existing in the number field is a single number, the single number is regarded as a page number of the paper book.

Therefore, the user can confirm additional information related to the paper book through the communication network only by photographing the paper book. In addition, the user can synchronize the paper book and the electronic book by simply photographing the paper book.

Hereinafter, a content control method according to a first embodiment of the present invention will be described with reference to FIGS. 7 to 11.

9 is a flowchart illustrating a content control method according to a first embodiment of the present invention.

First, the camera 602 photographs a subject according to a user's request, and outputs the photographed subject to the controller 601 (S11).

The controller 601 generates a book synchronization key when the subject is photographed, and displays the generated book synchronization key on the display unit 603. The book synchronization key is a key for synchronizing an e-book and a paper book, and a mark recorded in the e-book (for example, an important line displayed by the user (underlined mark) Matching notes (e.g., important content (written content) recorded by the user), music and / or video link information (e.g., music information or video information linked by the user) to the paper book It means for the key.

The controller 601 determines whether the book synchronization key is selected by the user (S12), and recognizes the photographed subject as a paper book when the book synchronization key is selected by the user (S13). The recognized paper book is output to the communication unit 604. Here, the paper book means a specific page of the paper book photographed by the user (for example, page 25 (8-3) of the paper book).

The communication unit 604 transmits the recognized paper book to the server 700 through a wireless communication network or a wired communication network (S14).

The server 700 receives a paper book input from the communication unit 604 and recognizes letters, numbers, and the like included in the received paper book. In addition, the server 700 divides a region in which recognized characters exist into a character region, divides a region in which the recognized number exists into a numeric region, and the numeric region is at the top or bottom of the recognized character region. When a number existing at and located in the number area is a single number, the single number is regarded as the page number of the paper book. For example, a page number of a general paper book is printed at the top or bottom of a book content so that the numeric area is located at the top or bottom of the recognized character area, and when the number present in the numerical area is a single number, The number is regarded as the page number of the paper book.

The server 700 retrieves electronic books that match the characters of the page number (characters in the recognized character area) from previously stored electronic books. That is, the server 700 retrieves a page (page of the electronic book) matching the characters of the page number (characters in the recognized character area) from the prestored electronic books, and retrieves the retrieved page (electronic book). Page) is transmitted to the communication unit 604 via the wireless or wired communication network. Here, the searched page (page of the e-book) may include an important line (underlined) displayed by the user, a memo (for example, important content recorded by the user), music and / or video link information (for example, Additional information (information edited by the user) such as music information or moving picture information linked by the user. Additional information matching the paper book may be recorded in metadata of the searched page (page of the electronic book).

The server 700 may transmit only the additional information excluding the searched page to the communication unit 604 through the wireless communication network or the wired communication network.

The communication unit 604 receives the additional information (edit information) from the server 700 (S15), and outputs the received additional information to the control unit 601.

The controller 601 matches the received additional information with the photographed paper book (page of a paper book), and outputs the matched information (page and additional information) to the display unit 603 (S16).

The display unit 603 displays the matched information (page and additional information) on the screen (S17). On the other hand, the control unit 601 receives an electronic book including the additional information (for example, an electronic book page including the additional information), and displays the received electronic book together with the additional information. You can also mark

10 is an exemplary view showing a page of a paper book photographed according to the first embodiment of the present invention.

As shown in FIG. 10, the controller 601 displays a specific page 10-1 of the paper book photographed through the camera 602 on the display unit 603.

11 is an exemplary diagram showing additional information matched with a paper book photographed according to the first embodiment of the present invention.

As shown in Fig. 11, the controller 601 matches the received additional information 10-2 with the photographed paper book (page of a paper book) 10-1, and the matched information ( Pages and additional information) are output to the display unit 603. The display unit 603 displays the matched information (page and additional information) 10-1 and 10-2 on the screen.

Accordingly, the content control apparatus and method according to the first embodiment of the present invention can confirm additional information related to the paper book through a communication network only by photographing the paper book.

In addition, the content control device and method according to the first embodiment of the present invention may synchronize the paper book and the electronic book only by the user photographing the paper book.

Hereinafter, an apparatus and method for controlling content according to a second embodiment of the present invention will be described with reference to FIGS. 7 and 12. The content control device and method thereof according to the second embodiment of the present invention are not only applied to the mobile communication terminal 100, the telematics terminal 200, and a video conferencing terminal, but also include a smart phone and a camera equipped with a camera. Laptop computer with digital camera, digital broadcasting terminal with camera, personal digital assistants with camera, portable multimedia player with camera, desktop computer with camera, camera It may also be applied to a television, a video player equipped with a camera, and the like.

12 is a flowchart illustrating a content control method according to a second embodiment of the present invention.

First, the camera 602 photographs a subject according to a user's request, and outputs the photographed subject to the controller 601 (S21).

The controller 601 generates a book synchronization key when the subject is photographed, and displays the generated book synchronization key on the display unit 603. The book synchronization key is a key for synchronizing an e-book and a paper book, and a mark recorded in the e-book (for example, an important line displayed by the user (underlined mark) Matching notes (e.g., important content (written content) recorded by the user), music and / or video link information (e.g., music information or video information linked by the user) to the paper book It means for the key.

The controller 601 determines whether the book synchronization key is selected by the user (S22), and recognizes the photographed subject as a paper book when the book synchronization key is selected by the user (S23). Here, the paper book means a specific page of the paper book photographed by the user (for example, page 25 (8-3) of the paper book).

The controller 601 recognizes letters, numbers, and the like included in the recognized paper book. In addition, the controller 601 divides the region in which the recognized characters exist into a character region, divides the region in which the recognized number exists into a numeric region, and the numeric region is the top of the recognized character region or When a number located at the bottom and existing in the number area is a single number, the single number is regarded as the page number of the paper book. For example, a page number of a general paper book is printed at the top or bottom of a book content so that the numeric area is located at the top or bottom of the recognized character area, and when the number present in the numerical area is a single number, The number is regarded as the page number of the paper book.

The controller 601 searches for electronic books that match the characters of the page number (characters in the recognized character area) from previously stored electronic books. That is, the controller 601 retrieves a page (page of the electronic book) matching the characters of the page number (characters in the recognized character area) from the prestored electronic books (S24). Here, the searched page (page of the e-book) may include an important line (underlined) displayed by the user, a memo (for example, important content recorded by the user), music and / or video link information (for example, Additional information (information edited by the user) such as music information or moving picture information linked by the user.

The controller 601 matches the retrieved additional information with the photographed paper book (page of a paper book) (matching process), and outputs the matched information (page and additional information) to the display unit 603 ( S25).

The display unit 603 displays the matched information (page and additional information) on the screen (S26). On the other hand, the controller 601 may display an electronic book (eg, a page of the electronic book) including the additional information on the display unit 603 together with the additional information without the matching process.

Accordingly, the content control apparatus and method according to the second embodiment of the present invention can quickly identify additional information related to the paper book by simply photographing the paper book.

In addition, the content control device and method according to the second embodiment of the present invention can quickly synchronize the paper book and the electronic book only by the user photographing the paper book.

Hereinafter, a content control device according to a third embodiment of the present invention will be described with reference to FIGS. 7 and 13-15. The content control apparatus according to the third embodiment of the present invention is not only applied to the mobile communication terminal 100, the telematics terminal 200, and a video conferencing terminal, but also includes a camera equipped with a smart phone and a camera. Notebook computers, terminals for digital broadcasting with cameras, personal digital assistants with cameras, portable multimedia players with cameras, desktop computers with cameras, televisions with cameras, It may also be applied to a video player equipped with a camera.

13 is a flowchart illustrating a content control method according to a third embodiment of the present invention.

First, the camera 602 captures a table of contents page of a paper book according to a user's request (S31).

The controller 601 generates a book synchronization key when the table of contents page of the paper book is photographed, and displays the generated book synchronization key through the display unit 603. The book synchronization key is a key for synchronizing an e-book and a paper book, and a mark recorded in the e-book (for example, an important line displayed by the user (underlined mark) Matching notes (e.g., important content (written content) recorded by the user), music and / or video link information (e.g., music information or video information linked by the user) to the paper book It means for the key.

The controller 601 determines whether the book synchronization key is selected by the user (S32), and generates a message requesting a page number when the book synchronization key is selected by the user (S33). A message is displayed on the screen through the display unit 603.

14 is an exemplary view showing a table of contents page and a message according to a third embodiment of the present invention.

As shown in Fig. 14, the control unit 601 selects the page number (the corresponding page number) desired by the user when the table of contents page 14-1 of the paper book is taken and the book synchronization key is selected by the user. Generates a message 14-2 for requesting the message, and displays the generated message 14-2 on the screen through the display unit 603.

The controller 601 determines whether a page number is input (S34), and when the page number is input, transmits the contents page and the page number to the server 700 through the communication unit 604 (S35). ).

15 is an exemplary view showing a page number according to a third embodiment of the present invention.

As shown in Fig. 15, the controller 601 determines whether the page number 15-1 has been inputted, and when the page number 15-1 has been entered in the input window, the contents page and the page number Send to the server 700. Here, the controller 601 divides the screen of the display unit 603 into a first area and a second area, displays the table of contents page 14-1 in the first area, and displays the page in the second area. The number 15-1 is displayed.

The server 700 receives a table of contents paper and a page number input from the communication unit 604 and recognizes letters, numbers, and the like included in the received shepherd paper.

The server 700 retrieves an electronic book that matches characters of the contents page from prestored electronic books, retrieves a page corresponding to the page number from the retrieved electronic books, and retrieves the page (the page of the electronic book). ) Is transmitted to the communication unit 604 through the wireless communication network or the wired communication network. Here, the searched page (page of the e-book) may include an important line (underlined) displayed by the user, a memo (for example, important content recorded by the user), music and / or video link information (for example, Additional information (information edited by the user) such as music information or moving picture information linked by the user. The server 700 may transmit only the additional information excluding the searched page to the communication unit 604 through the wireless communication network or the wired communication network.

The communication unit 604 receives a page including the additional information (edit information) from the server 700 (S36), and outputs the received page to the control unit 601.

The controller 601 displays the received page on the screen through the display unit 603 (S37).

On the other hand, when the page of the paper book corresponding to the page number is photographed through the camera 602, the controller 601 receives only the additional information, and receives the received additional information page of the photographed paper book. And the matched information (page and additional information) may be displayed on the display unit 603.

Accordingly, the content control apparatus and method thereof according to the third embodiment of the present invention can easily and accurately search for an electronic book corresponding to the paper book through the contents page and the page number of the paper book.

The controller 601 may recognize letters, numbers, and the like included in the table of contents paper. For example, the controller 601 retrieves an electronic book that matches the characters of the contents page from electronic books previously stored in the storage unit 605, and finds a page corresponding to the page number from the retrieved electronic book. Additional information) may be retrieved, and the retrieved page (page of the electronic book) may be displayed on the display unit 603. FIG. In addition, the controller 601 reads only the additional information from the storage unit 605 when the page of the paper book corresponding to the page number is photographed through the camera 602, and reads the readout information. The additional information may be matched with the page of the photographed paper book, and the matched information (page and additional information) may be displayed on the display unit 603.

Hereinafter, an apparatus and method for controlling content according to a fourth embodiment of the present invention will be described with reference to FIGS. 7 and 16 to 18. Content control device and method according to a fourth embodiment of the present invention is applied not only to the mobile communication terminal 100, the telematics terminal 200, video conferencing terminal, but also equipped with a camera (smart phone), camera Laptop computer with digital camera, digital broadcasting terminal with camera, personal digital assistants with camera, portable multimedia player with camera, desktop computer with camera, camera It may also be applied to a television, a video player equipped with a camera, and the like.

16 is a flowchart illustrating a content control method according to a fourth embodiment of the present invention.

First, the camera 602 captures a front page of a paper book (book cover) according to a user's request (S41).

The controller 601 generates a book synchronization key when the front page of the paper book is photographed, and displays the generated book synchronization key through the display unit 603. The book synchronization key is a key for synchronizing an e-book and a paper book, and a mark recorded in the e-book (for example, an important line displayed by the user (underlined mark) Matching notes (e.g., important content (written content) recorded by the user), music and / or video link information (e.g., music information or video information linked by the user) to the paper book It means for the key.

The controller 601 determines whether the book synchronization key is selected by the user (42), and generates a message requesting a page number when the book synchronization key is selected by the user (S43). A message is displayed on the screen through the display unit 603.

17 is an exemplary view showing a front page and a message according to a fourth embodiment of the present invention.

As shown in Fig. 17, the control unit 601 selects the page number (the corresponding page number) desired by the user when the front page 17-1 of the paper book is taken and the book synchronization key is selected by the user. Generates a message 14-2 for requesting the message, and displays the generated message 14-2 on the screen through the display unit 603.

The controller 601 determines whether a page number is input (S44), and transmits the front page and the page number to the server 700 through the communication unit 604 when the page number is input (S45). ).

18 is an exemplary view showing a page number according to a fourth embodiment of the present invention.

As shown in Fig. 18, the control unit 601 determines whether the page number 18-1 is inputted, and when the page number 18-1 is inputted into the input window, the front page and the page number. Send to the server 700. The controller 601 divides the screen of the display unit 603 into a first area and a second area, displays the front page 17-1 in the first area, and displays the page in the second area. The number 18-1 is displayed.

The server 700 receives a front paper and a page number input from the communication unit 604 and recognizes images, letters, numbers, and the like included in the received front paper. For example, the server 700 interprets the characteristics of an image of a front page (eg, a portrait, a bridge, a building, a building, a plant, etc.) through a "Google Goggles" service, and then has a lot of common features. The electronic book matching the front page can be searched by searching for a data in a database. Here, the server 700 recognizes a title (eg, a letter) of a fraudulent front page, and searches an electronic book matching the front page based on the recognized title and the image search result of the front page. It may be.

The server 700 retrieves an electronic book that matches the title of the front page and the image of the front page from previously stored electronic books, retrieves a page corresponding to the page number from the searched electronic books, and retrieves the retrieved page. (Page of the electronic book) is transmitted to the communication unit 604 via the wireless communication network or wired communication network. Here, the searched page (page of the e-book) may include an important line (underlined) displayed by the user, a memo (for example, important content recorded by the user), music and / or video link information (for example, Additional information (information edited by the user) such as music information or moving picture information linked by the user. The server 700 may transmit only the additional information excluding the searched page to the communication unit 604 through the wireless communication network or the wired communication network.

The communication unit 604 receives a page including the additional information (edit information) from the server 700 (S46), and outputs the received page to the control unit 601.

The controller 601 displays the received page on the screen through the display unit 603 (S47).

On the other hand, the controller 601 receives only the additional information when a specific page (eg, a body page of a paper book) of the paper book corresponding to the page number is photographed through the camera 602, and The received additional information may be matched with a specific page of the photographed paper book, and the matched information (page and additional information) may be displayed on the display unit 603.

Accordingly, the content control device and method according to the fourth embodiment of the present invention can easily and accurately search for an electronic book corresponding to the paper book through the front page and page number of the paper book.

The controller 601 may recognize an image, a letter, a number, and the like included in the front paper. For example, the controller 601 searches an electronic book that matches images and characters of the front page from electronic books previously stored in the storage unit 605, and corresponds to the page number from the searched electronic book. A page (including additional information) may be searched and the searched page (page of an electronic book) may be displayed on the display unit 603. In addition, the controller 601 stores only the additional information when the specific page of the paper book corresponding to the page number (eg, a body page of the paper book) is photographed through the camera 602. Read from 605, the read additional information is matched with a specific page of the photographed paper book, and the matched information (page and additional information) may be displayed on the display unit 603.

As described above, the content control apparatus and method according to the embodiments of the present invention can confirm additional information related to the paper book through a communication network only by photographing the paper book.

According to an embodiment of the present disclosure, an apparatus and a method for controlling a content may synchronize a paper book and an electronic book by simply photographing the paper book.

The apparatus and method for controlling content according to embodiments of the present invention can quickly identify additional information related to the paper book by simply photographing the paper book.

The apparatus and method for controlling content according to embodiments of the present invention can quickly synchronize a paper book and an electronic book by simply photographing the paper book.

The apparatus and method for controlling content according to embodiments of the present invention can easily and accurately search for an electronic book corresponding to a paper book through a table of contents page and a page number of the paper book.

The apparatus and method for controlling content according to embodiments of the present invention can easily and accurately search for an electronic book corresponding to a paper book through the front page and page number of the paper book.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

601: control unit 602: camera
603: display unit 604: communication unit
605: storage 700: server

Claims (38)

A camera for photographing paper books;
A controller for receiving additional information corresponding to the photographed paper book and matching the received additional information with the photographed paper book;
And a display unit for displaying the matched additional information and a paper book. The method of claim 1, wherein the control unit,
And a book synchronization key to recognize the subject photographed by the camera as the paper book. The method of claim 1, wherein the additional information is
And additional information recorded in an electronic book corresponding to the paper book. The method of claim 3, wherein the additional information,
And at least one of a mark, a memo, music, and / or video link information recorded in the electronic book. The method of claim 1,
And a communication unit for transmitting the paper book to a server, wherein the control unit receives additional information corresponding to the paper book from the server through the communication unit. The content control apparatus according to claim 5, wherein the paper book is a specific page of the paper book, and the additional information is additional information included in a specific page of the electronic book corresponding to the specific page. The method of claim 6, wherein the server,
Receives a specific page of the paper book input from the communication unit, recognizes letters and / or numbers included in the received specific page, divides the area in which the recognized characters exist into a text area, and the recognized number Is divided into a number area, and the number area is located at the top or bottom of the recognized character area, and when the number present in the number area is a single number, the single number is used as the page number of the paper book. A content control device, characterized in that. The method of claim 7, wherein the server,
And searching for a page of an e-book matching the letters of the page number from pre-stored e-books, and transmitting the additional information included in the searched page to the controller through the communication unit. The contents of claim 1, wherein the paper book is a table of contents page or a front page of the paper book, and the additional information is additional information included in a body page of an electronic book corresponding to a body page of the paper book. controller. The method of claim 9, wherein the control unit,
Receive a specific page of the paper book, recognize letters and / or numbers included in the received specific page, divide the area in which the recognized characters exist into a text area, the area in which the recognized number exists Is divided into a number area, and the number area is located at the top or bottom of the recognized character area, and when the number existing in the number area is a single number, the single number is regarded as the page number of the paper book. A content control device. The method of claim 10, wherein the control unit,
Search a page of an electronic book that matches the letters of the page number from pre-stored electronic books, match the additional information included in the searched page with the photographed paper book, and match the matched additional information and paper book. And display on the display unit. The method of claim 10, wherein the control unit,
And retrieving pages of electronic books that match the letters of the page number from prestored electronic books, and displaying the retrieved pages and the additional information included in the retrieved pages on the display unit. The method of claim 1, wherein the control unit,
The electronic book corresponding to the paper book is searched based on the table of contents page of the paper book and the page number of the paper book, the page corresponding to the page number is searched from the searched electronic book, and the searched page is displayed on the display unit. And a content control device. The method of claim 13, wherein the control unit,
Recognize characters of the table of contents page of the paper book, search electronic books that match the recognized characters from pre-stored electronic books, search pages corresponding to the page number from the searched electronic books, and search And a page is displayed on the display unit. The method of claim 13, wherein the control unit,
And a message requesting the page number when the contents page is photographed by the camera and a book synchronization key is selected, and displaying the generated message on the display unit. The method of claim 1, wherein the control unit,
The electronic book corresponding to the paper book is searched based on the front page of the paper book and the page number of the paper book, the page corresponding to the page number is searched from the searched electronic book, and the searched page And a content control device. The method of claim 16, wherein the control unit,
Recognize images and characters of the front page of the paper book, search electronic books that match the recognized images and characters from pre-stored electronic books, and retrieve pages corresponding to the page number from the searched electronic books. And displaying the searched page on the display unit. The method of claim 16, wherein the control unit,
And a message for requesting the page number when the front page is photographed through the camera and a book synchronization key is selected, and displaying the generated message on the display unit. The method of claim 1, wherein the control unit,
And display the photographed paper book in a first area of the display unit, and display a message requesting a page number of the paper book in a second area of the display unit. Receiving a paper book photographed through a camera;
Receiving additional information corresponding to the photographed paper book and matching the received additional information with the photographed paper book;
And displaying the matched additional information and the paper book on a display unit. The method of claim 20, wherein receiving the paper book comprises:
And recognizing a subject photographed by the camera as the paper book when a book synchronization key is selected. The method of claim 20, wherein the additional information,
And additional information recorded in the electronic book corresponding to the paper book. The method of claim 22, wherein the additional information,
And at least one of mark, memo, music, and / or video link information recorded in the electronic book. The method of claim 20, wherein receiving the additional information comprises:
Transmitting the paper book to a server via a communication network;
Receiving additional information corresponding to the paper book from the server through the communication network. 25. The method of claim 24, wherein the paper book is a specific page of the paper book, and the additional information is additional information included in a specific page of the electronic book corresponding to the specific page. The method of claim 25,
Receiving a specific page of a paper book input through the communication network and recognizing letters and / or numbers included in the received specific page;
Dividing the region in which the recognized characters exist into a character region, and dividing the region in which the recognized numbers exist into a numeric region;
Further comprising the step of considering the single number as the page number of the paper book when the number area is located at the top or bottom of the recognized character area and the number present in the number area is a single number. How to control content. The method of claim 26, wherein receiving the additional information,
Retrieving pages of electronic books that match the letters of the page number from prestored electronic books;
Transmitting the additional information included in the searched page through the communication network;
And receiving the transmitted additional information through the communication network. 21. The contents of claim 20, wherein the paper book is a table of contents page or a front page of the paper book, and the additional information is additional information included in a body page of an electronic book corresponding to a body page of the paper book. Control method. The method of claim 28, wherein matching the additional information with the photographed paper book comprises:
Receive a specific page of the paper book, recognize letters and / or numbers included in the received specific page, divide the area in which the recognized characters exist into a text area, the area in which the recognized number exists Dividing into a number area, and considering the single number as a page number of the paper book when the number area is located at the top or bottom of the recognized character area and the number present in the number area is a single number. Content control method comprising a. The method of claim 29, wherein displaying the paper book comprises:
Retrieving pages of electronic books that match the characters of the page number from prestored electronic books;
Matching the additional information included in the searched page with the photographed paper book;
And displaying the matched additional information and the paper book on the display unit. The method of claim 29, wherein displaying the paper book comprises:
Retrieving pages of electronic books that match the letters of the page number from prestored electronic books;
And displaying the searched page and the additional information included in the searched page on the display unit. The method of claim 20, wherein displaying the paper book comprises:
Retrieving an electronic book corresponding to the paper book based on the table of contents page of the paper book and the page number of the paper book;
Retrieving a page corresponding to the page number from the retrieved electronic book;
And displaying the searched page on the display unit. 33. The method of claim 32, wherein displaying the paper book comprises:
Recognizing characters of a table of contents page of the paper book;
Retrieving electronic books that match the recognized characters from pre-stored electronic books;
Retrieving a page corresponding to the page number from the retrieved electronic book;
And displaying the searched page on the display unit. 33. The method of claim 32, wherein searching for a page corresponding to the page number comprises:
Generating a message requesting the page number when the table of contents page is photographed through the camera and a book synchronization key is selected;
And displaying the generated message on the display unit. The method of claim 20, wherein displaying the paper book comprises:
Retrieving an electronic book corresponding to the paper book based on the front page of the paper book and the page number of the paper book;
Retrieving a page corresponding to the page number from the retrieved electronic book;
And displaying the searched page on the display unit. 36. The method of claim 35, wherein displaying the paper book comprises:
Recognizing images and characters of the front page of the paper book;
Retrieving an electronic book that matches the recognized image and text from prestored electronic books;
Retrieving a page corresponding to the page number from the retrieved electronic book;
And displaying the searched page on the display unit. 36. The method of claim 35, wherein searching for a page corresponding to the page number comprises:
Generating a message requesting the page number when the front page is photographed through the camera and a book synchronization key is selected;
And displaying the generated message on the display unit. The method of claim 20,
Displaying the photographed paper book on a first area of the display unit;
And displaying a message requesting a page number of the paper book on a second area of the display unit.

Images