KR20110090695A - Information providing apparatus and method thereof - Google Patents

Abstract

PURPOSE: An Information providing apparatus and method thereof are provided to enable a user to appreciate video and music by reproducing video from selecting image to detecting music data and by indicating the video and the music at the same time. CONSTITUTION: A display unit(403) indicates video data. A control unit(401) detects music data within video data. The control unit provides music data about musical data detected. The control unit indicates music history information of musical data within video data in the display unit. A storage unit(402) stores information about objects. Music information about the music data included in the video data is indicated in the display unit.

Description

Information provision apparatus and its method {INFORMATION PROVIDING APPARATUS AND METHOD THEREOF}

The present invention relates to an information providing apparatus and a method thereof.

In general, the information providing apparatus according to the prior art is applied to various devices such as a mobile terminal, a notebook computer, a television, and provides various information such as a television broadcast program and voice information to a user.

SUMMARY OF THE INVENTION An object of the present invention is to provide an information providing apparatus and method for easily providing a user with information about an object (for example, music) in a video.

Another object of the present invention is to provide an information providing apparatus and method for allowing a user to intuitively check information related to music in a video.

It is still another object of the present invention to detect a music data in video data, capture a video image corresponding to a point in time when the music data is detected, and display the music information and the video image for the music data together. The present invention provides an information providing device and method for intuitively selecting desired music.

Another object of the present invention is to detect the music data in the video data, to capture a video image corresponding to the point of time when the music data is detected, and to display the music information and the video image for the music data together, The present invention provides an information providing apparatus and method for allowing a user to enjoy a video and music together by playing the video from the time when the music data is detected when the video image is selected.

An information providing apparatus according to the present invention for achieving the above objects comprises: a display unit for displaying moving image data; And a controller for detecting music data in the video data and providing music information on the detected music data, wherein the controller displays music history information of music data in the video data on the display unit. It is done.

As an example related to the present invention, the music history information may include a video playback time bar, summary information about the video, and a playback time point of the detected music data.

As an example related to the present invention, the music history information may further include a representative image of the detected music data.

As an example related to the present invention, the controller may display an icon representing a playback time point of the detected music data on the video playback time bar.

As an example related to the present disclosure, the controller may detect music data from the video data when an input for searching music is received, and display music information on the detected music data on the display unit.

As an example related to the present invention, the controller may automatically detect music data from the video data, and display music information on the automatically detected music data on the display unit.

As an example related to the present invention, the control unit automatically detects music data from the video data when an input for searching for music is received, and applies the detected music data to the detected music data in the order of playing time of the detected music data. You can also assign and display numbers.

As an example related to the present invention, the controller transmits Pulse Code Modulation (PCM) data corresponding to the detected music data to a server through a communication network, and receives music information matching the detected PCM data from the server. It may include a communication unit.

As an example related to the present invention, the controller generates a music identifier for recognizing the detected music data, transmits the generated music identifier to a server through a communication network, and music information matching the music identifier from the server. It may also include a communication unit for receiving.

As an example related to the present invention, the control unit may display music information on the music data, overview information of the video data, and a representative image of the music data when the input for searching for music is received on the display unit. have.

As an example related to the present disclosure, when an input for searching for music is received, the controller displays the video data in a first area of the display unit and displays music information about music data included in the video data. It can also display in the 2nd area | region of a display part.

As an example related to the present disclosure, the controller may capture a moving image image corresponding to a playback time point at which the music data is detected, and display the captured moving image image on the display unit together with the music information.

As an example related to the present invention, when the moving image is selected, the controller may play the moving image data from a reproduction time point when the music data is detected.

According to an aspect of the present invention, there is provided a method of providing information, comprising: displaying moving image data on a display unit; Detecting music data in the moving image data and providing music information on the detected music data; And displaying music history information of music data in the moving image data on the display unit.

An information providing apparatus and method thereof according to embodiments of the present invention display an image data on a display unit, detect music data in the video data, and provide music information on the detected music data, thereby providing an object in the video. Information about (for example, music) can be easily provided to the user.

An information providing apparatus and method thereof according to embodiments of the present invention display a video data on a display unit, detect music data in the video data, and provide music history information on the detected music data to a user. The user can intuitively check the information related to the music in the video.

The information providing apparatus and method thereof according to the embodiments of the present invention display a moving image data on a first area of a display unit and display music information on music data in the moving image data on a second area of the display unit. You can intuitively check the music information while listening to music.

An information providing apparatus and method thereof according to embodiments of the present invention detect music data in video data, capture a video image corresponding to a point in time at which the music data is detected, and provide music information and the music information for the music data. By displaying video images together, the user can intuitively select the desired music.

An information providing apparatus and method thereof according to embodiments of the present invention detect music data in video data, capture a video image corresponding to a time point at which the music data is detected, and provide music information and the music information for the music data. By displaying a moving image together and playing back the moving image from the time point at which the music data is detected when the moving image is selected, the user can also enjoy the moving image and the music together.

1 is a block diagram illustrating a configuration of a mobile communication terminal to which an information providing apparatus according to embodiments of the present invention is applied.
2 is a diagram illustrating a proximity touch process of a mobile communication terminal.
3 is a block diagram illustrating a vehicle navigation system for explaining embodiments of the present invention.
4 is a block diagram illustrating a configuration of a telematics terminal to which an information providing apparatus according to embodiments of the present invention is applied.
5 is a block diagram illustrating an information providing apparatus according to embodiments of the present invention.
6 is a flowchart showing an information providing method according to a first embodiment of the present invention.
7 is an exemplary view showing music information displayed on a display unit according to the first embodiment of the present invention.
8 is a flowchart illustrating a method of providing information according to a second embodiment of the present invention.
9 is an exemplary view showing music history information displayed on a display unit according to the second embodiment of the present invention.
10 is a flowchart showing an information providing method according to a third embodiment of the present invention.
11 is an exemplary view showing music information displayed on a display unit according to the third embodiment of the present invention.
12 is a flowchart illustrating an information providing method according to a fourth embodiment of the present invention.
13 is an exemplary view showing a background music list displayed on the display unit according to the fourth embodiment of the present invention.

 Hereinafter, the user can easily select an object (object, for example, music) in the video, and provide information for intuitively confirming information related to the object (for example, music) selected by the user. Embodiments of the apparatus and method thereof are described in detail with reference to FIGS.

1 is a block diagram illustrating a configuration of a mobile communication terminal 100 to which an information providing apparatus according to embodiments of the present invention is applied. The mobile communication terminal (mobile phone) 100 may be implemented in various forms. For example, the mobile communication terminal 100 includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), and the like.

As shown in FIG. 1, the mobile communication terminal 100 includes a wireless communication unit 110, an A / V (Audio / Video) input unit 120, a user input unit 130, a sensing unit 140, and an output unit 150. ), A memory 160, an interface unit 170, a controller 180, a power supply unit 190, and the like. Not all components of the mobile communication terminal 100 shown in FIG. 1 are essential components, and the mobile communication terminal 100 may be implemented by more components than those shown in FIG. The mobile communication terminal 100 may also be implemented by components.

The wireless communication unit 110 includes one or more components for performing wireless communication between the mobile communication terminal 100 and a wireless communication system or wireless communication between the mobile communication terminal 100 and a network in which the mobile communication terminal 100 is located. It may include. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a pre-generated broadcast signal and / or broadcast related information and transmits the same to the mobile communication terminal 100. . The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112. The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be built in or external to the mobile communication terminal 100. Here, wireless Internet technologies include wireless LAN (WLAN), Wi-Fi, WiBro, WiMAX, World Interoperability for Microwave Access (WMAX), HSDPA (High Speed Downlink Packet Access), and the like. Can be used.

The short range communication module 114 means a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The position information module 115 is a module for checking or obtaining the position of the mobile terminal (it is possible to check the position of the vehicle when the mobile terminal is mounted on the vehicle). One example is the Global Position System (GPS) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite. As the location information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The A / V input unit 120 is for inputting an audio signal or a video signal, and the A / V input unit 120 includes a camera 121 and a microphone 122. May be included. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be configured according to the configuration of the mobile terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. In the call mode, the processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the mobile terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151, this may be referred to as a touch screen.

The sensing unit 140 may be an open / closed state of the mobile communication terminal 100, a location of the mobile communication terminal 100, a user contact presence, a bearing of the mobile communication terminal 100, an acceleration / deceleration of the mobile communication terminal 100, and the like. As described above, the current state of the mobile communication terminal 100 is sensed to generate a sensing signal for controlling the operation of the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in the form of a slide phone, whether the slide phone is opened or closed may be sensed. In addition, the sensing unit 140 is responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The interface unit 170 serves as an interface with all external devices connected to the mobile communication terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores a variety of information for authenticating the usage rights of the mobile communication terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile communication terminal 100 through a port. The interface unit 170 receives data from an external device or receives power to transmit the data to each component inside the mobile communication terminal 100 or transmit data within the mobile communication terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 includes a display unit 151, an audio output module 152, an alarm unit 153, and the like. This may be included.

The display unit 151 displays and outputs information processed by the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile communication terminal 100 is in a video call mode or a photographing mode, the mobile communication terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to an implementation form of the mobile communication terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile communication terminal 100.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 outputs the touch screen. In addition to the device can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

In addition, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch. When there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can determine which area of the display unit 151 is touched.

Hereinafter, the proximity sensor 141 of the mobile communication terminal 100 will be described with reference to FIG. 2.

2 is a diagram illustrating a proximity touch process of the mobile communication terminal 100. Proximity-touch in the present invention means that the pointer is approached a predetermined distance away from the screen without actually touching the screen.

The proximity sensor 141 may be disposed in the inner region of the mobile communication terminal 100 surrounded by the touch screen or near the touch screen. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using mechanical force by using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life and higher utilization than a contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as "Proximity Touch", and the touch The act of actually touching the pointer on the screen is called "Contact Touch". The position of the proximity touch with the pointer on the touch screen means a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

In addition, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). do. Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile communication terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile communication terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may vibrate the mobile terminal through a vibration means. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile communication terminal 100 through the vibration means in response to the key signal input. The user can recognize the occurrence of the event through the vibration as described above. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

The haptic module 154, in addition to the vibration, the pin arrangement to move vertically with respect to the contact skin surface, the blowing force or suction force of the air through the injection or inlet, the grazing to the skin surface, the contact of the electrode (eletrode), the stimulation such as electrostatic force Various tactile effects can be produced, such as the effects of the heat-absorbing effect and the effect of reproducing a sense of cold using the elements capable of absorbing heat or heat.

The haptic module 154 may not only deliver the haptic effect through direct contact, but may also be implemented to allow the user to feel the haptic effect through a muscle sense such as a finger or an arm. The haptic module 154 may be provided with two or more according to the configuration aspect of the telematics terminal. The haptic module 154 may be provided where the contact with the user is frequent in the vehicle. For example, it may be provided in a steering wheel, a shift gear lever, a seat seat, and the like.

The memory 160 may store a program for processing and controlling the controller 180 and temporarily stores input / output data (for example, map data, phonebook, message, still image, video, etc.). It can also perform a function for.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory). Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. In addition, the mobile communication terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and universal user authentication. It may include a module (Universal Subscriber Identity Module (USIM)). In addition, the device equipped with the identification module (hereinafter referred to as an identification device) may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile terminal 100 through a port. The interface unit 170 may receive data from an external device or receive power and transmit the data to each component inside the mobile terminal 100 or transmit data within the mobile terminal 100 to an external device.

The interface unit 170 may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input by the user from the cradle. It may be a passage through which a signal is transmitted to the mobile terminal 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile communication terminal 100. For example, the controller 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on a touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The functions of the components applied to the mobile communication terminal 100 may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. Hardware implementations include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPCs), and controllers (FPGAs). It may be implemented using at least one of controllers, micro-controllers, microprocessors, electrical units for performing functions, etc. In some cases such embodiments are implemented by the controller 180. In a software implementation, embodiments such as a procedure or function may be implemented with a separate software module that performs at least one function or operation Software code may be written in a software application written in a suitable programming language. Software code is also stored in the memory 160 and controlled. It may be executed by the unit 180.

The voice recognition module 182 recognizes the voice spoken by the user and performs a corresponding function according to the recognized voice signal.

The navigation session 300 applied to the mobile communication terminal 100 displays a driving route on map data.

On the other hand, the information providing apparatus applied to the mobile terminal, the display unit (display unit) 151 for displaying a video; The controller 180 detects an object (eg, background music) in the video and provides information about the detected object. The controller 180 displays history information of objects (eg, background music) in the video on the display unit 151. The object history information may include a video playback time bar, summary information of the video, and a playback (display) time point of the detected object (background music). The object history information may further include a representative image (eg, a thumbnail image) of the detected background music.

The controller 180 may display an icon representing a playback time point of the detected background music on the video playback time bar.

The controller 180 may detect music in the moving image data when an input for searching for music (or background music) is received, and display information on the detected music on the display unit.

The controller 180 may automatically detect music in the video when an input for searching music is received, and number and display different numbers of the detected music according to a play time order. have.

When an input for searching for music is received, the controller 180 may include information about music in the video data, overview information of the video, and a representative image of the music (for example, a specific music file). A thumbnail image) may be displayed on the display unit 151.

The controller 180 detects music included in the video in real time when an input for reproducing the video and receiving music to the first area of the display unit 151 is received, and represents the representative of the detected music. Information about the image and the detected music may be displayed on the second area of the display unit 151.

The information providing apparatus further includes a wireless communication unit 110 for transmitting the detected music to a server through a communication network and receiving information about the detected music from the server.

On the other hand, the controller 180 extracts PCM (Pulse Code Modulation) data from the video data being played, determines whether the data currently being reproduced is music data based on the extracted PCM data, and the data currently being reproduced. Is the music data, the PCM data corresponding to the music data is directly transmitted to the server, or to minimize the data capacity of the PCM data, the audio (music) Fingererprint (Fingerprint) for music recognition based on the PCM data ( A Musical ID), transmit the audio fingerprint to a server (e.g., Gracenote Database), receive music information matching the PCM data or music information matching the audio fingerprint from the server, The received music information is displayed on the display unit 151.

As a method of recognizing music based on the audio fingerprint, various known applications may be used. The audio fingerprint is information for easily recognizing music in a server (for example, a Gracenote Database), and the server is music information (for example, based on PCM data corresponding to the music data). For example, a singer's name, album name, music purchase site information, etc. may be searched.

The method of determining whether or not the currently reproduced data is music data based on the PCM data is described in detail in Korean Patent Application Nos. "10-2007-0132215" and "10-2008-0010032". Is omitted.

The controller 180 determines whether or not the currently reproduced data is music data based on the PCM data, or when a frequency equal to or greater than a predetermined frequency value among frequencies of the currently reproduced video is preset (for example, 10 seconds). The frequency generated continuously when generated continuously can be determined as music data.

3 is a block diagram illustrating a vehicle navigation system for explaining embodiments of the present invention.

As shown in Fig. 3, the vehicle navigation system includes an information providing center 30 which provides traffic information and various data (for example, programs, executable files, etc.); Telematics, which is mounted in a vehicle, receives traffic information through a long range wireless communication network 20 and / or a short range wireless communication network, and provides a road guidance service based on the GPS signal received through the satellite 10 and the traffic information. It consists of a terminal 200.

Hereinafter, the configuration of the telematics terminal 200 to which the information providing apparatus according to the embodiments of the present invention is applied will be described with reference to FIG. 4.

4 is a block diagram showing the configuration of the telematics terminal 200 to which the information providing apparatus according to the embodiments of the present invention is applied.

As shown in FIG. 4, the telematics terminal 200 includes a control unit (for example, a central processing unit, a CPU) 212 for controlling the telematics terminal 200 as a whole, a memory 213 for storing various kinds of information, and The main board 210 includes a key controller 211 for controlling various key signals and an LCD controller 214 for controlling a liquid crystal display (LCD).

The memory 213 stores map information (map data) for displaying road guidance information on a digital map. In addition, the memory 213 stores a traffic information collection control algorithm for inputting traffic information according to a road situation in which the vehicle is currently driving, and information for controlling the algorithm.

The main board 210 is assigned with a unique device number for a code division multiple access (CDMA) module 206, which is a mobile communication terminal embedded in a vehicle, for locating a vehicle, tracking a driving route from a starting point to a destination, and the like. GPS module 207 for receiving a GPS signal or transmitting traffic information collected by a user as a GPS (Global Positioning System) signal, a CD deck (CD Deck) 208 for reproducing a signal recorded on a compact disk (CD) ), A gyro sensor 209 and the like. The CDMA module 206 and the GPS module 207 transmit / receive signals through the antennas 204 and 205.

In addition, the broadcast receiving module 222 is connected to the main board 210 and receives a broadcast signal through the antenna 223. The main board 210 includes a display unit (201) under the control of the LCD control unit 214 through the interface board 203, a front board 202 under the control of the key control unit 211, and a vehicle. The camera 227 for capturing the inside and / or the outside is connected. The display unit 201 displays various video signals and text signals, and the front board 202 is provided with buttons for inputting various key signals, and the main board 210 provides a key signal corresponding to a user-selected button. To provide. In addition, the display unit 201 includes a proximity sensor and a touch sensor (touch screen) of FIG. 2.

The front board 202 may include a menu key for directly inputting traffic information, and the menu key may be configured to be controlled by the key controller 211.

The audio board 217 is connected to the main board 210 and processes various audio signals. The audio board 217 includes a microcomputer 219 for controlling the audio board 217, a tuner 218 for receiving a radio signal, a power supply unit 216 for supplying power to the microcomputer 219, and various voices. It consists of a signal processor 215 for processing a signal.

In addition, the audio board 217 is composed of a radio antenna 220 for receiving a radio signal, and a tape deck 221 for reproducing an audio tape. The audio board 217 may further configure a voice output unit (for example, an amplifier) 226 for outputting a voice signal processed by the audio board 217.

The voice output unit (amplifier) 226 is connected to the vehicle interface 224. That is, the audio board 217 and the main board 210 are connected to the vehicle interface 224. The vehicle interface 224 may be connected to a hands-free 225a for inputting a voice signal, an airbag 225b for occupant safety, a speed sensor 225c for detecting the speed of the vehicle, and the like. The speed sensor 225c calculates a vehicle speed and provides the calculated vehicle speed information to the central processing unit 212.

The navigation session 300 applied to the telematics terminal 200 generates road guide information based on map data and vehicle current location information, and notifies the user of the generated road guide information.

The display unit 201 detects a proximity touch in the display window through a proximity sensor. For example, the display unit 201 detects the position of the proximity touch when the pointer (for example, a finger or a stylus pen) is in close proximity, and displays the position information corresponding to the detected position. Output to the control unit 212.

The voice recognition device (or voice recognition module) 301 recognizes a voice spoken by the user and performs a corresponding function according to the recognized voice signal.

The navigation session 300 applied to the telematics terminal 200 displays a driving route on map data, and a predetermined distance from a blind spot where the position of the mobile communication terminal 100 is included in the driving route. Automatically establishes a wireless network with a terminal (e.g., a vehicle navigation device) mounted on a nearby vehicle and / or a mobile communication terminal carried by a nearby pedestrian through wireless communication (e.g., a short range wireless communication network). As a result, position information of the surrounding vehicle is received from the terminal mounted on the surrounding vehicle, and position information of the surrounding pedestrian is received from the mobile communication terminal carried by the surrounding pedestrian.

On the other hand, the information providing apparatus applied to the telematics terminal 200, the display unit (display unit) 201 for displaying a video; The controller 180 detects an object (eg, background music) in the video and provides information about the detected object. The controller 212 displays history information of objects (eg, background music) in the video on the display unit 201. The object history information may include a video playback time bar, summary information of the video, and a playback (display) time point of the detected object (background music). The object history information may further include a representative image (eg, a thumbnail image) of the detected background music.

The controller 212 may display an icon representing a playback time point of the detected background music on the video playback time bar.

The controller 212 may detect music in the moving image data when an input for searching for music (or background music) is received, and display information on the detected music on the display unit.

The control unit 212 may automatically detect music in the video when an input for searching for music is received, and number and display the detected music numbers differently in time order. .

The control unit 212, when an input for searching for music is received, information about music in the video data, overview information of the video, and a representative image of the music (for example, a specific music file) A thumbnail image) may be displayed on the display unit 201.

The controller 212 reproduces the video in the first area of the display unit 201, detects music included in the video in real time when an input for searching for music is received, and represents the detected music. Information about the image and the detected music may be displayed on the second area of the display unit 201.

The information providing apparatus further includes a wireless communication unit which transmits the detected music to a server through a communication network and receives information about the detected music from the server.

Meanwhile, the controller 212 extracts Pulse Code Modulation (PCM) data from the video data being played, determines whether the currently played data is music data based on the extracted PCM data, and determines the currently played data. Is the music data, the PCM data corresponding to the music data is directly transmitted to the server, or to minimize the data capacity of the PCM data, the audio (music) Fingererprint (Fingerprint) for music recognition based on the PCM data ( A Musical ID), transmit the audio fingerprint to a server (e.g., Gracenote Database), receive music information matching the PCM data or music information matching the audio fingerprint from the server, The received music information is displayed on the display unit 201.

As a method of recognizing music based on the audio fingerprint, various known applications may be used. The audio fingerprint is information for easily recognizing music in a server (for example, a Gracenote Database), and the server is music information (for example, based on PCM data corresponding to the music data). For example, a singer's name, album name, music purchase site information, etc. may be searched.

The method of determining whether or not the currently reproduced data is music data based on the PCM data is described in detail in Korean Patent Application Nos. "10-2007-0132215" and "10-2008-0010032". Is omitted.

The controller 212 determines whether the currently reproduced data is music data based on the PCM data, or a time when a frequency equal to or greater than a predetermined frequency value among frequencies of the currently reproduced video is preset (eg, 10 seconds). The frequency generated continuously when generated continuously can be determined as music data.

Hereinafter, an information providing apparatus according to embodiments of the present invention will be described with reference to FIG. 5. The information providing apparatus according to the embodiments of the present invention is not only applied to the mobile communication terminal 100 and the telematics terminal 200, but also a smart phone, a notebook computer, a digital broadcasting terminal, a PDA ( It may also be applied to Personal Digital Assistants (PMP), Portable Multimedia Players (PMPs), desktop computers, televisions, and video players.

5 is a block diagram illustrating an information providing apparatus according to embodiments of the present invention.

As shown in Fig. 5, the information providing apparatus 400 includes: a display unit 403 for displaying a video; And a controller 401 for detecting an object (eg, background music) in the video and providing information on the detected object. The controller 401 displays history information of objects (eg, background music) in the video on the display unit 403. The object history information may include a video playback time bar, summary information of the video, and a playback (display) time point of the detected object (background music). The object history information may further include a representative image (eg, a thumbnail image) of the detected background music. Information about the object is stored in the storage unit 402.

The controller 401 may display an icon representing a playback time point of the detected background music on the video playback time bar.

The controller 401 may detect music in the moving image data when an input for searching for music (or background music) is received, and display information on the detected music on the display unit.

The control unit 401 may automatically detect music in the video when an input for searching for music is received, and number and display the detected music in different numbers according to a play time order. have.

The control unit 401, when an input for searching for music is received, information about music in the video data, overview information of the video, and a representative image of the music (for example, a specific music file) A thumbnail image) may be displayed on the display unit 403.

The control unit 401 plays the video in the first area of the display unit 403, detects music included in the video in real time when an input for searching for music is received, and represents the detected music. Information about the image and the detected music may be displayed on the second area of the display unit 403.

The information providing apparatus further includes a wireless communication unit 404 for transmitting the detected music to the server 500 through a communication network and receiving information on the detected music from the server 500.

On the other hand, the control unit 401 extracts Pulse Code Modulation (PCM) data from the video data being played, determines whether the data currently being reproduced is music data based on the extracted PCM data, and determines the currently reproduced data. Is the music data, the PCM data corresponding to the music data is directly transmitted to the server, or to minimize the data capacity of the PCM data, the audio (music) Fingererprint (Fingerprint) for music recognition based on the PCM data ( A Musical ID), transmit the audio fingerprint to a server (e.g., Gracenote Database), receive music information matching the PCM data or music information matching the audio fingerprint from the server, The received music information is displayed on the display unit 403.

As a method of recognizing music based on the audio fingerprint, various known applications may be used. The audio fingerprint is information for easily recognizing music in a server (for example, a Gracenote Database), and the server is music information (for example, based on PCM data corresponding to the music data). For example, a singer's name, album name, music purchase site information, etc. may be searched.

Hereinafter, an information providing method according to a first embodiment of the present invention will be described with reference to FIGS. 5 and 6.

6 is a flowchart showing an information providing method according to a first embodiment of the present invention.

First, the controller 401 displays the video selected by the user on the display unit 403 (S11). For example, the controller 401 plays the video selected by the user through the display unit 403. The control unit 401 retrieves movie data from a hard disk drive (HDD), Universal Serial Bus (USB), Disc, digital living network alliance (DLNA), Common Internet File System (CIFS), online server, The retrieved movie data can be displayed on the display unit 403.

The controller 401 determines whether a key for detecting music data (eg, background music data) in the video is selected by the user (S12).

The controller 401 detects background music from video data currently being played when an input for searching for background music is received (for example, when a key for searching for background music is selected by the user) (S13). ). For example, the control unit 401 extracts Pulse Code Modulation (PCM) data from the video data being played, determines whether the data currently being played is music data based on the extracted PCM data, and determines whether the current playback is performed. When the data to be used is music data, the PCM data corresponding to the music data is detected.

The controller 401 may automatically detect background music from video data currently being played when an input for searching for background music is received (for example, when a key for searching for background music is selected by the user). It may be. In this case, the controller 401 may assign and display different numbers to the detected background music according to the order of playing time of the detected background music.

The controller 401 transmits PCM data corresponding to the detected background music to the server 500 through the communication unit 404 to transmit information (music information) on the detected background music to the server 500. Request to (S14). For example, the communication unit 404 connects to the server 500 through a wired or wireless communication network under the control of the control unit 401, and PCM data corresponding to the detected background music to the server 500. The server 500 requests the server 500 to transmit information about the detected background music (music information). On the other hand, the control unit 401 generates an audio (Fingerprint) (music identifier, Musical ID) for music recognition on the basis of the PCM data, the server 500 (eg For example, to Gracenote Database).

The server 500 searches for music information matching the PCM data or music information matching the audio fingerprint, and transmits the searched music information to the communication unit 404 through the communication network. For example, the server 500 (e.g., Gracenote Database) may include a singer's name, title, and representative image (e.g., thumbnail) of the background music based on the PCM data or the audio fingerprint. Music information including an image), an album name, purchase site information for purchasing background music, and the like, is retrieved, and the retrieved music information is transmitted to the communication unit 404 through the communication network.

The communication unit 404 receives the music information from the server 500 (S15), and outputs the received music information to the control unit 401.

The control unit 401 displays the music information on the display unit 403 (S16). For example, the controller 401 displays the music information and the overview information of the video on the display unit 403.

7 is an exemplary view showing music information displayed on a display unit according to the first embodiment of the present invention.

As shown in Fig. 7, the controller 401 reads the video outline information 7-1 together with the background music list 7-2 when a key for searching for the background music is selected by the user. Displayed on the display unit 403. The background music list 7-2 includes playback time information 7-3 of each background music and a title 7-4 of each background music.

In addition, the control unit 401 is configured to display the playback time information 7-3 of each background music included in the background music list 7-2 or the title (or singer name) 7-4 of each background music to the user. When selected by the user, information associated with the selected background music may be searched for, and the searched information may be displayed on the display unit 403. For example, the controller 401 selects the playback time information 7-3 of each background music or the title 7-4 of each background music included in the background music list 7-2 by the user. When the information associated with the selected background music is retrieved from a server such as Youtube, the retrieved information may be displayed on the display unit 403.

The controller 401 reads outline information of "dark knight" from the storage unit 402 when the video is "dark knight," and displays the read outline information (summary information). On the display. The above outline information includes "Dark Knight" representative (poster) image, "Dark Knight" movie director information, actor information (actor's profile, representative works, etc.), author information, release date information, genre information, award ( Awards information, NewsDesk, and the like. The summary information may further include a search icon for searching the movie-related data.

Therefore, the information providing apparatus and method thereof according to the first embodiment of the present invention display a moving picture data on a display unit, detect music data in the moving picture data, and provide music information for the detected music data. Information about an object (eg, music) in the video can be easily provided to the user.

Hereinafter, an information providing method according to a second embodiment of the present invention will be described with reference to FIGS. 5 and 8-9.

8 is a flowchart illustrating a method of providing information according to a second embodiment of the present invention.

First, the controller 401 displays the video selected by the user on the display unit 403 (S21). For example, the controller 401 plays the video selected by the user through the display unit 403. The control unit 401 retrieves movie data from a hard disk drive (HDD), Universal Serial Bus (USB), Disc, digital living network alliance (DLNA), Common Internet File System (CIFS), online server, The retrieved movie data can be displayed on the display unit 403.

The controller 401 determines whether a key for detecting music data (eg, background music data) in the video is selected by the user (S22).

The control unit 401 receives the background music (music data) from the currently playing video data when an input for searching for background music is received (for example, when a key for searching for background music is selected by the user). It is detected (S23). For example, the control unit 401 extracts Pulse Code Modulation (PCM) data from the video data being played, determines whether the data currently being played is music data based on the extracted PCM data, and determines whether the current playback is performed. When the data to be used is music data, the PCM data corresponding to the music data is detected.

The controller 401 may automatically detect background music from video data currently being played when an input for searching for background music is received (for example, when a key for searching for background music is selected by the user). It may be. In this case, the controller 401 may assign and display different numbers to the detected background music according to the order of playing time of the detected background music.

The controller 401 transmits PCM data corresponding to the detected background music to the server 500 through the communication unit 404 to transmit information (music information) on the detected background music to the server 500. Request to (S24). For example, the communication unit 404 connects to the server 500 through a wired or wireless communication network under the control of the control unit 401, and PCM data corresponding to the detected background music to the server 500. The server 500 requests the server 500 to transmit information about the detected background music (music information). On the other hand, the control unit 401 generates an audio (Fingerprint) (Musical ID) for music recognition on the basis of the PCM data, and the audio fingerprint to the server 500 (for example, It can also be sent to the Gracenote Database.

The server 500 searches for music information matching the PCM data or music information matching the audio fingerprint, and transmits the searched music information to the communication unit 404 through the communication network. For example, the server 500 (e.g., Gracenote Database) may include a singer's name, title, and representative image (e.g., thumbnail) of the background music based on the PCM data or the audio fingerprint. Music information including an image), an album name, purchase site information for purchasing background music, and the like, is retrieved, and the retrieved music information is transmitted to the communication unit 404 through the communication network.

The communication unit 404 receives the music information from the server 500 (S25), and outputs the received music information to the control unit 401.

The control unit 401 displays the music information on the display unit 403 (S26). For example, the controller 401 displays the music information and the overview information of the video on the display unit 403.

On the other hand, the controller 401 determines whether music history information is selected by the user (S27). For example, the controller 401 determines whether a key (not shown) for confirming the music history information is selected by the user in order for the user to confirm the music history information.

The control unit 401 displays the music history information on the display unit 403 when a key for confirming the music history information is selected by the user (S28).

9 is an exemplary view showing music history information displayed on a display unit according to the second embodiment of the present invention.

As shown in Fig. 9, the control unit 401 is a video playback time bar 9-1 when a key for confirming the music history information is selected by a user, and summary information (7- 7) for the video. 1) and the music history information including the playback time of the detected music (the time when the video has passed 55 minutes and 34 seconds) 9-2 is displayed on the display unit 403. The music history information may further include a representative image (eg, a thumbnail image of the corresponding music file) 9-4 of the detected background music.

The controller 401 may display an icon 9-3 indicating the playback time point 9-2 of the detected music on the video playback time bar 9-1.

Therefore, the information providing apparatus and method thereof according to the second embodiment of the present invention display moving picture data on a display unit, detect music data in the moving picture data, and provide music history information on the detected music data to the user. By providing, the user can intuitively check the information related to the music in the video.

Hereinafter, an information providing method according to a third embodiment of the present invention will be described with reference to FIGS. 5 and 10-11.

10 is a flowchart showing an information providing method according to a third embodiment of the present invention.

First, the controller 401 displays a video selected by the user on the entire screen of the display unit 403 (S31). For example, the controller 401 plays the video selected by the user through the display unit 403. The control unit 401 retrieves movie data from a hard disk drive (HDD), Universal Serial Bus (USB), Disc, digital living network alliance (DLNA), Common Internet File System (CIFS), online server, The retrieved movie data can be displayed on the display unit 403.

The controller 401 determines whether a key for detecting music data (eg, background music data) in the video is selected by the user (S32).

When the input for searching for background music is received (for example, when a key for searching for background music is selected by the user), the controller 401 moves the display unit 403 to a first area and a second area. Separated by.

The control unit 401 displays the video data currently being played on the first area of the display unit when the input for searching for the background music is received (S33), and the background music (music data) from the currently playing video data. To automatically detect in real time (S34). For example, the control unit 401 extracts Pulse Code Modulation (PCM) data from the video data being played, determines whether the data currently being played is music data based on the extracted PCM data, and determines whether the current playback is performed. When the data to be used is music data, the PCM data corresponding to the music data (background music) is detected.

The controller 401 transmits PCM data corresponding to the detected background music to the server 500 through the communication unit 404 to transmit information (music information) on the detected background music to the server 500. Request to (S35). For example, the communication unit 404 connects to the server 500 through a wired or wireless communication network under the control of the control unit 401, and PCM data corresponding to the detected background music to the server 500. The server 500 requests the server 500 to transmit information about the detected background music (music information). On the other hand, the control unit 401 generates an audio (Fingerprint) (Musical ID) for music recognition on the basis of the PCM data, and the audio fingerprint to the server 500 (for example, It can also be sent to the Gracenote Database.

The server 500 searches for music information matching the PCM data or music information matching the audio fingerprint (music identifier), and transmits the searched music information to the communication unit 404 through the communication network. . For example, the server 500 (e.g., Gracenote Database) may include a singer's name, title, and representative image (e.g., thumbnail) of the background music based on the PCM data or the audio fingerprint. Music information including an image), an album name, purchase site information for purchasing background music, and the like, is retrieved, and the retrieved music information is transmitted to the communication unit 404 through the communication network.

The communication unit 404 receives the music information from the server 500, and outputs the received music information to the control unit 401. The control unit 401 displays the music information on the display unit 403 (S36). For example, the controller 401 displays the video in the first area, the video playback time bar, the playback time of the detected music (the time when the video passes 55 minutes and 34 seconds), and the detected background. A representative image of the music (for example, a thumbnail image of the music file) and an icon representing the playback time of the detected music are displayed in the second area of the display unit 403.

11 is an exemplary view showing music information displayed on a display unit according to the third embodiment of the present invention.

As shown in Fig. 11, the control unit 401 selects the video 11-1 when a key for detecting music data (e.g., background music data) in the video is selected by the user. The display unit 403 displays the first area, and the video reproduction time bar 9-1 is displayed on the second area of the display unit 403. Further, the control unit 401 detects the detection on the moving picture playback time bar 9-1 when a key for detecting music data (for example, background music data) in the moving picture is selected by the user. A playback time of a piece of music (e.g., when the video has passed 55 minutes and 34 seconds) 9-2 is displayed, and the representative image of the detected background music is displayed at the playing time 9-2 of the detected music. (E.g., a thumbnail image of the music file) 9-4, and an icon 9-3 indicating the playback time of the detected music is displayed at the playback time 9-2 of the detected music. It is displayed on the second area of the display unit 403.

Therefore, the information providing apparatus and method thereof according to the third embodiment of the present invention display the moving picture data in the first area of the display unit and display the music information for the music data in the moving picture data in the second area of the display unit. The user can intuitively check the music information while watching the moving image.

Hereinafter, an information providing method according to a fourth embodiment of the present invention will be described with reference to FIGS. 5, 12, and 13.

12 is a flowchart illustrating an information providing method according to a fourth embodiment of the present invention.

First, the controller 401 displays the video selected by the user on the display unit 403 (S41). For example, the controller 401 plays the video selected by the user through the display unit 403. The control unit 401 retrieves movie data from a hard disk drive (HDD), Universal Serial Bus (USB), Disc, digital living network alliance (DLNA), Common Internet File System (CIFS), online server, The retrieved movie data can be displayed on the display unit 403.

The controller 401 determines whether a key for detecting music data (eg, background music data) in the video is selected by the user (S42).

The controller 401 detects background music from video data currently being played when an input for searching for background music is received (for example, when a key for searching for background music is selected by the user) (S43). ). For example, the control unit 401 extracts Pulse Code Modulation (PCM) data from the video data being played, determines whether the data currently being played is music data based on the extracted PCM data, and determines whether the current playback is performed. When the data to be used is music data, the PCM data corresponding to the music data is detected.

The control unit 401 is a moving image image corresponding to the playback time when the background music is detected when an input for searching for background music is received (for example, when a key for searching for background music is selected by the user). In operation S44, the captured video image is stored in the storage unit 402 as a thumbnail image. At this time, the controller 401 stores the reproduction time (music reproduction time) information from which the background music is detected (S45).

The controller 401 transmits PCM data corresponding to the detected background music to the server 500 through the communication unit 404 to transmit information (music information) on the detected background music to the server 500. Request to (S46). For example, the communication unit 404 connects to the server 500 through a wired or wireless communication network under the control of the control unit 401, and PCM data corresponding to the detected background music to the server 500. The server 500 requests the server 500 to transmit information about the detected background music (music information). On the other hand, the control unit 401 generates an audio (Fingerprint) (music identifier, Musical ID) for music recognition on the basis of the PCM data, the server 500 (eg For example, to Gracenote Database).

The server 500 searches for music information matching the PCM data or music information matching the audio fingerprint, and transmits the searched music information to the communication unit 404 through the communication network. For example, the server 500 (e.g., Gracenote Database) may include a singer's name, title, and representative image (e.g., thumbnail) of the background music based on the PCM data or the audio fingerprint. Music information including an image), an album name, purchase site information for purchasing background music, and the like, is retrieved, and the retrieved music information is transmitted to the communication unit 404 through the communication network.

The communication unit 404 receives the music information from the server 500 (S47), and outputs the received music information to the control unit 401.

The controller 401 displays the music information and the captured video image (thumbnail image) on the display unit 403 (S48).

13 is an exemplary view showing a background music list displayed on the display unit according to the fourth embodiment of the present invention.

As shown in Fig. 13, when the key for searching for the background music is selected by the user, the controller 401 recalls the video outline information 7-1 together with the background music list 7-2. Displayed on the display unit 403. The background music list 7-2 includes playback time information 7-3 of each background music, a title (or singer name of each background music) 7-4 of each background music, and a time point at which each background music is detected. Includes a moving image image (thumbnail image) 13-1.

The controller 401 determines whether the displayed video image (thumbnail image) is selected by the user (S49). For example, the controller 401 determines which one of the displayed video images (thumbnail images) is touched.

The controller 401 may be configured based on "playback time information at which background music is detected" stored in the storage unit 402 when any one of the displayed moving image images (thumbnail images) is selected by the user. The video is played back from the point of time when the background music is detected (S50). Here, the video image and the video file are linked to each other.

For example, when one of the displayed moving image images (thumbnail images) is selected by the user, the controller 401 may select "playback time information at which background music is detected" corresponding to the selected moving image image. Read from the storage unit 402. The controller 401 plays the video from the time point at which the background music is detected based on the "playback time information at which the background music is detected" read from the storage unit 402, so that the user corresponds to the selected video image. You can watch videos and music together.

Therefore, the information providing apparatus and method thereof according to the fourth embodiment of the present invention detect the music data in the moving picture data, capture the moving picture image corresponding to the point in time at which the music data is detected, and the music for the music data. By displaying the information and the moving image together, the user may intuitively select a desired music.

An information providing apparatus and method thereof according to a fourth embodiment of the present invention detects music data in moving image data, captures a moving image image corresponding to a point in time at which the music data is detected, By displaying the moving image together and playing the moving image from the time when the music data is detected when the moving image is selected, the user may enjoy the moving image and the music together.

As described above in detail, the information providing apparatus and method thereof according to the embodiments of the present invention display video data on a display unit, detect music data in the video data, and music information on the detected music data. By providing, information about an object (eg, music) in the video can be easily provided to the user.

An information providing apparatus and method thereof according to embodiments of the present invention display a video data on a display unit, detect music data in the video data, and provide music history information on the detected music data to a user. The user can intuitively check the information related to the music in the video.

The information providing apparatus and method thereof according to the embodiments of the present invention display a moving image data on a first area of a display unit and display music information on music data in the moving image data on a second area of the display unit. You can intuitively check the music information while listening to music.

An information providing apparatus and method thereof according to embodiments of the present invention detect music data in video data, capture a video image corresponding to a point in time at which the music data is detected, and provide music information and the music information for the music data. By displaying video images together, the user can intuitively select the desired music.

An information providing apparatus and method thereof according to embodiments of the present invention detect music data in video data, capture a video image corresponding to a point in time at which the music data is detected, and provide music information and the music information for the music data. By displaying a moving image together and playing back the moving image from the time point at which the music data is detected when the moving image is selected, the user can also enjoy the moving image and the music together.

Those skilled in the art will appreciate that various modifications and variations can be made without departing from the essential features of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas falling within the scope of the same shall be construed as falling within the scope of the present invention.

401: control unit 402: storage unit
403: display unit 404: communication unit
500: server

Claims (26)

A display unit which displays video data;
And a controller for detecting music data in the video data and providing music information on the detected music data, wherein the controller displays music history information of music data in the video data on the display unit. Information providing device. The method of claim 1, wherein the music history information,
And a playback time bar of a moving picture, a summary information of the moving picture, and a reproduction time of the detected music data. The method of claim 2, wherein the music history information,
And a representative image of the detected music data. 3. The apparatus of claim 2,
And an icon representing a playback time point of the detected music data is displayed on the video playback time bar. The method of claim 1, wherein the control unit,
And detecting music data from the video data when an input for searching music is received and displaying music information on the detected music data on the display unit. The method of claim 1, wherein the control unit,
And automatically detecting music data from the video data, and displaying music information on the automatically detected music data on the display unit. The method of claim 1, wherein the control unit,
Information automatically detecting music data from the video data when an input for searching for music is received, and numbering and displaying the detected music data according to a playback time sequence of the detected music data; Provision device. The method of claim 1, wherein the control unit,
And a communicator configured to transmit pulse code modulation (PCM) data corresponding to the detected music data to a server through a communication network and to receive music information matching the detected PCM data from the server. Device. The method of claim 1, wherein the control unit,
And a communication unit generating a music identifier for recognizing the detected music data, transmitting the generated music identifier to a server through a communication network, and receiving music information matching the music identifier from the server. Informational device. The method of claim 1, wherein the control unit,
And when the input for searching for music is received, music information on the music data, outline information of the video data, and a representative image of the music data are displayed on the display unit. The method of claim 1, wherein the control unit,
When the input for searching for music is received, the video data is displayed on a first area of the display unit, and music information on music data included in the video data is displayed on a second area of the display unit. Information providing device. The method of claim 1, wherein the control unit,
And a video image corresponding to a playback time point at which the music data is detected, and displaying the captured video image on the display unit together with the music information. 13. The apparatus according to claim 12,
And reproducing the moving image data from a reproduction time point at which the music data is detected when the moving image image is selected. Displaying video data on a display unit;
Detecting music data in the moving image data and providing music information on the detected music data;
And displaying music history information of music data in the moving image data on the display unit. The method of claim 14, wherein the music history information,
And a video playback time bar, a summary information on the video, and a playback time point of the detected music data. The method of claim 15, wherein the music history information,
And a representative image of the detected music data. The method of claim 15, wherein the music history information,
And an icon representing a playback time point of the detected music data. The method of claim 14, wherein providing music information about the detected music data comprises:
Detecting the music data from the video data when an input for searching for music is received;
And displaying music information on the detected music data on the display unit. The method of claim 14, wherein providing the music information comprises:
Automatically detecting the music data from the video data when an input for searching for music is received;
And numbering and displaying the detected music data according to the order of playback time of the detected music data. The method of claim 14, wherein providing the music information comprises:
Transmitting Pulse Code Modulation (PCM) data corresponding to the detected music data to a server through a communication network;
Receiving music information matching the detected PCM data from the server. The method of claim 14, wherein providing the music information comprises:
Generating a music identifier for recognizing the detected music data;
Transmitting the generated music identifier to a server through a communication network;
Receiving music information matching the music identifier from the server. The method of claim 14, wherein providing the music information comprises:
And displaying the music information on the music data, the outline information of the video data, and a representative image of the music data on the display unit when an input for searching for music is received. The method of claim 14, wherein providing the music information comprises:
Displaying the video data in a first area of the display unit when an input for searching music is received;
And displaying music information on music data included in the video data in a second area of the display unit. 15. The apparatus of claim 14,
And automatically detecting music data from the video data, and displaying music information on the automatically detected music data on the display unit. The method of claim 1, wherein the control unit,
And a video image corresponding to a playback time point at which the music data is detected, and displaying the captured video image on the display unit together with the music information. The method of claim 25, wherein the control unit,
And reproducing the moving image data from a reproduction time point at which the music data is detected when the moving image image is selected.

Images