KR101411636B1 - System, apparatus, method and computer readable recording medium for providing n-screen service through the recognition of circumstantial based on the smart tv - Google Patents

Abstract

The present invention relates to a system for providing an N-screen service through smart TV-based situation awareness which can simultaneously provide broadcasting services for a plurality of smart image devices, and in particular, comprises a plurality of terminals which display received image information on their screens; a plurality of motion recognition sensors which analyzes an image taken by a camera to recognize a motion; a plurality of expansion devices which is connected to the motion recognition sensors and the terminals, respectively, identifies at least one preset event from information sensed from the motion recognition sensor, transmits the event to a main set top box, and provides image information received from the main set top box to a connected corresponding terminal; and the main set top box which receives at least one piece of identified event information from each expansion device, determines a specific terminal to which image information is transmitted, and transmits corresponding image information to a corresponding expansion device connected to a determined terminal.

Description

TECHNICAL FIELD [0001] The present invention relates to a system, an apparatus, a method, and a computer-readable storage medium for providing an environment-aware service through a situation awareness based on a smart TV. BACKGROUND OF THE INVENTION }

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an N-screen service capable of reproducing contents on a plurality of terminals, and more particularly, to an N-screen service capable of reproducing contents on a plurality of terminals, A service providing system, an apparatus, a method, and a computer-readable recording medium.

Following the era of smartphones, the spread of smart TVs is rapidly increasing, and the connectivity of Internet-of-Thing (IOT) devices and the demand for context-aware smart services based on them are increasing rapidly.

Recently, N-screen technology has been studied as a next-generation network service that can use the same contents in a plurality of terminal devices. N screen is a next-generation computing network service that enables one content to be shared among various digital information devices such as smart phones, PCs, smart TVs, tablet PCs, and automobiles.

The N-screen technology can continuously view one content at any time, regardless of time, place, or digital device. Therefore, it is a service that can watch movies downloaded from a computer on a TV, view it on a subway, on a smart phone, or on a tablet PC. In this case, N means that a plurality of digital terminals can be connected with an irregular integer, and it is an expanded concept of '3 screen play' meaning that three screens such as a mobile phone, a PC, and a TV can be continuously viewed.

The N-screen service can share and execute multiple contents anytime and anywhere through a more advanced smart system on an industrial system divided into CPNT (Contents, Platform, Network, Terminal) It can provide a centralized service.

Meanwhile, due to the development of electronic technology, users in the home have various smart devices, but in the current digital broadcasting receiving environment, it is possible to output a service to only one device with respect to one set-top box.

Accordingly, there is a need for a method capable of simultaneously outputting broadcast data to a plurality of devices through one set-top box in cooperation with the N-screen technology. Also, there is a need for various studies to control the N screen in connection with the behavior of the user.

An object of the present invention is to monitor and collect the context of an IOT device connected to a mobile device scattered in various places, a smart TV and a digital set-top box, and recognize the situation of a user, a thing, a building, etc. based on the collected context An apparatus, a method, and a computer-readable recording medium that can provide a smart service optimized for the situation and dynamically provide the smart service.

In order to achieve the above-described object of the present invention and to achieve the specific effects of the present invention described below, the characteristic structure of the present invention is as follows.

According to an aspect of the present invention, there is provided a system for providing an escreen service through context awareness based on a smart TV, comprising: a plurality of terminals displaying received video information on a screen; A plurality of motion recognition sensors for analyzing an image photographed by the camera and recognizing the motion; And a control unit connected to the operation recognition sensor and each terminal for identifying at least one preset event from information sensed by the operation recognition sensor and transmitting the identified event to the main set top box, A plurality of connection expansion devices provided to the terminal; And a main set-top box for receiving at least one identified event information from each of the connection expansion devices, determining a specific terminal to which the video information is to be transmitted, and transmitting the corresponding video information to the connection extension device connected to the determined terminal do.

Preferably, the system further includes a video output device connected to the main set top box and displaying the video information provided from the main set top box on the screen.

Preferably, the system further includes a main motion recognition sensor connected directly to the main set-top box and analyzing an image photographed by the camera to recognize the motion.

Preferably, each of the connection expansion devices provides service context information corresponding to the identified event information to the main set top box.

Preferably, the preset event information is an event for changing a streaming service to a neighboring terminal of a user when movement within a service space of the specific terminal occurs.

Preferably, the preset event information is an event for suspending or terminating the streaming service which is currently being played back when the user is out of the viewing range of the specific terminal.

According to another aspect of the present invention, a main set top box includes a sensor interface unit for receiving sensed information from motion recognition sensors that analyze an image photographed by a camera and recognize an operation; An event identification unit for identifying at least one preset event by information received from the sensor interface unit; A network interface unit for receiving preset event information corresponding to information sensed by an operation recognition sensor connected to the connection expansion unit from a connection expansion unit connected to each terminal to be displayed; And a control unit for receiving at least one identified event information from each of the connection expansion devices to determine a specific terminal to which the video information is to be transmitted and controlling the connection extension apparatus connected to the determined terminal to transmit the corresponding video information do.

Preferably, the control unit further includes a user location identification unit for identifying a location of a user based on information received from the connection expansion device.

According to another aspect of the present invention, there is provided a method of providing an escreen service through context awareness based on a smart TV, wherein each step performed in a main set-top box includes motion recognition sensors for analyzing an image photographed by a camera, Receiving the sensed information from the sensor; Identifying at least one preset event by the received information; Receiving preset event information corresponding to information sensed through a motion recognition sensor connected to the connection expansion device from a connection extension device connected to each terminal to be displayed; Receiving the at least one identified event information and determining a specific terminal to transmit image information; And controlling the corresponding connection extension device connected to the determined terminal to transfer the corresponding image information.

Advantageously, the method further comprises identifying a location of the user by aggregating information received from the connection expansion device.

Preferably, the preset event information is an event for changing a streaming service to a neighboring terminal of a user when movement within a service space of the specific terminal occurs.

Preferably, the preset event information is an event for suspending or terminating the streaming service which is currently being played back when the user is out of the viewing range of the specific terminal.

Meanwhile, the information for performing the service providing procedure through the context awareness of the smart TV may be stored in a recording medium readable by the server computer. Such a recording medium includes all kinds of recording media in which programs and data are stored so that they can be read by a computer system. Examples include ROMs (Read Only Memory), Random Access Memory, CD (Compact Disk), DVD (Digital Video Disk) -ROM, magnetic tape, floppy disk, optical data storage device, (For example, transmission over the Internet). Such a recording medium may also be distributed over a networked computer system so that computer readable code in a distributed manner can be stored and executed.

As described above, according to the present invention, it is possible to eliminate restrictions on service output devices in the home through a set-top box supporting a plurality of smart video devices and an N screen service.

In addition, according to the present invention, there is an advantage that a relay service of two broadcast services can be simultaneously performed on a target smart video device existing in the same network through one main set-top box.

In addition, according to the present invention, it is possible to provide an optimum N screen service experience (User Experience) by providing an optimization function for processing image quality such as media format and screen resolution in parallel for each streaming target device in order to minimize service relay and optimize service ; UE) can be guaranteed.

FIG. 1 is a view illustrating an encircling service providing system through context awareness based on a smart TV according to the present invention.
2 is a view illustrating a detailed structure of a connection expansion device according to an embodiment of the present invention.
3 is a view showing the detailed structure of a main set-top box according to an embodiment of the present invention.
FIG. 4 is a flowchart illustrating a procedure for providing an ascreen service through context awareness based on a smart TV according to an embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which the claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a device for retransmitting a broadcast service received through a single set-top box to a screen format suitable for a plurality of smart video devices, more specifically, Or more broadcasting services to a plurality of smart video devices existing in the same network using streaming technology in real time.

In addition, according to an embodiment of the present invention, a user and a device are identified by using a sensor recognition technique for quality control and monitoring of a service, and a service control method suitable for each situation is determined after grasping a service viewing state of a user.

Therefore, according to the present invention, a set-top box that supports N screen services for a plurality of smart video devices can eliminate constraints on service output devices at home. In addition, it is possible to relay service of two or more broadcasting services simultaneously to the target smart video devices existing in the same network. In order to minimize the service relay and optimize the service, the video quality such as the media format and the screen resolution, It is possible to provide an optimum N screen service experience to the user.

The term 'terminal' as an object of the N screen in the following description includes not only a smart TV, a general desktop computer but also a smart phone. The 'terminal' may be a mobile communication terminal, a desktop computer, a notebook computer, a workstation, a palmtop computer A digital device having a memory means such as a personal digital assistant (PDA), a web pad, a settop box (STB), and the like and equipped with a microprocessor, As shown in FIG.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention.

First, a system and an apparatus according to an embodiment of the present invention will be described with reference to FIGS. 1 to 3, and a method according to an embodiment of the present invention will be described with reference to FIG.

FIG. 1 is a view illustrating an encircling service providing system through context awareness based on a smart TV according to the present invention.

1, a system according to an embodiment of the present invention includes N connection expansion devices 110a to 110n, N terminals 111a to 111n, N operation recognition sensors 112a to 112n, 1 communication network 120, a main set top box 130, a main operation recognition sensor 131, a video output apparatus 140, a second communication network 150, a service server 160, a terrestrial broadcast server 170, A cable broadcasting server 180, a satellite broadcasting server 190, and the like.

The main set top box 130 receives video information from the service server 160, the terrestrial broadcast server 170, the cable broadcast server 180, the satellite broadcast server 190, and the like through the second communication network 150, And provides the image information corresponding to the selected channel among the received image information to at least one of the N terminals 111a to 111n or the image output apparatus 140 according to an embodiment of the present invention.

In this case, the main set-top box 130 refers to the service context information provided from the N motion recognition sensors 112a to 112n to transmit the first communication The image can be transmitted through the network 120. [ In addition, the main set top box 130 may provide broadcast images received through the video output apparatus 140 (e.g., TV) directly connected thereto. The detailed configuration of the main set top box 130 will be described later with reference to FIG.

Each connection expansion device 110 is connected to each terminal 111 and decodes the video information received from the main set top box 130 and provides the decoded video information to each terminal 111, So that the image is displayed on the screen. In addition, an operation recognition sensor 112 is connected to each of the connection expansion devices 110 and receives information sensed from the connected operation recognition sensor 112 and transmits the sensed information to the main set top box 130 ). The detailed configuration of the connection expansion device 110 will be described later in the description of FIG. Also, the main operation recognition sensor 131 may be connected to the main set-top box 130, and directly receive the sensed information from the main operation recognition sensor 131 connected thereto.

The motion recognition sensor 112 performs a function of identifying a user who views the terminal 111 and an action of the user. The motion recognition sensor 112 may be a kinetic sensor combined with a camera and a kinetic determination unit. In this way, the information sensed by each of the motion recognition sensors 112 is provided to the connected expansion device 110, and the connection expansion device 110 transmits the sensing information collected from each motion recognition sensor 112 to the main set- Box 130 as shown in FIG. The main set-top box 130 receives the information sensed by the corresponding operation extension sensor 110 from each of the connection extension devices 110, thereby determining which image information is to be provided to which terminal 111.

The first communication network 120 or the second communication network 150 may be configured without discriminating the communication modes such as wired and wireless and may be a personal area network (PAN), a local area network (LAN) , A metropolitan area network (MAN), a wide area network (WAN), and the like. Also, the first communication network 120 or the second communication network 150 may be a known World Wide Web (WWW), and may be a wireless communication network such as an Infrared Data Association (IrDA) or Bluetooth Wireless transmission techniques used for short-range communication may also be used. 1, the first communication network 120 and the second communication network 150 are shown separately, but they may be integrated into one communication network. That is, it is also possible to implement the present invention over the same communication network.

The video output apparatus 140 is connected to the main set top box 130 and displays various broadcast signals received from the main set top box 130 on the screen. The video output apparatus 140 may be a TV (or a smart TV), and any apparatus having a display means may be the video output apparatus 140 of the present invention.

Hereinafter, the detailed structure of the main devices constituting the system will be described with reference to FIGS. 2 and 3. FIG.

2 is a view illustrating a detailed structure of a connection expansion device according to an embodiment of the present invention. 2, the connection expansion device 110 according to the embodiment of the present invention includes a sensor interface (I / F) unit 210, an event identification unit 220, a network I / F unit 230, an A / V streaming capture unit 240, an A / V decoding unit 250, a control unit 260, a UI generating unit 270, an image forming unit 280, an A / V output unit 290, . The control unit 260 may include an event processing unit 210 and a user identification unit 210.

Meanwhile, the connection expansion device 110 is a device that allows a broadcast image to be received from the main set-top box 130 through a streaming service according to an embodiment of the present invention.

More specifically, the sensor I / F unit 210 receives the sensed information from the motion recognition sensor 1120 connected to each connection expansion device 110, and transmits the sensed information to the event identification unit 220. The event identification unit 220 receives the sensed information and identifies whether an event has occurred. For example, at present, it identifies whether the user is located near the connection expansion device 110, whether the user is watching TV, and the like. When a specific event is detected in the event identification unit 220, the controller 260 transmits the detected event information to the controller 260. [ At this time, the event processing unit 261 of the controller 260 generates a service context corresponding to the detected event and transmits the service context to the main set top box 130 through the network I / F unit 230. Also, the user identification unit 262 of the control unit 260 identifies the user who generated the event according to the sensed information. At this time, the information on the user to be identified by the user identification unit 262 may be information on the user registered in advance in the database.

Meanwhile, the connection expansion device 130 receives an IP-based video stream transmitted through the main set-top box 130 according to an embodiment of the present invention, decodes the video stream, and outputs the decoded video stream to a TV screen. More specifically, when video stream information is received from the main set top box 130 through the network I / F unit 230, the A / V streaming capture unit 240 extracts A / V And the A / V decoding unit 250 decodes the received video A / V image streaming information.

Then, the image forming unit 280 composes the decoded A / V image streaming information with the UI information generated through the UI generating unit 270 to output the synthesized image. The A / V output unit 290 outputs the image formed through the image forming unit 280 to the display unit of the connected terminal 111 and displays the image on the screen.

As described above, the connection expansion device 130 senses various behavior information of the user located at the corresponding location and transmits corresponding service context information to the main set top box 130, And receives the video streaming information to be output from the terminal 111 connected to the extension device 130, and processes the received video streaming information so that the streaming information is output from the connected terminal 111.

3 is a view showing the detailed structure of a main set-top box according to an embodiment of the present invention. 3, the main set top box 130 according to the embodiment of the present invention includes a sensor I / F unit 311, an event identification unit 312, a camera I / F unit 321, a tuner I / A storage unit I / F unit 331, an A / V storage management unit 332, a control unit 340, a UI generating unit 351, an image forming unit 352, an A / V output unit 353, an A / V encoding unit 361, an A / V streaming unit 362, a network I / F unit 363, and the like. The control unit 340 may include an event processing unit 341, an A / V input control unit 342, a user location identifying unit 343, a device identifying unit 344, and the like.

Meanwhile, the main set top box 130 according to the embodiment of the present invention searches for and registers a smart video device (e.g., terminal 111) existing on the same network. Also, the registered streaming output profile for each device is managed.

More specifically, the main set-top box 130 collects a service context provided from a motion recognition sensor attached to the device, or collects a service context provided from the registered smart device. That is, information sensed from the main operation recognition sensor 131 connected to the main set top box 130 is received through the sensor I / F unit 311 and transferred to the event identification unit 312. The event identification unit 312 receives the sensed information and identifies whether an event has occurred. For example, it identifies whether the user is located near the video output device 140 currently connected to the main set top box 130, whether the user is watching the TV, and the like. If a specific event is detected in the event identification unit 312, the controller 340 transmits the detected event information to the controller 340. At this time, the event processing unit 341 of the control unit 340 generates a service context corresponding to the detected event.

The control unit 340 also receives service context information generated from the sensed information of the corresponding operation recognition sensor 112 from each of the connection expansion devices 110 via the network I / F unit 363 and provides the received service context information to the control unit 340 .

The event processing unit 341 of the control unit 340 analyzes the service contexts collected through the user request and the service monitoring to determine services such as user identification, service operation status determination, user operation identification, Determine the relevant situation. For example, when a movement within the service space range of the specific terminal 111 occurs, the streaming service is changed to the adjacent terminal 111 of the user, or when the user leaves the viewing range of the terminal 111, Or terminate it.

The user location identifying unit 343 of the control unit 340 identifies the location of the user by combining the received service context information. At this time, the device identification unit 344 judges whether the user is located in proximity to which terminal 111 by using the identified user's location information, thereby identifying a device (i.e., a nearby terminal 111) .

The A / V input control unit 342 controls video streaming information to be transmitted to each of the at least one terminal 111 by referring to the identified user location and device information. That is, the A / V input control unit 342 determines the target terminal 111 based on the user context and the service context collected from the service monitoring unit, and changes or determines the service output standard to be provided. At this time, the image information to be transmitted may be provided to the camera I / F unit 321 and the tuner I / F unit 322. The image information received from the external camera or the TV RF signal received through the camera I / F unit 321 and the tuner I / F unit 322 can be captured in the capture unit 323. In addition, the image information provided through the storage device I / F unit 331 may be stored in a separate storage unit (not shown) through the A / V storage management unit 332.

The A / V input control unit 342 of the control unit 340 provides the broadcast image information provided in various forms to each terminal 111 through the output unit 360. That is, the output unit 360 encodes the image service according to the process of the controller 340 and performs streaming output to the target smart device. At this time, streaming output for two or more broadcast services at the same time is possible.

That is, the A / V encoding unit 361 encodes the broadcasting image information to be transmitted, and provides the A / V streaming unit 362 with the encoded broadcasting image information. The A / V streaming unit 362 transmits the encoded broadcast image information through the network I / F unit 363 in a streaming format.

Also, the video output apparatus 140 directly connected to the main set-top box 130 can directly output the video service designated by the user. At this time, the image forming unit 352 combines the image information to be transmitted with the UI information generated through the UI generating unit 351 to form an image. The image information is provided to the image output device 140 through the A / F output unit 353. [

In the present specification, each functional unit (or module) may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, each functional unit may refer to a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and may be a code physically connected to the functional unit, But can be easily deduced to the average expert in the field of the invention.

Also, in this specification, a database may mean a functional and structural combination of software and hardware that stores information corresponding to each database. The database may be implemented as at least one table. In addition, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to the database.

Hereinafter, a method according to an embodiment of the present invention will be described with reference to FIG.

FIG. 4 is a flowchart illustrating a procedure for providing an ascreen service through context awareness based on a smart TV according to an embodiment of the present invention. According to an exemplary embodiment of the present invention, an input signal of the apparatus may be a Digital Broadcasting Service broadcast or an IP based MPEG2 TS that can be received by a user. At this time, the object of the relay service is a general TV connected to a smart video device or an extension device existing in the same network. The user requests a designated broadcast service to the designated device. At this time, the set-top box encodes and streams the broadcasting format and resolution suitable for the designated device. It is possible to take an appropriate situation by collecting the service context from the software installed in the terminal and the operation recognition sensor and monitoring the service status.

That is, referring to FIG. 4, channel tuning is first performed and content is played back (S401). At this time, service context information is received through each connection expansion device 110 as described above according to the embodiment of the present invention (S402). Then, it refers to the received service context to recognize the situation (S403), and identifies an appropriate device (terminal) to which the video information is to be transmitted (S404).

Then, the video information to be transmitted is encoded into an appropriate broadcasting format and resolution (i.e., target profile) of the target terminal (S405), and then streamed to the target terminal (target device) (S406). The corresponding streaming-transmitted image information is output from the target terminal (S407).

The various operations and functions as described herein with respect to the various methods may be performed by any of a number of types of functions, such as a particular processing function and / or a processing function implemented therein, and / ≪ / RTI > For example, such functions may be described herein, as well as performing various operations and processes as described herein, or any other operations and functions as described herein, etc., or the like, And may perform such operations, processes, and the like.

In some embodiments, such functions (which may be implemented on the same device or on distinct devices) may be implemented in such a manner and in accordance with various aspects of the present invention, etc., and / Operations and functions, and their equivalents. In some embodiments, such processing is performed together by the first functional portion in the first device and the second functional portion in the second device. In other embodiments, such processing, operations, etc. are performed entirely by the processing units within one particular apparatus. Even in other embodiments, such processing and operations are performed using at least a first functional portion and a second functional portion within a single device.

Also, in the foregoing description, the terms " system, " " device, " and " section " may be a single processing device or a plurality of processing devices. Such a processing device may be a microprocessor, a microcontroller, a digital signal processor, a microcomputer, a central processing unit, a field programmable gate array, a programmable logic device, a state machine, a logic circuit, an analog circuit, a digital circuit, and / (Analog and / or digital) based on hard coding of operational instructions. The processing module, module, processing circuit, and / or processing unit may be implemented as a single memory device, a plurality of memory devices, and / or a combination of the processing modules, the processing circuitry, and / Lt; / RTI > memory and / or an integrated memory element. Such a memory device may be any device that stores read only memory (ROM), random access memory (RAM), volatile memory, non-volatile memory, static memory, dynamic memory, flash memory, cache memory, and / . If the processing module, the module, the processing circuit, and / or the processing unit include one or more processing devices, the processing devices may be centrally located (i.e., directly or indirectly via a wired and / Connected), distributed (e.g., cloud computing via an indirect connection over a local and / or wide area network). If the processing module, module, processing circuit, and / or processing unit implements one or more of those functions through a static machine, analog circuitry, digital circuitry, and / or circuitry, memory and / It should further be noted that the corresponding operating instructions may be internal or external to the circuit including the static machine, analog circuitry, digital circuitry, and / or logic circuitry. The memory element may be stored and the processing module, module, processing circuitry, and / or processing unit may be configured to store a hard-coded and / or hard-coded data item corresponding to at least a portion of the steps and / or functions depicted in one or more of the figures It should be further noted that it carries out operational instructions. Such a memory device or memory element may be included within the components of the manufacture.

The invention has been described above with the aim of method steps illustrating the performance of certain functions and their relationships. The boundaries and order of these functional components and method steps have been arbitrarily defined herein for convenience of description. Alternative boundaries and sequences may be defined as long as the specific functions and relationships are properly performed. Any such alternative boundaries and sequences are therefore within the scope and spirit of the claimed invention. In addition, the boundaries of these functional components have been arbitrarily defined for ease of illustration. Alternative boundaries can be defined as long as certain important functions are properly performed. Likewise, the flow diagram blocks may also be arbitrarily defined herein to represent any significant functionality. For extended use, the flowchart block boundaries and order may have been defined and still perform some important function. Alternative definitions of both functional components and flowchart blocks and sequences are therefore within the scope and spirit of the claimed invention. Those skilled in the art will also appreciate that the functional components and other illustrated blocks, modules, and components herein may be implemented as illustrated or as separate components, such as semiconductor integrated circuits (ASICs) And the like, or any combination thereof.

The invention may also be described, at least in part, in the language of one or more embodiments. Embodiments of the invention are used herein to describe the invention, aspects thereof, features thereof, concepts thereof, and / or examples thereof. The physical embodiment of an apparatus, article of manufacture, machine, and / or process for implementing the invention may include one or more aspects, features, concepts, examples, etc., described with reference to one or more embodiments described herein . Moreover, in the entire drawings, embodiments may incorporate the same or similarly named functions, steps, modules, etc. that may use the same or different reference numerals, and so forth, Steps, modules, etc., may be the same or similar functions, steps, modules, etc., or the like.

In the meantime, the term " processing unit "is used in the description of various embodiments of the present invention. A module includes a functional block implemented via hardware to perform one or more functions, such as processing one or more input signals to produce one or more output signals. The hardware implementing the functional block may operate directly by combining software and / or firmware. As used herein, a module may include one or more sub-modules that are themselves modules.

While various combinations of features and specific combinations of features of the present invention are explicitly described herein, other combinations of these features and functions are likewise possible. The present invention is not limited to the specific examples disclosed herein, and explicitly incorporates these different combinations.

As described above, the present invention has been described with reference to particular embodiments, such as specific elements, and specific embodiments and drawings. However, it should be understood that the present invention is not limited to the above- And various modifications and changes may be made thereto by those skilled in the art to which the present invention pertains.

Accordingly, the spirit of the present invention should not be construed as being limited to the embodiments described, and all of the equivalents or equivalents of the claims, as well as the following claims, belong to the scope of the present invention .

110: connection extension device 111: terminal
112, 131: motion recognition sensor 120: first communication network
130: Main set-top box 140: Video output device
150: second communication network 160: service server
170: terrestrial broadcast server 180: cable broadcast server
190: Satellite broadcast server 210: Sensor I / F unit
220: Event identification unit 230: Network I / F unit
240: A / V streaming capturing unit 250: A / V decoding unit
260: control unit 261: event processing unit
262: user identification unit 270: UI generation unit
280: image forming section 290: A / V output section
311: Sensor I / F unit 312: Event identification unit
321: camera I / F unit 322: tuner I / F unit
323: Capture unit 331: Storage device I / F unit
332: A / V storage management unit 340:
341: Event processing unit 342: A / V input control unit
343: User location identification part 344: Device identification part
351: UI generating unit 352:
353: A / V output unit 361: A / V encoding unit
362: A / V streaming unit 363: Network I / F unit

Claims (14)

A system for providing an escreen service through context awareness based on a smart TV,
A plurality of terminals for displaying the received image information on a screen;
A plurality of motion recognition sensors for analyzing an image photographed by the camera and recognizing the motion;
And a control unit connected to the operation recognition sensor and each terminal for identifying at least one preset event from information sensed by the operation recognition sensor and transmitting the identified event to the main set top box, A plurality of connection expansion devices provided to the terminal; And
And a main set top box for receiving at least one identified event information from each of the connection expansion devices to determine a specific terminal to transmit the video information and transmitting the corresponding video information to the connection extension device connected to the determined terminal , Enscreen service provision system through context awareness based on smart TV.
The system of claim 1,
Further comprising a video output device connected directly to the main set top box and displaying video information provided from the main set top box on a screen.
3. The system of claim 2,
Further comprising a main operation recognition sensor directly connected to the main set top box and analyzing an image photographed by the camera to recognize an operation, wherein the system comprises a smart TV based context recognition service.
The apparatus of claim 1, wherein each connection expansion device
And provides the service context information corresponding to the identified event information to the main set top box.
The method as claimed in claim 1,
A system for providing an encrypnent service through a smart TV-based context recognition, which is an event for changing a streaming service to a neighboring terminal of a user when movement within a service space of a specific terminal occurs.
The method as claimed in claim 1,
Wherein the streaming service is suspended when the user is out of the viewing range of the specific terminal.
A sensor interface unit for receiving sensed information from motion recognition sensors for analyzing an image photographed by a camera and recognizing an operation;
An event identification unit for identifying at least one preset event by information received from the sensor interface unit;
A network interface unit for receiving preset event information corresponding to information sensed by an operation recognition sensor connected to the connection expansion unit from a connection expansion unit connected to each terminal to be displayed; And
And a controller for receiving at least one identified event information from each of the connection expansion devices to determine a specific terminal to which the video information is to be transmitted and controlling the connection extension device connected to the determined terminal to transmit the corresponding video information , Main set top box.
8. The apparatus of claim 7,
A device identification unit for receiving at least one identified event information from each of the connection extension devices and determining a specific terminal to transmit image information; And
And an A / V input controller for controlling transmission of corresponding video information to a corresponding connection extension device connected to the determined terminal.
9. The apparatus according to claim 8,
Further comprising a user location identification unit for identifying a location of a user by summing the information received from the connection extension device.
A method for providing an escrow service through context awareness based on a smart TV, wherein each step performed in a main set-
Receiving sensed information from motion recognition sensors for analyzing images photographed from a camera and recognizing motion;
Identifying at least one preset event by the received information;
Receiving preset event information corresponding to information sensed through a motion recognition sensor connected to the connection expansion device from a connection extension device connected to each terminal to be displayed;
Receiving the at least one identified event information and determining a specific terminal to transmit image information; And
And controlling the corresponding connection extension device connected to the determined terminal to transfer the corresponding video information to the corresponding connection extension device.
11. The method of claim 10,
Further comprising the step of identifying the location of the user by summing the information received from the connection expansion device.
[11] The method of claim 10,
A method for providing an enabling service through a smart TV based context recognition, which is an event for changing a streaming service to a neighboring terminal of a user when movement within a service space of a specific terminal occurs.
[11] The method of claim 10,
Wherein the streaming service is suspended when the user is out of the viewing range of the specific terminal.
A computer-readable recording medium storing a program for executing the method according to any one of claims 10 to 13.

Images