CN110087124A

CN110087124A - Long-range control method, terminal device and the smart television of smart television

Info

Publication number: CN110087124A
Application number: CN201910486755.XA
Authority: CN
Inventors: 管春辉; 丁科芝
Original assignee: Poly Polytron Technologies Inc
Current assignee: Poly Polytron Technologies Inc
Priority date: 2019-06-05
Filing date: 2019-06-05
Publication date: 2019-08-02
Also published as: WO2020244266A1

Abstract

The embodiment of the present invention provides the long-range control method, terminal device and smart television of a kind of smart television.The long-range control method of smart television of the invention, comprising: terminal device sends the first screenshotss solicited message in response to the operation of user, and the first screenshotss solicited message carries first identifier information；Smart television generates the first screenshot in response to the current display interface of the first screenshotss solicited message interception smart television, and uploads the first screenshot to image server；Terminal device obtains the first screenshot from image server according to first identifier information, and shows the first screenshot.The embodiment of the present invention can promote the precise control rate and efficiency of smart television.

Description

Remote control method of smart television, terminal device and smart television

Technical Field

The embodiment of the invention relates to the technology of smart televisions, in particular to a remote control method of a smart television, terminal equipment and a smart television.

Background

The smart television is a television product which is based on an Internet (Internet) application technology, has an open operating system and a chip, has an open application platform, can realize a bidirectional man-machine interaction function, integrates various functions such as audio and video, entertainment, data and the like, and meets the diversified and personalized requirements of users. With the development of the internet, smart televisions are increasingly popularized.

The remote controller is used for correspondingly controlling the smart television so as to meet the use requirements of users, such as watching TV dramas, news and the like. However, the smart television has powerful functions and more interface interactions, and the smart television is controlled by the remote controller with certain complexity, so that the smart television cannot be controlled quickly and accurately by the old or the child, and the control efficiency of the smart television is low.

Disclosure of Invention

The embodiment of the invention provides a remote control method of an intelligent television, terminal equipment and the intelligent television, so as to improve the control accuracy and efficiency of the intelligent television.

In a first aspect, an embodiment of the present invention provides a remote control method for a smart television, including: the terminal equipment responds to the operation of a user and sends first screen capturing request information, wherein the first screen capturing request information carries first identification information, and the first identification information is used for identifying a screen capturing corresponding to the first screen capturing request information by the smart television according to the first identification information; the smart television intercepts a current display interface of the smart television in response to the first screenshot request information, generates a first screenshot, and uploads the first screenshot to an image server; and the terminal equipment acquires the first screenshot from the image server according to the first identification information and displays the first screenshot.

In a second aspect, an embodiment of the present invention provides a remote control method for a smart television, including: the method comprises the steps that a terminal device responds to operation of a user and sends first screen cutting request information, wherein the first screen cutting request information carries first identification information, the first identification information is used for enabling a smart television to identify a screen cut corresponding to the first screen cutting request information according to the first identification information, and the first screen cutting request information is used for enabling the smart television to intercept a current display interface of the smart television and upload a first screen cut generated according to the first identification information to an image server; and the terminal equipment polls the image server according to the first identification information, and receives and displays the first screenshot of the image server responding to the polling feedback.

In a third aspect, an embodiment of the present invention provides a remote control method for a smart television, where the method includes: the method comprises the steps that the smart television receives first screen capturing request information, wherein the first screen capturing request information carries first identification information, and the first identification information is used for identifying a screen capturing corresponding to the first screen capturing request information according to the first identification information; the smart television intercepts a current display interface of the smart television according to the first screenshot request information and generates a first screenshot according to the first identification information; and the smart television uploads the first screenshot to an image server.

In a fourth aspect, an embodiment of the present invention provides a terminal device, including: the processing module is used for responding to the operation of the user received by the receiving module, sending first screenshot request information through the sending module, wherein the first screenshot request information carries first identification information, the first identification information is used for enabling the intelligent television to identify a screenshot corresponding to the first screenshot request information according to the first identification information, and the first screenshot request information is used for enabling the intelligent television to intercept a current display interface of the intelligent television and upload a first screenshot generated according to the first identification information to an image server; the processing module is further configured to poll the image server according to the first identification information, and receive and display the first screenshot of the image server in response to the polling feedback.

In a fifth aspect, an embodiment of the present invention provides an intelligent television, including: the receiving module is used for receiving first screenshot request information, wherein the first screenshot request information carries first identification information, and the first identification information is used for identifying a screenshot corresponding to the first screenshot request information by the smart television according to the first identification information; the processing module is used for intercepting the current display interface of the intelligent television according to the first screenshot request information and generating a first screenshot according to the first identification information; the processing module is further used for uploading the first screenshot to an image server through the sending module.

In a sixth aspect, an embodiment of the present invention provides a terminal device, including: a memory and a processor; the memory is used for storing instructions to make the processor execute the instructions so as to realize the remote control method of the intelligent television set according to the second aspect.

In a seventh aspect, an embodiment of the present invention provides an intelligent television, including: a memory and a processor; the memory is used for storing instructions to make the processor execute the instructions so as to realize the remote control method of the intelligent television according to the third aspect.

In an eighth aspect, an embodiment of the present invention provides a computer storage medium, including: the computer storage medium is for storing a computer program which, when executed, is for implementing the method of the first or second or third aspect.

According to the remote control method of the smart television, the terminal device and the smart television provided by the embodiment of the invention, the terminal device responds to the operation of a user and sends the first screenshot request information, the first screenshot request information carries the first identification information, the first identification information is configured to enable the smart television to identify the screenshot corresponding to the first screenshot request information according to the first identification information, the smart television responds to the first screenshot request information to intercept the current display interface of the smart television, a first screenshot is generated and uploaded to the image server, the terminal device obtains the first screenshot from the image server according to the first identification information and displays the first screenshot, and the first screenshot is used for displaying the current state of the smart television, so that the user can remotely control the smart television based on the current state, and the control accuracy and efficiency of the smart television are improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic view of an application scenario according to an embodiment of the present invention;

fig. 2 is a block diagram of a hardware configuration of the smart television 200 according to an embodiment of the present invention;

fig. 3 is a block diagram of a hardware configuration of the control apparatus 100 in the embodiment of the present invention;

fig. 4 is a schematic diagram of a functional configuration of the smart television 200 according to an embodiment of the present invention;

fig. 5a is a schematic diagram of software configuration in the smart television 200 according to an embodiment of the present invention;

fig. 5b is a schematic configuration diagram of an application program in the smart television 200 according to an embodiment of the present invention;

fig. 6A is an interaction flowchart of a remote control method of a smart television according to an embodiment of the present invention;

FIG. 6B is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 6C is a schematic view of an interface according to an embodiment of the present invention;

fig. 7A is an interaction flowchart of another remote control method for a smart television according to an embodiment of the present invention;

FIG. 7B is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 8 is a system architecture diagram according to an embodiment of the present invention;

fig. 9A is an interaction flowchart of another remote control method for a smart television according to an embodiment of the present invention;

FIG. 9B is a schematic view of an interface according to an embodiment of the present invention;

fig. 10 is an interaction flowchart of another remote control method for a smart television according to an embodiment of the present invention;

FIG. 11 is a schematic view of an interface according to an embodiment of the present invention;

fig. 12 is a schematic structural diagram of a terminal device according to an embodiment of the present invention;

fig. 13 is a schematic structural diagram of another terminal device according to an embodiment of the present invention;

fig. 14 is a schematic structural diagram of an intelligent television according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The terms "first," "second," and the like, as referred to herein, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application) that is typically wirelessly controllable over a relatively short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the smart tv 200 through the mobile terminal 300 and the control device 100.

The control device 100 may control the smart tv 200 in a wireless or other wired manner by using a remote controller, including infrared protocol communication, bluetooth protocol communication, other short-distance communication manners, and the like. The user may input a user command through a button on the remote controller, a voice input, a control panel input, etc. to control the smart tv 200. Such as: the user can input a corresponding control instruction through a volume up-down key, a channel control key, an up/down/left/right moving key, a voice input key, a menu key, a power on/off key and the like on the remote controller, so as to realize the function of controlling the smart television 200.

In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the smart tv 200. For example, the smart tv 200 is controlled using an application running on the smart device. The application, through configuration, may provide the user with various controls in an intuitive User Interface (UI) on a screen associated with the smart device.

For example, the mobile terminal 300 may install a software application with the smart tv 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. Such as: the control instruction protocol can be established between the mobile terminal 300 and the intelligent television 200, the remote control keyboard is synchronized to the mobile terminal 300, and the function of controlling the intelligent television 200 is realized by controlling the user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the smart television 200, so that the synchronous display function is realized.

As also shown in fig. 1, the smart tv 200 also performs data communication with the server 400 through various communication means. The smart tv 200 may be allowed to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the smart tv 200. Illustratively, the smart tv 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The servers 400 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.

The smart tv 200, distinguished from the display type, may include a liquid crystal display, an OLED display, a projection display device. The specific display device type, size, resolution, etc. are not limited, and those skilled in the art will appreciate that the smart tv 200 may have some changes in performance and configuration as desired.

The smart tv 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function.

A block diagram of a hardware configuration of the smart tv 200 according to an exemplary embodiment is exemplarily shown in fig. 2. As shown in fig. 2, the smart tv 200 includes a controller 210, a tuning demodulator 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 60-2, a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.

A display 280 for receiving the image signal from the video processor 260-1 and displaying the video content and image and components of the menu manipulation interface. The display 280 includes a display screen assembly for presenting a picture, and a driving assembly for driving the display of an image. The video content may be displayed from broadcast television content, or may be broadcast signals that may be received via a wired or wireless communication protocol. Alternatively, various image contents received from the network communication protocol and sent from the network server side can be displayed.

Meanwhile, the display 280 simultaneously displays a user manipulation UI interface generated in the smart tv 200 and used to control the smart tv 200.

And, a driving component for driving the display according to the type of the display 280. Alternatively, in case the display 280 is a projection display, it may also comprise a projection device and a projection screen. In some embodiments, the display may be a plasma display screen, a liquid crystal display screen, an OLED display screen, or a combination of an optical lens and an optical projection screen.

The communication interface 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communication interface 230 may be a Wifi chip 231, a bluetooth communication protocol chip 232, a wired ethernet communication protocol chip 233, or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown).

The smart tv 200 may establish control signal and data signal transmission and reception with an external control device or a content providing device through the communication interface 230. And an infrared receiver, an interface device for receiving an infrared control signal for controlling the apparatus 100 (e.g., an infrared remote controller, etc.).

The detector 240 is used by the smart tv 200 to collect signals of external environment or interaction with the outside. The detector 240 includes a light receiver 242, a sensor for collecting the intensity of ambient light, and parameters such as parameter changes can be adaptively displayed by collecting the ambient light.

The image acquisition device 241, such as a camera and a camera, may be used to acquire an external environment scene, acquire attributes of a user or interact gestures with the user, adaptively change display parameters, and recognize gestures of the user, so as to implement an interaction function with the user.

In some other exemplary embodiments, the detector 240, a temperature sensor, and the like may be further configured, for example, by sensing the ambient temperature, the smart tv 200 may adaptively adjust the display color temperature of the image. For example, when the temperature is higher, the color temperature of the image displayed by the smart tv 200 can be adjusted to be a cool tone, or when the temperature is lower, the image displayed by the smart tv 200 can be adjusted to be a warm tone.

In some other exemplary embodiments, the detector 240, a sound collector, and the like, such as a microphone, may be configured to receive a sound of a user, a voice signal including a control instruction for controlling the smart tv 200 by the user, or collect an environmental sound for identifying an environmental scene type, and the smart tv 200 may adapt to the environmental noise.

The input/output interface 250 controls data transmission between the smart tv 200 and other external devices through the controller 210. Such as receiving video and audio signals or command instructions from an external device.

Input/output interface 250 may include, but is not limited to, the following: any one or more of high definition multimedia interface HDMI interface 251, analog or data high definition component input interface 253, composite video input interface 252, USB input interface 254, RGB ports (not shown in the figures), etc.

In some other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the above-mentioned plurality of interfaces.

The tuning demodulator 220 receives the broadcast television signals in a wired or wireless receiving manner, may perform modulation and demodulation processing such as amplification, frequency mixing, resonance, and the like, and demodulates the television audio and video signals carried in the television channel frequency selected by the user and the EPG data signals from a plurality of wireless or wired broadcast television signals.

The tuner demodulator 220 is responsive to the user-selected television signal frequency and the television signal carried by the frequency, as selected by the user and controlled by the controller 210.

The tuner-demodulator 220 may receive signals in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcast, cable broadcast, satellite broadcast, or internet broadcast signals, etc.; and according to different modulation types, the modulation mode can be digital modulation or analog modulation. Depending on the type of television signal received, both analog and digital signals are possible.

In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio and video signals after modulation and demodulation, and the television audio and video signals are input into the smart television 200 through the input/output interface 250.

The video processor 260-1 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be directly displayed or played on the smart tv 200.

Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and the normal format is implemented in, for example, an interpolation frame mode.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

The audio processor 260-2 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, amplification processing, and the like to obtain an audio signal that can be played in the speaker.

In other exemplary embodiments, video processor 260-1 may comprise one or more chips. The audio processor 260-2 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated together with the controller 210 in one or more chips.

An audio output 272, which receives the sound signal output from the audio processor 260-2 under the control of the controller 210, such as: the speaker 272, and the external sound output terminal 274, in addition to the speaker 272 carried by the smart tv 200 itself, may be output to a generating device of an external device, such as: an external sound interface or an earphone interface and the like.

The power supply provides power supply support for the smart television 200 with power input from an external power source under the control of the controller 210. The power supply may include a built-in power supply circuit installed inside the smart tv 200, or may be a power supply interface installed outside the smart tv 200 and providing an external power supply in the smart tv 200.

A user input interface for receiving an input signal of a user and then transmitting the received user input signal to the controller 210. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication module.

For example, the user inputs a user command through the remote controller 100 or the mobile terminal 300, the user input interface responds to the user input through the controller 210, and the smart tv 200 responds to the user input.

In some embodiments, a user may enter a user command on a Graphical User Interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

The controller 210 controls the operation of the smart tv 200 and responds to the user's operation through various software control programs stored in the memory 290.

As shown in fig. 2, the controller 210 includes a RAM213 and a ROM214, and a graphic processor 216, a CPU processor 212, a communication interface 218, such as: a first interface 218-1 through an nth interface 218-n, and a communication bus. The RAM213 and the ROM214, the graphic processor 216, the CPU processor 212, and the communication interface 218 are connected via a bus.

A ROM213 for storing instructions for various system boots. If the power of the smart tv 200 starts to be started when the power-on signal is received, the CPU processor 212 executes the system start instruction in the ROM, and copies the operating system stored in the memory 290 to the RAM213, so as to start to execute the start operating system. After the start of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM213, and then starts running and starting the various application programs.

A graphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on the display 280.

A CPU processor 212 for executing operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. And a main processor for performing some operations of the smart tv 200 in a pre-power-up mode and/or displaying a picture in a normal mode. A plurality of or one sub-processor for one operation in a standby mode or the like.

The controller 210 may control the overall operation of the display apparatus 100. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input devices (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the smart tv 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes various software modules for driving the smart tv 200. Such as: various software modules stored in memory 290, including: the system comprises a basic module, a detection module, a communication module, a display control module, a browser module, various service modules and the like.

The basic module is a bottom layer software module for signal communication among the hardware in the postpartum care smart television 200 and sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

For example: the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the display 280 to display image content, and may be used to play information such as multimedia image content and UI interface. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between browsing servers. And the service module is used for providing various services and modules including various application programs.

Meanwhile, the memory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.

A block diagram of the configuration of the control apparatus 100 according to an exemplary embodiment is exemplarily shown in fig. 3. As shown in fig. 3, the control apparatus 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control device 100 is configured to control the smart tv 200, and may receive an input operation instruction of a user, and convert the operation instruction into an instruction recognizable and responsive by the smart tv 200, and function as an interaction intermediary between the user and the smart tv 200. Such as: the user responds to the channel plus and minus operation by operating the channel plus and minus keys on the control device 100.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the smart tv 200 according to user requirements.

In some embodiments, as shown in fig. 1, the mobile terminal 300 or other intelligent electronic device may function similarly to the control device 100 after installing an application for operating the smart tv 200. Such as: the user may implement the functions of controlling the physical keys of the device 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on the mobile terminal 300 or other intelligent electronic device.

The controller 110 includes a processor 112 and RAM113 and ROM114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components for communication and coordination and external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the smart tv 200 under the control of the controller 110. Such as: and sending the received user input signal to the smart television 200. The communication interface 130 may include at least one of a WiFi chip, a bluetooth module, an NFC module, and other near field communication modules.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touch pad 142, a sensor 143, keys 144, and other input interfaces. Such as: the user can realize the user instruction input function through actions such as voice, touch, gestures, pressing and the like, and the input interface converts the received analog signals into digital signals and converts the digital signals into corresponding instruction signals to be sent to the smart television 200.

The output interface includes an interface that transmits the received user instruction to the smart tv 200. In some embodiments, the interface may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, a user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the smart television 200 through the infrared sending module. The following steps are repeated: when the radio frequency signal interface is used, a user input instruction needs to be converted into a digital signal, and then the digital signal is modulated according to a radio frequency control signal modulation protocol and then is sent to the smart television 200 through a radio frequency sending terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is provided with a communication interface 130, such as: the WiFi, bluetooth, NFC, etc. modules may send the user input command to the smart tv 200 through the WiFi protocol, or bluetooth protocol, or NFC protocol encoding.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 200 under the control of the controller 110. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operational power support to the various elements of the control device 100 under the control of the controller 110. A battery and associated control circuitry.

Fig. 4 is a schematic diagram illustrating a functional configuration of the smart tv 200 according to an exemplary embodiment. As shown in fig. 4, the memory 290 is used to store an operating system, an application program, contents, user data, and the like, and performs various operations of driving the system operation of the smart tv 200 and responding to the user under the control of the controller 210. The memory 290 may include volatile and/or nonvolatile memory.

The memory 290 is specifically configured to store an operating program for driving the controller 210 in the smart tv 200, and store various application programs built in the smart tv 200, various application programs downloaded by a user from an external device, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and internal data of various supported applications. The memory 290 is used to store system software such as an OS kernel, middleware, and applications, and to store input video data and audio data, and other user data.

The memory 290 is specifically used for storing drivers and related data such as the audio/video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuning demodulator 220, the input/output interface of the detector 240, and the like.

In some embodiments, memory 290 may store software and/or programs, software programs for representing an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (e.g., the middleware, APIs, or applications), and the kernel may provide interfaces to allow the middleware and APIs, or applications, to access the controller to implement controlling or managing system resources.

The memory 290, for example, includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external instruction recognition module 2907, a communication control module 2908, a light receiving module 2909, a power control module 2910, an operating system 2911, and other applications 2912, a browser module, and the like. The controller 210 performs functions such as: a broadcast television signal reception demodulation function, a television channel selection control function, a volume selection control function, an image control function, a display control function, an audio control function, an external instruction recognition function, a communication control function, an optical signal reception function, an electric power control function, a software control platform supporting various functions, a browser function, and the like.

Fig. 5a is a block diagram illustrating a configuration of a software system in the smart tv 200 according to an exemplary embodiment.

As shown in fig. 5a, an operating system 2911, including executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary for data processing performed between application programs and hardware components. In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.

In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display screen, a camera, Flash, WiFi, and audio drivers.

The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.

A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.

The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.

Control applications 2911-4 for controllable process management, including runtime applications and the like.

The event transmission system 2914, which may be implemented within the operating system 2911 or within the application program 2912, in some embodiments, on the one hand, within the operating system 2911 and on the other hand, within the application program 2912, is configured to listen for various user input events, and to refer to handlers that perform one or more predefined operations in response to the identification of various types of events or sub-events, depending on the various events.

The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.

The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.

The event or sub-event refers to an input detected by one or more sensors in the smart tv 200 and an input of an external control device (e.g., the control device 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting gestures through gesture recognition, inputting sub-events through remote control key commands of the control equipment and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.

The interface layout manager 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, and other various execution operations related to the layout of the interface.

As shown in fig. 5b, the application layer 2912 contains various applications that may also be executed at the smart tv 200. The application may include, but is not limited to, one or more applications such as: live television applications, video-on-demand applications, media center applications, application centers, gaming applications, and the like.

The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live tv application may display a video of the live tv signal on the smart tv 200.

A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on the smart television. The application center may obtain these applications from different sources, store them in local storage, and then be run on the smart tv 200.

As described above, a television (e.g., the smart television 200) has a powerful function and more interface interactions, and there is a certain complexity in operating and controlling the smart television through a remote controller, and for the elderly or children, the smart television cannot be controlled correspondingly and quickly and accurately, and the control efficiency of the smart television is low.

In order to solve the technical problem, an embodiment of the present invention provides a remote control method for a smart television, where the remote control method enables a remote user to visually obtain a current state of the smart television to be controlled, and remotely control the smart television, so as to improve control efficiency of the smart television. For example, the remote user may be a parent or a young person, who has a certain operation experience, and the remote user may control the smart tv at home to provide help for the elderly or children at home.

Taking the scenario shown in fig. 1 as an example for explanation, a terminal device (for example, the mobile terminal 300) may implement remote control on the smart television 200 through the remote control method of the smart television according to the embodiment of the present invention, so as to improve the control efficiency of the smart television and improve the user experience. The following embodiments are illustrated around specific scenarios.

The terminal device may be a Personal Computer (PC) or a mobile terminal, and the mobile terminal may also be referred to as a User Equipment (UE), an access terminal, a subscriber unit, a subscriber station, a mobile station, a User terminal, a wireless communication device, a User agent, or a User Equipment. The mobile terminal may be a smartphone, a cellular phone, a cordless phone, a tablet, a Personal Digital Assistant (PDA) device, a handheld device with wireless communication capability or other processing device connected to a wireless modem, a vehicle mounted device, a wearable device, etc. In the embodiment of the present invention, the terminal device has an interface for communicating with a cellular network and/or a Wireless Local Area Network (WLAN).

The specific implementation manner of the method can be seen in the explanation of the following embodiments.

Fig. 6A is an interaction flowchart of a remote control method for a smart television according to an embodiment of the present invention, where a terminal device related in this embodiment may be any one of the terminal devices described above, and as shown in fig. 6A, the method according to this embodiment may include:

step 101, a terminal device responds to an operation of a user and sends first screenshot request information, wherein the first screenshot request information carries first identification information, and the first identification information is configured to enable a smart television to identify a screenshot corresponding to the first screenshot request information according to the first identification information.

In one implementation, a terminal device may receive a trigger of a user and generate a first signal for requesting to turn on a remote control.

When the terminal device displays a user interface, the terminal device may receive a trigger of a user and generate a first signal for requesting to open a remote control, where the trigger of the user may be a click operation on a certain control on the user interface of the terminal device, and the first signal may be a signal for clicking a control corresponding to the request to open the remote control. The click may be generated by a user's finger, a stylus, or other control object action that may be detected by the touch sensitive display screen.

As an example, referring to fig. 6B, after the user opens the preset application, the terminal device first displays a first user interface 61 as shown in the left side of fig. 6B, where the first user interface 61 includes a status bar 612, a navigation bar 613, and a content view 611, where the status bar 612 is used to present information of a signal, time, power, and the like of the terminal device itself, and is located at the top of the entire first user interface, the navigation bar 613 may also be referred to as a title bar and is used to display a title (e.g., "my"), and the content view 611 is used to present various information below the status bar, this embodiment is exemplified by a content view in a list form, the content view may include one or more item bars, each item in the content view may be in a single picture form or a text form, or in a combined picture and text form, for example, as shown in fig. 6B, each in text form, e.g., "my shopping," "remote monitoring," etc. The column entries are distinguished by dividing lines, and only the column entries are displayed without setting the dividing lines. Each column entry in the list is set as a selection control, for example: when a user clicks a position corresponding to the 'play history' character, triggering the control and entering an interface corresponding to the control, wherein the interface corresponding to the 'play history' control is configured to display the viewing history of the user; and when the finger of the user clicks the selection control corresponding to the remote monitoring character, triggering the terminal equipment to generate the first signal.

The terminal device sends, in response to the first signal, first screenshot request information to the smart television corresponding to the first signal, where the first screenshot request information carries first identification information, where the first identification information may be any one or a combination of a timestamp, a random number, and other identification information, and the first identification information is used to uniquely identify a file (e.g., a screenshot), for example, the first identification information may be a timestamp and a random number, and the random number may be a 5-bit random number. The terminal device may directly send the first screen-cut request information to the smart television through the local area network, or send the first screen-cut request information to the smart television through the server, for example, the server may be a single server or include an internet server and a message forwarding server, where the internet server is connected to the message forwarding server, the message forwarding server is connected to the smart television, the terminal device may first send the first screen-cut request information to the internet server, the internet server sends the first screen-cut request information to the message forwarding server, and the message forwarding server forwards the first screen-cut request information to the smart television.

In another implementation manner, the terminal device may directly send the first screen-cutting request information in response to the operation of the user, and after receiving the operation of the user, the terminal device directly obtains the current system time of the terminal device, and generates the first screen-cutting request information according to the current system time and the random number of the terminal device, or the current system time of the terminal device and the unique identifier representing the terminal device. The first screenshot request information includes the time and the random number of the current system of the terminal device, or the time of the current system of the terminal device and the unique identifier representing the terminal device. Therefore, the software process can be simplified and the system efficiency can be improved.

The user operation with the corresponding first screen cut request information is a first operation of the user in some embodiments.

And step 102, the smart television intercepts the current display interface of the smart television in response to the first screenshot request information, generates a first screenshot, and uploads the first screenshot to the image server.

The smart television receives the first screen capturing request information, responds to the first screen capturing request information, captures a current display interface of the smart television, names the screen capturing of the current display interface by the first identification information, and uploads the generated first screen capturing to an image server. The image server may generate a Uniform Resource Locator (URL |) corresponding to the first identification information, and store the first screenshot. The image server of the embodiment of the application can be used for storing the screenshots of the display interface of the intelligent television at all times.

And 103, the terminal equipment acquires the first screenshot from the image server according to the first identification information and displays the first screenshot.

The terminal device can obtain a URL corresponding to the first identification information from the image server according to the first identification information, and obtain the first screenshot according to the URL, wherein the first screenshot is used for displaying the current state of the smart television, so that a user can perform remote operation control on the smart television based on the current state. The terminal device can display the first screenshot through a display screen. In some embodiments, the terminal device may send polling information including the first identification information to the image server, the server feeds back to the terminal device according to the polling information, the terminal device may also send a first instruction including the first identification information to the image server while sending the first screenshot request information, the image server continuously matches the screenshot (for example, the screenshot named as the first identification information) corresponding to the first identification information in the first instruction in the uploaded image, and sends the screenshot which is successfully matched or the URL corresponding to the screenshot to the terminal device.

In an implementation manner, the terminal device may send the first identification information to the image server, and the image server obtains the URL corresponding to the first identification information according to the first identification information, obtains a screenshot based on the URL, and returns the screenshot to the terminal device.

As further illustrated by the above example, referring to fig. 6B, in response to the first signal, the terminal device switches the currently displayed user interface, displays a second user interface 62 shown on the right side of fig. 6B on the display screen, where the second user interface 62 may include a status bar 621, a navigation bar 622, a content view 623 and a button 624, where the content view 623 may be in an aggregate view form, displays information in a tiled form, and displays information with pictures as a theme and texts as auxiliary information, and the content view 623 shown on the right side of fig. 6B may display the first screenshot, and when the first screenshot is not obtained, a window corresponding to the content view may display prompt information that the screenshot of the current display interface is not obtained or a screenshot of the smart television display interface at a previous time point. In some embodiments, the window corresponding to the content view also displays the first identifier corresponding to the screenshot while displaying the screenshot, and when the first identifier includes the timestamp, the user can determine the time when the screenshot displayed in the window corresponding to the content view is displayed through the displayed first identifier. Meanwhile, different remote control operations, such as 'return to home', 'turn off television', 'volume down by 5', etc., can also be presented in the second user interface in a text form. The controls presented in these texts correspond to different common control instructions, for example: if the user selects the control of returning to the homepage, the terminal device can send the first control instruction to the smart television, and the smart television can return to the homepage according to the received first control instruction; and if the user selects the control of 'volume reduction by 5', the terminal device can send the second control instruction to the smart television, and the smart television can perform the operation of volume reduction by 5 according to the received second control instruction. These common control commands may be adjusted based on historical user operation. Also included in the interactive interface is an input control 624, which is operated by the user, the terminal device receives the voice/text input by the user, for example, the input control 624 includes a "press and talk" button 6242 and a toggle button 6241, the user presses the button 6242, the terminal device receives the voice input by the user through a microphone, the user clicks the toggle button 6241, and the terminal device displays a text input box on the second user interface to receive the text input by the user in the text input box. Through the second user interface 62, after the remote monitoring is started, the terminal device may send the first screenshot request information to the smart television, and after the user interaction interface displaying the screenshot is entered, the terminal device may receive the refresh control 625 in the user interaction interface from the user to resend the screenshot request information. The user interaction interface displays the screenshot of the current display interface of the intelligent television to a user, so that the user can clearly know the current state of the intelligent television and perform remote control operation on the intelligent television, the remote control operation can be realized by inputting corresponding voice/text on the user interface, and the remote control operation can also be realized by selecting a common instruction control by the user.

In this embodiment, a terminal device responds to an operation of a user, and sends first screenshot request information, where the first screenshot request information carries first identification information, the first identification information is configured to enable a smart television to identify a screenshot corresponding to the first screenshot request information according to the first identification information, the smart television responds to the first screenshot request information to intercept a current display interface of the smart television, and generates a first screenshot, and uploads the first screenshot to an image server, the terminal device obtains the first screenshot from the image server according to the first identification information, and displays the first screenshot, where the first screenshot is used to display a current state of the smart television, so that the user can remotely control the smart television based on the current state, and control accuracy and efficiency of the smart television are improved.

In the above embodiment, the terminal device may establish a one-to-one binding relationship with the smart television, or log in the same account with the smart television, so that the remote control of the smart television is realized by the above method. In some embodiments, the terminal device may also establish a binding relationship with the plurality of smart televisions, or log in the same account with the plurality of smart televisions, so that the plurality of smart televisions can be remotely controlled by the above method. In another implementation manner, in response to that the terminal device simultaneously corresponds to multiple intelligent devices (intelligent televisions, intelligent gateways, etc.), before the terminal device switches to the second user interface 62 on the right side of fig. 6B, the terminal device displays a third user interface 64 as shown in fig. 6C, where the third user interface 64 may include multiple selection buttons 641 of the intelligent televisions, so that when the user clicks the corresponding button 641, the terminal device switches to the second user interface 62 of the intelligent television corresponding to the button 641.

Fig. 7A is an interaction flowchart of another remote control method for a smart television according to an embodiment of the present invention, as shown in fig. 7A, based on the embodiment shown in fig. 6A, the method of this embodiment may further include:

step 201, the terminal device responds to the operation of the user and generates a remote control operation instruction.

In one implementation, the terminal device may receive a trigger of a user and generate a second signal for transmitting a remote control operation instruction.

As an example, when the terminal device displays the second user interface 62 on the right side of fig. 6B, the terminal device may receive an input from a user and generate a second signal for transmitting a remote control operation instruction, where the second signal may be generated by the user clicking a control corresponding to the remote control operation instruction. The click may be generated by a user's finger, a stylus, or other control object action that may be detected by the touch sensitive display screen. The second signal may also be generated from speech/text input by the user through operation of input control 624.

For example, the user may input "return to home" through the input control 624, the terminal device generates the second signal according to the user input, and sends a corresponding control instruction according to the second signal, where the control instruction is used for the smart television to perform a corresponding operation, for example, the control instruction corresponding to the "return to home" is a first control instruction, and the smart television performs an operation of returning to home according to the first control instruction.

As an example, in response to the second signal, the terminal device may display the remote control operation instruction input by the user on the currently displayed user interface, for example, add a display frame in the second user interface 62 shown on the right side of fig. 6B, display text of the remote control operation instruction input by the user in the display frame, and the display effect may be as shown in fig. 7B, and further include a display frame 1 in the second user interface shown in fig. 7B, in which the text of the remote control operation instruction is displayed, for example, "return to home page".

In other embodiments, the terminal device directly generates the remote control operation instruction in response to the operation of the user, and the operation of the user corresponding to the remote control operation instruction is a second operation of the user. Illustratively, after receiving a "return home page" instruction input by a user, the terminal device directly generates a remote control operation instruction corresponding to the "return home page" instruction. Therefore, the software process can be simplified and the system efficiency can be improved.

Step 202, identifying the type of the remote control operation instruction.

In one implementation mode, the type of the remote control operation instruction is identified by the terminal device, and in another implementation mode, the terminal device sends the remote control operation instruction to the semantic identification server, and the semantic identification server identifies the type of the remote control operation instruction.

As an example, referring to the system architecture shown in fig. 8, as shown in fig. 8, the interconnection server 31 is respectively connected to the terminal device 1, the application server 32, the semantic recognition server 33, and the message forwarding server 34, the message forwarding server 34 is further connected to the smart tv 2, and the smart tv 2 may also be connected to the terminal device 1 through a local area network. In response to the second signal, the terminal device sends the remote control operation instruction to the internet server 31, the internet server 31 forwards the remote control operation instruction to the semantic recognition server 33, and the semantic recognition server 33 recognizes the remote control operation instruction and determines whether the type of the remote control operation instruction is a television playing control class or an application function control class. The television playing control instruction refers to an instruction for the smart television to operate and control the smart television, and the application function instruction refers to an instruction for the application server to respond and generate media content to be pushed to the television, for example: the tv playing control class specifically refers to an operation instruction for controlling a state of the smart tv, such as an instruction for controlling a volume, an instruction for switching a channel, and the like, and the application function control class specifically refers to an operation instruction for providing a corresponding function to the smart tv through an application server, such as pushing a media resource of the application server to the smart tv.

And 203, if the type of the remote control operation instruction is a television playing control type, sending the remote control operation instruction to the smart television so that the smart television performs corresponding control operation according to the remote control operation instruction.

And when the type of the remote control operation instruction is a television playing control type, the remote control operation instruction is sent to the smart television, and the smart television carries out corresponding control operation according to the remote control operation instruction. For example, the remote control operation instruction may be transmitted to the smart tv through the internet server 31 and the message forwarding server 34. For example, the remote control operation command is a television volume down by 5.

And 204, if the type of the remote control operation instruction is an application function control type, sending the remote control operation instruction to a corresponding application server so that the application server pushes corresponding media content to the smart television according to the remote control operation instruction.

When the type of the remote control operation instruction is an application function control type, the terminal device sends the remote control operation instruction to a corresponding application server, or the television responds to the remote control operation instruction of the terminal device and sends the remote control operation instruction to the server, the application server pushes corresponding media content to the smart television according to the remote control operation instruction, and the smart television plays the media content. For example, the remote control operation instruction may be transmitted to the application server 32 through the internet server 31.

In this embodiment, a terminal device receives a trigger of a user and generates a first signal for requesting to start a remote control, the terminal device sends a first screenshot request message in response to the first signal, the first screenshot request message carries first identification information, the smart television intercepts a current display interface of the smart television according to the first screenshot request message, generates a first screenshot according to the first identification information and uploads the first screenshot to an image server, the terminal device obtains the first screenshot from the image server according to the first identification information and displays the first screenshot, the first screenshot is used for displaying a current state of the smart television so that the user can remotely control the smart television based on the current state, the terminal device receives the trigger of the user and generates a second signal for sending a remote control operation instruction, identifies a type of the remote control operation instruction, and if the type of the remote control operation instruction is a television play control type, and if the type of the remote control operation instruction is an application function control type, the remote control operation instruction is sent to a corresponding application server, so that the application server pushes corresponding media content to the smart television according to the remote control operation instruction, thereby realizing the remote control of the smart television and improving the control efficiency of the smart television.

Fig. 9A is an interaction flowchart of another remote control method for a smart television according to an embodiment of the present invention, where this embodiment relates to second screenshot request information, and an effect of the second screenshot request information is different from that of the first screenshot request information, where the second screenshot request information is used by the smart television to obtain a second screenshot, and the second screenshot is a result of performing remote control on the smart television based on the first screenshot, so as to know whether a remote operation is successful, as shown in fig. 9A, on the basis of the embodiment shown in fig. 7A, the method in this embodiment may further include:

step 301, the terminal device sends second screen capture request information, where the second screen capture request information is used to enable the smart television to obtain a second screen capture after responding to the remote operation instruction, and the second screen capture request information carries second identification information.

The terminal device can send the second screen capture request information after sending the remote control operation instruction, or at the same time of sending the remote control instruction, so that the terminal device can obtain a new screen capture image to display a screen capture after the smart television responds to the remote control operation instruction or a screen capture at a new moment. And the user can judge the operation required to be carried out next step through the new screen capture image displayed by the terminal equipment.

In some embodiments, the second screen capture request may be triggered by the terminal device upon receiving a refresh operation by the user. In other embodiments, the user sends the second screen capture request at the same time as sending the remote operation control instruction. And after the intelligent television responds to the television playing control instruction or receives the content issued by the server responding to the application function instruction, responding to a second screen capturing request to capture and upload the screen.

The terminal equipment can send second screen capture request information to the smart television through the local area network; alternatively, the terminal device transmits the second screen capture request information to the smart tv through the interconnection server 31 and the message forwarding server 34. The second screen capture request information is used for requesting the smart television to capture the current display interface of the smart television again, generating a second screenshot according to the second identification information and uploading the second screenshot to the image server;

and 302, the smart television re-captures the current display interface of the smart television according to the second screen capture request information, generates a second screenshot according to the second identification information and uploads the second screenshot to the image server, wherein the second screenshot is used for displaying the operation result of the remote control operation instruction.

The smart television receives the second screen capture request information, responds to the second screen capture request information, and re-captures the current display interface of the smart television to generate a second screenshot, names the second screenshot by the second identification information, and uploads the second screenshot to the image server. The image server may generate a URL |, which corresponds to the second identification information, and store the second screenshot, where the second screenshot is used to display an operation result of the remote control operation instruction.

And 303, the terminal device acquires a second screenshot from the image server according to the second identification information, and displays the second screenshot, wherein the second screenshot is used for displaying an operation result of the remote control operation instruction.

The terminal device can obtain a URL corresponding to the second identification information from the image server according to the second identification information, and obtain the second screenshot according to the URL, wherein the second screenshot is used for displaying a result of the remote control instruction of the smart television. The terminal device can display the second screenshot through a display screen so that a user can determine whether the remote operation is successful.

As further illustrated by the above example, referring to fig. 9B, in response to the terminal device transmitting the remote control operation instruction, the terminal device adds a display frame in the second user interface 62 shown on the right side of fig. 6B, displays the instruction transmission state in the display frame, the display effect can be seen in the second user interface shown on the left side of fig. 9B, on which the display frame 2 is displayed, the text instructing the sending state is displayed in the display frame 2, for example, in the text "sending the command to the tv", after the terminal device obtains the screenshot corresponding to the second identification information from the image server, the second user interface 62 shown on the right side of fig. 9B is displayed on the touch display screen, the content view in the second user interface 62 displays the screenshot corresponding to the second identification information, that is, the screenshot shown in the window corresponding to the content view shown on the left side of fig. 9B is updated to the screenshot corresponding to the second identification information. In some embodiments, the screenshot shown in the window corresponding to the content view shown in the left side of fig. 9B may also be updated to the screenshot state of the smart television screen, as shown in the middle of fig. 9B, and then the screenshot state of the smart television screen shown in the window corresponding to the content view shown in the middle of fig. 9B is updated to the screenshot corresponding to the second identification information.

In this embodiment, terminal equipment sends second screen capture request information, where the second screen capture request information is used to enable an intelligent television to obtain a second screen capture after responding to a remote operation instruction, the second screen capture request information carries second identification information, the intelligent television re-captures a current display interface of the intelligent television according to the second screen capture request information, generates the second screen capture according to the second identification information, and uploads the second screen capture to an image server, the second screen capture is used to display an operation result of the remote control operation instruction, the terminal equipment obtains the second screen capture from the image server according to the second identification information, and displays the second screen capture, and the second screen capture is used to display an operation result of the remote control operation instruction, so that control efficiency of the intelligent television is improved.

Fig. 10 is an interaction flowchart of another remote control method for a smart television according to an embodiment of the present invention, as shown in fig. 10, based on the embodiment shown in fig. 6A, fig. 7A, or fig. 9A, the method of this embodiment may further include:

step 401, the terminal device responds to the operation of the user, and sends device query request information, where the device query request information is used to obtain a currently available device name.

In one implementation, the terminal device receives an operation of a user and generates a third signal, and in response to the third signal, the terminal device transmits device query request information.

Before any of the above embodiments, the method of this embodiment may be that, when the terminal device displays a user interface, the terminal device may receive a third signal triggered by a user and generated to open the remote monitoring interface, where the third signal may be a click on a control corresponding to remote monitoring. The click may be generated by a user's finger, a stylus, or other control object action that may be detected by the touch sensitive display screen. The terminal device may send a device query request to the interconnection server to obtain a currently available device name, for example, names of devices such as a smart television in a bedroom of a home, a smart television in a living room, and the like.

In some embodiments, the terminal device directly sends the device query request information in response to the received operation of the user, and simultaneously triggers a signal for opening the remote monitoring interface. Therefore, the software process can be simplified and the system efficiency can be improved.

Step 402, the interconnection server sends the name of the current available device to the terminal device, and displays the name of the available device in a list form on a remote monitoring interface displayed by the terminal device.

The currently available device name is used for requesting remote control of the corresponding smart television.

The terminal device may select one device from the currently available device names to perform the remote control described in the foregoing embodiments. For example, the terminal device may display a third user interface 64 as shown in fig. 6C, and a selection button 641 for each available device is displayed on the third user interface 64 to provide the user with a selection of available devices.

In this embodiment, a terminal device may respond to a user operation, and send device query request information to an interconnection server, where the device query request information is used to obtain a currently available device name, and the interconnection server sends the currently available device name to the terminal device, where the currently available device name is used to request a corresponding smart television for remote control, so as to flexibly select a smart television for remote control, and remotely and effectively control the smart television.

Illustratively, referring to fig. 11, the terminal device may further receive a trigger of the user on the second user interface 62 and generate a second signal for sending a remote control operation instruction, for example, a voice is input through the button 624 of the second user interface 62, the voice is "turn off the television", the terminal device may send the remote control operation instruction for turning off the television to the television by the method of the above-described embodiment of the present application, so that the television performs an operation of turning off the television, the terminal device displays the display frame 3 through the second user interface 62, and text of the remote control operation instruction, for example, "turn off the television", is displayed in the display frame 3. As shown in the second user interface in the middle of fig. 11, the second user interface 62 may also display a display box 4, and the display box 4 displays text instructing a transmission state, for example, "instruction is being transmitted to television". In some embodiments, the screenshot shown in the window corresponding to the content view shown on the left side of fig. 11 may also be updated to the television screenshot state, as shown in the middle of fig. 11, after the smart television responds to the remote operation instruction for turning off the television, the terminal device may display a display box 5 in the content view shown in the middle of fig. 11, and text of the current state of the television may be displayed in the display box 5, for example, "your television is turned off … …. Of course, the terminal device may also update the television screenshot state shown in the window corresponding to the content view shown in the middle of fig. 11 to display a text that "television screenshot information is not acquired".

Fig. 12 is a schematic structural diagram of a terminal device according to an embodiment of the present invention, and as shown in fig. 12, the terminal device according to this embodiment may include: the system comprises a receiving module 11, a processing module 12 and a sending module 13, wherein the processing module 12 is configured to send, through the sending module 13, first screenshot request information in response to a user operation received by the receiving module 11, where the first screenshot request information carries first identification information, the first identification information is used to enable the smart television to identify a screenshot corresponding to the first screenshot request information according to the first identification information, and the first screenshot request information is used to enable the smart television to intercept a current display interface of the smart television and upload a generated first screenshot to an image server according to the first identification information; the processing module 12 is further configured to poll the image server according to the first identification information, and receive and display the first screenshot of the image server in response to the polling feedback.

Optionally, the processing module 12 is further configured to receive an operation of a user through the receiving module 11 and generate a remote control operation instruction of a television play control class, where the remote control operation instruction of the television play control class is an instruction that the smart television can respond to and operate and control the smart television; the processing module 12 is further configured to send a second screen capture request through the sending module 13, where the second screen capture request information is used to enable the smart television to obtain a second screen capture after responding to the remote control operation instruction of the television play control class, and the second screen capture request information carries second identification information, and the second identification information is used to enable the smart television to identify the second screen capture; the processing module 12 is further configured to poll the image server according to the second identification information, and receive and display the second screenshot of the image server responding to the polling feedback through the receiving module 11.

Optionally, the processing module 12 is further configured to receive, through the receiving module 11, an operation of a user and generate a remote control operation instruction of an application function class instruction, where the remote control operation instruction of the application function class instruction refers to an instruction that an application server can respond to and generate media content to be pushed to a television; the processing module 12 is further configured to send a second screen capture request through the sending module 13, where the second screen capture request information is used to enable the smart television to obtain a second screen capture after responding to the pushed media content of the application server, and the second screen capture request information carries second identification information, and the second identification information is used to enable the smart television to identify the second screen capture; the processing module 12 is further configured to poll the image server according to the second identification information, and receive and display the second screenshot of the image server responding to the polling feedback through the receiving module 11.

Optionally, the processing module 12 may control the sending module 13 to send the first screen capture request information or the second screen capture request information to the smart television through a local area network; or, the processing module 12 may control the sending module 13 to send the first screenshot request information or the second screenshot request information to the smart television through an interconnection server and a message forwarding server, where the message forwarding server and the smart television are connected with each other for a long time.

Optionally, the processing module 12 is further configured to respond to an operation of a user before sending the first screen capturing request information, and send device query request information through the sending module 13, where the device query request information is used to obtain a currently available device name; the receiving module 11 is further configured to receive a currently available device name, where the currently available device name is used to request remote control of a corresponding smart television.

Optionally, the first identification information includes a current timestamp.

The terminal device of this embodiment may be configured to execute the technical solution executed by the terminal device in the foregoing method embodiments, and the implementation principle and the technical effect are similar, which are not described herein again.

Fig. 13 is a schematic structural diagram of another terminal device according to an embodiment of the present invention, and as shown in fig. 13, the apparatus according to this embodiment may include: a memory 21 and a processor 22, wherein the memory 21 is used for storing a computer program, and the processor 22 is used for executing the computer program to implement the method described in the above embodiments.

The apparatus of this embodiment may be configured to implement the technical solution of the terminal device in the foregoing method embodiment, and the implementation principle and the technical effect are similar, which are not described herein again.

Fig. 14 is a schematic structural diagram of an intelligent television according to an embodiment of the present invention, and as shown in fig. 14, the intelligent television according to this embodiment may include: the smart television comprises a receiving module 31, a processing module 32 and a sending module 33, wherein the receiving module 31 is configured to receive first screenshot request information, the first screenshot request information carries first identification information, and the first identification information is used for identifying a screenshot corresponding to the first screenshot request information by the smart television according to the first identification information; the processing module 32 is configured to intercept a current display interface of the smart television according to the first screenshot request information, and generate a first screenshot according to the first identification information; the processing module 32 is further configured to upload the first screenshot to an image server through a sending module 33.

Optionally, the receiving module 31 is further configured to receive a remote control operation instruction of a television play control class, and perform a corresponding control operation according to the remote control operation instruction; or, the processing module 32 is further configured to receive and play media content pushed by the application server through the receiving module 31, where the media content is pushed to the smart television by the application server according to a remote control operation instruction of the application function control class.

Optionally, the receiving module 31 is further configured to receive second screen capture request information, where the second screen capture request information is used to enable the smart television to obtain a second screen capture after responding to a remote control operation instruction, and the second screen capture request information carries second identification information; the processing module 32 is configured to capture the current display interface of the smart television again after responding to the remote control operation instruction according to the second screen capture request information, generate a second screen capture according to the second identification information, upload the second screen capture to the image server through the sending module 33, and use the second screen capture to display an operation result of the remote control operation instruction.

The smart television of this embodiment may be configured to execute the technical solution of the smart television in the foregoing method embodiment, and the implementation principle and the technical effect are similar, which are not described herein again.

An embodiment of the present invention further provides a computer storage medium, where the computer storage medium is used to store a computer program, and the computer program is used to implement the method according to any of the above embodiments when executed. The implementation principle and the technical effect are similar, and the detailed description is omitted here.

Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A remote control method of an intelligent television is characterized by comprising the following steps:

the terminal equipment responds to the operation of a user and sends first screen-cutting request information, and the first screen-cutting request information carries first identification information;

the smart television intercepts a current display interface of the smart television in response to the first screenshot request information, generates a first screenshot, and uploads the first screenshot to an image server, wherein the first screenshot is identified by using the first identification information;

and the terminal equipment acquires the first screenshot from the image server according to the first identification information and displays the first screenshot.

2. The method of claim 1, further comprising:

the terminal equipment responds to the operation of a user and generates a remote control operation instruction;

the terminal equipment sends the remote control operation instruction to the smart television according to the type of the remote control operation instruction, and if the type of the remote control operation instruction is a television playing control type, the smart television carries out corresponding control operation according to the remote control operation instruction;

if the type of the remote control operation instruction is an application function control type, the remote control operation instruction is sent to a corresponding application server, so that the application server pushes corresponding media content to the smart television according to the remote control operation instruction.

3. The method of claim 2, further comprising:

the terminal equipment sends second screen capture request information, wherein the second screen capture request information is used for enabling the smart television to obtain a second screen capture after responding to a remote control operation instruction, and the second screen capture request information carries second identification information;

the smart television receives a remote control operation instruction sent by a user, and sends a second identification information to the image server, wherein the second identification information is used for identifying a second screen capture request message;

and the terminal equipment acquires the second screenshot from the image server according to the second identification information and displays the second screenshot.

4. The method according to any one of claims 1 to 3, wherein before the terminal device transmits the first screen-cut request information, the method further comprises:

the terminal equipment responds to the operation of a user and sends equipment query request information, and the equipment query request information is used for acquiring the name of the current available equipment;

the terminal equipment receives the name of the current available equipment, and displays the name of the available equipment on a remote monitoring interface displayed by the terminal equipment in a list form, wherein the name of the current available equipment is used for requesting remote control of the corresponding intelligent television.

5. A method according to any one of claims 1 to 3, wherein the first identification information comprises a current timestamp.

6. A remote control method of an intelligent television is characterized by comprising the following steps:

the method comprises the steps that a terminal device responds to operation of a user and sends first screen cutting request information, wherein the first screen cutting request information carries first identification information, the first identification information is used for enabling a smart television to identify a screen cut corresponding to the first screen cutting request information according to the first identification information, and the first screen cutting request information is used for enabling the smart television to intercept a current display interface of the smart television and upload a first screen cut generated according to the first identification information to an image server;

and the terminal equipment polls the image server according to the first identification information, and receives and displays the first screenshot of the image server responding to the polling feedback.

7. The method of claim 6, further comprising:

receiving user operation and generating a remote control operation instruction of a television play control class, wherein the remote control operation instruction of the television play control class is an instruction which can be responded by the intelligent television and is used for operating and controlling the intelligent television;

sending a second screen capture request, wherein the second screen capture request information is used for enabling the smart television to obtain a second screen capture after responding to the remote control operation instruction of the television play control class, and the second screen capture request information carries second identification information which is used for enabling the smart television to identify the second screen capture;

and the terminal equipment polls the image server according to the second identification information, and receives and displays the second screenshot of the image server responding to the polling feedback.

8. The method of claim 6, further comprising:

receiving the operation of a user and generating a remote control operation instruction of an application function instruction, wherein the remote control operation instruction of the application function instruction refers to an instruction which can be responded by an application server and is used for generating media content pushed to a television;

sending a second screen capture request, wherein the second screen capture request information is used for enabling the smart television to obtain a second screen capture after responding to the pushed media content of the application server, and the second screen capture request information carries second identification information which is used for enabling the smart television to identify the second screen capture;

9. A remote control method of an intelligent television is characterized by comprising the following steps:

the method comprises the steps that the smart television receives first screen capturing request information, wherein the first screen capturing request information carries first identification information, and the first identification information is used for identifying a screen capturing corresponding to the first screen capturing request information according to the first identification information;

the smart television intercepts a current display interface of the smart television according to the first screenshot request information and generates a first screenshot according to the first identification information;

and the smart television uploads the first screenshot to an image server.

10. The method of claim 9, further comprising:

the intelligent television receives a remote control operation instruction of a television playing control class, and performs corresponding control operation according to the remote control operation instruction; or,

the intelligent television receives and plays media content pushed by an application server, wherein the media content is pushed to the intelligent television by the application server according to a remote control operation instruction of an application function control class.

11. The method of claim 10, further comprising:

the smart television receives second screen capture request information, wherein the second screen capture request information is used for enabling the smart television to obtain a second screen capture after responding to a remote control operation instruction, and the second screen capture request information carries second identification information;

and the smart television re-captures the current display interface of the smart television after responding to a remote control operation instruction according to the second screen capturing request information, generates a second screen capture according to the second identification information, and uploads the second screen capture to the image server, wherein the second screen capture is used for displaying an operation result of the remote control operation instruction.

12. A terminal device, comprising:

the processing module is used for responding to the operation of the user received by the receiving module, sending first screenshot request information through the sending module, wherein the first screenshot request information carries first identification information, the first identification information is used for enabling the intelligent television to identify a screenshot corresponding to the first screenshot request information according to the first identification information, and the first screenshot request information is used for enabling the intelligent television to intercept a current display interface of the intelligent television and upload a first screenshot generated according to the first identification information to an image server;

and the processing module polls the image server according to the first identification information and receives and displays the first screenshot fed back by the image server in response to the polling.

13. An intelligent television, comprising:

the receiving module is used for receiving first screenshot request information, wherein the first screenshot request information carries first identification information, and the first identification information is used for identifying a screenshot corresponding to the first screenshot request information by the smart television according to the first identification information;

the processing module is used for intercepting the current display interface of the intelligent television according to the first screenshot request information and generating a first screenshot according to the first identification information;

the processing module is further used for uploading the first screenshot to an image server through the sending module.