WO2021180224A1

WO2021180224A1 - Display device

Info

Publication number: WO2021180224A1
Application number: PCT/CN2021/080553
Authority: WO
Inventors: 刘丽英; 刘儒茜; 于颜梅; 李斌; 王大勇; 朱铄; 孙梅艳
Original assignee: 海信视像科技股份有限公司
Priority date: 2020-03-13
Filing date: 2021-03-12
Publication date: 2021-09-16
Also published as: WO2021180223A1

Abstract

Provided in the embodiments of the present application is a display device, which comprises a display and a controller. If the display is in a rotating state, the controller uses Textureview to draw a video frame of a video to be played back. Textureview can support the translation, scaling, rotation at any angle, screenshotting and other transformations of video frames. Therefore, by drawing a video frame by using Textureview, the presentation direction of the drawn video frame can be adapted to the presentation direction of the display.

Description

A display device

This application claims the priority of the Chinese patent filed with the Chinese Patent Office on March 13, 2020 with the application number 202010176794.2 and the application titled "A display device and display screen rotation adaptation method"; this application claims in April 2020 The priority of the Chinese patent filed with the Chinese Patent Office on the 28th with the application number 202010350580.2 and the application titled "A method and display device for rotating video images"; this application requires that it be filed with the Chinese Patent Office on September 27, 2020. The application number is 202011036180.0 is the priority of the Chinese patent application titled "A display device and video playback method in portrait mode"; the application is required to be submitted to the Chinese Patent Office on July 17, 2020, and the application number is 202010693749.4. The application title is "A display The priority of “equipment”; its entire contents are incorporated in this application by reference.

Technical field

This application relates to the field of television technology, and in particular to a display device.

Background technique

Smart TV has an independent operating system and supports function expansion. Various applications can be installed in the smart TV according to user needs, for example, traditional video applications, social applications such as short videos, and reading applications such as comics and books. These applications can use the screen of the smart TV to display application images, and provide rich media resources for the smart TV. At the same time, smart TVs can also exchange data and share resources with different terminals. For example, a smart TV can be connected to a mobile phone through wireless communication methods such as local area network, Bluetooth, etc., so as to play resources in the mobile phone or directly cast a screen to display the screen on the mobile phone.

Summary of the invention

This application shows a display device, including:

monitor;

A rotating component, connected to the display, for driving the display to rotate based on the control of the controller;

The controller is configured with a drawing control, the drawing control includes: an image layer drawing control and an image layer drawing control, and is configured to perform the following steps:

In response to receiving a video play instruction, monitoring the state of the display, the state including: a rotating state and a static state;

If the display is in a rotating state, draw the video frame of the to-be-played video through the image layer drawing control;

If the display is in a static state, the video frame of the to-be-played video is drawn through the video layer drawing control.

Description of the drawings

In order to explain the technical solution of the present application more clearly, the following will briefly introduce the drawings needed in the embodiments. Obviously, for those of ordinary skill in the art, without creative work, Other drawings can be obtained from these drawings.

FIG. 1A is an application scenario diagram of a display device of this application;

FIG. 1B is a rear view of a display device of this application;

Figure 2 is a block diagram of the hardware configuration of the control device of the application;

Figure 3 is a block diagram of the hardware configuration of the display device of this application;

FIG. 4 is a block diagram of the architecture configuration of the operating system in the storage device of the display device of the present application;

FIG. 5A is a schematic diagram of media assets in the horizontal screen display direction of the application;

Figure 5B is a schematic diagram of media assets in the vertical screen display direction of the application;

Fig. 6 is a flow chart of the operation of the controller during video playback according to a feasible embodiment;

Fig. 7A is a flowchart of a controller in a video playback process provided according to a feasible embodiment;

FIG. 7B is a flowchart of a controller in a video playback process provided according to a feasible embodiment;

FIG. 8 is a flow chart of the operation of the display device during the video playback process according to a feasible embodiment;

FIG. 9 is a change diagram of a picture displayed on a display according to a feasible embodiment;

FIG. 10 is a flow chart of the operation of the display device during the video playback process according to a feasible embodiment;

FIG. 11 is a change diagram of a picture displayed on a display according to a feasible embodiment;

FIG. 12 is a change diagram of a picture displayed on a display according to a feasible embodiment;

FIG. 13 is a curve showing the relationship between the first rotation angle of the display and the rotation time in the process of the rotation component driving the display to rotate from the vertical screen state to the horizontal screen state;

FIG. 14 is a flowchart of the operation of the display device during the video playback process according to a feasible embodiment;

FIG. 15 is a change diagram of a picture displayed on a display according to a feasible embodiment;

FIG. 16A is a schematic diagram of the horizontal screen state of the display device of this application;

Figure 16B is a schematic diagram of the vertical screen state of the display device of the application;

FIG. 17 is a schematic flowchart of a method for starting a video playback in a portrait state of the application;

FIG. 18 is a schematic diagram of the display method when the application starts to play the video;

FIG. 19 is a schematic diagram of the flow of controlling the video layer to display video data in this application;

FIG. 20 is a schematic diagram of the application process for controlling the display of a black screen on the graphics layer;

FIG. 21 is a schematic flowchart of a method for closing a video playback in a portrait state of the application.

Detailed ways

In order to enable those skilled in the art to better understand the technical solutions in the application, the following will clearly and completely describe the technical solutions in the embodiments of the application in conjunction with the drawings in the embodiments of the application. Obviously, the described The embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work should fall within the protection scope of this application.

Rotating TV is a new type of smart TV, which mainly includes a display and rotating components. Among them, the display is connected to the bracket or wall through a rotating component, and the placement angle of the display can be adjusted by the rotating component to achieve the purpose of rotation. Different monitor placement angles can adapt to animation pages with different aspect ratios. For example, in most cases, the monitor is placed horizontally to display video pages such as movies and TV shows with an aspect ratio of 16:9. When the video page’s aspect ratio is 9:16 for short videos, comics, etc., the horizontally placed display needs to zoom the page and display black areas on both sides of the display. Therefore, the display can be placed vertically by rotating the component to fit a 9:16 ratio video page.

Rotating TV supports many applications. In order to make it easier for users to watch, you can specify the start-up signal source of the TV by setting the startup mode. For example, in order to obtain the movie-watching experience of a traditional TV, the start-up signal source of the TV can be set to a live broadcast signal, so that the TV directly enters the live broadcast state after being turned on. The user can set the power-on signal source to any application through the setting program. Since different applications support different display postures, the posture of the TV when it is turned on must be compatible with the application as the power-on signal source, so that the page corresponding to the power-on signal source application can be displayed normally.

However, when the user is watching TV, he will adjust the posture of the rotating TV’s display as needed, and keep it in the adjusted posture when shutting down. For example, when a user watches a short video or cartoon on a TV, he switches the screen to a vertical placement state, and shuts down the device in the vertical placement state. Then when the user turns on the next time, the screen posture is in the vertical placement state. If the startup signal source is set to an application that only supports the horizontal placement state, the screen posture does not match the startup signal source application and cannot be displayed correctly. Therefore, this application provides a display device and a display method of an application interface.

In order to facilitate the user to display the target media asset details page in different horizontal and vertical screen display directions of the display, and to facilitate the user's viewing experience when the display device is in different viewing states, an embodiment of the present application provides a display device, a detail page display method, and computer storage Medium, display device such as rotating TV. It should be noted that the method provided in this embodiment is not only applicable to rotating TVs, but also applicable to other display devices, such as computers and tablet computers.

The term "module" used in the various embodiments of this application can refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can execute related components Function.

The term "remote control" used in the various embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance. The component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and can also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hard keys in general remote control devices.

The term "gesture" used in the embodiments of the present application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.

The term "hardware system" used in the various embodiments of this application may refer to an integrated circuit (IC), printed circuit board (Printed circuit board, PCB) and other mechanical, optical, electrical, and magnetic devices with computing , Control, storage, input and output functions of the physical components. In the various embodiments of the present application, the hardware system is also usually referred to as a motherboard or a main chip or a controller.

Refer to FIG. 1A, which is an application scenario diagram of a display device provided by some embodiments of this application. As shown in FIG. 1A, the control device 100 and the display device 200 can communicate in a wired or wireless manner.

Among them, the control device 100 is configured to control the display device 200, which can receive operation instructions input by the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and act as an intermediary for the interaction between the user and the display device 200 effect. For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.

The control device 100 may be a remote controller 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 in a wireless or other wired manner. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc. For example, the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. Function.

The control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like. For example, an application program running on a smart device is used to control the display device 200. The application can be configured to provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.

Exemplarily, the mobile terminal 100B may install a software application with the display device 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication. For example, the mobile terminal 100B can establish a control instruction protocol with the display device 200, and the functions of the physical keys arranged on the remote control 100A can be realized by operating various function keys or virtual controls of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.

The display device 200 may provide a broadcast receiving function and a network TV function of a computer support function. The display device can be implemented as digital TV, Internet TV, Internet Protocol TV (IPTV), and so on.

The display device 200 may be a liquid crystal display, an organic light emitting display, or a projection device. The specific display device type, size and resolution are not limited.

The display device 200 also performs data communication with the server 300 through a variety of communication methods. Here, the display device 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display device 200. For example, the display device 200 can send and receive information, such as receiving electronic program guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The server 300 can be one group or multiple groups, and can be one type or multiple types of servers. The server 300 provides other network service content such as video-on-demand and advertising services.

In some embodiments, as shown in FIG. 1B, the display device 200 includes a rotating assembly 276, a controller 250, a display 275, a terminal interface protruding from a gap on the back plate, and a rotating assembly 276 connected to the back plate. 276 can make the display 275 rotate. Viewed from the front of the display device, the rotating component 276 can rotate the display screen to the vertical display direction, that is, the state where the vertical side length of the screen is greater than the horizontal side length, or the screen can be rotated to the horizontal display direction, that is, the screen A state where the lateral side length is greater than the vertical side length.

The configuration block diagram of the control device 100 is exemplarily provided in FIG. 2. As shown in FIG. 2, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, a user output interface 150, and a power supply 160.

The controller 110 includes a random access memory (RAM) 111, a read only memory (ROM) 112, a processor 113, a power-on interface, and a communication bus. The controller 110 is used to control the operation and operation of the device 100, as well as the communication and cooperation between internal components, and external and internal data processing functions.

Exemplarily, when an interaction of a user pressing a button arranged on the remote control 100A or an interaction of touching a touch panel arranged on the remote control 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction, and This signal is sent to the display device 200.

The memory 120 is used to store various operating programs, data, and applications of the driving and controlling device 100 under the control of the controller 110. The memory 120 can store various control signal instructions input by the user.

The communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110. For example, the control device 100 sends a control signal (such as a touch signal or a control signal) to the display device 200 via the communicator 130, and the control device 100 can receive the signal sent by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example, in the case of an infrared signal interface, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 via the infrared sending module. For another example, in the case of a radio frequency signal interface, a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.

The user input interface 140 may include at least one of a microphone 141, a touch panel 142, a sensor 143, a button 144, etc., so that the user can input user instructions for controlling the display device 200 to the control device through voice, touch, gesture, pressing, etc. 100.

The user output interface 150 outputs a user instruction received by the user input interface 140 to the display device 200, or outputs an image or voice signal received by the display device 200. Here, the user output interface 150 may include an LED interface 151, a vibration interface 152 that generates vibration, a sound output interface 153 that outputs a sound, a display 154 that outputs an image, and the like. For example, the remote controller 100A can receive output signals such as audio, video, or data from the user output interface 150, and display the output signals as images on the display 154, as audio on the sound output interface 153, or as output on the vibration interface 152. Vibration form.

The power supply 160 is used to provide operating power support for each element of the control device 100 under the control of the controller 110. The form can be battery and related control circuit.

A block diagram of the hardware configuration of the display device 200 is exemplarily provided in FIG. 3. As shown in FIG. 3, the display device 200 may include a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, Rotating component 276, audio processor 280, audio output interface 285, power supply 290.

Among them, the rotating assembly 276 may include components such as a drive motor and a rotating shaft. Among them, the driving motor can be connected to the controller 250 and output the rotation angle under the control of the controller 250; one end of the rotating shaft is connected to the power output shaft of the driving motor, and the other end is connected to the display 275, so that the display 275 can be fixedly installed on the rotating assembly 276. On the wall or bracket.

The rotating assembly 276 may also include other components, such as transmission components, detection components, and so on. Among them, the transmission component can adjust the rotation speed and torque output by the rotating assembly 276 through a specific transmission ratio, and can be a gear transmission mode; the detection component can be composed of sensors arranged on the rotating shaft, such as an angle sensor, an attitude sensor, and the like. These sensors can detect parameters such as the angle of rotation of the rotating component 276 and send the detected parameters to the controller 250 so that the controller 250 can determine or adjust the state of the display device 200 according to the detected parameters. In practical applications, the rotating assembly 276 may include, but is not limited to, one or more of the aforementioned components.

The tuner and demodulator 210, which receives broadcast television signals through wired or wireless means, can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television selected by the user from multiple wireless or cable broadcast television signals The audio and video signals carried in the frequency of the channel, as well as additional information (such as EPG data).

The tuner and demodulator 210 can be selected by the user and controlled by the controller 250 to respond to the frequency of the television channel selected by the user and the television signal carried by the frequency.

The tuner and demodulator 210 can receive signals in many ways according to different broadcasting formats of TV signals, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting; and according to different modulation types, it can be digital modulation or analog Modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.

In some other exemplary embodiments, the tuner demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a TV signal after modulation and demodulation, and is input to the display device 200 through the external device interface 240.

The communicator 220 is a component used to communicate with external devices or external servers according to various types of communication protocols. For example, the display device 200 may transmit content data to an external device connected via the communicator 220, or browse and download content data from an external device connected via the communicator 220. The communicator 220 may include a network communication protocol module such as a WIFI module 221, a Bluetooth module 222, and a wired Ethernet module 223 or a near field communication protocol module, so that the communicator 220 can receive the control signal of the control device 100 according to the control of the controller 250, and Realize the control signal as WIFI signal, Bluetooth signal, radio frequency signal, etc.

The detector 230 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside. The detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's voice, such as a voice signal of a control instruction for the user to control the display device 200; or, it may collect environmental sounds used to identify the type of environmental scene to realize display The device 200 can adapt to environmental noise.

In some other exemplary embodiments, the detector 230 may also include an image collector 232, such as a camera, a camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and to collect The attributes of the user or interactive gestures with the user to achieve the function of interaction between the display device and the user.

In some other exemplary embodiments, the detector 230 may further include a light receiver, which is used to collect the ambient light intensity to adapt to changes in display parameters of the display device 200 and so on.

In some other exemplary embodiments, the detector 230 may also include a temperature sensor. For example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. Exemplarily, when the temperature is relatively high, the display device 200 can be adjusted to display a colder image color temperature; when the temperature is relatively low, the display device 200 can be adjusted to display a warmer color temperature of the image.

The external device interface 240 is a component that provides the controller 250 to control data transmission between the display device 200 and external devices. The external device interface 240 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.

Among them, the external device interface 240 may include: a high-definition multimedia interface (HDMI) terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, and a component (Component) Any one or more of terminals (not provided in the figure), red, green and blue (RGB) terminals (not provided in the figure), etc.

The controller 250 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 260.

As shown in FIG. 3, the controller 250 includes a random access memory (RAM) 251, a read only memory (ROM) 252, a graphics processor 253, a processor 254, a power-on interface 255, and a communication bus 256. Among them, the RAM 251, the ROM 252, the graphics processor 253, and the processor 254 power-on interface 255 are connected through the communication bus 256.

ROM252, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the processor 254 runs the system startup instruction in the ROM 252, and copies the operating system stored in the memory 260 to the RAM 251 to start the operating system. After the operating system is started, the processor 254 copies various application programs in the memory 260 to the RAM 251, and then starts to run and start various application programs.

The graphics processor 253 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. The graphics processor 253 may include an arithmetic unit, which is used to perform operations by receiving various interactive instructions input by the user, and then display various objects according to the display attributes; and a renderer, which is used to generate various objects obtained based on the arithmetic unit, and perform The rendered result is displayed on the display 275.

The processor 254 is configured to execute operating system and application program instructions stored in the memory 260. And according to the received user input instructions, to execute various applications, data and content processing, so as to finally display and play various audio and video content.

In some exemplary embodiments, the processor 254 may include multiple processors. The multiple processors may include a main processor and multiple or one sub-processors. The main processor is configured to perform some initialization operations of the display device 200 in the display device preloading mode, and/or, the operation of the animation page in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode of the display device.

The power-on interface 255 may include the first interface to the nth interface. These interfaces may be network interfaces connected to external devices via a network.

The controller 250 may control the overall operation of the display device 200. For example, in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

Among them, the object can be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object, for example, the operation of displaying the page, document, image, etc. connected to the hyperlink, or the operation of executing the program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to a voice spoken by the user.

The memory 260 is used to store various types of data, software programs or application programs for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or non-volatile memory. The term “memory” includes the memory 260, the RAM 251 and ROM 252 of the controller 250, or the memory card in the display device 200.

In some embodiments, the memory 260 is specifically used to store the operating program that drives the controller 250 in the display device 200; to store various application programs built in the display device 200 and downloaded from external devices by the user; and to store the configuration provided by the display 275 Data such as various GUIs, various objects related to the GUI, and visual effect images of the selector used to select GUI objects.

In some embodiments, the memory 260 is specifically used to store drivers and related data of the tuner and demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, etc. For example, external data (such as audio and video data) received from an external device interface or user data (such as key information, voice information, touch information, etc.) received from a user interface.

In some embodiments, the memory 260 specifically stores software and/or programs for representing an operating system (OS). These software and/or programs may include, for example, a kernel, middleware, application programming interface (API), and/or application. Exemplarily, the kernel can control or manage system resources and functions implemented by other programs (such as middleware, API or application programs); at the same time, the kernel can provide interfaces to allow middleware, API or application programs to access the controller, To achieve control or management of system resources.

FIG. 4 exemplarily provides a block diagram of the architecture configuration of the operating system in the memory of the display device 200. The operating system architecture consists of the application layer, the middleware layer, and the kernel layer from top to bottom.

Application layer, system built-in applications and non-system-level applications belong to the application layer. Responsible for direct interaction with users. The application layer can include multiple applications, such as settings applications, e-post applications, media center applications, and so on. These applications can be implemented as web applications, which are executed based on the WebKit engine, and specifically can be developed and executed based on HTML5, Cascading Style Sheets (CSS) and JavaScript.

Here, HTML, the full name of HyperText Markup Language (Hyper Text Markup Language), is a standard markup language used to create web pages. Web pages are described through markup tags. HTML tags are used to describe text, graphics, animations, sounds, and tables. , Links, etc., the browser will read the HTML document, explain the content of the tags in the document, and display it in the form of a web page.

CSS, the full name of Cascading Style Sheets (Cascading Style Sheets), is a computer language used to express the style of HTML files, and can be used to define style structures, such as fonts, colors, and positions. CSS styles can be directly stored in HTML web pages or in separate style files to achieve control over styles in web pages.

JavaScript is a language used in web page programming, which can be inserted into HTML pages and interpreted and executed by the browser. The interaction logic of the web application is implemented through JavaScript. JavaScript can encapsulate the JavaScript extension interface through the browser to realize the communication with the kernel layer,

The middleware layer can provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer can be implemented as the Multimedia and Hypermedia Information Coding Expert Group (MHEG) of the middleware related to data broadcasting, and can also be implemented as the DLNA middleware of the middleware related to external device communication, and can also be implemented as providing Display the middleware of the browser environment in which each application in the device runs.

The kernel layer provides core system services, such as file management, memory management, process management, network management, system security authority management and other services. The kernel layer can be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: providing display drivers for displays, camera drivers for cameras, button drivers for remote controls, and WIFI modules Provide WiFi driver, audio driver for audio output interface, power management driver for power management (PM) module, etc.

In Fig. 3, the user interface 265 receives various user interactions. Specifically, it is used to send the input signal of the user to the controller 250, or to transmit the output signal from the controller 250 to the user. Exemplarily, the remote control 100A may send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user interface 265, and then the user interface 265 transfers to the controller 250; or the remote control 100A may Receive output signals such as audio, video, or data output from the user interface 265 after the controller 250 processes, and display the received output signal or output the received output signal as audio or vibration.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 275, and the user interface 265 receives the user input command through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of the selector in the GUI to select different objects or items. Among them, "user interface" is a medium interface for interaction and information exchange between application programs or operating systems and users, and it realizes the conversion between the internal form of information and the form acceptable to users. The commonly used form of the user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of an electronic device. The control can include icons, controls, menus, tabs, text boxes, dialog boxes, status bars, channel bars, Widgets, etc. Visual interface elements.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 recognizes the sound or gesture through the sensor to receive the user input command.

The video processor 270 is used to receive external video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal. The video signal displayed or played directly on the display 275.

For example, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

Among them, the demultiplexing module is used to demultiplex the input audio and video data stream, such as the input MPEG-2 stream (based on the compression standard of digital storage media moving images and voice), then the demultiplexing module will demultiplex it Multiplexed into video signals and audio signals, etc.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

An image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or itself to generate an image signal for display.

The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 60Hz video to a frame rate of 120Hz or 240Hz, and the usual format is realized by such as frame interpolation.

The display formatting module is used to change the signal output by the frame rate conversion module to a signal conforming to the display format such as a display, for example, format the signal output by the frame rate conversion module to output RGB data signals.

The display 275 is used to receive the image signal input from the video processor 270 to display video content, images, and a menu control interface. The displayed video content can be from the video content in the broadcast signal received by the tuner and demodulator 210, or from the video content input by the communicator 220 or the external device interface 240. The display 275 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.

And, the display 275 may include a display screen component for presenting a page and a driving component for driving image display. Alternatively, if the display 275 is a projection display, it may also include a projection device and a projection screen.

Rotating the component 276, the controller 250 can send a control signal to make the rotating component 276 rotate the display 275.

The audio processor 280 is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, and the result can be stored in the microphone 286 The audio signal to be played.

Exemplarily, the audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), High Efficiency AAC (HE-AAC) and other formats.

The audio output interface 285 is used to receive the audio signal output by the audio processor 280 under the control of the controller 250. The audio output interface 285 may include a microphone 286, or output to an external audio output terminal 287 of a generator of an external device, such as a headset Output terminal.

In some other exemplary embodiments, the video processor 270 may include one or more chips. The audio processor 280 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips, or may be integrated with the controller 250 in one or more chips.

The power supply 290 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200.

Since the display device 200 provided in the present application includes a display 275 and a rotating component 276, the rotating component 276 can drive the display 275 to rotate, so that the display 275 can be displayed in different directions. Therefore, in an implementation manner, the display direction may include a horizontal screen display direction and a vertical screen display direction. Among them, the horizontal display direction refers to the display direction in which the horizontal length (width) of the display 275 is greater than the vertical length (height) when viewed from the front of the display 275; the vertical display direction refers to the display direction from the display 275 When viewed from the front, the length (width) in the horizontal direction of the display 275 is smaller than the length (height) in the vertical direction in the display direction.

Obviously, affected by the installation/placement position of the display device 200, the vertical direction in the present application refers to substantially vertical, and the horizontal direction also refers to substantially horizontal. The horizontal display direction is mainly used to display horizontal media assets such as TV series and movies, as shown in Figure 5A. The operation mode when the display 275 is in the horizontal display orientation may be referred to as the horizontal media viewing mode, and the operation mode when the display 275 is in the vertical display orientation may be referred to as the vertical media viewing mode. The controller 250 in the display device 200 is further connected to the server 300 in communication, and is used to call the interface of the server 300 to obtain corresponding data. The display 275 in the display device 200 can be driven to rotate by the rotating component 276 and used to display a user interface. In practical applications, the user can control the play mode, play content, etc. of the display device 200 through the control device 100, where the play mode includes a horizontal screen media viewing mode and a vertical screen media viewing mode.

The vertical screen display direction is mainly used to display vertical media assets such as short videos and comics, as shown in FIG. 5B. In the portrait display direction, the display 275 can display a user interface corresponding to the portrait display direction, and has an interface layout and interaction mode corresponding to the portrait display direction. In the vertical screen media asset viewing mode, users can watch short videos, comics and other vertical screen media assets. In the same way, since the controller 250 in the display device 200 is further connected to the server 300 in communication, it is possible to obtain the media data corresponding to the vertical screen by calling the interface of the server 300 when the display direction is displayed in the vertical screen.

The vertical screen display direction is more suitable for playing media assets with a vertical screen ratio of 9:16, for example, short videos shot through terminals such as mobile phones. Since terminal devices such as mobile phones mostly use vertical screen ratios such as 9:16 and 9:18, when the terminal is connected to the display device 200 and the terminal page is displayed through the display device 200, the vertical screen display orientation can avoid transitional zooming of the page , Make full use of the application page of the display 275, and have a better user experience.

It should be noted that the above-mentioned horizontal display direction and vertical display direction are only two different display directions of the display 275, and do not limit the displayed content. For example, short videos, cartoons, etc. can still be displayed in the horizontal display direction. Vertical media assets; horizontal media assets such as TV series and movies can still be displayed in the vertical screen display direction, but the inconsistent display windows need to be compressed and adjusted in the display direction.

When the user uses the display device 200, the display direction of the display 275 is adjusted according to the user's viewing needs. For example, you can control the rotation key on the device 100, or select the rotation option on the UI interface, or input the "rotation" related voice through the voice system to issue a rotation instruction, and the controller 250 will control the rotation component 276 to rotate according to the rotation instruction. To drive the display 275 to rotate. For example, when a user wants to watch a short video through the display device 200, he can input a rotation instruction in one of the above-mentioned ways to rotate the display 275 in the horizontal display orientation 90 degrees counterclockwise to the vertical display orientation, so as to adapt to the short video, etc. The aspect ratio of the vertical application.

In the process of video playback, the display device needs to perform image quality processing and/or motion compensation on the frame of the video to be played. This requires the display device to draw the video frame to the image quality processing module/or through its Surfaceview (video layer control) Motion compensation module. Therefore, during the video playback process, the display device draws the video frame through the Surfaceview (video layer control). However, when the display is rotating, because the Surfaceview cannot control the rotation of the video frame at any angle, the display direction of the video frame does not match the display direction of the display during the display rotation. The user experience is poor.

In order to solve the above technical problems, an embodiment of the present application provides a display device, the display device at least includes: a display, a rotating component, and a controller. The functions and connection modes of the display, rotating component, and controller can be referred to the above-mentioned embodiments. Go into details.

Fig. 6 is a flow chart of the operation of the controller during video playback according to a feasible embodiment; the controller is further configured to execute steps S11 and S12.

S11 monitors the state of the display in response to receiving the video playback instruction, the state includes: rotating state and static state;

When the user wants to play the video, the user can send the video play instruction to the display device. In some feasible embodiments, the video play instruction may be a video play instruction sent by the user in the form of voice; the sending process of the video play instruction may be: the user outputs the wake-up word in advance, and then outputs the video play instruction, based on the wake-up word between the user and The controller 250 establishes a connection, so that the controller 250 can respond to the video playback instruction output by the user. For example, the user inputs the wake-up word "Xiaoju classmate" and the video playback instruction "play XXX video". In some feasible embodiments, the video play instruction may be a video play instruction sent by the user through the remote control; the sending process of the video play instruction may be: the user touches the relevant controls of the remote control so that the controller 250 can send the corresponding The video playback instruction of the controller 250 can make a corresponding response to the video playback instruction. For example, the user can trigger the remote control to send a video playback instruction to the controller 250 by clicking the confirm button of the remote control. This embodiment only exemplarily provides two startup modes of the display device. In the actual application process, the sending process of the video playback instruction may be, but not limited to, the above two modes.

In this application, the controller can be provided with corresponding monitoring components, so that the controller can monitor the status of the display. In some feasible embodiments, an angle monitor may be provided in the controller 250. Accordingly, the controller 250 may monitor the real-time rotation angle of the display 275. When the real-time rotation angle is greater than zero, the display is in a rotating state. In another feasible embodiment, a gravity acceleration sensor may be provided in the controller 250. By monitoring the information of the gravity sensor in the three directions of the spatial coordinate system (x, y, z), the posture corresponding to the display 275 at any time can be obtained. , According to the posture, you can determine whether the display is in a rotating state or a static state. In another feasible embodiment, an angular acceleration sensor may be provided in the controller 250, and by monitoring the angle increase value monitored by the angle sensor, it is determined whether the display is in a stationary state or a rotating state. In this application, the controller may also be provided with other monitors for monitoring the status of the display 275.

S12 If the display is in a static state, draw the video frame of the to-be-played video through the video layer drawing control. If the display is in a rotating state, draw the video frame of the video to be played through the image layer drawing control;

When the display is in a static state, the operation flow of the controller can be seen in FIG. 7A. FIG. 7A is a flowchart of the controller during video playback according to a feasible embodiment; it can be seen from the figure that the controller is configured as Steps:

S21 receives audio and video data;

In this application, the controller is used to receive audio and video data, where the audio and video data may include: network audio and video data drawn using the network, pre-downloaded audio and video data and wired audio and video data transmitted through a USB interface. Cable audio and video data includes satellite TV signals, V-segment, U-segment TV signals, and other TV signals transmitted by cable stations via microwave (or optical cable). This embodiment only exemplarily shows several types of audio and video signals. In the actual application process, the audio and video signals may be, but are not limited to, the above-mentioned types of signals. .

S22 decode audio and video data;

In this application, the controller is provided with a codec, which can decode audio and video data, where the audio and video data can be decoded using a decoding method commonly used in this field. To be too restrictive.

S23 synchronize audio and video data;

After decoding, two channels of data are obtained at the same time, one is audio data, and the other is video data.

Since the subsequent controller needs to transmit audio data to the speaker, so that the speaker can play the audio data. The video data needs to be transmitted to the display so that the display can play the video data. Generally, in order to improve the user’s sense of experience, it is necessary to perform a row of image quality processing or motion compensation on the video data, which results in a longer time for the audio data to reach the display. In order to achieve the effect of "audio-visual synchronization", the embodiment of the present application The central controller synchronizes audio data and video data, so that the time when the audio data reaches the speaker is equal to the time when the video data reaches the display.

Wherein, the realization of synchronizing the audio data and the video data may be to add a delay parameter to the audio data, so that the time for the audio data to reach the speaker is equal to the time for the video data to reach the display. In the process of actual application, the implementation manner of synchronizing audio data and video data is, but not limited to the foregoing implementation manner, and the applicant does not make too many limitations here.

S24 draws a video frame according to the video data;

In this embodiment, the controller draws the video frame through the Surfaceview, wherein the drawing method of the video frame can be a drawing method commonly used in the art, and the applicant does not make too many limitations here.

S25 performs motion compensation or image quality processing on video frames;

The process of image quality processing can be the adjustment of some parameters of the video frame, these parameters can be but not limited to contrast, brightness, color, hue, sharpness, hue, color temperature, noise reduction, mpeg noise reduction, point noise reduction , White enhancement, color enhancement, red gain, green gain, blue gain, R-compensation, G-compensation, B-deviation, white balance and other parameters related to image quality processing. The image quality processing can also be adding some special effects to the video frame. The special effects can be, but not limited to, snow scenes, 3D images, etc. This embodiment only exemplarily introduces two image quality processing methods. In the actual application process, the image quality processing process may be, but is not limited to the above two implementation methods.

S26 controls the display to display the processed video frame.

In this application, the controller draws the video frame of the video to be played through the Surfaceview, so that when the display is in a static state, the image quality processing or motion compensation can be performed on the video frame to improve the user experience.

When the display is in a rotating state, the operation flow of the controller can be seen in FIG. 7B. FIG. 7B is a flow chart of the controller in the video playback process according to a feasible embodiment; it can be seen from the figure that the controller is configured as Steps:

S21 receives audio and video data;

S22 decode audio and video data;

Among them, the decoding method of audio and video data can refer to the above-mentioned embodiment, which will not be repeated here.

S23 synchronize audio and video data;

Among them, the synchronization of audio and video data can refer to the above-mentioned embodiment, which will not be repeated here.

S24 draws a video frame according to the video data and the rotation angle of the display;

In this embodiment, the controller draws the video frame of the video to be played through the Textureview. Textureview can support translation, scaling, arbitrary angle rotation, screenshots and other transformations of video frames. Therefore, by drawing video frames through Textureview, the display direction of the drawn video frames can be adapted to the display direction of the display. When a user uses the display device provided in this embodiment to watch a video, even when the display is in a rotating state, the picture (also referred to as a video frame in this application) viewed by the user is always adapted to the display direction of the display, and the user experience is better.

S26 controls the monitor to display video frames.

In the solution shown in the embodiment of the present application, if the display is in a rotating state, the controller draws the video frame of the to-be-played video through the Textureview. Textureview can support translation, scaling, arbitrary angle rotation, screenshots and other transformations of video frames. Therefore, by drawing video frames through Textureview, the display direction of the drawn video frames can be adapted to the display direction of the display. When a user uses the display device provided in this embodiment to watch a video, even when the display is in a rotating state, the picture viewed by the user is always adapted to the display direction of the display, and the user experience is better. If the controller always uses Textureview to draw video frames during video playback, the video that the user watches is a video that has not undergone image quality processing. In the actual application process, in order to provide users with better visual effects, it is usually necessary to perform image quality processing or motion compensation on video frames. However, due to hardware limitations, if the video frame is output in the graphics layer, the image quality cannot be processed. Based on this, in the display device provided by this embodiment, when the display is in a static state, the controller draws the video frame of the to-be-played video through the Surfaceview, so that when the display is in a static state, the video frame can be processed for image quality or motion compensation. , To further enhance the user experience.

The following is a detailed description of the operation flow of the display device during the video playback process in conjunction with specific examples.

Example 1:

Figure 8 is a flow chart of the operation of the display device during video playback according to a feasible embodiment; it can be seen from the figure that during the video playback process, the controller is configured to perform the steps:

S31 receives audio and video data;

S32 decodes audio and video data;

S33 In response to receiving the video play instruction, read the first display direction and the second display direction. The first display direction is the display direction of the video to be played, and the second display direction is the display direction of the video to be played. The current display direction of the display device ；

There are many ways to read the first/second display direction.

For example, the controller 250 may determine the first display direction by reading the resolution of the video. The resolution of the video includes the width and height of the video. If the width is greater than the height, the display direction of the video is the horizontal display direction; if the width is less than the height, the display direction of the video is the vertical display direction.

Specifically, after the action of loading the video is completed, the attribute value of the video is also stored in the local memory of the controller 250. At this time, the controller 250 can determine the display direction of the video by calling the resolution in the attribute value. . The resolution records the number of pixels contained in the video in the two dimensions of "horizontal" and "vertical". For example, a 1920*1080 video is composed of 1920 pixels in the horizontal direction and 1080 pixels in the vertical direction (2,073,600 pixels in total). Based on the resolution, it can be known whether the video is displayed on the horizontal screen or displayed on the vertical screen.

In some feasible embodiments, if the resolution of the video loaded by the controller 250 is 320*240, the controller 250 determines that the video is a horizontal display video, and the corresponding first display direction is a horizontal display direction. In another feasible embodiment, the controller 250 retrieves the loaded video with a resolution of 768*1024, and the controller 250 determines that the video is a vertical screen display video, and correspondingly, the first display direction is a horizontal display direction .

For another example, by adding a direction indicator to the configuration information of the video, the controller 250 may obtain the configuration information of the video being played through the application; then, based on the configuration information, determine whether the first display direction is the horizontal display direction or the vertical display direction.

Specifically, the controller 250 is further configured to: read the direction indicator; if the display direction indicator is the first direction indicator, the display direction supported by the video is the horizontal display direction; if the display direction indicator is the second direction indicator, then the video The supported display orientation is the portrait orientation. In the actual application process, the first identification value and the second identification value can be set according to requirements, and the applicant does not make too many restrictions here. The identification value can be added to the configuration information: com.android, H/V/HV, H indicates that the video only supports horizontal display orientation, V indicates that the video only supports vertical display, and HV indicates that the video supports both horizontal display and vertical display. direction.

In some feasible embodiments, the controller 250 retrieves the direction identifier of the video: com.android, H, and the controller 250 determines that the display direction supported by the video is the horizontal display direction. In another feasible embodiment, the controller 250 reads the direction identifier of the video: com.android, V, and the controller 250 determines that the first display direction is the vertical display direction.

The current display direction (second display direction) of the display 275 can be monitored by a sensor built into the display device 200. For example, the display 275 of the display device 200 is provided with a gyroscope, a gravity acceleration sensor, etc., and the posture data of the display 275 relative to the direction of gravity can be determined by measuring the angular acceleration or the direction of gravity. The monitored posture data is then compared with the posture data in the horizontal display direction and the vertical display direction, respectively, to determine the display direction where the display 275 is currently located.

For another example, a grating angle sensor, a magnetic field angle sensor, or a sliding resistance angle sensor, etc. can be arranged on the rotating component 276, and the angle rotated by the rotating component 276 can be measured and compared with the angle in the horizontal display direction and the vertical display direction. , To determine the current display direction of the display 275.

The embodiments of the present application are merely illustrative of several implementation ways of reading the first/second display direction. In the actual application process, the implementation ways of reading the first/second display direction are not limited to the above-mentioned ones. Kind of way.

S3411 In response to the first display direction being different from the second display direction, the rotation component is controlled to drive the display to rotate, so that the display direction of the display after rotation is adapted to the second display direction, and the first rotation angle is read, and the first rotation angle is the display The rotation angle;

In some feasible embodiments, in response to the video playback instruction input by the user, the controller 250 reads the first display direction and the second display direction; if the first display direction is not consistent with the second display direction, the controller 250 controls the rotating component 276 drives the display 275 to rotate, so that the display direction of the display 275 after the rotation is adapted to the first display direction; for example, the controller 250 detects that the current rotation angle of the display 275 is 90 degrees through the angle sensor, then it can determine that the display direction of the display 275 is The display direction of the vertical screen, and when the first display direction is read as the horizontal display direction, the display 275 can be rotated so that the display direction of the rotated display 275 is the vertical display direction. For another example, if the controller 250 detects that the current rotation angle of the display 275 is 90 degrees through the angle sensor, it can determine that the display direction of the display 275 is the horizontal display direction, and when the first display direction is read as the vertical display direction, it can check The display 275 is rotated so that the display direction of the rotated display 275 is the horizontal display direction.

In this embodiment, the controller may be equipped with an angle sensor, and the angle sensor records the first rotation angle in real time. Among them, the first selected rotation angle is a relative value, which is an angle increased or decreased from the starting point relative to the initial state of the display. For example, in a video player, the controller 250 detects that the current rotation angle of the display 275 is 90 through an angle sensor. Degrees, when the display is rotated to 91 degrees, the first choice of rotation angle is 1 degree. When the display is rotated to 89 degrees, the first choice of rotation angle is also 1 degree.

Because the display device is restricted by the rotating component and its component structure during the application process, after rotating a certain angle in a certain direction, it can no longer continue to rotate in that direction. Therefore, if the rotating assembly rotates in one direction each time, the rotating assembly will be damaged after multiple rotations.

Based on this, the rotation direction of the display controlled by the controller in this application is opposite to the most recent rotation direction of the display. For example, if the most recent rotation of the display is clockwise, the next time the controller controls the display to rotate counterclockwise. For another example, if the latest rotation direction of the display is counterclockwise, the next time the controller controls the display to rotate clockwise. Through the above-mentioned control method, damage to the display caused by excessive rotation can be avoided.

S3412 draws the video frame of the video to be displayed based on the first rotation angle, so that the second rotation angle is equal to the first rotation angle, and the second rotation angle is the rotation angle of the video frame.

The drawing process can be as follows: when the controller 250 controls the rotating component 276 to drive the display 275 to rotate clockwise, the controller 250 reads the first rotation angle. When the controller needs to draw the first video frame, the controller uses Textureview to read The first rotation angle taken is 0.25 degrees, and Textureview rotates the first video frame by 0.25 degrees counterclockwise. According to the above process, the video frame of the video to be displayed is drawn based on the first rotation angle until the display stops rotating.

In S3413, in response to the first rotation angle being equal to the preset rotation angle, draw the video frame of the to-be-played video through the video layer drawing control, and perform image quality processing or motion compensation on the video frame.

In this application, the display is switched between the landscape mode and the portrait mode. In a feasible embodiment, the preset angle can be set to but not limited to 90 degrees.

Among them, the image quality processing or motion compensation can refer to the above-mentioned embodiments, which will not be repeated here.

In S342, in response to the first display direction being the same as the second display direction, the video frame is drawn, and motion compensation or image quality processing is performed on the video frame to obtain a processed video frame.

In response to the first display direction and the second display direction being the same, the controller draws the video frame through the Surfaceview, where the drawing method of the video frame may be a drawing method commonly used in the art, and the applicant does not make too many limitations here.

Then image quality processing and/or motion compensation are performed on the video frame, where the process of image quality processing and/or motion compensation can adopt image quality processing and/or motion compensation methods commonly used in the field according to requirements, and the applicant has not done this here. Many restrictions.

The S35 controller display displays the processed video frame.

During the rotation of the display, the change diagram of the picture displayed on the display can be seen in FIG. 9, which is a change diagram of the picture displayed on the display according to a feasible embodiment; it can be seen from FIG. 9 that the process of the display is rotated In the process of rotating the display, the displayed video frame can be rotated with the display. The picture that the user sees is always adapted to the display direction of the display, and the user experience is better.

Example 2:

In the solution shown in Embodiment 1, if the display is in a rotating state, the video frame of the to-be-played video is drawn through the image layer drawing control; if the display is in a static state, the video frame of the to-be-played video is drawn through the video layer drawing control. When the display changes from the rotating state to the static state, the controller switches from the Textureview output video frame to the Surfaceview output video frame. During the process of switching from Textureview output video frame to Surfaceview output video frame, because there is a time interval, during this time interval, the controller does not output any video frame to the display, correspondingly, a flashing black screen will appear on the display. Please refer to Figure 9 for details. It can be seen from Figure 9 that when the display is rotated 90 degrees, the display will flash black screen (corresponding to the screen 12 in Figure 9).

Based on the above problems, the applicant has made further improvements to the display device. For the operation flow of the improved display device, refer to FIG. 10, which is a flowchart of the operation of the display device during video playback according to a feasible embodiment; it can be seen from the figure that during the video playback process, the controller It is also configured to perform the following steps:

In S3414, in response to the first rotation angle being equal to the preset rotation angle, intercept the occluded image, and the occluded image is the image displayed on the display when the display stops rotating;

In this application, when the first rotation angle is equal to the preset rotation angle, the display stops rotating. At this time, the controller intercepts the occluded image, and the occluded image is the image displayed on the display when the display stops rotating.

The controller controls the display to display the occlusion image. In this application, the occlusion image is located in the upper layer of the video frame. Therefore, when the occlusion image and the video frame exist at the same time, only the occlusion image can be seen from the user's perspective.

S3415 counts the display time of the occluded image;

The controller takes the time of displaying the occluded image as the starting point of time, and counts the display time of the occluded image in real time.

In S3416, in response to the display time being equal to the preset still frame time, cancel the occluded image.

The preset still frame time can be configured according to requirements. In a feasible embodiment, the preset still frame time can be the interval between the first time and the second time. The first time corresponds to the last video frame output by Textureview. The time corresponding to the first video frame output by Surfaceview at the second time. When the display time is equal to the preset still frame time, the occluded image is cancelled to ensure that the user can watch the video normally.

In this embodiment, during the rotation of the display, the change of the picture displayed on the display can be seen in FIG. 11. FIG. 11 is a change of the picture displayed on the display according to a feasible embodiment; During the rotation process, the displayed video frame can be rotated along with the display during the rotation of the display. When the display transitions from a rotating state to a static state, the controller switches from Textureview output video frame to Surfaceview output video frame. During this process, the controller controls the display to display the occlusion screen (corresponding to the occlusion screen 14 in Figure 11). Therefore, There will be no flashing black screen during this process.

Example 3:

Figure 12 is a flow chart of the operation of the display device during video playback according to a feasible embodiment; it can be seen from the figure that during the video playback process, the controller is also configured to perform steps:

S41 receives audio and video data;

S42 decode audio and video data;

S43 reads the angle increase value of the display device;

In S4411, in response to the angle increase value being greater than 0, the rotation component is controlled to drive the display to rotate, and the first rotation angle is calculated according to the angle increase value, where the first rotation angle is the rotation angle of the display;

In some feasible embodiments, in response to the video playback instruction input by the user, the controller 250 reads the angle increase value of the display device; if the angle increase value is greater than 0 in response to the angle increase value, the controller 250 controls the rotation component 276 to drive the display 275 to rotate, So that the display direction of the display 275 after rotation is adapted to the first display direction; for example, when the controller 250 detects that the angle increase value of the display 275 is greater than 0 through the acceleration sensor, the first rotation angle is calculated according to the angle increase value.

Among them, the first rotation angle can be calculated in the following manner. In a feasible embodiment, the controller receives the angle increase value of 0.1 degree every 10 ms, and the corresponding first rotation angle calculated every 10 ms is: 0.1 degree, 0.2 degree, 0.3 degree...up to 90 degrees. .

S4412 draws the video frame of the video to be displayed based on the first rotation angle, so that the display direction of the video frame is adapted to the display direction of the display.

Wherein, the implementation manner of drawing the video frame of the video to be displayed based on the first rotation angle can refer to the foregoing implementation, and will not be repeated here.

In S4413, in response to the first rotation angle being equal to the preset rotation angle, draw the video frame of the video to be played through the video layer drawing control, and perform image quality processing or motion compensation on the video frame.

S4414 responds to that the first rotation angle is equal to the preset rotation angle, then intercepts the blocked image, the blocked image is the image displayed on the display when the display stops rotating; S4415 responds to the first rotation angle equals to the preset rotation angle, and counts the display time of the blocked image ；

In S4416, in response to the display time being equal to the preset still frame time, cancel the occluded image.

The S45 controller display displays the processed video frame.

In this embodiment, during the rotation of the display, the change diagram of the screen displayed on the display can continue to refer to FIG. 11, which is a change diagram of the screen displayed on the display according to a feasible embodiment; it can be seen from FIG. During the rotation of the display, the displayed video frame can be rotated with the display during the rotation of the display. The user experience is better. When the display is changed from the rotating state to the static state, the controller will switch the video frame output by Textureview. Until Surfaceview outputs the video frame, during this process, the controller controls the display to show the occluded picture. Therefore, the problem of flashing black screen will not occur in this process.

Example 4:

In the solutions shown in Examples 1-3, a chain motor (also referred to as a rotating assembly in this application) is currently used to drive the display 275 to rotate. The rotation component 276 is provided with a limit switch. When the rotation component 276 drives the display 275 to rotate by 90 degrees, it will collide with the limit switch, causing the rotation angle of the display 275 to change greatly. For details, please refer to FIG. 13. FIG. 13 shows the relationship curve between the first rotation angle and the rotation time of the display 275 in the process that the rotation component 276 drives the display 275 to rotate from the vertical screen state to the horizontal screen state. When the time is Ti, the rotation component 276 hits the limit switch, and the rotation angle of the corresponding display 275 fluctuates greatly. Correspondingly, the video frame drawn based on the first rotation angle will be greatly inclined. Refer to screen 11 in Figure 9 or Figure 11.

Based on the above problems, I have applied for further improvements to the display device provided in the above embodiment. For the operation flow chart of the improved display device, please refer to FIG. 14. FIG. 14 is a video playback process provided according to a feasible embodiment. The operation flow chart of the display device; it can be seen from the figure that during the video playback process, the controller is also configured to execute the steps:

S51 receives audio and video data;

S52 decodes audio and video data;

S5311 records the rotation time in response to the display starting to rotate, and the rotation time is used to record the length of time the display rotates;

For the determination method of the display starting to rotate, please refer to the above-mentioned embodiment, which will not be repeated here.

S5312 generates a predicted angle according to the rotation time and the pre-stored rotation speed;

In this application, the rotation speed is generated in advance, and the rotation speed can be directly called when the predicted angle needs to be generated. The generation process of the rotation speed can be: the controller is configured to perform steps (1)-(4)

_{Step (1) The controller separately records the time T θ,N} required for the display to rotate the first preset angle 275N times;

In the actual application process, the first preset angle can be set according to requirements. In a feasible embodiment, the first preset angle is set to 90 degrees.

First rotation: the controller 250 controls the rotation of the display, and at the same time records the time T _90,1 required for the display 275 to rotate 90 degrees;

Second rotation: the controller 250 controls the rotation of the display, and at the same time records the time T _90,2 required for the display 275 to rotate 90 degrees;

Third rotation: the controller 250 controls the rotation of the display, and at the same time records the time T _90,3 required for the display 275 to rotate 90 degrees;

Fourth rotation: the controller 250 controls the rotation of the display, and at the same time records the time T _90,4 required for the display 275 to rotate 90 degrees;

...

Nth rotation: The controller 250 controls the rotation of the display, and at the same time records the time T _90,N required for the display 275 to rotate 90 degrees.

Step (2) The controller counts the probability of occurrence at each time;

The controller 250 counts the occurrence probability of _{T θ,1} , T _θ,2 ... T _θ,N.

Step (3) The controller screens out the time when the probability is greater than the preset probability as the target time;

Among them, the preset probability can be set according to requirements, wherein the higher the value of the preset probability, the more accurate the corresponding calculation result.

Step (4) Calculate the rotation speed according to the first preset angle and the target time;

The rotation speed can be calculated according to the following formula:

Among them, V is the rotation speed, θ is the first preset angle, and T _{θ, N} is the target time.

In a feasible embodiment, θ=30 degrees, calculated according to the above method:

In a feasible embodiment, θ=90 degrees, calculated according to the above method:

In this application, the predicted angle=rotation time*rotation speed.

S5313 Draw the video frame based on the predicted angle, so that the second rotation angle is equal to the predicted angle, and the second rotation angle is the rotation angle of the video frame.

The implementation manner of drawing the video frame based on the drawing angle can refer to the foregoing implementation manner of drawing the video frame based on the first rotation angle, which will not be repeated here.

S5314 intercepts the blocked image in response to the display stop rotating;

In response to the display stop rotating, S5315 draws the video frame of the video to be played through the video layer drawing control, and performs image quality processing or motion compensation on the video frame.

S5316 Counts the display time of the occluded image;

In S5317, in response to the display time being equal to the preset still frame time, cancel the occluded image;

The S54 controller display displays the processed video frame.

During the rotation of the display device display shown in the embodiment of the application, the predicted rotation angle is calculated based on the rotation time and the rotation speed. The predicted angle is not affected by the actual rotation angle of the display, even if the display touches the limit during the rotation. In the case of a large jitter caused by the switch, the controller can also obtain an appropriate predicted angle based on the current rotation time and rotation speed. In this application, the prediction angle increases uniformly with the increase of time, so that the video screen configured based on the prediction angle rotates at a uniform speed with the increase of time. In this process, the video screen changes smoothly, and the user experience is better. In this embodiment, during the rotation of the display, the change of the picture displayed on the display can be seen in FIG. 15. FIG. 15 is a change of the picture displayed on the display according to a feasible embodiment; During the rotation process, the displayed video frame can be rotated along with the display during the rotation of the display. When the display changes from the rotating state to the static state, the controller switches from the Textureview output video frame to the Surfaceview output video frame. During this process, the controller controls the display to show the occluded picture, so there will be no flashing black screen during this process. The problem.

For the display device 200, an instruction can be issued by the controller 250 to control the driving motor of the rotating assembly 276 to rotate a preset angle according to the direction indicated by the instruction, so as to drive the display 275 to rotate to different rotation states. Generally, in order to adapt to different viewing needs, multiple rotation angles can be preset to make the display 275 in different rotation states. For example, the rotation state may include a horizontal screen state and a vertical screen state, where the horizontal screen state means that the long side of the screen of the display 275 is parallel to the ground (or horizontal plane), and the short side is perpendicular to the ground (or horizontal plane), as shown in FIG. 16A As shown; the vertical screen state means that the short side of the screen of the display 275 is parallel to the ground (or horizontal plane), and the long side is perpendicular to the ground (or horizontal plane) as shown in FIG. 16B.

Obviously, the horizontal screen state is more suitable for playing media assets with a horizontal screen ratio of 16:9, 4:3, etc., such as regular video resources such as movies and TV shows. The vertical screen state is more suitable for playing media assets with a vertical screen ratio of 9:16, 3:4, etc., for example, short videos, comics, etc. shot through terminals such as mobile phones.

It should be noted that although the horizontal screen state is mainly used to display horizontal media assets such as TV series and movies, and the vertical screen state is mainly used to display vertical media assets such as short videos and comics, the above-mentioned horizontal screen state and vertical screen state are only two types. Different display states do not limit the displayed content. For example, vertical media assets such as short videos and comics can still be displayed in the horizontal screen state; horizontal media assets such as TV series and movies can still be displayed in the vertical screen state, but the inconsistent display window needs to be zoomed in this state. Adjustment.

Different rotation states correspond to different rotation angles of the rotating assembly 276. In practical applications, if the rotation angle of the rotating component 276 is defined as 0 degrees when the display 275 is in the horizontal screen state, the rotation angle of the rotating component 276 when the display 275 is in the vertical screen state is 90 degrees (or -90 degrees). In addition to the above-mentioned horizontal screen state and vertical screen state, the rotating component 276 can also drive the display 275 to rotate at any angle, for example, a 180-degree inverted screen state.

When the display device 200 plays certain videos, the display 275 needs to be automatically rotated to adapt to different forms of video resources. For example, when the display 275 is in the horizontal screen state, the user chooses to play vertical screen media assets such as short videos. The operating system of the display device 200 can detect that the aspect ratio of the video resource is less than 1, and the current screen aspect ratio of the display 275 is greater than 1, that is, it is determined that the current rotation state does not match the video resource, thereby automatically sending control to the rotation component 276 Instruct it to drive the display 275 to rotate 90 degrees clockwise (or counterclockwise) to adjust the display 275 to the vertical screen state.

When the display device 200 displays a video image, it may also perform image quality processing on the video image through an image quality adjustment algorithm. The image quality processing may include processing the image on each frame of the video picture, such as color correction, color adjustment, etc., and may also include processing the multi-frame data of the video picture, such as frame interpolation algorithm, motion compensation, etc. Through image quality processing, the image display quality can be further improved, so as to have a better viewing experience under the same equipment configuration and without increasing the size of the video source resource.

Generally, in order to display a video screen on the display 275, multiple display levels are configured in the system framework of the display device 200, such as a video layer (Video layer), a graphics layer (surface layer), and so on. Wherein, the video layer refers to the display level used to present the play screen on the display device 200 after the user plays the media assets, and may also be referred to as the image quality layer of the display device 200. The playback screen corresponding to the media assets can be displayed in the image quality layer. The graphics layer is used to provide a display level of interactive operations for users, and may also be referred to as a UI (User Interface) layer of the display device 200. Among them, the video layer can perform image quality processing on the displayed image, and the graphics layer can perform post-adjustment of the displayed image, such as rotation, zoom, and so on. In addition, the graphics layer as the UI layer can also add various interactive controls to the display screen, such as controlling the homepage, so as to manually adjust the screen.

For the rotatable display device 200, due to the large size and weight of the display 275, the rotating assembly 276 cannot quickly rotate the display 275 to a preset angle. Therefore, the user needs to wait for a certain period of time to be normal during the rotation of the display 275. Watch video resources. For example, it takes 10-30 seconds for the display 275 to rotate from the horizontal screen state to the vertical screen state. During this time, as the display 275 rotates, the image originally presented on the display 275 will be tilted until the display 275 is completely rotated to After the vertical screen state (or after rotating to a preset angle), the display screen can be adjusted to rotate and fill the screen. It can be seen that during this period, the user needs to watch the tilted picture for a long time, which seriously affects the user experience.

In view of this, in some embodiments, it is possible to rotate the display screen while rotating the display 275, so that the display screen is always in a positive state, so that the user can view the display screen normally during the process of rotating the display 275. . In order to achieve the above effects, after playing the video data in the video layer, the screen in the video layer can be intercepted, and the intercepted screen can be rotated and zoomed, and then sent to the graphics layer for display. The processed display screen can be Keep it in a state where it is always shown to the user.

For example, when the display 275 is rotated 30 degrees clockwise, the image in the video layer can be intercepted and rotated 30 degrees counterclockwise so that the screen is displayed on the graphics layer at an angle of 30 degrees counterclockwise to offset the rotation angle of the display 275. . At this time, the viewing angle of the user is in the forward display state.

In the same way, for some media assets that do not support the vertical screen state, the above method can also be used to complete the display in the vertical screen state. For example, for some applications, the playback interface only supports the horizontal screen state. When the display 275 is in the vertical screen state, the image can be captured through the video layer, and then the image can be scaled, cropped, and filled to form a vertical screen. Display the scaled screen, so that the processed screen is displayed on the graphics layer.

Generally, the video data played by the display device 200 includes video data for presenting a display screen and audio data for presenting sound. Since only the video data in the video layer can be intercepted and displayed on the graphics layer, the audio data still needs to be output from the original channel, that is, the video data still needs to be played in the video layer to output the audio data.

Based on this, when the display device 200 is in the vertical screen state or during the rotation process, starting video playback will be affected by factors such as hardware performance, application decoding efficiency, etc., and there will be picture delays, making the video data sent to the graphics layer for the first time. Cannot be obtained in time, and the video layer is already displaying the screen content. In this case, when starting to play a video in portrait mode, the screen in the video layer will flash first, and then the graphics layer screen will be displayed.

Similarly, when exiting video playback, since the graphics layer exits faster than the video layer, the video layer will still output the corresponding image of the video data after exiting the graphics layer, resulting in a flash video layer when exiting the video playback in the vertical screen state. The problem with the picture. That is, for the rotatable display device 200, a flashing screen problem occurs when starting to play a video and when exiting from playing a video, which seriously affects the user experience.

In order to improve the user experience, some embodiments of the present application provide a video playback method in a portrait mode. The method may be applied to the display device 200, where the display device 200 may include a display 275, a rotating component 276, and a controller 250. The method can be configured in the controller 250 in the form of a control program to control the display screen control when starting to play the video. As shown in Figure 17, the method includes the following steps:

S171: Acquire a start playing instruction input by the user.

The display device 200 may obtain the video data through the server 300 or a local resource and a third-party resource platform, and decode it through a player in the display device 200 to present the specific screen content corresponding to the video data on the display 275.

According to different interaction modes between the display device 200 and the user, the user can input an instruction for starting to play the video through different interactive actions. For example, the user can interactively enter the application list interface or the media asset selection interface through the buttons on the control device 100 (such as the remote control), and use the "up, down, left, and right" keys to adjust in the application list interface or the media asset selection interface. Focus cursor position. After the focus cursor is positioned on the application icon such as "××Video" or any media resource icon, press the "OK/OK" key to input the start playing instruction to start playing the video data.

The user can also input a control instruction for starting to play video data in other ways. For example, for the display device 200 that supports touch operation, the user can directly click and touch on the position of the icon corresponding to the video data in the application list interface or the media asset selection interface to play the corresponding video data. For the display device 200 with a built-in intelligent voice system, the user can control the display device 200 to start playing video data by inputting voice instructions such as "play "XX", "I want to watch "XX"".

S172: In response to the start playing instruction, play the video data through the video layer.

After acquiring the user input to start playing instructions, the display device 200 may acquire video data from the corresponding video source. For example, the display device 200 can retrieve the local video data stored in the memory 260 after receiving the start playback instruction; the display device 200 can also form a data acquisition instruction after receiving the start playback instruction, and send the data acquisition instruction To the server 300 or the third-party resource platform, the server 300 or the third-party resource platform may feed back the video data to the display device 200 according to the data acquisition instruction.

After the display device 200 obtains the video data, the video data can be decoded by the player to form a specific video picture, so that the specific video picture is played through the video layer. Obviously, for video data, video data and audio data can generally be obtained after decoding, where the video data can form a specific picture through the video layer for display on the display 275. The audio data can output corresponding sound through an audio output device built-in or externally connected to the display device 200 to play the audio data. In order to achieve audio-visual synchronization, the display process of video data and audio data must be synchronized.

It should be noted that in this embodiment, the playback of video data through the video layer refers to the process of displaying the video on the video layer after decoding the video, and does not include the process of presenting the final picture on the display 275. The final picture presented on the display 275 is formed by superimposing multiple display levels, and the video layer is only one of the multiple display levels.

S173: Intercept an image frame from the video layer, and send the intercepted image frame to the graphics layer.

When the display 275 is in the vertical screen state or in the process of rotating, in order to present a positive display screen that is convenient for the user to watch, the screen of the video layer needs to be intercepted, and after processing such as rotation and zooming, it is displayed on the graphics layer. Since the graphics layer is displayed on the upper layer of the video layer, the screens in the graphics layer will block the screens of the video layer, so that the displayed content viewed by the user is the content in the graphics layer after transformation.

For example, the vertical screen state is a state that is rotated 90° clockwise relative to the horizontal screen state. When the display 275 is in the vertical screen state, each frame of image in the video layer needs to be captured, and the captured image is rotated counterclockwise. 90°, zoom in and out at the same time, to adapt to the display window form of the vertical screen state.

Obviously, in order to enable the display device 200 to normally output audio data and to capture image frames in the video layer, the video layer should continue to display the video images during the video playback process. In addition, in order to make the graphics layer obscure the picture in the video layer, the process of processing the intercepted image picture may also include adding a filling area to the image picture. For example, the filled area may be to add a pure color picture to the edge area outside the effective content in the image picture, so as to block the picture content in the video layer through the pure color picture.

S174: Control the graphics layer to display a black screen, until the graphics layer receives the image frame, continue to display the image frame on the graphics layer.

After sending the intercepted image screen to the graphics layer, the graphics layer can display the processed intercepted screen. Since the image in the video layer needs to be rotated, zoomed, filled, etc. after being intercepted, the process of intercepting, processing, and sending to the graphics layer will take a certain amount of time before it can be displayed in the graphics layer. For a period of time after starting to play, no specific pictures have been displayed in the graphics layer, but the corresponding pictures have been displayed in the video layer, so that the display 275 displays the pictures in the video layer during this period of time, and a splash screen problem occurs.

To this end, as shown in Figure 18, after controlling to send the screenshots in the video layer to the graphics layer, you can control the graphics layer to display a black screen, so that the graphics layer can block the screen content in the video layer until the graphics layer After receiving the intercepted picture in, continue to display the picture corresponding to the intercepted video data in the graphics layer.

It can be seen that, in this embodiment, by controlling the graphics layer to display a black screen at the beginning of the video playback stage, the video layer has already displayed the played video content, and the graphics layer is slow to obtain the video frame so that there is no video content, resulting in flashing video The problem with the video picture in the layer.

In order to be able to play video data in the video layer, in some embodiments, the step of playing video data through the video layer further includes:

S201: Start the application program specified in the start playing instruction;

S202: Create a player and the video layer through the application program;

S203: Decode the video data by the player to play a picture corresponding to the video data on the video layer.

Since the display device 200 can play the video data through the application program, after the user inputs the start play instruction, the controller 250 can parse the start play instruction, obtain the specified application package name information therein, and use the specified application package name. Information starts running applications that can play video data. Wherein, the application program refers to a system application or a third-party application that can be installed in the display device 200, and can be expressed in different forms according to the operating system platform of the display device 200, for example, an APK based on the Android system.

After launching the application, the player and video layer can be created through the application. For example, the APK creates a player and the APK creates a video window, that is, a video layer (surfaceview), so that the video data to be played is decoded by the player, so as to play a picture corresponding to the video data on the video layer.

For example, the user selects the "Juhaokan" application in the application program interface, and after pressing the "OK/OK" button on the remote control, starts and runs the Juhaokan application APK, and then selects any media asset icon in the application interface. Start video data playback. The APK creates a player and a video layer according to the video playback program, so that the selected media asset data is decoded by the player, and the decoded picture is displayed on the video layer.

For the rotatable display device 200, due to its built-in playback mode, when the state of the display 275 is detected to be changed, the orientation of the picture in the video layer is automatically adjusted to adapt to the rotation state of the display 275. The rotation state includes a horizontal screen state and a vertical screen state. For example, when the display device 200 is in the horizontal screen state, the video layer can be displayed according to the original orientation of the video data, while in the vertical screen state, the picture formed in the video layer can be rotated 90° clockwise to adapt to the vertical screen. state.

However, in the embodiment of the present application, the screen rotation operation in the vertical screen state is set during the processing after the video layer screen is captured, so in order to prevent the final presented screen from rotating by 90°. As shown in FIG. 19, in some embodiments of the present application, the step of creating the player and the video layer through the application program further includes:

S181: Set first mark information for the video layer;

S182: Detect the rotation state of the display through the rotation component;

S183: If the display is in the vertical screen state, control the non-rotation angle of the picture of the video layer according to the first mark information.

In order to indicate that the current video playback process needs to adapt to the rotation state, after the player and the video layer are created, the created video layer can be represented by setting mark information. For example, after the video window is created, the APK sets the flag information flags1 and passes it to the video layer (surfaceview).

The APK then detects the rotation state of the display 275. When it is judged that the display 275 is in the vertical screen state at this time, the surfaceview controls the corresponding picture in the video layer according to the flag information flags1 set by the application, and no longer follows the display The rotation angle of 275 (vertical screen 90 degrees) is rotated to avoid the abnormal display problem of multiple rotations of 90 degrees in the display direction of the video content.

Wherein, the detection of the rotation state can be completed by devices such as a gravity acceleration sensor built in the display device 200 and an angle sensor provided on the rotation component 276. For example, it can be preset that the rotation angle of the display 275 in the landscape state is 0, and the angle sensor detects that the rotation angle of the rotation component 276 is 90°, and it can be determined that the current display 275 is in the portrait state.

It should be noted that during the rotation process of the display 275, the image screen is also taken from the video layer and adjusted to be displayed on the graphics layer. In the process of video layer screen rotation control, the rotation component 276 is generally rotated. After a certain angle, the rotation of the image frame is automatically completed. Therefore, during the entire rotation of the display 275, the manner in which the video layer frame rotates following the rotation angle of the display 275 should be stopped. That is, in some embodiments, when it is detected that the rotation angle of the rotation component 276 changes, the control of the non-rotation angle of the picture of the video layer according to the first mark information may be executed.

As shown in FIG. 20, in some embodiments of the present application, the step of controlling the graphics layer to display a black screen further includes:

S191: Create a graphics layer and set second mark information for the graphics layer;

S192: Detect whether the image frame is received by the graphics layer;

S193: If the graphics layer does not receive the image frame, control the graphics layer to display a black screen according to the second mark information.

Through the application that is started to run, a graphics layer can be created, and the second flag information can be set for the graphics layer, that is, the APK sets the flag information flags2, and transmits it to the surface (graphic layer). After the graphic layer is created, the received image frame can be detected through the graphic layer, that is, whether an image frame that is intercepted from the video layer and processed by the image is received. If the graphics layer receives the image frame, it can directly display the received frame; if the graphics layer does not receive the image frame, it can display a black screen before displaying the image frame to cover the frame in the video layer.

For example, the apk sends an instruction a to the interception service to start the interception service to create a surface (graphics layer) through the interception service. The interception service also intercepts the decoded video data in real time and sends it to the graphics layer for display. When sufaceflinger detects that no video data has been sent to the corresponding graphics layer, it will control the graphics layer to display a black screen according to the flag information flags2 set by the previously received application. This avoids the problem of flashing the video image of the video layer when the video layer has already displayed the played video content, and the graphics layer has no video content due to the slow acquisition of video frames.

It should be noted that in the above display process, the player has a life cycle state, so it can also detect the state of the player during the life cycle, and set the first mark information for the video layer according to the state of the player. And create a graphics layer. For example, when the APK detects that the life cycle of the player is before the prepared state, the APK sets the flag information flags2 and passes it to the surface (graphics layer); and when the APK detects that the life cycle of the player is in the prepared state, the APK passes to The interception service sends instruction a to create a surface (graphics layer).

Since in the above-mentioned embodiment, the image in the video layer needs to be intercepted, and the intercepted image needs to be adjusted for display on the graphics layer, in some embodiments, the image can be intercepted as follows, that is, from the The steps of capturing an image frame at the video layer further include:

S311: Create an interception service;

S312: Perform image quality processing on the video data to obtain an image frame;

S313: Invoke the interception service to intercept the image screen.

Wherein, the interception service is used to intercept the video frame data. The interception service can also be created when the system is started and initialized, and when the display screen needs to be rotated, the service is called to intercept the video layer data in real time and send it to the graphics layer for display. . Before the interception, the video data can also be processed for image quality through the video layer to obtain an image.

In order to obtain a better display effect or adapt to the hardware configuration of the display device 200, the image screen may have a higher frame rate and/or different image screen effects from the original image to be displayed. Obviously, in order to be able to form a video picture on the graphics layer, the interception frequency of the interception service can be set to be greater than 25 frames/second. In order to obtain a better display effect, the interception frequency can be appropriately increased. For example, the interception frequency of the interception service can be set equal to the screen refresh rate of the display 275 at 60 Hz.

For example, after the video layer completes (or partially completes) the image quality processing of the to-be-displayed video image, the created interception service can be invoked, and the image image after image quality processing can be obtained in the video layer. For the image screen, the interception service can intercept frame by frame to obtain the same number of frames as the original image. The interception service can also intercept the frame at intervals to reduce the number of interception and image processing under the premise of meeting the video fluency, and alleviate the problem of the display device 200. Processing load.

In order to adapt to the effect of maintaining the forward display screen during the rotation process, in some embodiments, the step of sending the captured image screen to the graphics layer further includes:

S321: Obtain display rotation information through the rotation component;

S322: Rotate and/or zoom the captured image frame according to the display rotation information to obtain an intermediate image;

S323: Send the intermediate image to the graphics layer.

In this embodiment, the intermediate image refers to the image frame presented to the user during the rotation of the display 275. The intermediate image can be displayed in the graphics layer. Therefore, in order to form the intermediate image, the controller 250 can obtain the display rotation information through the rotation component 276 in real time, that is, obtain the rotation angle state of the display 275 at any time. Then, according to the display rotation information, perform adjustment processing such as rotation and/or zooming of the intercepted image to adjust the image to a form that can adapt to the current 275 corner state of the display, and finally send the adjusted intermediate image to the graphics layer for display , To maintain the positive display.

Based on the above video playback method in the vertical screen state, some embodiments of the present application also provide a display device 200, which includes a display 275, a rotating component 276, and a controller 250. Wherein, the display 275 is configured to present a user interface; the rotation component 276 is configured to drive the display 275 to rotate so that the display 275 is in one of a landscape state or a portrait state; the controller 250 is configured to execute The following program steps:

S171: Acquire a start playing instruction input by the user;

S172: In response to the start playing instruction, play the video data through the video layer;

S173: Intercept an image frame from the video layer, and send the intercepted image frame to a graphics layer, where the graphics layer is displayed on an upper layer of the video layer;

It can be seen from the above technical solutions that the display device 200 and the video playback method in the vertical screen state provided in the above embodiments can play video data through the video layer after obtaining the user input start playback instruction, and capture the image screen from the video layer, and Send the intercepted image screen to the graphics layer. When starting the video playback, control the graphics layer to display a black screen first. After the graphics layer receives the image screen, continue to display the image screen on the graphics layer. The method can control the graphics layer to display a black screen picture before playing the video, and alleviate the splash screen problem caused by the different starting speeds of the video layer and the graphics layer.

The foregoing embodiment provides that when starting to play a video, the black screen state is displayed by controlling the graphics layer to alleviate the problem of screen flickering during startup caused by different startup speeds. Corresponding to the above-mentioned embodiment, when the video is stopped, the closing speeds of the graphics layer and the video layer are also different, which will cause the display device 200 to first close the graphics layer and then close the video layer. Therefore, after closing the graphics layer , The problem of the flickering screen may reappear in the display 275.

Based on this, in some embodiments of the present application, a method for playing a video in a portrait mode is also provided, which is applied to the display control of the display device 200 when the video is turned off to play. As shown in Figure 21, the method includes the following steps:

S211: Acquire a closing playback instruction input by the user;

S212: In response to the closing play instruction, close the video layer;

S213: Intercept the image frame from the video layer, and stop sending the intercepted image frame to the graphics layer after the callback of the completion of closing of the video layer is detected.

In the same way, when closing the video playback process, the user can input the closing playback instruction through the control device 100, touch operation, or voice input. Since the closing speed of the video layer is slower than that of the graphics layer, the controller 250 can first execute the program to close the video layer after receiving the closing playback instruction, and continue to capture images from the video layer during the execution of the program , And sent to the graphics layer for display, to maintain the graphics layer has a picture. Until the callback information that the video layer is closed is detected, stop capturing the image frame and sending the captured image frame to the graphics layer.

After stopping sending the intercepted image to the graphics layer, close the graphics layer to close the video playback. Therefore, in the process of closing the playback function, there is always a picture in the graphics layer that can block the picture of the video layer, so that through the occlusion of the picture of the graphics layer, the problem of splash screen caused by displaying the video layer picture during the closing process is alleviated.

Further, in order to close the playback process, the method further includes:

S501: Detect the callback of completion of closing of the video layer;

S502: Release the player after detecting the completion of the callback for closing the video layer;

S503: Stop acquiring decoded video data after detecting the callback of completion of the player release.

After stopping sending the captured image frame to the graphics layer, the controller 250 may further detect the callback information of the completion of the video layer closing, so as to release the player after detecting the callback of the completion of the video layer closing, and then detect the completion of the player release. Callback information, so that after detecting the completion of the callback of the player release, stop obtaining the decoded video data.

That is, during the entire process of turning off the video playback function, if the display 275 is in the vertical screen state, the apk will first receive the message of the return button of the remote control to input a command to turn off the playback. And according to the command to close the playback, apk destroys the current video playback window surfaceview; apk releases the player after receiving the callback of completion of surfaceview destruction; apk sends command d to the service after receiving the callback of completion of the player release, and use To control the interception service to stop intercepting the decoded video data. Therefore, after the player is released, stop obtaining the decoded video data to ensure that the video layer will not flash when the video exits.

S211: Acquire a closing playback instruction input by the user;

S212: In response to the closing play instruction, close the video layer;

S213: Intercept the image frame from the video layer, and stop sending the intercepted image frame to the graphics layer after the callback of the completion of closing of the video layer is detected, and the graphics layer is displayed on the upper layer of the video layer.

It can be seen from the above technical solutions that the display device 200 and the video playback method in the vertical screen state provided by the above embodiments can first execute the closing of the video layer after obtaining the user's input to close the playback instruction, and continue from the video layer during the execution of the closing of the video layer The video layer intercepts the image frame, and stops sending the intercepted image frame to the graphics layer after detecting the callback of the completion of the closing of the video layer. The method can delay the closing of the graphics layer when the user performs the action of closing the video playback, so that the graphics layer and the video layer are closed synchronously, so as to alleviate the problem of flickering screen when the video is closed.

When the display device 200 displays a video image, it can also perform image quality processing on the video image through an image quality adjustment algorithm. The image quality processing may include processing the image on each frame of the video picture, such as color correction, color adjustment, etc., and may also include processing the multi-frame data of the video picture, such as frame interpolation algorithm, motion compensation, etc. Through image quality processing, the image display quality can be further improved, so as to have a better viewing experience under the same equipment configuration and without increasing the size of the video source resource.

S171: Acquire a start playing instruction input by the user.

According to different interaction modes between the display device 200 and the user, the user can input an instruction for starting to play a video through different interactive actions. For example, the user can interactively enter the application list interface or the media asset selection interface through the buttons on the control device 100 (such as the remote control), and use the "up, down, left, and right" keys to adjust in the application list interface or the media asset selection interface. Focus cursor position. After the focus cursor is positioned on the application icon such as "××Video" or any media resource icon, press the "OK/OK" key to input the start playing instruction to start playing the video data.

The user can also input a control instruction for starting to play video data in other ways. For example, for the display device 200 that supports touch operation, the user can directly click the touch on the position of the icon corresponding to the video data in the application list interface or the media asset selection interface to play the corresponding video data. For the display device 200 with a built-in intelligent voice system, the user can control the display device 200 to start playing video data by inputting voice instructions such as "play "XX", "I want to watch "XX"".

S201: Start the application program specified in the start playing instruction;

S202: Create a player and the video layer through the application program;

Since the display device 200 can play the video data through the application program, after the user inputs the start play instruction, the controller 250 can parse the start play instruction, obtain the specified application package name information therein, and use the specified application package name. Information starts running applications that can play video data. Wherein, the application program refers to a system application or a third-party application that can be installed in the display device 200, and may be expressed in different forms according to the operating system platform of the display device 200, for example, an APK based on the Android system.

S181: Set first mark information for the video layer;

S182: Detect the rotation state of the display through the rotation component;

It should be noted that during the rotation process of the display 275, the image screen is also taken from the video layer and adjusted to be displayed on the graphics layer. In the process of video layer screen rotation control, the rotation component 276 is generally rotated. After a certain angle, the rotation of the image frame is automatically completed. Therefore, during the entire rotation of the display 275, the way in which the video layer frame rotates following the rotation angle of the display 275 should be stopped. That is, in some embodiments, when it is detected that the rotation angle of the rotation component 276 changes, the control of the non-rotation angle of the picture of the video layer according to the first mark information may be executed.

S192: Detect whether the image frame is received by the graphics layer;

For example, the apk sends an instruction a to the interception service to start the interception service to create a surface (graphics layer) through the interception service. The interception service also intercepts the decoded video data in real time and sends it to the graphics layer for display. when

When sufaceflinger detects that no video data has been sent to the corresponding graphics layer, it will control the graphics layer to display a black screen according to the flag information flags2 set by the previously received application. This avoids the problem of flashing the video image of the video layer when the video layer has already displayed the played video content, and the graphics layer has no video content due to the slow acquisition of video frames.

S311: Create an interception service;

S313: Invoke the interception service to intercept the image screen.

In order to obtain a better display effect or adapt to the hardware configuration of the display device 200, the image screen may have a higher frame rate and/or different image screen effects from the original image to be displayed. Obviously, in order to be able to form a video picture on the graphics layer, the interception frequency of the interception service can be set to be greater than 25 frames/sec. In order to obtain a better display effect, the interception frequency can be appropriately increased. For example, the interception frequency of the interception service can be set equal to the screen refresh rate of the display 275 at 60 Hz.

S321: Obtain display rotation information through the rotation component;

S323: Send the intermediate image to the graphics layer.

S171: Acquire a start playing instruction input by the user;

S211: Acquire a closing playback instruction input by the user;

S212: In response to the closing play instruction, close the video layer;

In the same way, when closing the video playback process, the user can input the closing playback instruction by controlling the device 100, touch operation, or voice input. Since the closing speed of the video layer is slower than that of the graphics layer, the controller 250 can first execute the program to close the video layer after receiving the closing playback instruction, and continue to capture images from the video layer during the execution of the program , And sent to the graphics layer for display, to maintain the graphics layer has a picture. Until the callback information that the video layer is closed is detected, stop capturing the image frame and sending the captured image frame to the graphics layer.

Further, in order to close the playback process, the method further includes:

S501: Detect the callback of completion of closing of the video layer;

S211: Acquire a closing playback instruction input by the user;

S212: In response to the closing play instruction, close the video layer;

In specific implementation, the present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and the program may include part or all of the embodiments of the camera shooting angle adjustment method provided by the present invention when the program is executed. step. The storage medium can be a magnetic disk, an optical disc, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM), etc.

Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solutions in the embodiments of the present invention can be embodied in the form of software products, which can be stored in a storage medium, such as ROM/RAM. , Magnetic disks, optical disks, etc., including a number of instructions to enable a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the various embodiments of the present invention or the methods of certain parts of the embodiments.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit it; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features can be equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present application. Scope.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the implementation to the specific form disclosed above. According to the above teaching, various modifications and variations can be obtained. The selection and description of the foregoing embodiments are for better explaining the principles and practical applications, so that those skilled in the art can better use the embodiments and various modified embodiments suitable for specific use considerations.

Claims

A display device, characterized in that it comprises:

monitor;

A rotating component, connected to the display, for driving the display to rotate based on the control of the controller;

The controller is configured with a drawing control, the drawing control includes: an image layer drawing control and an image layer drawing control, and is configured to perform the following steps:

In response to receiving a video play instruction, monitoring the state of the display, the state including: a rotating state and a static state;

If the display is in a rotating state, draw the video frame of the to-be-played video through the image layer drawing control;

If the display is in a static state, the video frame of the to-be-played video is drawn through the video layer drawing control.
The display device of claim 1, wherein the controller is further configured to perform the following steps:

In response to receiving a video play instruction, read a first display direction and a second display direction, where the first display direction is the current display direction of the display, and the second display direction is the display direction of the video to be played ；

In response to the first display direction being different from the second display direction, the rotation component is controlled to drive the display to rotate, so that the display direction of the display after the rotation is adapted to the second display direction.
The display device according to claim 1 or 2, wherein the controller is further configured to perform the following steps:

In response to the display starting to rotate, recording a rotation time, where the rotation time is used to record the duration of the rotation of the display;

Generate a predicted angle according to the rotation time and the pre-stored rotation speed;

The video frame is drawn based on the prediction angle, so that the display direction of the video frame is adapted to the display direction of the display.
The display device of claim 1, wherein the controller is further configured to perform the following steps:

In response to the first display direction being different from the second display direction, reading a first rotation angle, where the first rotation angle is the rotation angle of the display;

The video frame of the video to be displayed is drawn based on the first rotation angle, so that the second rotation angle is equal to the first rotation angle, and the second rotation angle is the rotation angle of the video frame.
The display device of claim 1, wherein the controller is further configured to perform the following steps:

In response to receiving the video play instruction, reading the angle increase value of the display;

In response to the angle increase value being greater than zero, calculating a first rotation angle based on the angle increase value, where the first rotation angle is the rotation angle of the display;

Based on the first rotation angle, the video frame of the video to be displayed is drawn so that the second rotation angle is equal to the first rotation angle, and the second rotation angle is the rotation angle of the video frame.
The display device according to claim 4 or 5, wherein the controller is further configured to perform the following steps:

In response to the first rotation angle being equal to the preset rotation angle, the video frame of the to-be-played video is drawn through the video layer drawing control.
The display device according to claim 4 or 5, wherein the controller is further configured to perform the following steps:

In response to the display starting to rotate, start counting the rotation time of the display;

In response to the rotation time being equal to the preset rotation time, the video frame of the to-be-played video is drawn through the video layer drawing control.
The display device of claim 5, wherein the controller is further configured to perform the following steps:

In response to the angle increase value being equal to zero, the video frame of the to-be-played video is drawn through the video layer drawing control.
The display device according to claim 1, wherein the controller is further configured to:

When the display stops rotating, the occluded image is captured, and the occluded image is the image displayed on the display when the display stops rotating;

The display is controlled to display the occlusion image, and the occlusion image is arranged on the upper layer of the video frame.
The display device according to claim 9, wherein the controller is further configured to:

Counting the display time of the occluded image;

In response to the display time being equal to the preset still frame time, the occluded image is cancelled.