CN106507173B - Mobile terminal and split-screen display control method - Google Patents
Mobile terminal and split-screen display control method Download PDFInfo
- Publication number
- CN106507173B CN106507173B CN201610942763.7A CN201610942763A CN106507173B CN 106507173 B CN106507173 B CN 106507173B CN 201610942763 A CN201610942763 A CN 201610942763A CN 106507173 B CN106507173 B CN 106507173B
- Authority
- CN
- China
- Prior art keywords
- display
- split
- screen
- instruction
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses a mobile terminal and a split screen display control method, wherein the mobile terminal comprises: the acquisition module is used for acquiring video data in a video stream instruction when the video stream instruction is detected; the first judgment module is used for judging whether video data which are being played exist on a display screen or not; the second judgment module is used for judging whether the mobile terminal receives a split-screen display instruction or not when video data which is being played exists on the display screen; the display module is used for displaying a preset split screen interface in a preset area of the display screen when a split screen display instruction is detected; and the playing module plays the video data acquired from the video stream instruction on the split-screen interface when detecting the video playing instruction. The invention solves the problem that a user cannot use the mobile terminal to watch a plurality of videos simultaneously, meets the diversified function requirements of the user, enriches the display function of the mobile terminal on the premise of not influencing the use experience of the user, and improves the use experience of the user.
Description
Technical Field
The invention relates to the technical field of display control, in particular to a mobile terminal and a split-screen display control method.
Background
The development and popularization of the application technology of the mobile terminal promote the mobile terminal to obtain more and more scene applications in the life of people, and people can watch videos or programs and the like by using the mobile terminal. In real-world scenes, people often need to watch videos from different contents at the same time, for example, a user wants to watch video a and video B at the same time during using a mobile terminal, or the user suddenly wants to watch video B but does not want to turn off video a during watching video a. However, the current mobile terminal has only one display interface, and a plurality of display interfaces cannot be simultaneously used by the user to simultaneously watch videos, so that the user can only watch one video and cannot watch the videos simultaneously, the scene using requirements of the user cannot be met, and the using experience of the user is seriously damaged.
Disclosure of Invention
The invention mainly aims to provide a mobile terminal and a split-screen display control method, and aims to solve the technical problem that a user cannot simultaneously watch a plurality of videos in the process of using the mobile terminal, so that the scene using requirements of the user cannot be met.
In order to achieve the above object, an embodiment of the present invention provides a mobile terminal, where the mobile terminal includes:
the acquisition module is used for acquiring video data in a video stream instruction when the video stream instruction is detected;
the first judgment module is used for judging whether video data which are being played exist on the display screen or not;
the second judgment module is used for judging whether the mobile terminal receives a split-screen display instruction or not when video data which is being played exists on the display screen;
the display module is used for displaying a preset split screen interface in a preset area of the display screen when a split screen display instruction is detected;
and the playing module is used for playing the video data acquired from the video stream instruction on the split-screen interface when the video playing instruction is detected.
Optionally, the display module comprises:
the detection unit is used for reducing the display scale of the current display interface on the display screen when the split-screen display instruction is detected;
and the split screen unit is used for displaying the split screen interface in an area outside the current display interface.
Optionally, the mobile terminal further includes:
and the adjusting module is used for adjusting the display scale and/or the display position of the split screen interface in real time according to an adjusting instruction triggered by external operation when the adjusting instruction is received.
Optionally, the mobile terminal further includes:
and the loading module is used for loading the video data acquired from the video stream instruction to the split-screen interface and taking the first frame image played by the video data as a preview interface of the split-screen interface.
Optionally, the mobile terminal further includes:
and the release module is used for releasing the resources of the split screen interface when the video playing of the split screen interface is detected to be finished.
In addition, to achieve the above object, the present invention further provides a split-screen display control method, including:
when a video streaming instruction is detected, video data in the video streaming instruction is acquired;
judging whether video data which are being played exist on a display screen or not;
when video data which are being played exist on a display screen, judging whether the mobile terminal receives a split screen display instruction;
when a split-screen display instruction is detected, displaying a preset split-screen interface in a preset area of a display screen;
and when a video playing instruction is detected, playing the video data acquired from the video streaming instruction on a split-screen interface.
Optionally, when the split-screen display instruction is detected, the step of displaying a preset split-screen interface in a preset area of the display screen includes:
when a split-screen display instruction is detected, reducing the display scale of the current display interface on the display screen;
and displaying the split screen interface in an area outside the current display interface.
Optionally, when the split-screen display instruction is detected, after the step of displaying the preset split-screen interface in the preset area of the display screen, the method further includes:
and when an adjusting instruction triggered by external operation is received, adjusting the display scale and/or the display position of the split screen interface in real time according to the adjusting instruction.
Optionally, when the video playing instruction is detected, before the step of playing, on the split-screen interface, the video data acquired from the video streaming instruction, the method further includes:
and loading the video data acquired from the video stream instruction to a split-screen interface, and taking a first frame image played by the video data as a preview interface of the split-screen interface.
Optionally, when the video playing instruction is detected, after the step of playing the video data acquired from the video streaming instruction on the split-screen interface, the method further includes:
and when the video playing of the split screen interface is detected to be finished, releasing the split screen interface resources.
According to the invention, when a video stream instruction is detected by an acquisition module, video data in the video stream instruction is acquired; then a first judgment module judges whether video data which are being played exist on a display screen or not; when video data which are being played exist on the display screen, the second judging module judges whether the mobile terminal receives a split-screen display instruction; when a split-screen display instruction is detected, the display module displays a preset split-screen interface in a preset area of the display screen; finally, when a video playing instruction is detected, the playing module plays video data acquired from the video streaming instruction on a split screen interface, so that the technical problem that the display screen can only display one playing interface is avoided in the process that a user uses the mobile terminal to watch videos, the problem that the user cannot use the mobile terminal to watch scenes of multiple videos is solved, diversified function requirements of the user are met, further, on the premise that the user use experience is not influenced, the display function and the technical effect of the mobile terminal are enriched, and the use experience of the user is greatly improved.
Drawings
Fig. 1 is a schematic diagram of a hardware structure of an alternative mobile terminal for implementing various embodiments of the present invention;
FIG. 2 is a diagram of a wireless communication device of the mobile terminal of FIG. 1;
FIG. 3 is a diagram illustrating the split-screen display effect of the mobile terminal according to the first embodiment of the present invention
Fig. 4 is a diagram illustrating an effect of reducing an original display interface to display a split-screen interface according to a second embodiment of the mobile terminal of the present invention;
FIG. 5 is a diagram illustrating an effect of displaying a preview interface of the mobile terminal according to the fourth embodiment of the present invention;
FIG. 6 is a diagram illustrating an effect of releasing a split screen interface according to a fifth embodiment of the mobile terminal of the present invention;
FIG. 7 is a block diagram of a mobile terminal according to a first embodiment of the present invention;
FIG. 8 is a schematic diagram illustrating a detailed module of a display module in a second embodiment of a mobile terminal according to the present invention;
fig. 9 is a block diagram of a mobile terminal according to a third embodiment of the present invention;
fig. 10 is a block diagram of a mobile terminal according to a fourth embodiment of the present invention;
fig. 11 is a block diagram of a mobile terminal according to a fifth embodiment of the present invention;
FIG. 12 is a flowchart illustrating a first exemplary embodiment of a split-screen display control method according to the present invention;
fig. 13 is a flowchart illustrating a step of displaying a preset split screen interface in a preset area of a display screen when a split screen display instruction is detected according to a second embodiment of the split screen display control method of the present invention;
FIG. 14 is a flowchart illustrating a split-screen display control method according to a third embodiment of the present invention;
FIG. 15 is a flowchart illustrating a control method for split-screen display according to a fourth embodiment of the present invention;
fig. 16 is a flowchart illustrating a screen-division display control method according to a fifth embodiment of the present invention.
The objects, features, and advantages of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.
Fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.
The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, a power supply unit 190, an acquisition module 10, a first judgment module 20, a second judgment module 30, a display module 40, a play module 50, and the like. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.
The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication device or network.
The a/V input unit 120 is used to receive an audio or video signal.
The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal.
The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or jerky movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100.
The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100.
The output unit 150 may include a display unit 151 and the like. The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.
Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other mobile terminals), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure value as well as a touch input position and a touch input area.
The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.
The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, and the multimedia module 181 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.
The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.
The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication means such as wired and wireless communication means and satellite-based communication means that transmit data via frames or packets.
A communication apparatus in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.
Such communication devices may use different air interfaces and/or physical layers. For example, the air interface used by the communication device includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and universal mobile telecommunications device (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and so forth. The following description relates to a CDMA communication device, as a non-limiting example, but such teachings are equally applicable to other types of devices.
Referring to fig. 2, the CDMA wireless communication apparatus may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that an apparatus as shown in fig. 2 may include a plurality of BSCs 2750.
Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).
The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a base transceiver sub-assembly (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.
As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the apparatus. In fig. 2, several global positioning device (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.
In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. As a typical operation of the wireless communication apparatus, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.
Based on the hardware structure of the mobile terminal and the structure of the communication device, the mobile terminal is provided.
Referring to fig. 7, the present invention provides a mobile terminal, which includes, in a first embodiment of the mobile terminal:
the acquiring module 10 is configured to acquire video data in a video stream instruction when the video stream instruction is detected;
a first judging module 20, configured to judge whether video data being played exists on a display screen;
the second judging module 30 is configured to, when video data being played exists on the display screen, judge whether the mobile terminal receives a split-screen display instruction;
the display module 40 is configured to display a preset split screen interface in a preset area of the display screen when a split screen display instruction is detected;
and the playing module 50 is configured to play the video data acquired from the video stream instruction on the split-screen interface when the video playing instruction is detected.
The mobile terminal can be a smart phone, an IPAD and other devices, the display area of the mobile terminal is generally a touch screen, the mobile terminal can detect the operation of a user on the touch screen of the mobile terminal through the touch sensing function on the touch screen and convert the operation into an operation instruction corresponding to the operation, and the touch operation of the user plays a key role in the final realized technical effect of the embodiment.
The display effect of the mobile terminal is generally that the whole used screen is used as a display unit, that is, one display interface is covered with the whole display screen, which causes that a user can only watch one display interface each time, and once the user wants to watch other display interfaces, the current display interface must be manually closed or switched to another display interface to watch a new display interface.
The conventional video transmission technology generally packs video data into a large data packet, which has a very large memory capacity and is inconvenient to retrieve and use. In the process of transmitting the video data, if the mobile terminal cannot completely receive the video data packet, the data packet is considered to be incomplete and damaged, and cannot be analyzed, so that the corresponding video object cannot be called from the memory, the video cannot be played, and the video cannot be played while being received in the process of transmitting the video data. While video streaming technology can solve this problem well.
Specifically, when a video stream command is detected, the obtaining module 10 is connected to a transmission channel of the video stream command, and directly obtains video data in the video stream command through the transmission channel. The video stream refers to a transmission mode of video data. The essence of video is a continuous image set capable of smoothing transition, so the transmission principle of video stream is mainly to transmit the video image being recorded or shot to the mobile terminal in the form of a tiny video segment data packet (a set of continuous single-frame images within a preset time length), and since the mobile terminal has to decode the video data packet again for playing, the mobile terminal acquiring the video stream can realize fast playing of the acquired video data after a very short delay (for example, 1 second or 2 seconds) without waiting for the transmitting terminal to record the complete set of video and then receive the video data completely. The video streaming mode can provide video recording resources to the mobile terminal in near real time. Such scenes often appear in real life like live programs, video calls, etc.
After acquiring the video data, the first determining module 20 needs to determine whether there is video data being played on the display screen, and when there is video data being played on the display screen, the second determining module 30 determines whether the mobile terminal receives a split-screen display instruction. The function is to determine a display area of received video data, if no video data being played exists on a current display screen, the video data is directly played in a preset playing area in a current display interface, and if the video data being played exists on the current display screen, the received video data cannot occupy the display area of the video being played originally, and the next step of judgment must be carried out to judge whether a split-screen display instruction exists.
When the split-screen display instruction is detected, the display module 40 displays a preset split-screen interface in a preset area of the display screen. The split screen interface means that the mobile terminal displays a predefined display interface in an area on a display screen. Referring to fig. 3(a), the display area of the display interface exists independently from the original display interface, and the display effect is presented by the existence of a plurality of mutually independent display interfaces on the display screen. For example, the original display interface and the split screen interface can be operated and controlled through control instructions which are not mutually influenced; or referring to fig. 3(b), the display area of the split-screen interface may be above the original display interface, that is, displayed at any position on the original display interface, and the display content of the original display interface is covered in the display area. The scene of the function is that a video which is playing exists on a display screen, and at the moment, a user cannot watch a new video which is required to be opened, and then a display interface is opened again. The precondition of opening a new display interface is that a split-screen display instruction is received, and the split-screen display instruction can be generated intelligently by the mobile terminal according to the current display condition or can be a display instruction triggered by the touch operation of the user on the mobile terminal.
Finally, when a video playing instruction is detected, the playing module 50 plays the video data acquired from the video streaming instruction on the split-screen interface. The final display effect of the function is that when a user triggers a video playing instruction through operation, the final purpose of playing video data can be achieved by triggering the video playing instruction. At this time, the user may observe a direct experience that a plurality of videos are played simultaneously on the display screen in a split-screen manner, including the previously detected video being played and the video data being played on the split-screen interface. It should be noted that the triggering of the video playing command is not unique, and the triggering manner has diversified characteristics, including but not limited to the following manners:
1. a user clicks a play button on a split screen interface;
2. clicking or sliding operation is carried out on any position of the split screen interface by a user;
3. the voice recognition function of the mobile terminal is used for controlling the mobile terminal through voice.
The above triggering methods are only examples, and the operation control method capable of triggering the video playing command is within the scope of the present invention.
According to the invention, when a video stream instruction is detected by an acquisition module 10, video data in the video stream instruction is acquired; then the first judging module 20 judges whether video data being played exists on the display screen; when video data which is being played exists on the display screen, the second judging module 30 judges whether the mobile terminal receives a split-screen display instruction; when a split-screen display instruction is detected, the display module 40 displays a preset split-screen interface in a preset area of the display screen; finally, when a video playing instruction is detected, the playing module 50 plays the video data acquired from the video streaming instruction on the split-screen interface, so that the technical problem that the display screen can only display one playing interface is avoided in the process that the user uses the mobile terminal to watch videos, the problem that the user cannot use the mobile terminal to watch the scenes of multiple videos is solved, the diversified function needs of the user are met, the display function and the technical effect of the mobile terminal are enriched on the premise that the use experience of the user is not influenced, and the use experience of the user is greatly improved.
Further, on the basis of the first embodiment of the mobile terminal of the present invention, a second embodiment of the mobile terminal is proposed, and referring to fig. 8, the difference between the second embodiment and the first embodiment is that the display module 40 includes:
the detection unit 41 is configured to, when a split-screen display instruction is detected, reduce a display scale of a current display interface on a display screen;
and the screen splitting unit 42 is used for displaying the screen splitting interface in an area outside the current display interface.
In this embodiment, the detection unit 41 may assist in implementing display of the split screen interface, the current display interface occupies the entire display interface on the display screen, and the detection unit 41 reduces the display scale of the current display interface to release other dropped blank areas to become the display area of the split screen interface; the split screen unit 42 may utilize the detection unit 41 to reduce the blank area released after the original display scale of the display interface, and display the split screen interface in various display forms, such as an up-down distribution display (a), a left-right distribution display (b), and so on, with reference to fig. 4.
Further, on the basis of the second embodiment of the mobile terminal of the present invention, a third embodiment of the mobile terminal is proposed, and referring to fig. 9, the difference between the third embodiment and the second embodiment is that the mobile terminal further includes:
and the adjusting module 60 is configured to, when an adjusting instruction triggered by an external operation is received, adjust the display scale and/or the display position of the split screen interface in real time according to the adjusting instruction.
In this embodiment, the display effect of the split-screen display interface in the display area does not necessarily meet the expectation of the user, or the user finds that the display effect is not ideal enough and needs to adjust. Because the function is adjusted based on the user definition, the adjustment effect can be realized only by receiving the adjustment instruction triggered by the user. The adjustment mode can be adjusting the display scale and/or the display position of the split screen interface. For example, a user may perform a sliding operation on a display frame of the split screen interface to zoom in or out a display area of the split screen interface, or may press and hold the display area of the split screen interface for a period of time (1 second or 2 seconds, etc.), that is, may move the split screen interface to an arbitrary position on the display screen as a new display area and display the new display area.
Further, on the basis of the third embodiment of the mobile terminal of the present invention, a fourth embodiment of the mobile terminal is proposed, and referring to fig. 10, the difference between the fourth embodiment and the third embodiment is that the mobile terminal further includes:
the loading module 70 is configured to load the video data acquired from the video stream instruction onto the split-screen interface, and use a first frame image played by the video data as a preview interface of the split-screen interface.
Referring to fig. 5, after the split-screen interface is displayed, in order to make the user clearly identify the video to be played, the loading module 70 loads the acquired video data onto the split-screen interface. The user can more conveniently clarify the playing state of the video. Meanwhile, the first frame image in the received video data packet is used as a preview interface of the split screen interface. The preview interface is a display interface before the user watches the video, and through the preview interface, the user can have an initial impression on the video content and can also help the user to determine whether the video is a video which the user wants to select to play.
Further, on the basis of the fourth embodiment of the mobile terminal of the present invention, a fifth embodiment of the mobile terminal is proposed, and referring to fig. 11, the difference between the fifth embodiment and the fourth embodiment is that the mobile terminal further includes:
and the releasing module 80 is configured to release the split screen interface resource when it is detected that video playing of the split screen interface is finished.
In the process of watching the video by the user, once the video playing in the split-screen interface is finished, it means that the transmission channel does not have the corresponding video data, and the video data cannot be continuously received in a video streaming manner, so that the corresponding split-screen interface also loses the function of playing the corresponding video data. In order to ensure the smoothness of normal operation of the mobile terminal, resources occupied by the split screen interface should be released for the mobile terminal to redistribute. Referring to fig. 6, in this scenario, when it is detected that video playing of the split screen interface is finished, the release module 80 releases the memory resource occupied by the split screen interface, so as to ensure that the mobile terminal can normally operate and ensure smoothness of operation.
The present invention also provides a split-screen display control method, which is mainly applied to a mobile terminal, and in a first embodiment of the split-screen display control method, referring to fig. 12, the split-screen display control method includes:
step S10, when a video stream command is detected, video data in the video stream command is acquired;
step S20, judging whether the video data being played exists on the display screen;
step S30, when video data being played exists on the display screen, judging whether the mobile terminal receives a split screen display instruction;
step S40, when a split-screen display instruction is detected, displaying a preset split-screen interface in a preset area of a display screen;
step S50, when a video playing instruction is detected, playing the video data acquired from the video streaming instruction on the split-screen interface.
The mobile terminal can be a smart phone, an IPAD and other devices, the display area of the mobile terminal is generally a touch screen, the mobile terminal can detect the operation of a user on the touch screen of the mobile terminal through the touch sensing function on the touch screen and convert the operation into an operation instruction corresponding to the operation, and the touch operation of the user plays a key role in the final realized technical effect of the embodiment.
The display effect of the mobile terminal is generally that the whole used screen is used as a display unit, that is, one display interface is covered with the whole display screen, which causes that a user can only watch one display interface each time, and once the user wants to watch other display interfaces, the current display interface must be manually closed or switched to another display interface to watch a new display interface.
The conventional video transmission technology generally packs video data into a large data packet, which has a very large memory capacity and is inconvenient to retrieve and use. In the process of transmitting the video data, if the mobile terminal cannot completely receive the video data packet, the data packet is considered to be incomplete and damaged, and cannot be analyzed, so that the corresponding video object cannot be called from the memory, the video cannot be played, and the video cannot be played while being received in the process of transmitting the video data. While video streaming technology can solve this problem well.
Specifically, when a video stream command is detected, a transmission channel of the video stream command is connected, and video data in the video stream command is directly acquired through the transmission channel. The video stream refers to a transmission mode of video data. The essence of video is a continuous image set capable of smoothing transition, so the transmission principle of video stream is mainly to transmit the video image being recorded or shot to the mobile terminal in the form of a tiny video segment data packet (a set of continuous single-frame images within a preset time length), and since the mobile terminal has to decode the video data packet again for playing, the mobile terminal acquiring the video stream can realize fast playing of the acquired video data after a very short delay (for example, 1 second or 2 seconds) without waiting for the transmitting terminal to record the complete set of video and then receive the video data completely. The video streaming mode can provide video recording resources to the mobile terminal in near real time. Such scenes often appear in real life like live programs, video calls, etc.
After the video data are acquired, whether the video data which are being played exist on the display screen or not is judged, and when the video data which are being played exist on the display screen, whether a split-screen display instruction is received by the mobile terminal or not is judged. The function is to determine a display area of received video data, if no video data being played exists on a current display screen, the video data is directly played in a preset playing area in a current display interface, and if the video data being played exists on the current display screen, the received video data cannot occupy the display area of the video being played originally, and the next step of judgment must be carried out to judge whether a split-screen display instruction exists.
And when a split-screen display instruction is detected, displaying a preset split-screen interface in a preset area of the display screen. The split screen interface means that the mobile terminal displays a predefined display interface in an area on a display screen. Referring to fig. 3(a), the display area of the display interface exists independently from the original display interface, and the display effect is presented by the existence of a plurality of mutually independent display interfaces on the display screen. For example, the original display interface and the split screen interface can be operated and controlled through control instructions which are not mutually influenced; or referring to fig. 3(b), the display area of the display interface may be above the original display interface, that is, displayed at any position on the original display interface, and the display content of the original display interface is covered in the display area. The scene of the function is that a video which is playing exists on a display screen, and at the moment, a user cannot watch a new video which is required to be opened, and then a display interface is opened again. The precondition of opening a new display interface is that a split-screen display instruction is received, and the split-screen display instruction can be generated intelligently by the mobile terminal according to the current display condition or can be a display instruction triggered by the touch operation of the user on the mobile terminal.
Finally, when a video playing instruction is detected, the playing module 50 plays the video data acquired from the video streaming instruction on the split-screen interface. The final display effect of the function is that when a user triggers a video playing instruction through operation, the final purpose of playing video data can be achieved by triggering the video playing instruction. At this time, the user may observe a direct experience that a plurality of videos are played simultaneously on the display screen in a split-screen manner, including the previously detected video being played and the video data being played on the split-screen interface. It should be noted that the triggering of the video playing command is not unique, and the triggering manner has diversified characteristics, including but not limited to the following manners:
1. a user clicks a play button on a split screen interface;
2. clicking or sliding operation is carried out on any position of the split screen interface by a user;
3. the voice recognition function of the mobile terminal is used for controlling the mobile terminal through voice.
The above triggering methods are only examples, and the operation control method capable of triggering the video playing command is within the scope of the present invention.
The method comprises the steps of acquiring video data in a video stream instruction when the video stream instruction is detected; then judging whether video data which is being played exists on the display screen; when video data which are being played exist on a display screen, judging whether the mobile terminal receives a split screen display instruction; when a split-screen display instruction is detected, displaying a preset split-screen interface in a preset area of the display screen; finally, when a video playing instruction is detected, video data acquired from the video streaming instruction is played on a split screen interface, so that the technical problem that a display screen can only display one playing interface is avoided in the process that a user uses the mobile terminal to watch videos, the problem that the user cannot use the mobile terminal to watch scenes of multiple videos is solved, diversified functional requirements of the user are met, the display function and the technical effect of the mobile terminal are enriched on the premise that the user use experience is not influenced, and the use experience of the user is greatly improved.
Further, on the basis of the first embodiment of the method of the present invention, a second embodiment of the method is proposed, and referring to fig. 13, the difference between the second embodiment and the first embodiment is that the step of displaying a preset split-screen interface in a preset area of the display screen when the split-screen display instruction is detected includes:
step S41, when a split-screen display instruction is detected, the display scale of the current display interface on the display screen is reduced;
and step S42, displaying the split screen interface in an area outside the current display interface.
The function of the embodiment can assist in realizing the display of the split screen interface, the current display interface occupies the whole display interface on the display screen, and other blank areas released by reducing the display scale of the current display interface can become the display area of the split screen interface; the blank area released after the display scale of the original display interface is reduced is utilized to display the split screen interface in a plurality of display forms, referring to fig. 4, such as up-down distribution display (a), left-right distribution display (b), and the like.
Further, on the basis of the second embodiment of the method of the present invention, a third embodiment of the method is proposed, and referring to fig. 14, the difference between the third embodiment and the second embodiment is that, when the step of displaying the preset split-screen interface in the preset area of the display screen when the split-screen display instruction is detected, the method further includes:
and step S60, when an adjusting instruction triggered by external operation is received, adjusting the display scale and/or the display position of the split screen interface in real time according to the adjusting instruction.
In this embodiment, the display effect of the split-screen display interface in the display area does not necessarily meet the expectation of the user, or the user finds that the display effect is not ideal enough and needs to adjust. Because the function is adjusted based on the user definition, the adjustment effect can be realized only by receiving the adjustment instruction triggered by the user. The adjustment mode can be adjusting the display scale and/or the display position of the split screen interface. For example, a user may perform a sliding operation on a display frame of the split screen interface to zoom in or out a display area of the split screen interface, or may press and hold the display area of the split screen interface for a period of time (1 second or 2 seconds, etc.), that is, may move the split screen interface to an arbitrary position on the display screen as a new display area and display the new display area.
Further, on the basis of the third embodiment of the method of the present invention, a fourth embodiment of a split-screen display control method is proposed, and referring to fig. 15, a difference between the fourth embodiment and the third embodiment is that, when a video playing instruction is detected, before the step of playing, on the split-screen interface, the video data acquired from the video streaming instruction, the method further includes:
and step S70, loading the video data acquired from the video stream instruction to the split-screen interface, and taking the first frame image played by the video data as a preview interface of the split-screen interface.
Referring to fig. 5, after the split screen interface is displayed, in order to make it convenient for the user to specify the video to be played, the acquired video data is loaded onto the split screen interface. The user can more conveniently clarify the playing state of the video. Meanwhile, the first frame image in the received video data packet is used as a preview interface of the split screen interface. The preview interface is a display interface before the user watches the video, and through the preview interface, the user can have an initial impression on the video content and can also help the user to determine whether the video is a video which the user wants to select to play.
Further, on the basis of the fourth embodiment of the method of the present invention, a fifth embodiment of a split-screen display control method is proposed, and referring to fig. 16, the difference between the fifth embodiment and the fourth embodiment is that, when a video playing instruction is detected, after the step of playing the video data acquired from the video streaming instruction on the split-screen interface, the method further includes:
and step S80, when the video playing of the split screen interface is detected to be finished, releasing the split screen interface resources.
In the process of watching the video by the user, once the video playing in the split-screen interface is finished, it means that the transmission channel does not have the corresponding video data, and the video data cannot be continuously received in a video streaming manner, so that the corresponding split-screen interface also loses the function of playing the corresponding video data. In order to ensure the smoothness of normal operation of the mobile terminal, resources occupied by the split screen interface should be released for the mobile terminal to redistribute. Referring to fig. 6, the scene is that when it is detected that video playing of the split screen interface is finished, the memory resource occupied by the split screen interface is released, so that normal operation of the mobile terminal is ensured, and smoothness of operation is ensured.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (8)
1. A mobile terminal, characterized in that the mobile terminal comprises:
the acquisition module is used for acquiring video data in a video stream instruction when the video stream instruction is detected;
the first judgment module is used for judging whether video data which are being played exist on the display screen or not;
the second judgment module is used for judging whether the mobile terminal receives a split-screen display instruction or not when video data which is being played exists on the display screen;
the display module is used for displaying a preset split screen interface in a preset area of a display screen when a split screen display instruction is detected, wherein the split screen interface is a display interface which is defined in advance and is displayed and preset in an area of the display screen by the mobile terminal;
the playing module is used for playing video data acquired from the video streaming instruction on a split-screen interface when the video playing instruction is detected;
wherein the mobile terminal further comprises:
and the release module is used for releasing the resources of the split screen interface when the video playing of the split screen interface is detected to be finished.
2. The mobile terminal of claim 1, wherein the display module comprises:
the detection unit is used for reducing the display scale of the current display interface on the display screen when the split-screen display instruction is detected;
and the split screen unit is used for displaying the split screen interface in an area outside the current display interface.
3. The mobile terminal of claim 2, wherein the mobile terminal further comprises:
and the adjusting module is used for adjusting the display scale and/or the display position of the split screen interface in real time according to an adjusting instruction triggered by external operation when the adjusting instruction is received.
4. The mobile terminal of claim 3, wherein the mobile terminal further comprises:
and the loading module is used for loading the video data acquired from the video stream instruction to the split-screen interface and taking the first frame image played by the video data as a preview interface of the split-screen interface.
5. A split-screen display control method is characterized by comprising the following steps:
when a video streaming instruction is detected, video data in the video streaming instruction is acquired;
judging whether video data which are being played exist on a display screen or not;
when video data which are being played exist on a display screen, judging whether the mobile terminal receives a split screen display instruction;
when a split-screen display instruction is detected, displaying a preset split-screen interface in a preset area of a display screen, wherein the split-screen interface is a display interface which is defined in advance and is displayed and preset in an area of the display screen by a mobile terminal;
when a video playing instruction is detected, playing video data acquired from the video streaming instruction on a split-screen interface;
when a video playing instruction is detected, after the step of playing the video data acquired from the video streaming instruction on the split-screen interface, the method further comprises the following steps:
and when the video playing of the split screen interface is detected to be finished, releasing the split screen interface resources.
6. The split-screen display control method of claim 5, wherein the step of displaying a preset split-screen interface in a preset area of the display screen when the split-screen display instruction is detected comprises:
when a split-screen display instruction is detected, reducing the display scale of the current display interface on the display screen;
and displaying the split screen interface in an area outside the current display interface.
7. The split-screen display control method of claim 6, wherein the step of displaying a preset split-screen interface in a preset area of the display screen when the split-screen display instruction is detected further comprises:
and when an adjusting instruction triggered by external operation is received, adjusting the display scale and/or the display position of the split screen interface in real time according to the adjusting instruction.
8. The split-screen display control method according to claim 7, wherein when the video playing instruction is detected, before the step of playing the video data acquired from the video streaming instruction on the split-screen interface, the method further comprises:
and loading the video data acquired from the video stream instruction to a split-screen interface, and taking a first frame image played by the video data as a preview interface of the split-screen interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610942763.7A CN106507173B (en) | 2016-10-31 | 2016-10-31 | Mobile terminal and split-screen display control method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610942763.7A CN106507173B (en) | 2016-10-31 | 2016-10-31 | Mobile terminal and split-screen display control method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106507173A CN106507173A (en) | 2017-03-15 |
| CN106507173B true CN106507173B (en) | 2020-02-18 |
Family
ID=58320970
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610942763.7A Active CN106507173B (en) | 2016-10-31 | 2016-10-31 | Mobile terminal and split-screen display control method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106507173B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106028124B (en) * | 2016-07-04 | 2019-10-15 | 北京金山安全软件有限公司 | Video playing method and device and electronic equipment |
| CN107087137B (en) * | 2017-06-01 | 2021-08-06 | 腾讯科技（深圳）有限公司 | Method and device for presenting video and terminal equipment |
| CN107577414A (en) * | 2017-09-07 | 2018-01-12 | 广东欧珀移动通信有限公司 | The method and mobile terminal of split screen display available |
| CN107393362A (en) * | 2017-09-21 | 2017-11-24 | 淄博职业学院 | A kind of computer application teaching and training system |
| CN107613341B (en) * | 2017-09-29 | 2020-10-27 | 惠州Tcl移动通信有限公司 | Method for playing different videos on multiple display interfaces, storage medium and mobile terminal |
| CN107920270A (en) * | 2017-10-27 | 2018-04-17 | 努比亚技术有限公司 | Video separated screen control method for playing back, terminal and computer-readable recording medium |
| CN110166843A (en) * | 2019-04-08 | 2019-08-23 | 浙江大华技术股份有限公司 | Video broadcasting method, equipment and storage device |
| CN110109604B (en) * | 2019-04-29 | 2021-03-12 | 维沃移动通信有限公司 | Application interface display method and mobile terminal |
| CN110286842A (en) * | 2019-06-28 | 2019-09-27 | Oppo广东移动通信有限公司 | The control method of a kind of electronic equipment and split screen display available |
| CN113473158B (en) * | 2021-06-30 | 2024-01-30 | 北京百度网讯科技有限公司 | Live broadcast data processing method, device, electronic equipment and medium |
| CN113891103A (en) * | 2021-08-24 | 2022-01-04 | 广州方硅信息技术有限公司 | Live broadcast display method and device, storage medium and computer equipment |
| CN114911407B (en) * | 2022-06-20 | 2024-11-08 | 上海联影医疗科技股份有限公司 | Image playing control device of medical diagnosis and treatment system |
| WO2024139950A1 (en) * | 2022-12-30 | 2024-07-04 | 海信视像科技股份有限公司 | Display device and processing method for display device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103813206A (en) * | 2014-02-25 | 2014-05-21 | 深圳创维－Rgb电子有限公司 | Multi-screen interactive information processing method and device |
| CN106028124A (en) * | 2016-07-04 | 2016-10-12 | 北京金山安全软件有限公司 | Video playing method and device and electronic equipment |
-
2016
- 2016-10-31 CN CN201610942763.7A patent/CN106507173B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103813206A (en) * | 2014-02-25 | 2014-05-21 | 深圳创维－Rgb电子有限公司 | Multi-screen interactive information processing method and device |
| CN106028124A (en) * | 2016-07-04 | 2016-10-12 | 北京金山安全软件有限公司 | Video playing method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106507173A (en) | 2017-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106507173B (en) | Mobile terminal and split-screen display control method | |
| CN106210328B (en) | Information display device and method | |
| CN106775391B (en) | Interface switching device and method | |
| CN106909274B (en) | Image display method and device | |
| US20130088614A1 (en) | Mobile terminal and method for generating an out-of-focus image | |
| CN106445352B (en) | Edge touch device and method of mobile terminal | |
| CN106911850B (en) | Mobile terminal and screen capturing method thereof | |
| CN107071263B (en) | Image processing method and terminal | |
| CN105260083A (en) | Mobile terminal and method for realizing split screens | |
| CN106488282B (en) | Multimedia information output control method and mobile terminal | |
| CN105554386A (en) | Mobile terminal and camera shooting control method thereof | |
| CN106028090A (en) | Mobile terminal and video recording method thereof | |
| CN106385573A (en) | Picture processing method and terminal | |
| CN106817614B (en) | Audio and video frame loss device and method | |
| CN105722246B (en) | Network speed superposition device and method | |
| CN105791541B (en) | Screenshot method and mobile terminal | |
| CN105227771B (en) | Picture transmission method and device | |
| CN105049916B (en) | A kind of video recording method and device | |
| CN106550190A (en) | A kind of camera control method and device | |
| CN106791449B (en) | Photo shooting method and device | |
| CN106385502B (en) | Photo arrangement method and mobile terminal | |
| CN109168029A (en) | It is a kind of adjust resolution ratio method, equipment and computer can storage medium | |
| CN105744061B (en) | Eye print recognition interaction device and method | |
| CN109275038B (en) | Game live broadcast method, terminal and computer readable storage medium | |
| CN106375842A (en) | Image sharing device and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200109 Address after: 200333 room 227, No.41, Jinrun Road, Putuo District, Shanghai Applicant after: Shanghai every moment Cultural Communication Co., Ltd Address before: 518057 Guangdong Province, Shenzhen high tech Zone of Nanshan District City, No. 9018 North Central Avenue's innovation building A, 6-8 layer, 10-11 layer, B layer, C District 6-10 District 6 floor Applicant before: Nubian Technologies Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |