[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN106028060A - Picture check device, system and method - Google Patents

Picture check device, system and method Download PDF

Info

Publication number
CN106028060A
CN106028060A CN201610355141.4A CN201610355141A CN106028060A CN 106028060 A CN106028060 A CN 106028060A CN 201610355141 A CN201610355141 A CN 201610355141A CN 106028060 A CN106028060 A CN 106028060A
Authority
CN
China
Prior art keywords
picture
video
terminal
burst
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610355141.4A
Other languages
Chinese (zh)
Inventor
孙垚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to CN201610355141.4A priority Critical patent/CN106028060A/en
Publication of CN106028060A publication Critical patent/CN106028060A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a picture check device. The device comprises a check request module which is used for sending a check instruction for checking appointed picture or videos to an appointed server; a fragment display module which is used for receiving each piece of fragment data of the pictures or videos returned by the server in sequence and displaying the picture contents corresponding to each piece of fragment data in sequence; and a check stop module which is used for sending a stop instruction for stopping downloading the pictures or the videos to the server when a slide operation is detected and the display contents of the pictures or the videos are not displayed in a display screen due to the slide operation before the pictures or the videos are displayed completely. The invention also discloses a picture check system and method. According to the device, the method and the system, when the network pictures or videos are checked at a terminal, the picture fragments are displayed, and the use experience of the user is improved.

Description

Picture checks device, system and method
Technical field
The present invention relates to communication technical field, particularly relate to a kind of picture and check device, system and method.
Background technology
When user wants to check network picture or video in terminal, generally require picture request checked or video delays After depositing or downloading to terminal, picture that request could be checked by terminal or video display are to user.But, user's request sometimes is looked into The picture seen or video are not user's picture of wanting to check or video, and at this time user also can only wait the picture that request is checked Or after video is shown completely in terminal, just can find oneself in fact this picture or video to be lost interest in, user is come Saying, not only consuming substantial amounts of data traffic, and the time waited is the longest, the experience of user is poor.
Summary of the invention
Present invention is primarily targeted at a kind of picture of proposition and check device, system and method, it is intended to check network picture Or during video, realize the burst displaying of picture.
For achieving the above object, the present invention provides a kind of picture to check that device, described picture check that device includes:
Module is checked in request, for send to the server specified check the picture specified or video check instruction;
Burst display module, for receiving described picture or each burst number of video that described server returns successively According to, and show the picture material that each fragment data is corresponding successively;
Stop checking module, for before described picture or video are shown completely, when slide and described being detected When the displaying content of picture or video shows the most on a display screen because of described slide, send to described server under stopping Carry the halt instruction of described picture or video.
Optionally, described burst display module includes:
Receive unit, for receiving described picture or the fragment data of video that described server currently returns;
Drawing unit, for sitting according to the slice images data in the fragment data being currently received and slice images region Mark, draws, in the region that corresponding coordinate point is constituted on described display screen, the picture material that described slice images data are corresponding.
Optionally, described picture checks that device also includes that transmission module, described upper transmission module include:
Split cells, is split as multiple points for picture or video user selected according to the first preset burst mechanism Sheet packet;
Uploading unit, uploads to described service for the multiple packet segments using the mode of multitask fractionation to be obtained Device.
For achieving the above object, the present invention also provides for a kind of picture and checks that system, the described picture system of checking include first Terminal, the second terminal, server, described first terminal and described second terminal include that device checked by any of the above-described picture, described Server includes:
Pretreatment module, for after receiving the picture or video that described first terminal uploads, according to described picture or Original resolution and preset multiple main flow resolution of video carry out pretreatment to described picture or video, main to obtain each Pretreatment picture that flow point resolution is corresponding or video also store;
Determine module, for receive described second terminal send when checking instruction, check in instruction according to described Picture or the mark of video, described second terminal resolution, determine and the to be viewed pre-place of described second terminal resolution match Reason picture or video;
Burst module, for carrying out described pretreatment picture to be viewed or video point according to the second preset burst mechanism Sheet generates fragment data, and according to the severity level determined, fragment data is returned to described second terminal successively.
Optionally, described burst module includes:
Acquiring unit, for obtaining described pretreatment picture to be viewed or the picture/mb-type of video;
Determine unit, the picture/mb-type got for basis and preset picture/mb-type and divisional type mapping relations, Determine the severity level of divisional type and divisional type;
Sharding unit, is used for utilizing face recognition technology, to each figure in described pretreatment picture to be viewed or video Sheet, carries out region burst successively according to the severity level order from high to low of described divisional type;
Dispatching Unit, every for being made up of slice images area coordinate and slice images data that region burst is obtained The fragment data of individual burst, returns to described second terminal successively.
Additionally, for achieving the above object, the present invention also provides for a kind of picture inspection method, described picture inspection method bag Include:
Send to the server specified check the picture specified or video check instruction;
Receive described picture or each fragment data of video that described server returns successively, and show each point successively The picture material that sheet data are corresponding;
Before described picture or video are shown completely, when in displaying slide and described picture or video being detected Slide described in Rong Yin and when showing the most on a display screen, send to described server and stop downloading described picture or video Halt instruction.
Optionally, the described described picture receiving the return of described server successively or each fragment data of video, and depend on The picture material that each fragment data of secondary displaying is corresponding includes:
Receive described picture or the fragment data of video that described server currently returns;
According to the slice images data in the fragment data being currently received and slice images area coordinate, in described display The picture material that described slice images data are corresponding is drawn in the region that on screen, corresponding coordinate point is constituted.
Optionally, described picture inspection method also includes:
Picture or the video user selected are split as multiple packet segment according to the first preset burst mechanism;
The multiple packet segments using the mode of multitask fractionation to be obtained upload to described server.
For achieving the above object, the present invention also provides for a kind of picture inspection method, and described picture inspection method includes:
Server is after receiving the picture or video that first terminal uploads, according to described picture or original resolution of video Rate and preset multiple main flow resolution carry out pretreatment to described picture or video, corresponding to obtain each main flow resolution Pretreatment picture or video also store;
Receive that the second terminal sends when checking instruction, according to described check in instruction picture or the mark of video, Described second terminal resolution, determines the pretreatment picture to be viewed with described second terminal resolution match or video;
Described pretreatment picture to be viewed or video are carried out burst according to the second preset burst mechanism and generates burst number According to, and fragment data is returned to described second terminal successively according to the severity level determined.
Optionally, described described pretreatment picture to be viewed or video are carried out burst according to the second preset burst mechanism Generate fragment data, and fragment data is returned to described second terminal successively according to the severity level determined include:
Obtain described pretreatment picture to be viewed or the picture/mb-type of video;
According to the picture/mb-type got and preset picture/mb-type and divisional type mapping relations, determine divisional type and The severity level of divisional type;
Utilize face recognition technology, to each picture in described pretreatment picture to be viewed or video, according to described point The severity level of district's type order from high to low carries out region burst successively;
The burst of each burst being made up of slice images area coordinate and slice images data that region burst is obtained Data, return to described second terminal successively.
The picture that the present invention proposes checks device, system and method, after receiving the fragment data that server returns successively, and phase Should show that it asks picture or the picture of video checked by ground burst successively, and ask the picture checked or video to be shown completely Before, when user slide display screen cause the displaying content of the picture asking to check or video to show the most on a display screen time, to Server sends and stops picture or the halt instruction of video that the request of downloading is checked, thus is not desired to continue to check that request is looked into user When the picture seen or video, both saved picture or the flow remaining fragment data of video that user's request of downloading is checked, and The mode that burst is shown substantially reduces user and checks picture or video time to be waited, improve user check picture or The experience of video.
Accompanying drawing explanation
Fig. 1 is the hardware architecture diagram realizing each one mobile terminal of embodiment of the present invention;
Fig. 2 is the radio communication device schematic diagram of mobile terminal as shown in Figure 1;
Fig. 3 is the module diagram that device first embodiment checked by picture of the present invention;
Fig. 4 is the module diagram of burst display module in Fig. 3;
Fig. 5 is that the module diagram of upper transmission module in device the second embodiment checked by picture of the present invention;
Fig. 6 is that the module diagram of server in system one embodiment checked by picture of the present invention;
Fig. 7 is the module diagram of burst module in Fig. 6;
Fig. 8 is terminal and the sequential chart of server interaction in picture inspection method first embodiment of the present invention;
Fig. 9 is the schematic flow sheet of the 5th step in picture inspection method first embodiment of the present invention;
Figure 10 is the schematic flow sheet of the 6th step in picture inspection method first embodiment of the present invention;
Application scenarios schematic diagram when Figure 11 is that in the present invention, burst is shown;
Figure 12 is the schematic flow sheet of the first step in picture inspection method the second embodiment of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further referring to the drawings.
Detailed description of the invention
Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing.In follow-up description, use For representing the suffix explanation only for the beneficially present invention of such as " module ", " parts " or " unit " of element, itself Not specific meaning.Therefore, " module " can mixedly use with " parts ".
Mobile terminal can be implemented in a variety of manners.Such as, the terminal described in the present invention can include such as moving Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP The mobile terminal of (portable media player), guider etc. and consolidating of such as numeral TV, desk computer etc. Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, mobile except being used in particular for Outside the element of purpose, structure according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 is the hardware architecture diagram realizing each one mobile terminal of embodiment of the present invention.
Mobile terminal 100 can include wireless communication unit 110, A/V (audio/video) input block 120, user's input Unit 130, sensing unit 140, output unit 150, memorizer 160, interface unit 170, controller 180 and power subsystem 190 Etc..Fig. 1 shows the mobile terminal with various assembly, it should be understood that be not required for implementing all groups illustrated Part.Can alternatively implement more or less of assembly.Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assembly, and it allows mobile terminal 100 and radio communication device Or the radio communication between network.Such as, wireless communication unit can include broadcast reception module 111, mobile communication module 112, at least one in wireless Internet module 113, short range communication module 114 and positional information module 115.
Broadcast reception module 111 receives broadcast singal and/or broadcast via broadcast channel from external broadcasting management server Relevant information.Broadcast channel can include satellite channel and/or terrestrial channel.Broadcast management server can be to generate and send Broadcast singal and/or the server of broadcast related information or the broadcast singal generated before receiving and/or broadcast related information And send it to the server of terminal.Broadcast singal can include that TV broadcast singal, radio signals, data are broadcasted Signal etc..And, broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast phase Pass information can also provide via mobile communications network, and in this case, broadcast related information can be by mobile communication mould Block 112 receives.Broadcast singal can exist in a variety of manners, and such as, it can be with the electronics of DMB (DMB) Program guide (EPG), the form of electronic service guidebooks (ESG) etc. of digital video broadcast-handheld (DVB-H) and exist.Broadcast Receiver module 111 can be broadcasted by using various types of broadcasters to receive signal.Especially, broadcast reception module 111 Can be by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video wide Broadcast-hand-held (DVB-H), the data broadcaster of forward link media (MediaFLO@), received terrestrial digital broadcasting integrated service Etc. (ISDB-T) digital broadcast apparatus receives digital broadcasting.Broadcast reception module 111 may be constructed such that and is adapted to provide for extensively Broadcast the various broadcasters of signal and above-mentioned digital broadcast apparatus.Via broadcast reception module 111 receive broadcast singal and/ Or broadcast related information can be stored in memorizer 160 (or other type of storage medium).
Mobile communication module 112 sends radio signals to base station (such as, access point, node B etc.), exterior terminal And in server at least one and/or receive from it radio signal.Such radio signal can include that voice leads to Words signal, video calling signal or the various types of data sending according to text and/or Multimedia Message and/or receiving.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.This module can be internally or externally It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by this module can include WLAN (WLAN) (Wi-Fi), Wibro (WiMAX), Wimax (worldwide interoperability for microwave access), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting junction service.Some examples of short-range communication technology include indigo plant Tooth TM, RF identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybee TM etc..
Positional information module 115 is the module of positional information for checking or obtain mobile terminal.Positional information module Typical case be GPS (global pick device).According to current technology, positional information module 115 calculates from three or more The range information of many satellites and correct time information and for the Information application triangulation calculated, thus according to warp Degree, latitude and highly accurately calculating three-dimensional current location information.Currently, for calculating the method use of position and temporal information Three satellites and by using the position and the error of temporal information that other satellite correction calculates.Additionally, position Information module 115 can calculate velocity information by Continuous plus current location information in real time.
A/V input block 120 is used for receiving audio or video signal.A/V input block 120 can include camera 121 He Mike 122, the camera 121 static images to being obtained by image capture apparatus in Video Capture pattern or image capture mode Or the view data of video processes.Picture frame after process may be displayed on display unit 151.Process through camera 121 After picture frame can be stored in memorizer 160 (or other storage medium) or via wireless communication unit 110 carry out send out Send, two or more cameras 121 can be provided according to the structure of mobile terminal.Mike 122 can be in telephone calling model, note Record pattern, speech recognition mode etc. operational mode receives sound (voice data) via mike, and can be by so Acoustic processing be voice data.Audio frequency (voice) data after process can be converted in the case of telephone calling model can The form output of mobile communication base station it is sent to via mobile communication module 112.Mike 122 can implement various types of making an uproar Sound eliminates (or suppression) algorithm and with the noise of elimination (or suppression) generation during receiving and send audio signal or does Disturb.
User input unit 130 can generate key input data to control each of mobile terminal according to the order of user's input Plant operation.User input unit 130 allows user to input various types of information, and can include keyboard, metal dome, touch Plate (such as, detection due to touched and cause resistance, pressure, the sensitive component of change of electric capacity etc.), roller, rocking bar etc. Deng.Especially, when touch pad is superimposed upon on display unit 151 as a layer, touch screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 100, (such as, mobile terminal 100 open or close shape State), the position of mobile terminal 100, user is for the presence or absence of contact (that is, touch input) of mobile terminal 100, mobile terminal Orientation, the acceleration of mobile terminal 100 of 100 or speed is moved and direction etc., and generate for controlling mobile terminal 100 The order of operation or signal.Such as, when mobile terminal 100 is embodied as sliding-type mobile phone, sensing unit 140 can sense This sliding-type phone opens or cuts out.It addition, sensing unit 140 can detect power subsystem 190 whether provide electric power or Whether person's interface unit 170 couples with external device (ED).
Interface unit 170 is used as at least one external device (ED) and is connected, with mobile terminal 100, the interface that can pass through.Such as, External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing Line FPDP, memory card port, for connect have the port of device of identification module, audio frequency input/output (I/O) end Mouth, video i/o port, ear port etc..Identification module can be that storage is for verifying that user uses each of mobile terminal 100 Kind of information and subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) can be included Etc..It addition, the device (hereinafter referred to as " identification device ") with identification module can be to take the form of smart card, therefore, know Other device can be connected with mobile terminal 100 via port or other attachment means.Interface unit 170 may be used for receive from The input (such as, data message, electric power etc.) of external device (ED) and the input received is transferred in mobile terminal 100 One or more elements or may be used between mobile terminal and external device (ED) transmit data.
It addition, when mobile terminal 100 is connected with external base, interface unit 170 can serve as allowing electricity by it Power provides the path of mobile terminal 100 from base or can serve as allowing from the various command signals of base input by it It is transferred to the path of mobile terminal.May serve as identifying that mobile terminal is from various command signals or the electric power of base input The no signal being accurately fitted within base.Output unit 150 is configured to provide defeated with vision, audio frequency and/or tactile manner Go out signal (such as, audio signal, video signal, alarm signal, vibration signal etc.).Output unit 150 can include display Unit 151, dio Output Modules 152 etc..
Display unit 151 may be displayed on the information processed in mobile terminal 100.Such as, it is in electricity when mobile terminal 100 During words call mode, display unit 151 can show and call or other (such as, text messaging, multimedia file that communicate Download etc.) relevant user interface (UI) or graphic user interface (GUI).When mobile terminal 100 is in video calling pattern Or during image capture mode, display unit 151 can show image and/or the image of reception of capture, illustrate video or figure UI or GUI of picture and correlation function etc..
Meanwhile, when display unit 151 and touch pad the most superposed on one another with formed touch screen time, display unit 151 can serve as input equipment and output device.Display unit 151 can include liquid crystal display (LCD), thin film transistor (TFT) In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least A kind of.Some in these display may be constructed such that transparence is watched from outside with permission user, and this is properly termed as transparent Display, typical transparent display can for example, TOLED (transparent organic light emitting diode) display etc..According to specific The embodiment wanted, mobile terminal 100 can include two or more display units (or other display device), such as, move Dynamic terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch screen can be used for detection and touches Input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal be in call signal receive pattern, call mode, logging mode, Time under the isotype such as speech recognition mode, broadcast reception mode, that wireless communication unit 110 is received or at memorizer 160 The voice data transducing audio signal of middle storage and be output as sound.And, dio Output Modules 152 can provide with mobile The audio frequency output (such as, call signal receives sound, message sink sound etc.) that the specific function that terminal 100 performs is relevant. Dio Output Modules 152 can include pick up, buzzer etc..
Memorizer 160 can store the process performed by controller 180 and the software program controlling operation etc., or can The data (such as, telephone directory, message, still image, video etc.) that maybe will export have been exported temporarily to store.And And, memorizer 160 can with storage about when touch be applied to touch screen time the vibration of various modes of output and audio signal Data.
Memorizer 160 can include that the storage medium of at least one type, described storage medium include flash memory, hard disk, many Media card, card-type memorizer (such as, SD or DX memorizer etc.), random access storage device (RAM), static random-access store Device (SRAM), read only memory (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc..And, mobile terminal 100 can be connected execution memorizer with by network The network storage device cooperation of the storage function of 160.
Controller 180 generally controls the overall operation of mobile terminal.Such as, controller 180 performs and voice call, data Control that communication, video calling etc. are relevant and process.It addition, controller 180 can include for reproducing (or playback) many matchmakers The multi-media module 181 of volume data, multi-media module 181 can construct in controller 180, or it is so structured that with control Device 180 separates.Controller 180 can perform pattern recognition process, with the handwriting input that will perform on the touchscreen or picture Draw input and be identified as character or image.
Power subsystem 190 receives external power or internal power under the control of controller 180 and provides operation each unit Suitable electric power needed for part and assembly.
Various embodiment described herein can be to use such as computer software, hardware or its any combination of calculating Machine computer-readable recording medium is implemented.Implementing for hardware, embodiment described herein can be by using application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can Program gate array (FPGA), processor, controller, microcontroller, microprocessor, be designed to perform function described herein At least one in electronic unit is implemented, and in some cases, such embodiment can be implemented in controller 180. Software is implemented, the embodiment of such as process or function can with allow to perform the single of at least one function or operation Software module is implemented.Software code can be come by the software application (or program) write with any suitable programming language Implementing, software code can be stored in memorizer 160 and be performed by controller 180.
So far, mobile terminal is described according to its function.Below, for the sake of brevity, will describe such as folded form, Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc. is as showing Example.Therefore, the present invention can be applied to any kind of mobile terminal, and is not limited to slide type mobile terminal.
It should be noted that network picture or video that the mobile terminal shown in Fig. 1 can be also used for checking request enter Row burst is shown, the virtual functions module that this concrete mobile terminal includes is as follows:
Module 400 is checked in request, for send to the server specified check the picture specified or video check instruction;
Burst display module 500, for receiving this picture or each fragment data of video that this server returns successively, And show the picture material that each fragment data is corresponding successively;
Stop checking module 600, for before this picture or video are shown completely, when slide and this figure being detected When the displaying content of sheet or video shows the most on a display screen because of this slide, send to this server and stop downloading this figure Sheet or the halt instruction of video.
In the mobile terminal shown in Fig. 1, the virtual module that controller comprises i.e. asks to check module 400, to appointment Server send check the picture specified or video check instruction after, wait the data that this server to be received returns;When this The virtual module of controller i.e. burst display module 500, receives this picture or each burst of video that this server returns After data, according to the sequencing of the fragment data returned, show the picture material that each fragment data is corresponding successively, thus real The network picture now checked request or the burst of video are shown.
At the picture checked of request or video, when also not showing complete on the display unit 151 of mobile terminal, controller The virtual module comprised i.e. stops checking module 600, at the slide detected in user input unit 130, and this picture Or the displaying content of video because of this slide not when the display screen display of display unit 151, send to this server Stop downloading this picture or the halt instruction of video, so that this server stops continuing to send this picture or video to mobile terminal Residue fragment data.
As shown in Figure 1 mobile terminal 100 may be constructed such that utilize via frame or packet transmission data all if any Line and radio communication device and satellite-based communicator operate.
The communicator being wherein operable to according to the mobile terminal of the present invention is described referring now to Fig. 2.
Such communicator can use different air interfaces and/or physical layer.Such as, communicator use Air interface includes such as frequency division multiple access (FDMA), time division multiple acess (TDMA), CDMA (CDMA) and universal mobile communications dress Put (UMTS) (especially, Long Term Evolution (LTE)), global mobile communication device (GSM) etc..As non-limiting example, under The description in face relates to cdma communication device, but such teaching is equally applicable to other type of device.
With reference to Fig. 2, cdma wireless communication device can include multiple mobile terminal 100, multiple base station (BS) 270, base station Controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is configured to and Public Switched Telephony Network (PSTN) 290 form interface.MSC280 is also structured to and the BSC275 formation interface that can be couple to base station 270 via back haul link. If back haul link can construct according to any one in the interface that Ganji knows, described interface includes such as E1/T1, ATM, IP, PPP, frame relay, HDSL, ADSL or xDSL.It will be appreciated that device as shown in Figure 2 can include multiple BSC275.
Each BS270 can service one or more subregion (or region), by multidirectional antenna or the sky of sensing specific direction Each subregion that line covers is radially away from BS270.Or, each subregion can be by for two or more of diversity reception Antenna covers.Each BS270 may be constructed such that support multiple frequencies distribution, and the distribution of each frequency has specific frequency spectrum (such as, 1.25MHz, 5MHz etc.).
Intersecting that subregion and frequency are distributed can be referred to as CDMA Channel.BS270 can also be referred to as base station transceiver Device (BTS) or other equivalent terms.In this case, term " base station " may be used for broadly representing single BSC275 and at least one BS270.Base station can also be referred to as " cellular station ".Or, each subregion of specific BS270 can be claimed For multiple cellular stations.
As shown in Figure 2, broadcast singal is sent in device the mobile terminal operated by broadcsting transmitter (BT) 295 100.Broadcast reception module 111 is arranged on mobile terminal 100 and sentences the broadcast that reception is sent by BT295 as shown in Figure 1 Signal.In fig. 2 it is shown that several global pick devices (GPS) satellite 300.Satellite 300 helps to position multiple mobile terminals At least one in 100.
In fig. 2, depict multiple satellite 300, but it is understood that, it is possible to use any number of satellite obtains Useful location information.Positional information module 115 is generally configured to coordinate with satellite 300 and thinks to obtain as shown in Figure 1 The location information wanted.Substitute GPS tracking technique or outside GPS tracking technique, it is possible to use mobile terminal can be followed the tracks of Other technology of position.It addition, at least one gps satellite 300 can optionally or additionally process satellite dmb transmission.
As a typical operation of radio communication device, BS270 receives the reverse link from various mobile terminals 100 Signal.Mobile terminal 100 generally participates in call, information receiving and transmitting communicates with other type of.Certain base station 270 receive each instead Processed in specific BS270 to link signal.The data obtained are forwarded to the BSC275 being correlated with.BSC provides call Resource distribution and the mobile management function of the coordination of soft switching process included between BS270.The number that BSC275 also will receive According to being routed to MSC280, it provides the extra route service for forming interface with PSTN290.Similarly, PSTN290 with MSC280 forms interface, MSC Yu BSC275 forms interface, and BSC275 correspondingly controls BS270 with by forward link signals It is sent to mobile terminal 100.
Based on above-mentioned mobile terminal hardware configuration, the structure of communicator, propose apparatus of the present invention, system and method each Individual embodiment.
The present invention further provides a kind of picture and check device, as shown in Figure 3, it is shown that device the checked by picture of the present invention The module diagram of one embodiment, picture checks that device includes:
Module 400 is checked in request, for send to the server specified check the picture specified or video check instruction;
Picture checks that device may be provided in terminal, and terminal can be above-mentioned mobile terminal.Prestore in terminal and receive it The reference address of the server checking instruction sent.The picture specified or video can be determined by the mark of picture or video, The video related in the present invention is made up of according to appointment playing sequence multiframe picture.
After user selectes picture to be viewed or video in terminal, the request of triggering terminal checks that module 400 will comprise Picture to be viewed or checking of the mark of video that user selectes instruct on the server being sent to specify, and check use with request Picture to be viewed that family is selected or video.
Burst display module 500, for receiving picture or each fragment data of video that server returns successively, and depends on The picture material that each fragment data of secondary displaying is corresponding;
After what server reception terminal sent checks instruction, the mark according to checking picture or the video comprised in instruction is looked into Look for corresponding picture file or video file, then the every frame picture in the picture file found or video file is carried out point Sheet processes, thus obtains picture or the video fragment data after burst asking to check, and obtains fragment data according to burst Sequencing, each fragment data is returned to terminal successively.
The burst display module 500 of terminal receives the picture checked of request or the burst number of video that server returns successively According to, and after receiving a fragment data, show the picture material that this fragment data is corresponding at once, thus reach same figure The burst of the content of the same frame picture of sheet or video is shown.
Further, with reference to Fig. 4, burst display module 500 specifically includes:
Receive unit 501, for receiving picture or the fragment data of video that server currently returns;
Drawing unit 502, for according to the slice images data in the fragment data being currently received and slice images district Territory coordinate, draws, in the region that corresponding coordinate point is constituted on a display screen, the picture material that slice images data are corresponding.
Server after processing the fragment data obtaining user's picture of checking of request or video, the burst that will obtain immediately Data return to terminal.The reception unit 501 of terminal is whenever receiving fragment data, the then drawing unit that server returns The 502 slice images data comprised according to this fragment data and slice images area coordinates, at the corresponding seat of the display screen of terminal Draw these slice images data in the region that punctuate is constituted, thus show the picture material that these slice images data are corresponding.
Wherein, the Pixel Information of the image that slice images data comprise in referring to a burst region of picture and each picture The coordinate points (setting up coordinate system for reference with the picture carrying out burst) that element is corresponding;Slice images area coordinate refers to the one of picture Coordinate points corresponding to the boundary pixel point in individual burst region (with carry out burst picture for reference to setting up coordinate system) set;Eventually The corresponding coordinate point of display screen of end refer to the coordinate points identical with each coordinate points comprised in slice images area coordinate (with Picture to be viewed or the display area of video are for reference to setting up coordinate system).
Burst display module 500, after receiving the fragment data that server returns, comprises according to fragment data immediately Slice images data and slice images area coordinate, on a display screen corresponding coordinate point constitute region in drafting slice images The picture material that data are corresponding such that it is able to show same picture successively according to the sequencing of the fragment data of server return Different images content, reach burst show effect.
Stop checking module 600, for before picture or video are shown completely, when detect slide and picture or When the displaying content of video shows the most on a display screen because of slide, send to server and stop download pictures or video Halt instruction.
If the displaying content asking the picture checked or video in terminal is maintained at the display screen display of terminal, then eventually The burst display module 500 of end will constantly receive the picture checked of request or the fragment data of video that server returns, and It is illustrated in dividing of the relevant position of viewing area, the effect that formation burst is shown, the picture checked until request or video successively Sheet data have all received, and the picture checked of request or video display completely till.
If before asking the picture checked or video to be shown completely, terminal detects user's slip on a display screen Operation, and judge when the displaying content of the picture asking to check or video shows the most on a display screen because of this slide, The stopping of terminal is checked that module 600 sends to server and is stopped downloading picture or the halt instruction of video that its request is checked, with Notice server stops continuing to return picture or the residue fragment data of video that its request is checked to terminal.
Device checked by the picture that the present invention proposes, and after receiving the fragment data that server returns successively, divides the most successively Before sheet shows its picture of checking of request or picture of video, and the picture checked in request or video are shown completely, when with When family slip display screen causes the displaying content of the picture asking to check or video to show the most on a display screen, send to server Stop downloading the picture checked of request or the halt instruction of video, thus user be not desired to continue to check picture that request is checked or During video, both saved the flow that user downloads the residue fragment data of the picture checked of request or video, and burst had been shown Mode substantially reduces user and checks picture or video time to be waited, improves user and checks the use of picture or video Experience.
Further, proposing picture of the present invention based on first embodiment and check device the second embodiment, the present embodiment is with upper Stating picture and check that the difference of device first embodiment is, the present embodiment picture checks that device also includes transmission module 700, reference Fig. 5, upper transmission module 700 includes:
Split cells 701, is split as many for picture or video user selected according to the first preset burst mechanism Individual packet segment;
Uploading unit 702, the multiple packet segments for using the mode of multitask fractionation to be obtained upload to service Device.
First burst mechanism for being split as several fragment datas specifying size by the packet exceeding a certain size Bag, thus reach this packet is carried out the purpose of batch processing.Picture or the video that user selectes is split at split cells 701 After obtaining multiple packet segment, multiple packet segments that fractionation is obtained by uploading unit 702 use the mode of multitask (i.e. System can run multiple process simultaneously, and each process also can perform multiple thread simultaneously) upload onto the server.
Device checked by the picture that the present invention proposes, picture that needs are uploaded by the mode using multitask, burst to upload or Video is sent to server, accelerates uploading speed, decreases period of reservation of number, improves the experience of user.
The present invention also provide for further a kind of picture check system, the picture system of checking include first terminal, the second terminal, Server, first terminal and the second terminal include that device checked by the picture of any of the above-described embodiment;With reference to Fig. 6, picture of the present invention Check that in system one embodiment, server includes:
Pretreatment module 800, for after receiving the picture or video that first terminal uploads, according to picture or video Original resolution and preset multiple main flow resolution carry out pretreatment to picture or video, to obtain each main flow resolution pair The pretreatment picture answered or video also store;
First terminal is the class in above-mentioned terminal, for representing to server uploading pictures or the mobile terminal of video. Second terminal is the class in above-mentioned terminal, for represent send to server check the picture specified or video check instruction Mobile terminal.
Multitask, burst is used to upload picture or the packet of video that mode is uploaded for first terminal, server Pretreatment module 800, after receiving the packet segment that first terminal is uploaded, first will belong to the fragment data of same packet Bag is integrated, thus obtains complete picture or video.
Original resolution of picture or video is when first terminal uploading pictures or video, first terminal by this picture or Some base attribute information of video, such as the mark (such as title or numbering) of picture or the resolution of video, picture or video, figure Sheet or the data package size of video, picture/mb-type, the width of picture and high, be uploaded to receive picture or the service of video simultaneously Device.Preset main flow resolution can be configured according to the screen resolution that current main-stream terminal is used, and such as, main flow is differentiated Rate may be configured as 640 × 480,960 × 540,1280 × 720,1920 × 1080 etc..
The smallest object that the pretreatment module 800 of server carries out pretreatment is picture, the figure received for server Sheet, pretreatment module 800 directly carries out pretreatment to this picture, and the video received for server, pretreatment module 800 depends on Frame picture in secondary extraction video, and every frame picture is carried out pretreatment.The pretreatment module 800 of the server figure to receiving The pretreatment of sheet or video includes:
(1), for each main flow resolution, calculate according to current main flow resolution currently need to process picture (or The frame picture of video) converted after the height Mh of pretreatment picture (or frame picture of preprocessed video) that obtains, specific as follows:
Main flow resolution being designated as: Sw × Sh, the resolution of picture (or frame picture of video) is: Pw × Ph
The size being calculated Mh is carried out secondary adjustment, specific as follows:
For the picture uploaded, after above-mentioned process, i.e. can get the height Mh that picture needs to be adjusted to;For uploading Video, owing to width and the height of each frame picture are identical, thus it is the most available only need to calculate a frame picture in video In this video, every frame picture needs the height Mh being adjusted to.
(2) according to the original wide high proportion of every frame picture of calculated height Mh, picture or video, calculate and height Width Mw corresponding for Mh;
(3) according to calculated height Mh and width Mw, every frame picture of picture or video is compressed, cutting, And the pretreatment picture that obtains or preprocessed video are saved in the appointment position of server after processing.
Determine module 900, for receive that the second terminal sends when checking instruction, according to check in instruction picture or The mark of video, the second terminal resolution, determine the pretreatment picture to be viewed with the second terminal resolution match or video;
After what server received that the second terminal sends checks instruction, determine that module 900 is first according to checking that instruction comprises Picture or video identifier lookup server on whether stored this picture or video, when on server storage have this picture or During video, search in this picture or the pretreatment picture of main flow resolution corresponding to video or video, if exist and check finger The main flow resolution that the second terminal resolution of comprising in order is identical, when there is the main flow resolution identical with the second terminal resolution During rate, pretreatment picture corresponding for this main flow resolution or video are defined as with the second terminal resolution match is to be viewed pre- Process picture or video;When there is not the main flow resolution identical with the second terminal resolution, according to above-mentioned pre-treatment step Picture that computation requests is checked or the Mh of video, the picture then calculated during pretreatment and request checked or video The pretreatment picture of main flow resolution corresponding for the immediate Mh of Mh or video, be defined as and the second terminal resolution match Pretreatment picture to be viewed or video.
Burst module 990, for carrying out pretreatment picture to be viewed or video point according to the second preset burst mechanism Sheet generates fragment data, and according to the severity level determined, fragment data is returned to the second terminal successively.
Second burst mechanism is for being several burst numbers according to certain burst logic by the data fragmentation of same picture According to, and when burst, different fragment datas is set a severity level according to certain logic.Server is determining Picture that two terminal request are checked or the pretreatment picture to be viewed of the corresponding terminal resolution match with the second terminal of video Or after video, pretreatment picture to be viewed or video are carried out burst according to the second burst mechanism and generate some by burst module 990 Individual fragment data, and by fragment data according to burst time the severity level determined return to the second terminal successively.
Further, with reference to Fig. 7, burst module 990 specifically includes:
Acquiring unit 991, for obtaining pretreatment picture to be viewed or the picture/mb-type of video;
The picture/mb-type of pretreatment picture to be viewed or video asks picture or the figure of video checked with corresponding user Sheet type is identical, and picture or the picture/mb-type of video that user's request is checked are incited somebody to action when being and uploaded this picture or video by first terminal The base attribute information comprising picture/mb-type is also uploaded onto the server and is stored.Picture/mb-type refers to the class of the picture uploaded Type after frame picture is sorted out in type, or video, such as personage, landscape, building etc..
Determine unit 992, for mapping pass according to the picture/mb-type got and preset picture/mb-type with divisional type System, determines the severity level of divisional type and divisional type;
Being previously stored with picture/mb-type and divisional type mapping relations on server, i.e. different picture/mb-type are each self-corresponding Divisional type and the severity level of each divisional type.Such as, picture/mb-type is landscape, it is determined that unit 992 is according to picture category Type and divisional type mapping relations, it may be determined that divisional type corresponding to this picture/mb-type be mountain, water, plant, other (except mountain, water, Exophytic subregion is all classified as other), the severity level of divisional type be followed successively by from high to low mountain, water, plant, other, can be by Numeral numbering order from small to large represents the severity level of divisional type order from high to low, such as, divisional type mountain Severity level is 1, and the severity level of divisional type water is 2, and the severity level of divisional type plant is 3, divisional type other Severity level is 4.
Sharding unit 993, is used for utilizing face recognition technology, to each figure in pretreatment picture to be viewed or video Sheet, carries out region burst successively according to the severity level order from high to low of divisional type;
Dispatching Unit 994, is made up of slice images area coordinate and slice images data for obtained by region burst The fragment data of each burst, return to the second terminal successively.
Being as a example by landscape by picture/mb-type, the sharding unit 993 of server utilizes face recognition technology, to pre-place to be viewed It is that mountain carries out region burst for the first time that each picture in reason picture or video is first according to divisional type, and determines each burst Slice images area coordinate and slice images data, each point that then first time region burst is obtained by Dispatching Unit 994 Sheet data (slice images area coordinate and slice images data by each burst are constituted) return to the second terminal;District for the first time After territory burst terminates, it is that water carries out second time region burst that sharding unit 993 continues according to divisional type, and determines each burst Slice images area coordinate and slice images data, each point that then second time region burst is obtained by Dispatching Unit 994 Sheet data return to the second terminal;After region burst terminates for the second time, it is that plant enters that sharding unit 993 continues according to divisional type Row third time region burst, and determine slice images area coordinate and the slice images data of each burst, then Dispatching Unit Each fragment data that third time region burst obtains is returned to the second terminal by 994;After region burst terminates for the third time, burst It is that other carry out the 4th sub-region burst that unit 993 continues according to divisional type, and determines the slice images region of each burst Coordinate and slice images data, then each fragment data that the 4th sub-region burst obtains is returned to by Dispatching Unit 994 Two terminals.
Burst module 990, according to pretreatment picture to be viewed or the picture/mb-type of video, utilizes face recognition technology to treat Check that pretreatment picture or video carry out burst, and return successively according to the severity level (i.e. the sequencing of burst) of divisional type Return fragment data to the second terminal, allow users to be sequentially received the burst number of picture according to the severity level of divisional type According to, reach first to show the effect of important slice images content when burst is shown.
System checked by the picture that the present invention proposes, and picture or video that first terminal is uploaded by server are differentiated according to main flow Rate carries out pretreatment, and preserves pretreatment picture corresponding to each main flow resolution or video, when the second terminal request checks finger When fixed picture or video, server according to the terminal resolution of the second terminal determine with the second terminal resolution match to be checked See pretreatment picture or video, then by pretreatment picture to be viewed or video slicing and return to the second terminal successively, make Two terminals receive and are capable of burst after fragment datas and show, check the speed of download pictures improving user.
Invention further provides picture inspection method first embodiment, as shown in Figure 8, it is shown that picture of the present invention is looked into See that terminal and the sequential chart of server interaction in method first embodiment, the corresponding above-mentioned picture of the present embodiment check that device first is real Execute example and system one embodiment checked by above-mentioned picture.Wherein, terminal is divided into first terminal and the second terminal, and picture of the present invention is checked Method includes:
The first step: first terminal is to the server uploading pictures specified or video;
Second step: server after receiving the picture or video that first terminal uploads, original according to picture or video Resolution and preset multiple main flow resolution carry out pretreatment to picture or video, corresponding to obtain each main flow resolution Pretreatment picture or video also store;
First terminal is above-mentioned mobile terminal, for representing to server uploading pictures or a class mobile terminal of video. Original resolution of picture or video is when first terminal uploading pictures or video, and first terminal is by this picture or the one of video A little base attribute information, such as the mark (such as title or numbering) of picture or the resolution of video, picture or video, picture or video Data package size, picture/mb-type, the width of picture and high, be uploaded to receive picture or the server of video simultaneously.Preset Main flow resolution can be configured according to the screen resolution that current main-stream terminal is used, and such as, main flow resolution can be arranged It is 640 × 480,960 × 540,1280 × 720,1920 × 1080 etc..
It is picture that server carries out the smallest object of pretreatment, the picture received for server, then directly to this figure Sheet carries out pretreatment, the video received for server, and server extracts the frame picture in video successively, and to every frame picture Carry out pretreatment.The pretreatment of the server picture to receiving or video includes:
(1), for each main flow resolution, calculate according to current main flow resolution currently need to process picture (or The frame picture of video) converted after the height Mh of pretreatment picture (or frame picture of preprocessed video) that obtains, specific as follows:
Main flow resolution being designated as: Sw × Sh, the resolution of picture (or frame picture of video) is: Pw × Ph
The size being calculated Mh is carried out secondary adjustment, specific as follows:
For the picture uploaded, after above-mentioned process, i.e. can get the height Mh that picture needs to be adjusted to;For uploading Video, owing to width and the height of each frame picture are identical, thus it is the most available only need to calculate a frame picture in video In this video, every frame picture needs the height Mh being adjusted to.
(2) according to the original wide high proportion of every frame picture of calculated height Mh, picture or video, calculate and height Width Mw corresponding for Mh;
(3) according to calculated height Mh and width Mw, every frame picture of picture or video is compressed, cutting, And the pretreatment picture that obtains or preprocessed video are saved in the appointment position of server after processing.
3rd step: the second terminal send to the server specified check the picture specified or video check instruction;
Second terminal is above-mentioned mobile terminal, checks checking of the picture specified or video for representing to send to server One class mobile terminal of instruction.The reference address receiving its server checking instruction sent is prestored in second terminal.Refer to Fixed picture or video can be determined by the mark of picture or video, the video related in the present invention by multiframe picture according to appointment Playing sequence forms.
After user selectes picture to be viewed or video in the second terminal, triggering the second terminal will comprise what user selected Picture to be viewed or the mark of video check on the server that instruction is sent to specify, check that what user selected treats with request The picture checked or video.
4th step: server receive that the second terminal sends when checking instruction, according to checking in instruction picture or regarding The mark of frequency, the second terminal resolution, determine the pretreatment picture to be viewed with the second terminal resolution match or video;
After what server received that the second terminal sends checks instruction, first according to checking the picture that comprises of instruction or video Identifier lookup server on whether stored this picture or video, when on server storage have this picture or video time, search In this picture or the pretreatment picture of main flow resolution corresponding to video or video, if exist and check the comprised in instruction The main flow resolution that two terminal resolution are identical, when there is the main flow resolution identical with the second terminal resolution, this is main Pretreatment picture that flow point resolution is corresponding or video be defined as the pretreatment picture to be viewed with the second terminal resolution match or Video;When there is not the main flow resolution identical with the second terminal resolution, look into according to above-mentioned pre-treatment step computation requests The picture seen or the Mh of video, then the Mh by the picture checked with request calculated during pretreatment or video is closest The pretreatment picture of main flow resolution corresponding for Mh or video, be defined as and the to be viewed pre-place of the second terminal resolution match Reason picture or video.
5th step: it is raw that pretreatment picture to be viewed or video are carried out burst according to the second preset burst mechanism by server Become fragment data, and fragment data is returned to the second terminal successively according to the severity level determined;
Second burst mechanism is for being several burst numbers according to certain burst logic by the data fragmentation of same picture According to, and when burst, different fragment datas is set a severity level according to certain logic.Server is determining Picture that two terminal request are checked or the pretreatment picture to be viewed of the corresponding terminal resolution match with the second terminal of video Or after video, pretreatment picture to be viewed or video are carried out burst according to the second burst mechanism and generates several fragment datas, And by fragment data according to burst time the severity level determined return to the second terminal successively.
Further, with reference to Fig. 9, above-mentioned 5th step specifically includes:
S51, obtain pretreatment picture to be viewed or the picture/mb-type of video;
The picture/mb-type of pretreatment picture to be viewed or video asks picture or the figure of video checked with corresponding user Sheet type is identical, and picture or the picture/mb-type of video that user's request is checked are incited somebody to action when being and uploaded this picture or video by first terminal The base attribute information comprising picture/mb-type is also uploaded onto the server and is stored.Picture/mb-type refers to the class of the picture uploaded Type after frame picture is sorted out in type, or video, such as personage, landscape, building etc..
S52, according to the picture/mb-type that gets and preset picture/mb-type and divisional type mapping relations, determine subregion class Type and the severity level of divisional type;
Being previously stored with picture/mb-type and divisional type mapping relations on server, i.e. different picture/mb-type are each self-corresponding Divisional type and the severity level of each divisional type.Such as, picture/mb-type is landscape, then according to picture/mb-type and divisional type Mapping relations, it may be determined that divisional type corresponding to this picture/mb-type is mountain, water, plant, other are (except mountain, water, exophytic subregion All be classified as other), the severity level of divisional type be followed successively by from high to low mountain, water, plant, other, can by numeral number from little Representing the severity level of divisional type order from high to low to big order, such as, the severity level on divisional type mountain is 1, The severity level of divisional type water is 2, and the severity level of divisional type plant is 3, and other severity level of divisional type is 4.
S53, utilize face recognition technology, to each picture in pretreatment picture to be viewed or video, according to subregion class The severity level of type order from high to low carries out region burst successively;
S54, each burst being made up of slice images area coordinate and slice images data that region burst is obtained Fragment data, returns to the second terminal successively.
Being as a example by landscape by picture/mb-type, server by utilizing face recognition technology, to pretreatment picture to be viewed or video In each picture to be first according to divisional type be that mountain carries out for the first time region burst, and determine the slice images district of each burst Territory coordinate and slice images data, each fragment data (burst by each burst then first time region burst obtained Image-region coordinate and slice images data are constituted) return to the second terminal;After region burst terminates for the first time, continue according to dividing District's type is that water carries out second time region burst, and determines slice images area coordinate and the slice images data of each burst, Then each fragment data that second time region burst obtains is returned to the second terminal;After region burst terminates for the second time, continue Continuous is that plant carries out third time region burst according to divisional type, and determines slice images area coordinate and the burst of each burst View data, then returns to the second terminal by each fragment data that third time region burst obtains;Region burst for the third time After end, continuing according to divisional type is that other carry out the 4th sub-region burst, and determines the slice images region of each burst Coordinate and slice images data, then return to the second terminal by each fragment data that the 4th sub-region burst obtains.
According to pretreatment picture to be viewed or the picture/mb-type of video, utilize face recognition technology to pretreatment figure to be viewed Sheet or video carry out burst, and return fragment data successively according to the severity level (i.e. the sequencing of burst) of divisional type and arrive Second terminal, allows users to be sequentially received according to the severity level of divisional type the fragment data of picture, reaches at burst First the effect of important slice images content is shown during displaying.
6th step: the second terminal receives picture or each fragment data of video that server returns successively, and opens up successively Show the picture material that each fragment data is corresponding;
Second terminal receives the picture checked of request or the fragment data of video that server returns successively, and is receiving Show the picture material that this fragment data is corresponding after one fragment data at once, thus reach same picture or video same The burst of the content of frame picture is shown.
Further, with reference to Figure 10, above-mentioned 6th step specifically includes:
S61, receive the picture that currently returns of server or the fragment data of video;
Slice images data in the fragment data that S62, basis are currently received and slice images area coordinate, in display The picture material that slice images data are corresponding is drawn in the region that on screen, corresponding coordinate point is constituted.
Server after processing the fragment data obtaining user's picture of checking of request or video, the burst that will obtain immediately Data return to the second terminal.Second terminal is whenever receiving the fragment data that server returns, then according to this burst number According to the slice images data comprised and slice images area coordinate, the district that the corresponding coordinate point at the display screen of the second terminal is constituted Draw these slice images data in territory, thus show the picture material that these slice images data are corresponding.
Wherein, the Pixel Information of the image that slice images data comprise in referring to a burst region of picture and each picture The coordinate points (setting up coordinate system for reference with the picture carrying out burst) that element is corresponding;Slice images area coordinate refers to the one of picture Coordinate points corresponding to the boundary pixel point in individual burst region (with carry out burst picture for reference to setting up coordinate system) set;The The corresponding coordinate point of the display screen of two terminals refers to the coordinate identical with each coordinate points comprised in slice images area coordinate Point (sets up coordinate system with the display area of picture to be viewed or video for reference).
Second terminal whenever receive server return fragment data after, the burst figure comprised according to fragment data immediately As data and slice images area coordinate, in the region that corresponding coordinate point is constituted on the display screen of the second terminal, draw burst figure As the picture material that data are corresponding such that it is able to show same figure successively according to the sequencing of the fragment data of server return The different images content of sheet, reaches the effect that burst is shown, application scenarios when burst is shown is as shown in figure 11.
7th step: before picture or video are shown completely, in detecting the displaying of slide and picture or video When appearance shows the most on a display screen because of slide, the second terminal to server sends and stops download pictures or the stopping of video Instruction;
If the displaying content asking picture or the video checked in the second terminal is maintained on the display screen of the second terminal Display, then the second terminal will constantly receive the picture checked of request or the fragment data of video that server returns, and successively It is illustrated in the relevant position of viewing area, forms the effect that burst is shown, until asking picture or the burst number of video checked According to all having received, and the picture checked of request or video display completely till.
If before the picture checked of request or video are shown completely, the second terminal detects that user is on a display screen Slide, and judge that the displaying content of the picture asking to check or video shows the most on a display screen because of this slide Time, the second terminal to server sends and stops downloading picture or the halt instruction of video that its request is checked, to notify server Stop continuing to return picture or the residue fragment data of video that its request is checked to the second terminal.
8th step: server stopping processes remaining fragment data in picture or video.
The picture inspection method that the present invention proposes, after the second terminal receives the fragment data that server returns successively, accordingly Ground burst successively shows that it asks picture or the picture of video checked, and is asking the picture checked or video to show it completely Before, when user slide display screen cause the displaying content of the picture asking to check or video to show the most on a display screen time, to clothes Business device sends and stops picture or the halt instruction of video that the request of downloading is checked, thus is not desired to continue to check that request is checked user Picture or during video, both saved the flow of the residue fragment data of picture that user's request of downloading checks or video, and point The mode that sheet is shown substantially reduces user and checks picture or video time to be waited, improves user and checks picture or regard The experience of frequency.
Further, propose picture inspection method second of the present invention based on above-mentioned picture inspection method first embodiment to implement Example, the corresponding above-mentioned picture of the present embodiment checks that device the second embodiment, the present embodiment are implemented with above-mentioned picture inspection method first The difference of example is, first terminal uses the mode uploading pictures or video that multitask, burst upload in the present embodiment.Reference Figure 12, picture inspection method also includes:
Picture or video that user is selected by S11, first terminal are split as multiple points according to the first preset burst mechanism Sheet packet;
S12, the multiple packet segments using the mode of multitask fractionation to be obtained are uploaded onto the server.
First burst mechanism for being split as several fragment datas specifying size by the packet exceeding a certain size Bag, thus reach this packet is carried out the purpose of batch processing.After fractionation completes, it is multiple that fractionation is obtained by first terminal (i.e. system can run multiple process to the mode of packet segment employing multitask simultaneously, and each process also can perform multiple simultaneously Thread) upload onto the server.Multitask, burst is used to upload picture or the data of video that mode is uploaded for first terminal Bag, the packet segment belonging to same packet, after receiving the packet segment that first terminal is uploaded, is first entered by server Row is integrated, thus obtains complete picture or video.
The picture inspection method that the present invention proposes, needs are uploaded by the mode that first terminal uses multitask, burst to upload Picture or video be sent to server, accelerate uploading speed, decrease period of reservation of number, improve the use body of user Test.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive above-described embodiment side Method can add the mode of required general hardware platform by software and realize, naturally it is also possible to by hardware, but a lot of in the case of The former is more preferably embodiment.Based on such understanding, prior art is done by technical scheme the most in other words The part going out contribution can embody with the form of software product, and this computer software product is stored in a storage medium In (such as ROM/RAM, magnetic disc, CD), including some instructions with so that a station terminal equipment (can be mobile phone, computer, take Business device, air-conditioner, or the network equipment etc.) perform the method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, every utilize this Equivalent structure or equivalence flow process that bright description and accompanying drawing content are made convert, or are directly or indirectly used in other relevant skills Art field, is the most in like manner included in the scope of patent protection of the present invention.

Claims (10)

1. device checked by a picture, it is characterised in that described picture checks that device includes:
Module is checked in request, for send to the server specified check the picture specified or video check instruction;
Burst display module, for receiving described picture or each fragment data of video that described server returns successively, and Show the picture material that each fragment data is corresponding successively;
Stop checking module, for before described picture or video are shown completely, when slide and described picture being detected Or the displaying content of video is when showing the most on a display screen because of described slide, sends to described server and stop downloading institute State the halt instruction of picture or video.
2. device checked by picture as claimed in claim 1, it is characterised in that described burst display module includes:
Receive unit, for receiving described picture or the fragment data of video that described server currently returns;
Drawing unit, the slice images data in the fragment data that basis is currently received and slice images area coordinate, Draw, in the region that corresponding coordinate point is constituted on described display screen, the picture material that described slice images data are corresponding.
3. device checked by picture as claimed in claim 1 or 2, it is characterised in that described picture checks that device also includes uploading Module, described upper transmission module includes:
Split cells, is split as multiple burst number for picture or video user selected according to the first preset burst mechanism According to bag;
Uploading unit, uploads to described server for the multiple packet segments using the mode of multitask fractionation to be obtained.
4. system checked by a picture, it is characterised in that the described picture system of checking includes first terminal, the second terminal, service Device, described first terminal and described second terminal include that the picture as described in any one of claim 1-3 checks device, described clothes Business device includes:
Pretreatment module, for after receiving the picture or video that described first terminal uploads, according to described picture or video Original resolution and preset multiple main flow resolution described picture or video are carried out pretreatment, divide obtaining each main flow Pretreatment picture that resolution is corresponding or video also store;
Determine module, for receive described second terminal send when checking instruction, check picture in instruction according to described Or the mark of video, described second terminal resolution, determine and the pretreatment figure to be viewed of described second terminal resolution match Sheet or video;
Burst module, raw for described pretreatment picture to be viewed or video are carried out burst according to the second preset burst mechanism Become fragment data, and fragment data is returned to described second terminal successively according to the severity level determined.
5. system checked by picture as claimed in claim 4, it is characterised in that described burst module includes:
Acquiring unit, for obtaining described pretreatment picture to be viewed or the picture/mb-type of video;
Determine unit, for according to the picture/mb-type got and preset picture/mb-type and divisional type mapping relations, determining Divisional type and the severity level of divisional type;
Sharding unit, is used for utilizing face recognition technology, to each picture in described pretreatment picture to be viewed or video, presses Severity level order from high to low according to described divisional type carries out region burst successively;
Dispatching Unit, for each point be made up of slice images area coordinate and slice images data obtained by region burst The fragment data of sheet, returns to described second terminal successively.
6. a picture inspection method, it is characterised in that described picture inspection method includes:
Send to the server specified check the picture specified or video check instruction;
Receive described picture or each fragment data of video that described server returns successively, and show each burst number successively According to corresponding picture material;
Before described picture or video are shown completely, when detect the displaying content of slide and described picture or video because of Described slide and when showing the most on a display screen, send to described server and stop downloading described picture or the stopping of video Instruction.
7. picture inspection method as claimed in claim 6, it is characterised in that the described institute receiving the return of described server successively State each fragment data of picture or video, and show that the picture material that each fragment data is corresponding includes successively:
Receive described picture or the fragment data of video that described server currently returns;
According to the slice images data in the fragment data being currently received and slice images area coordinate, on described display screen The picture material that described slice images data are corresponding is drawn in the region that corresponding coordinate point is constituted.
Picture inspection method the most as claimed in claims 6 or 7, it is characterised in that described picture inspection method also includes:
Picture or the video user selected are split as multiple packet segment according to the first preset burst mechanism;
The multiple packet segments using the mode of multitask fractionation to be obtained upload to described server.
9. a picture inspection method, it is characterised in that described picture inspection method includes:
Server after receiving the picture or video that first terminal uploads, according to original resolution of described picture or video and Preset multiple main flow resolution carry out pretreatment to described picture or video, the pre-place corresponding to obtain each main flow resolution Manage picture or video and store;
Receive that the second terminal sends when checking instruction, according to described picture or the mark of video, described of checking in instruction Second terminal resolution, determines the pretreatment picture to be viewed with described second terminal resolution match or video;
Described pretreatment picture to be viewed or video are carried out burst according to the second preset burst mechanism and generates fragment data, and Fragment data is returned to described second terminal successively according to the severity level determined.
10. picture inspection method as claimed in claim 9, it is characterised in that described by described pretreatment picture to be viewed or Video carries out burst according to the second preset burst mechanism and generates fragment data, and by fragment data according to the importance level determined Return to described second terminal the most successively include:
Obtain described pretreatment picture to be viewed or the picture/mb-type of video;
According to the picture/mb-type got and preset picture/mb-type and divisional type mapping relations, determine divisional type and subregion The severity level of type;
Utilize face recognition technology, to each picture in described pretreatment picture to be viewed or video, according to described subregion class The severity level of type order from high to low carries out region burst successively;
The fragment data of each burst being made up of slice images area coordinate and slice images data that region burst is obtained, Return to described second terminal successively.
CN201610355141.4A 2016-05-25 2016-05-25 Picture check device, system and method Pending CN106028060A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610355141.4A CN106028060A (en) 2016-05-25 2016-05-25 Picture check device, system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610355141.4A CN106028060A (en) 2016-05-25 2016-05-25 Picture check device, system and method

Publications (1)

Publication Number Publication Date
CN106028060A true CN106028060A (en) 2016-10-12

Family

ID=57093849

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610355141.4A Pending CN106028060A (en) 2016-05-25 2016-05-25 Picture check device, system and method

Country Status (1)

Country Link
CN (1) CN106028060A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108881773A (en) * 2017-12-29 2018-11-23 北京视联动力国际信息技术有限公司 A kind of method and apparatus of video communication
CN111158619A (en) * 2019-12-25 2020-05-15 珠海格力电器股份有限公司 Picture processing method and device
CN114630172A (en) * 2020-12-11 2022-06-14 腾讯科技(深圳)有限公司 Multimedia information processing method and device, electronic equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902575A (en) * 2012-12-27 2014-07-02 腾讯科技(深圳)有限公司 Pictorial information loading method and related device
CN104391890A (en) * 2014-11-10 2015-03-04 广东欧珀移动通信有限公司 Image loading method and system
WO2015143905A1 (en) * 2014-03-26 2015-10-01 北京奇虎科技有限公司 Picture loading device and method
CN105306963A (en) * 2015-10-20 2016-02-03 努比亚技术有限公司 Video processing system, device and method self-adapting to mobile terminal resolution

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902575A (en) * 2012-12-27 2014-07-02 腾讯科技(深圳)有限公司 Pictorial information loading method and related device
WO2015143905A1 (en) * 2014-03-26 2015-10-01 北京奇虎科技有限公司 Picture loading device and method
CN104391890A (en) * 2014-11-10 2015-03-04 广东欧珀移动通信有限公司 Image loading method and system
CN105306963A (en) * 2015-10-20 2016-02-03 努比亚技术有限公司 Video processing system, device and method self-adapting to mobile terminal resolution

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108881773A (en) * 2017-12-29 2018-11-23 北京视联动力国际信息技术有限公司 A kind of method and apparatus of video communication
CN111158619A (en) * 2019-12-25 2020-05-15 珠海格力电器股份有限公司 Picture processing method and device
CN114630172A (en) * 2020-12-11 2022-06-14 腾讯科技(深圳)有限公司 Multimedia information processing method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN104902075B (en) Multi-screen interaction method and system
CN104731507B (en) The application changing method of mobile terminal and mobile terminal
CN104808944B (en) Touch operation inducing method and device
CN104735255B (en) Multi-screen display method and system
CN106453538A (en) Screen sharing apparatus and method
CN106201395A (en) A kind of display packing and mobile terminal
CN106155694A (en) A kind of application and the display packing and device applied of attending to anything else
CN106157970A (en) A kind of audio identification methods and terminal
CN106302651A (en) The social sharing method of picture and there is the terminal of picture social activity share system
CN106249989A (en) Social networking application program icon aligning method during a kind of sharing contents and mobile terminal
CN106850941A (en) Method, photo taking and device
CN106231095A (en) Picture synthesizer and method
CN106873936A (en) Electronic equipment and information processing method
CN106909681A (en) A kind of information processing method and its device
CN106101455A (en) Page jump management method, device and terminal
CN105739873A (en) Screen capturing method and terminal
CN106250081A (en) A kind of display packing based on double screen terminal and device
CN106406737A (en) A screen operating method and device and a mobile terminal
CN106534500A (en) Customization service system and method based on figure attributes
CN105183830B (en) picture browsing method and device
CN106873887A (en) It is a kind of that the system and method for application function is controlled based on gesture
CN106131274A (en) Mobile terminal control device and method
CN104917868B (en) Text progress adjusting method and device
CN104731508B (en) Audio frequency playing method and device
CN106383707A (en) Picture display method and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20161012