[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2016070373A1 - Method for implementing synchronous preview display between mobile terminal and web terminal - Google Patents

Method for implementing synchronous preview display between mobile terminal and web terminal Download PDF

Info

Publication number
WO2016070373A1
WO2016070373A1 PCT/CN2014/090425 CN2014090425W WO2016070373A1 WO 2016070373 A1 WO2016070373 A1 WO 2016070373A1 CN 2014090425 W CN2014090425 W CN 2014090425W WO 2016070373 A1 WO2016070373 A1 WO 2016070373A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile terminal
terminal
web
file
web terminal
Prior art date
Application number
PCT/CN2014/090425
Other languages
French (fr)
Chinese (zh)
Inventor
姜天鹏
Original Assignee
北京安奇智联科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京安奇智联科技有限公司 filed Critical 北京安奇智联科技有限公司
Priority to PCT/CN2014/090425 priority Critical patent/WO2016070373A1/en
Publication of WO2016070373A1 publication Critical patent/WO2016070373A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications

Definitions

  • the present invention generally relates to the field of mobile communications, and more particularly to a method and system for interconnecting between a mobile terminal and a web terminal and for simultaneous manipulation by the mobile terminal and display on the web terminal.
  • connection of the data cable also has special requirements for the hardware interface of the device. For example, the commonly used HDMI interface is only configured on a relatively new computer device, and the slightly old model is not configured, so that the connection cannot be realized.
  • WiFi technology provides simultaneous control and display between mobile electronic devices and personal computers.
  • an access point AP
  • the access point acts as a wireless network relay between the mobile electronic device and the personal computer, and the personal computer and the mobile device must be connected to the wireless network relay at the same time to achieve interconnection.
  • AP access point
  • Short-range near-field communication technologies such as Bluetooth technology are now increasingly being used to transfer data between mobile electronic devices for simultaneous manipulation and display.
  • Bluetooth technology High speed data transfer speeds are usually not available.
  • personal computers are usually not equipped with Bluetooth modules, making bidirectional connection communication impossible.
  • An object of the present invention is to provide a method for synchronous preview display between a mobile device and a web terminal, wherein the mobile terminal and the web terminal are respectively connected to a server end located in the cloud through a network, and the method includes the following steps. : a) selecting, by the mobile terminal, a file to be previewed; b) transmitting, by the mobile terminal, an instruction requesting preview to the server, displaying a file to be previewed at the mobile terminal; c) the server side Forwarding the preview request to the web terminal; d) the web terminal receives the request, triggering generation of a long connection address, and opening a web service for receiving the transferred file; e) the web terminal connecting the long connection The address is sent to the mobile terminal; f) the mobile terminal sends the current preview file to the web terminal according to the received long connection address; g) the web terminal caches the received preview file and presents the preview file in the web terminal a file; h) receiving a manipulation instruction to the preview file at the mobile terminal; i) transmit
  • the long connection in the step d is an http long connection.
  • the long connection address in the step d or the file in the step f is transmitted after being transited by the server.
  • the file when the previewed file only needs to be displayed on a single screen, the file is directly presented; when the previewed file needs to be displayed in multiple screens, the first page of the file is displayed.
  • the manipulation instruction is selected from the steps of enlarging, reducing, turning, scrolling, and selecting a specific paragraph.
  • the transmitting and displaying in the step b are performed simultaneously or sequentially.
  • the web terminal stores the received instructions in a first-in, first-out queue manner, and then retrieves corresponding instructions from the queue according to the time sequence of receiving the instructions for parsing and conversion.
  • step f when the manipulation instruction issued by the mobile terminal involves manipulating other files than the current preview file, the process returns to step f, and then step g is performed.
  • the web terminal clears the files in the local cache when all manipulations are ended at the mobile terminal.
  • the connection between the web terminal and the mobile terminal is established by the following steps: a01) issuing a connection request by the web terminal to the server end; a02) the server end Transmitting two-dimensional code information to the web terminal; a03) scanning the two-dimensional code information by the mobile terminal; a04) in response to the operation of scanning the two-dimensional code, the mobile terminal and the web terminal respectively
  • the server sends its own network connection status; a05) the server obtains the network status of the mobile terminal and the web terminal respectively connected to the server, and determines whether the network connection between the mobile terminal and the web terminal is Under the same local area network, and setting the network status identifiers to different states according to whether they are in the same local area network; a06) the server end respectively sends a connection establishment permission to the mobile terminal and the web terminal, where the mobile terminal and the mobile terminal Establish a connection between the web terminals.
  • a user can achieve a reliable, high-speed, stable, user-interactive connection between a mobile electronic device and a web terminal having a web interface, enabling a good control of the web terminal through the mobile terminal, and Synchronize the preview of the displayed scheme.
  • FIG. 1a and 1b schematically show a system block diagram of interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention.
  • Fig. 2 schematically shows an interaction flow diagram for interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention.
  • Figure 3a schematically illustrates an exemplary mobile terminal in accordance with one embodiment of the present invention 110 connection interface.
  • FIG. 3b schematically illustrates a connection presentation interface of an exemplary web terminal 120 in accordance with one embodiment of the present invention.
  • FIG. 4 is a flow chart diagrammatically showing a method of synchronous preview display and manipulation between web terminal 120 and mobile terminal 110 in accordance with the present invention.
  • 5a-5c schematically illustrate exemplary displays on mobile terminal 110 and web terminal 120, respectively, in accordance with the method of FIG.
  • FIG. 1a and 1b schematically show a system block diagram of interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention.
  • 1a schematically shows a system block diagram for interconnection between a mobile terminal and a web terminal by means of a server side according to the present invention
  • FIG. 1b shows a system block diagram including a specific architecture and composition of the server side.
  • system 100 includes at least one mobile terminal 110, at least one web terminal 120, and a remotely located server side 130 for enabling interconnection between mobile terminal 110 and web terminal 120 for interactive communication. .
  • the mobile terminal 110 and the web terminal 120 are respectively connected to the server side 130 through the first network 140, and the mobile terminal 110 and the web terminal 120 are connected to each other through the second network 150.
  • FIG. 1 shows only one mobile terminal 110 and one web terminal 120.
  • system 100 can include more mobile terminals 110 and/or more web terminals 120.
  • each mobile terminal 110 has a unique web terminal 120 that uniquely corresponds to it.
  • the mobile terminal 110 and the web terminal 120 can communicate bidirectionally with the server side 130 via any type of first network 140, respectively.
  • the first network 140 is selected, for example, from something such as A local area network (“LAN”) such as an intranet and a wide area network (“WAN”) such as the Internet.
  • the first network 140 can be configured to support the transmission of information using a plurality of protocol setting formats. Additionally, the first network 140 can be a public network, a private network, or a combination thereof.
  • the first network 140 can also be implemented using any one or more types of physical media, including wired communication paths and wireless communication paths associated with multiple service providers. Wireless communication methods such as WiFi or WLAN, GPRS, cellular networks, such as GSM networks, 3G networks, LTE networks, or CDMA networks.
  • a direct network connection can also be established between the mobile terminal 110 and the web terminal 120, and two-way communication is performed through the second network 150.
  • the protocol mode adopted by the second network 150 is, for example, a manner in which http polling is combined with WebSocket direct connection.
  • the mobile terminal 110 can be a smart phone, a personal digital assistant (PDA), a tablet, a multi-function mobile terminal, or any other mobile device that includes computing functionality and data communication capabilities.
  • the mobile terminal 110 includes an app interface application 111 (shown in FIG. 1b) and a preview module 112 included therein.
  • the App application 111 is, for example, a custom application (app) for two-way communication with web-enabled applications.
  • the preview module 112 is configured to receive a specific operation instruction issued by the user on the mobile terminal 110 and send it to the web terminal 120 to perform a synchronization operation on the web terminal 120.
  • the preview module 112 can also be used to trigger a synchronized display of the mobile terminal 110 and the web terminal 120.
  • the specific method steps of synchronous manipulation and synchronous display will be described in detail below when describing the method flow of the present invention.
  • the mobile terminal 110 includes one or more computing devices that can receive input manipulation instructions from a user and can present an output, and thus the mobile terminal 110 further includes an I/O interface (input/output interface) 112, Can receive one or more inputs and present the output.
  • the input interface can include one or more of a camera, a touchpad, a touch screen, a stylus, and a microphone.
  • an output can be presented through the output interface to output a user's control operation instructions or feedback information from other users, and the like.
  • the output interface includes one or more of a display screen, one or more speakers, and a tactile interface.
  • the web terminal 120 can be any terminal device that supports a web protocol, such as a desktop computer, a laptop computer, a notebook computer, a tablet computer, a game console, a smart TV, and the like.
  • the web terminal 120 includes a web interface 121 and a cache 122 (as shown in Figure 1b).
  • the web interface 121 is, for example, a web browser.
  • the respective web terminal 120 includes a browser application for requesting, parsing, displaying, executing a web page, and executing an application included in the web page.
  • the browser application 128 can be a user that allows users to search, browse, and/or use URLs (uniform resources) Any application of a resource (eg, a web page and a web service) identified by a locator or URI (Uniform Resource Identifier).
  • URL is used herein to mean the network address or location of a document.
  • "document” refers to any document or content in any format that can be used by a web browser or other application, including but not limited to: word processing documents, spreadsheet documents, presentation documents, drawings, web pages, text, images. , audio, video, etc.
  • the cache 122 is used to cache files sent from the mobile terminal 110 for use in implementing the synchronous manipulation and synchronous display functions of the mobile terminal 110 to the web terminal 120. When the display or manipulation ends, the cache 122 can automatically clear the files cached therein.
  • Figure 1b shows a system block diagram containing the specific architecture and composition of the server side.
  • the server side 130 includes a two-dimensional code module 131, a network access module 132, a network status identifier 133, and an address generation module 134.
  • the two-dimensional code module 131 is configured to generate a two-dimensional code for scanning by the mobile terminal 110.
  • the two-dimensional code contains a Universally Unique Identifier (UUID), which is a unique identification code.
  • UUID Universally Unique Identifier
  • the mobile terminal 110 connects to the server side 130 by scanning the UUID of the two-dimensional code table to request acquisition of a unique connection address and session.
  • the network access module 132 is configured to determine the network connection status of the mobile terminal 110 and the web terminal 120 after the corresponding mobile terminal 110 scans the two-dimensional code, so as to adapt the mobile terminal 110 and the web terminal 120 according to different network connection conditions.
  • the connections are made to establish a connection between the mobile terminal 110 and the web terminal 120.
  • the established connection is an http long connection.
  • the connection can continuously send multiple data packets. If there is no data packet transmission during the connection hold period, in order to ensure that the two terminals remain connected, the detection data packet (ie, heartbeat packet) is sent within a predetermined interval, the mobile terminal 110 and the web. A detection packet needs to be sent between the terminals 120 to maintain the connection.
  • the network access module 132 obtains the network status that the mobile terminal 110 and the web terminal 120 are respectively connected to the server end 130, and determines whether the network connection of the mobile terminal 110 and the web terminal 120 are under the same network.
  • the same network according to the present invention means that the same network segment can be directly connected under the same router without going through the external network.
  • the network status indicator 133 is set to a different state depending on whether it is in the same local area network. For example, if it is in the same network, an identifier, such as the number 1, is set in the network status indicator 133; if not in the same network, the identifier is not set in the network status indicator 133, or another different identifier is set, for example The number is 0.
  • the network access module 132 periodically acquires the network status of each of the mobile terminal 110 and the web terminal 120 connected to the server to determine the mobile terminal. Whether the network connection between the terminal 110 and the web terminal 120 is in the same state under the same local area network changes, and the network status indicator 133 is updated for the changed network status.
  • the frequency of the periodic acquisition may be, for example, once every 30 seconds.
  • the periodically transmitted signal is also referred to as a "heartbeat signal" and can also be used to detect whether the mobile terminal 110 and the web terminal 120 are still connected to the server side 130. For example, when the heartbeat response signal fed back by the mobile terminal 110 or the web terminal 120 is not received for a certain number of times, the server 130 can determine that the mobile terminal 110 or the web terminal 120 has disconnected from the server end 130.
  • the network status indicator 133 is used to store an identification of the adaptive connection between the mobile terminal 110 and the web terminal 120 due to different network connection conditions. For example, the mobile terminal 110 and the web terminal 120 are in the same network, and an identifier is set in the network status identifier 133; if not in the same network, another different identifier is set.
  • the address generation module 134 is configured to generate a file address that needs to be transferred between the mobile terminal 110 and the web terminal 120. After the connection is established between the mobile terminal 110 and the web terminal 120 in accordance with the method of the present invention, the user may select to upload a file to the web terminal 120 via the mobile terminal 110 or download the file from the web terminal 120 to the mobile terminal 110. When the user issues such a request to move the file, the address generation module 134 generates a network-based address, such as a URL, for the transmitted file, to the mobile terminal 110 or web terminal 120 that needs to download the file, the mobile terminal 110 and the web terminal 120. Simply access the address to download the file to transfer the file.
  • a network-based address such as a URL
  • FIG. 2 shows a flow chart of a method for a user to interact with the web terminal 120 via the server terminal 130 via the mobile terminal 110. as shown in picture 2,
  • the user sends a connection request to the server side 130 via the web terminal 120.
  • the user can send a connection request by launching a browser on the web terminal 120 and entering address information of www.****.cc in the browser address bar.
  • the server 130 sends the QR code information to the web terminal 120 in response to the connection request sent by the web terminal 120, and presents the two-dimensional code information on the web terminal 120 in step 220.
  • the two-dimensional code information includes a universal unique identification code (UUID), and the UUID is a unique identification code.
  • UUID universal unique identification code
  • the mobile terminal 110 connects to the server side 130 by scanning the UUID of the two-dimensional code table to request acquisition of a unique connection address and session.
  • the user scans the web terminal 120 through the mobile terminal 110.
  • QR code information on For example, scanning is performed by a camera carried on the mobile terminal 110.
  • the user activates the app software on the mobile terminal 110, and the app software prompts the user to scan the two-dimensional code to implement the connection.
  • the mobile terminal 110 and the web terminal 120 initiate a connection request to the server side in steps 230a and 230b, respectively, and transmit their own network connection status to the server side 130.
  • the network connection status is a network connection to the server end.
  • the server side 130 determines whether the network connection of the mobile terminal 110 and the web terminal 120 is under the same local area network by acquiring the network status of the mobile terminal 110 and the web terminal 120 respectively connected to the server, and whether the network connection is in the same local area network.
  • the network status indicator sets a different status. For example, if it is in the same network, an identifier, such as the number 1, is set in the network status indicator 133; if not in the same network, the identifier is not set in the network status indicator 133, or another different identifier is set, for example The number is 0.
  • the server side 130 transmits a connection establishment permission to the mobile terminal 110 and the web terminal 120 in steps 240a and 240b, respectively, thereby establishing a connection between the mobile terminal 110 and the web terminal 120.
  • a http long connection is established.
  • FIG. 3a schematically illustrates a connection interface of an exemplary mobile terminal 110 in accordance with one embodiment of the present invention.
  • the presentation interface of the mobile terminal 110 is divided into an item column 301 located at the top of the interface and a file example column 302 located below the item column 301.
  • files that can be synchronously transferred are schematically classified into items such as "photograph”, “gallery”, “music”, “video”, “document”, and the like, and the user can switch between different items.
  • items are merely exemplary, and new items can be added or reduced according to different needs.
  • the files belonging to the item will be displayed according to different sorting methods such as time and file size, preferably by thumbnail, file name, file icon, and the like.
  • more synchronization information between the mobile terminal 110 and the web terminal 120 may be further displayed after step 245.
  • the statistical information of the file to be synchronously transmitted by the mobile terminal 110 is transmitted to the server side 130, and then the information is forwarded to the web terminal 120 via the server side 130 in step 255.
  • the synchronization statistics information includes the number of files to be transferred by the synchronous connection, the file type, and the number of files of each category.
  • FIG. 3b schematically illustrates a connection presentation interface of an exemplary web terminal 120 in accordance with one embodiment of the present invention.
  • the navigation bar 303 located on the left side of the interface and the file statistics column 304 located on the right side of the navigation bar 303 are divided.
  • files that can be synchronously transmitted are schematically classified into "photograph”, “gallery”, “music”, “video”, “document”, “sms", “folder”, “application”, and the like. Project, users can switch between different projects.
  • the number of various files is displayed in the file statistics column 304 according to the type of the file. For example, the exemplary music icon 305a in Figure 3b, and the number of music (39) icons 305b below it.
  • some basic information of the transmitted mobile terminal 110 such as the storage capacity information of the mobile terminal 110 presented at 306 below in the file statistics column 304, may also be presented to facilitate the user managing the mobile terminal 110 through the web terminal 120.
  • the disconnection can be achieved by closing the web interface of the web terminal 120 (e.g., a browser) or by closing either or both of the app.
  • the server 130 may also pass to the mobile terminal 110 and the web terminal. 120 sends a heartbeat signal to verify if the connection is still maintained. For example, when the heartbeat response signal fed back by the mobile terminal 110 or the web terminal 120 is not received for a certain number of times, the server 130 can determine that the mobile terminal 110 or the web terminal 120 has disconnected from the server end 130. The server side 130 can then disconnect the connection between the mobile terminal 110 and the web terminal 120.
  • the server 130 determines that the mobile terminal 110 or the web terminal 120 has disconnected from the server 130, the server 130 sends a command to the web terminal 120, and the web terminal 120 returns to the initial unconnected state, for example, The page state of the QR code.
  • the server side 130 also simultaneously sends a command to the mobile terminal 110 such that the mobile terminal 110 also returns to the initially unconnected state. That is, when the server side 130 detects that any one of the mobile terminal 110 or the web terminal 120 is disconnected, the other party is immediately disconnected at the same time to ensure the security of the information.
  • the server end 120 when the mobile terminal 110 or the web terminal 120 moves When the mobile network mode (for example, GPRS, 3G, 4G, etc.) is connected to the server side 130, the server end 120 can simultaneously detect the mobile network cell condition in which the mobile terminal 110 or the web terminal 120 is located when detecting the heartbeat signal. When the cell connected by any one of the mobile terminal 110 or the web terminal 120 is switched, it can be determined that the mobile terminal 110 or the web terminal 120 has left the other party for a physical distance. In order to ensure the security of file transfer, it may be set to disconnect the connection between the mobile terminal 110 and the web terminal 120 after leaving a certain distance.
  • the mobile network mode for example, GPRS, 3G, 4G, etc.
  • FIG. 4 shows a flow diagram of a method of synchronously manipulating a web terminal 120 by the mobile terminal 110 and synchronizing display between the web terminal 120 and the mobile terminal 110. As shown in Figure 4,
  • Figures 5a and 5b show two exemplary ways.
  • Fig. 5a shows a schematic diagram of a preview picture format file
  • Fig. 5b shows a schematic diagram of a preview document format file. The user can select the file to preview by clicking on the screen.
  • an instruction to request preview is issued to the server by the mobile terminal 110.
  • this operational request can be triggered by clicking on any button on the mobile terminal 110. For example, click on the "Preview” button at the bottom of the screen in Figure 5b.
  • the file to be previewed is displayed at the mobile terminal 110.
  • the previewed file when the previewed file only needs to be displayed on a single screen (for example, a picture file), the file can be directly presented; when the previewed file needs to be displayed in multiple screens (for example, a document file of multiple pages), The first page of the file can be displayed.
  • Steps 410a and 410b may be performed simultaneously, that is, by the user issuing an instruction to preview the request, and simultaneously triggering step 410a and step 410b.
  • step 410a and step 410b may also be performed in sequence, and the order of the steps may be arbitrarily changed.
  • the server 130 forwards the request for the preview to the web terminal 120.
  • the web terminal 120 receives the request, triggering the generation of a long connection address, while the web terminal 120 opens the web service for receiving the transferred file.
  • the long connection is a http long connection.
  • web terminal 120 transmits the long connection address to mobile terminal 110.
  • the long connection address can be performed through the server end 130. After being transferred, it is sent to the mobile terminal 110.
  • the mobile terminal 110 transmits the current preview file to the web terminal 120 based on the received long connection address.
  • the transmission of the preview file may also be performed by the relay of the server side 130.
  • the mobile terminal 110 may first transmit the preview file to the storage area opened by the server end 130, and then the server end 130 forwards the preview file to the web terminal 120.
  • the server 130 may also transfer the storage address of the preview file to the web terminal 120, and the web terminal 120 accesses the address to download the desired preview file.
  • web terminal 120 caches the received preview file and presents the file in web terminal 120. At this time, synchronous display between the web terminal 120 and the mobile terminal 110 is achieved.
  • Figure 5c shows a schematic diagram of a display document file of an exemplary web terminal 120.
  • the cached file when the previewed file only needs to be displayed on a single screen, the cached file can be directly presented; when the previewed file needs to be displayed in multiple screens (for example, a multi-page document file), the file can be displayed. Home page.
  • the preview file is manipulated at the mobile terminal 110.
  • the manipulation instructions include, but are not limited to, zooming in, zooming out, turning pages, scrolling, selecting a particular paragraph, and the like.
  • the manipulation command is sent to the web terminal 120.
  • the manipulation instruction may also be transmitted to the web terminal 120 after being relayed by the server 130.
  • the web terminal 120 receives the instruction, parses it and converts it into an instruction to perform the same operation on the currently rendered file in the cache, and performs the same operation on the file. In this way, synchronous operation of the mobile terminal 110 and the web terminal 120 is realized, and the user can implement synchronous control and synchronous display of the web terminal 120 only by manipulating the mobile terminal 110.
  • the web terminal 120 may store the received instructions in a "first in, first out" queue manner, and then follow the order of receiving instructions. The corresponding instruction is taken out from the queue for parsing and conversion.
  • the new one is The preview file is sent to web terminal 120 and step 435 is presented to present a new preview file at web terminal 120.
  • the user's manipulation command issued by the mobile terminal 110 is a page turning operation on the picture file
  • the next picture will be displayed at the mobile terminal 110.
  • the web terminal 120 may clear the files in the local cache.
  • the user can well experience the effect of manipulating the web terminal 120 through the mobile terminal 110 by the method of synchronously manipulating instructions of the present invention.
  • the mobile terminal 110 By establishing a long connection between the mobile terminal 110 and the web terminal 120, continuous transmission of instructions and preview files can be ensured so that manipulation commands issued by the user in the mobile terminal 110 can be immediately synchronized to the web terminal.
  • caching the preview file in advance it is also possible to avoid delays and jams caused by transferring files during the manipulation process, thereby achieving a seamless and good synchronization experience.
  • a user can implement a reliable, high-speed, stable, user interaction experience with better synchronization control and synchronous display between the mobile electronic device and the web terminal having the web interface.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

Provided in the present invention is a method for implementing synchronous preview display between a mobile terminal and a web terminal, the mobile terminal and the web terminal respectively communicating via a network with a cloud-based server, the method comprising the following steps: a) selecting the files for preview display by means of the mobile terminal; b) sending a preview request command to a server by means of the mobile terminal, and displaying the files to be previewed on the mobile terminal; c) the server forwarding the preview request to the web terminal; d) the web terminal receiving the request, triggering the generation of a long connection address, and activating a web service to receive a transferred file; e) the web terminal sending the long connection address to the mobile terminal; f) the mobile terminal sending the current preview file to the web terminal; g) the web terminal caching and presenting the file; h) on the mobile terminal, receiving a control command for the preview file; and i) sending the control command to the web terminal, parsing and converting into a command to implement the same operation on the file from the cache currently being displayed.

Description

用于在移动设备和web终端之间进行同步预览显示的方法Method for synchronous preview display between mobile device and web terminal 技术领域Technical field
本发明总体上涉及移动通信领域,特别地,涉及一种在移动终端和web终端之间进行互连以及通过移动终端同步操控并在web终端上显示的方法和系统。The present invention generally relates to the field of mobile communications, and more particularly to a method and system for interconnecting between a mobile terminal and a web terminal and for simultaneous manipulation by the mobile terminal and display on the web terminal.
背景技术Background technique
目前,例如移动电话、平板电脑、移动媒体播放器的移动电子设备已经在人们日常生活中越来越流行使用。移动设备已经有逐渐取代传统个人电脑的趋势,成为个人信息的存储中心。然而,个人电脑在很多应用领域中,凭借其大幅的显示屏幕、便利的输入方式以及更为多样的软件和操作系统仍然有其不可替代的作用。因此人们在日常生活中,经常需要在移动设备和个人电脑之间进行信息的传递、同步显示和交互。Currently, mobile electronic devices such as mobile phones, tablets, and mobile media players have become increasingly popular in people's daily lives. Mobile devices have gradually replaced traditional PCs and become the storage center for personal information. However, personal computers still have an irreplaceable role in many applications, with their large display screens, convenient input methods, and a wider variety of software and operating systems. Therefore, in daily life, people often need to transfer information, synchronize display and interaction between mobile devices and personal computers.
传统的在移动电子设备和个人电脑之间操控和同步显示的方法例如使用数据线、视频/音频线等将个人电脑与电子设备连接,并通过运行特定的软件来实现。但这些方法是非常麻烦的,用户的体验十分不好。例如,数据线的方式使得用户需要额外准备硬件,为用户带来不便。另外,很多时候需要额外安装驱动程序才能实现除了传输文件之外的其他更为复杂的功能。数据线的连接还会对设备的硬件接口有特殊的要求,例如常用的HDMI接口,只在比较新的电脑设备上才进行配置,稍微陈旧的型号均没有配置,使得连接无法实现。Conventional methods of manipulating and synchronizing display between a mobile electronic device and a personal computer, such as using a data line, a video/audio line, etc., connect the personal computer to the electronic device and are implemented by running specific software. But these methods are very cumbersome and the user experience is very bad. For example, the way of the data line makes the user need to prepare additional hardware, which is inconvenient for the user. In addition, many additional drivers are required to implement more complex functions than transferring files. The connection of the data cable also has special requirements for the hardware interface of the device. For example, the commonly used HDMI interface is only configured on a relatively new computer device, and the slightly old model is not configured, so that the connection cannot be realized.
此外,WiFi技术可以提供移动电子设备和个人电脑之间的同步操控和显示。然而,在以往常规的用WiFi技术实现同步显示的方案中,通常需要接入点(AP)。接入点用作在移动电子设备和个人电脑之间的无线网络中继,个人电脑和移动设备必须同时连接到该无线网络中继上才能实现互连。在由AP为主导形成的网络中,如果断开AP,那会破坏整个网络,同时也会破坏移动设备和个人电脑之间的连接。In addition, WiFi technology provides simultaneous control and display between mobile electronic devices and personal computers. However, in the conventional conventional scheme of implementing synchronous display using WiFi technology, an access point (AP) is usually required. The access point acts as a wireless network relay between the mobile electronic device and the personal computer, and the personal computer and the mobile device must be connected to the wireless network relay at the same time to achieve interconnection. In a network dominated by APs, if the AP is disconnected, it will destroy the entire network and also damage the connection between the mobile device and the personal computer.
蓝牙技术等短距离近场通信技术现在也已经越来越多被用来实现在移动电子设备之间传输数据从而实现同步的操控和显示。然而,蓝牙技术 通常无法提供高速的数据传输速度。另外,个人电脑通常并不是都配备有蓝牙模块,从而使得双向连接通信无法实现。Short-range near-field communication technologies such as Bluetooth technology are now increasingly being used to transfer data between mobile electronic devices for simultaneous manipulation and display. However, Bluetooth technology High speed data transfer speeds are usually not available. In addition, personal computers are usually not equipped with Bluetooth modules, making bidirectional connection communication impossible.
另外,由于智能手机的多功能性和便携性,用户经常通过智能手机拍摄照片、录制音乐、视频等,而受限于智能手机较小的屏幕,用户时常需要在个人电脑或其他大屏幕显示器上展示或观看手机上的内容,例如手机上存储的照片等。而智能手机由于具备多种输入方式,也可以成为很好的操控终端。因此,如何能够在移动电子设备和个人电脑互连的基础上稳定高速地实现移动终端对个人电脑的操控,以及同步显示,也是本领域亟待解决的一个问题。In addition, due to the versatility and portability of smartphones, users often take photos, record music, videos, etc. through their smartphones, which are limited by the smaller screen of the smartphone, and users often need to be on a personal computer or other large-screen display. Show or watch content on your phone, such as photos stored on your phone. Smartphones can also be a good control terminal because of their multiple input methods. Therefore, how to realize the control of the personal computer to the personal computer and the synchronous display on the basis of the interconnection of the mobile electronic device and the personal computer is also an urgent problem to be solved in the field.
因此,需要一种在移动电子设备和个人电脑之间实现可靠、高速的同步显示方案,从而解决现有技术中的上述问题。Therefore, there is a need for a reliable, high speed synchronous display scheme between a mobile electronic device and a personal computer to solve the above problems in the prior art.
发明内容Summary of the invention
本发明的目的在于提供一种用于在移动设备和web终端之间进行同步预览显示的方法,所述移动终端和web终端通过网络分别与位于云端的服务器端通信连接,所述方法包括以下步骤:a)通过所述移动终端选择要预览显示的文件;b)通过所述移动终端向所述服务器端发送请求预览的指令,在所述移动终端显示要预览的文件;c)所述服务器端向所述web终端转发该预览的请求;d)所述web终端收到该请求,触发生成长连接地址,并开启web服务以用来接收传送的文件;e)所述web终端将该长连接地址发送给移动终端;f)移动终端将当前的预览文件根据所接收到的长连接地址,发送给web终端;g)web终端将所接收到的预览文件进行缓存,并在web终端中呈现该文件;h)在移动终端接收对预览文件的操控指令;i)将该操控指令发送至web终端;j)web终端接收该指令,解析并转化为对当前呈现的缓存中的文件进行相同操作的指令,并对该文件进行相同的操作。An object of the present invention is to provide a method for synchronous preview display between a mobile device and a web terminal, wherein the mobile terminal and the web terminal are respectively connected to a server end located in the cloud through a network, and the method includes the following steps. : a) selecting, by the mobile terminal, a file to be previewed; b) transmitting, by the mobile terminal, an instruction requesting preview to the server, displaying a file to be previewed at the mobile terminal; c) the server side Forwarding the preview request to the web terminal; d) the web terminal receives the request, triggering generation of a long connection address, and opening a web service for receiving the transferred file; e) the web terminal connecting the long connection The address is sent to the mobile terminal; f) the mobile terminal sends the current preview file to the web terminal according to the received long connection address; g) the web terminal caches the received preview file and presents the preview file in the web terminal a file; h) receiving a manipulation instruction to the preview file at the mobile terminal; i) transmitting the manipulation instruction to the web terminal; j) receiving the instruction by the web terminal, parsing and converting into The current cache of documents presented in the same operation instructions, and the file is the same operation.
优选地,所述步骤d中的长连接为http长连接。Preferably, the long connection in the step d is an http long connection.
优选地,所述步骤d中的长连接地址或步骤f中的文件通过服务器端进行中转后发送。Preferably, the long connection address in the step d or the file in the step f is transmitted after being transited by the server.
优选地,当所预览的文件只需单屏显示时,直接呈现该文件;当所预览的文件需要多屏显示时,显示该文件的首页。Preferably, when the previewed file only needs to be displayed on a single screen, the file is directly presented; when the previewed file needs to be displayed in multiple screens, the first page of the file is displayed.
优选地,所述操控指令选自对文件进行放大、缩小、翻页、滚屏、选择特定段落。 Preferably, the manipulation instruction is selected from the steps of enlarging, reducing, turning, scrolling, and selecting a specific paragraph.
优选地,所述步骤b中的发送和显示同时进行或依次进行。Preferably, the transmitting and displaying in the step b are performed simultaneously or sequentially.
优选地,当移动终端发出连续多个操控指令时,web终端将收到的这些指令以先进先出的队列方式进行存储,再按照接收指令的时间顺序从队列中取出相应的指令进行解析转换。Preferably, when the mobile terminal issues a plurality of consecutive manipulation commands, the web terminal stores the received instructions in a first-in, first-out queue manner, and then retrieves corresponding instructions from the queue according to the time sequence of receiving the instructions for parsing and conversion.
优选地,当移动终端发出的操控指令涉及对当前预览文件之外的其他文件进行操控时,返回步骤f,接着执行步骤g。Preferably, when the manipulation instruction issued by the mobile terminal involves manipulating other files than the current preview file, the process returns to step f, and then step g is performed.
优选地,当在移动终端结束所有操控时,web终端清空本地缓存中的文件。Preferably, the web terminal clears the files in the local cache when all manipulations are ended at the mobile terminal.
优选地,在所述步骤a)之前,所述web终端和所述移动终端之间通过下列步骤建立连接:a01)由所述web终端向所述服务器端发出连接请求;a02)所述服务器端向所述web终端发送二维码信息;a03)通过所述移动终端扫描所述二维码信息;a04)响应于所述扫描二维码的操作,所述移动终端和所述web终端分别向所述服务器端发送自身的网络连接状况;a05)所述服务器端获取所述移动终端和所述web终端各自连接到服务器端的网络状况,判断所述移动终端和所述web终端的网络连接是否处于同一局域网下,并针对是否处于同一局域网络将网络状况标志符设置不同的状态;a06)所述服务器端分别向所述移动终端和所述web终端发送连接建立许可,在所述移动终端和所述web终端之间建立连接。Preferably, before the step a), the connection between the web terminal and the mobile terminal is established by the following steps: a01) issuing a connection request by the web terminal to the server end; a02) the server end Transmitting two-dimensional code information to the web terminal; a03) scanning the two-dimensional code information by the mobile terminal; a04) in response to the operation of scanning the two-dimensional code, the mobile terminal and the web terminal respectively The server sends its own network connection status; a05) the server obtains the network status of the mobile terminal and the web terminal respectively connected to the server, and determines whether the network connection between the mobile terminal and the web terminal is Under the same local area network, and setting the network status identifiers to different states according to whether they are in the same local area network; a06) the server end respectively sends a connection establishment permission to the mobile terminal and the web terminal, where the mobile terminal and the mobile terminal Establish a connection between the web terminals.
根据本发明的方法和系统,用户可以在移动电子设备和具有web接口的web终端之间实现可靠、高速、稳定、用户交互体验更好的连接,实现通过移动终端对web终端的良好操控,以及同步预览显示的方案。According to the method and system of the present invention, a user can achieve a reliable, high-speed, stable, user-interactive connection between a mobile electronic device and a web terminal having a web interface, enabling a good control of the web terminal through the mobile terminal, and Synchronize the preview of the displayed scheme.
应当理解,前述大体的描述和后续详尽的描述均为示例性说明和解释,并不应当用作对本发明所要求保护内容的限制。It is to be understood that the foregoing general descriptions
附图说明DRAWINGS
参考随附的附图,本发明更多的目的、功能和优点将通过本发明实施方式的如下描述得以阐明,其中:Further objects, features, and advantages of the present invention will be made apparent by the following description of the embodiments of the invention.
图1a和图1b示意性示出根据本发明的在移动终端和web终端之间借助服务器端进行互连的系统框图。1a and 1b schematically show a system block diagram of interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention.
图2示意性示出了根据本发明的在移动终端和web终端之间借助服务器端进行互连的交互流程图。Fig. 2 schematically shows an interaction flow diagram for interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention.
图3a示意性地示出了根据本发明一个实施例的示例性移动终端 110的连接界面。Figure 3a schematically illustrates an exemplary mobile terminal in accordance with one embodiment of the present invention 110 connection interface.
图3b示意性地示出了根据本发明一个实施例的示例性web终端120的连接呈现界面。FIG. 3b schematically illustrates a connection presentation interface of an exemplary web terminal 120 in accordance with one embodiment of the present invention.
图4示意性地示出了根据本发明在web终端120和移动终端110之间进行同步预览显示和操控的方法流程图。4 is a flow chart diagrammatically showing a method of synchronous preview display and manipulation between web terminal 120 and mobile terminal 110 in accordance with the present invention.
图5a-图5c分别示意性地示出了根据图4的方法在移动终端110和web终端120上的示例性显示。5a-5c schematically illustrate exemplary displays on mobile terminal 110 and web terminal 120, respectively, in accordance with the method of FIG.
具体实施方式detailed description
通过参考示范性实施例,本发明的目的和功能以及用于实现这些目的和功能的方法将得以阐明。然而,本发明并不受限于以下所公开的示范性实施例;可以通过不同形式来对其加以实现。说明书的实质仅仅是帮助相关领域技术人员综合理解本发明的具体细节。Objects and functions of the present invention, and methods for achieving the objects and functions will be clarified by referring to the exemplary embodiments. However, the invention is not limited to the exemplary embodiments disclosed below; it can be implemented in various forms. The essence of the description is merely to assist those skilled in the relevant art to understand the specific details of the invention.
在下文中,将参考附图描述本发明的实施例。在附图中,相同的附图标记代表相同或类似的部件,或者相同或类似的步骤。Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the figures, the same reference numerals are used to refer to the same or similar parts, or the same or similar steps.
系统概述System Overview
图1a和图1b示意性示出根据本发明的在移动终端和web终端之间借助服务器端进行互连的系统框图。其中图1a示意性示出根据本发明的在移动终端和web终端之间借助服务器端进行互连的系统框图,图1b示出了包含服务器端的具体架构和组成的系统框图。如图1a所示,系统100包括至少一个移动终端110、至少一个web终端120,以及用于实现在移动终端110和web终端120之间进行互连以实现交互式通信的位于远程的服务器端130。移动终端110和web终端120分别通过第一网络140与服务器端130连接,移动终端110和web终端120彼此之间通过第二网络150连接。出于示意性的目的,图1仅示出了一个移动终端110和一个web终端120。然而,可以理解的是在其他实施方式中,系统100可以包括更多的移动终端110和/或更多的web终端120。在根据本发明的一个实施方式中,当系统100具有多个移动终端110和多个web终端120时,每个移动终端110都有唯一的web终端120与其唯一相对应。1a and 1b schematically show a system block diagram of interconnection between a mobile terminal and a web terminal by means of a server side in accordance with the present invention. 1a schematically shows a system block diagram for interconnection between a mobile terminal and a web terminal by means of a server side according to the present invention, and FIG. 1b shows a system block diagram including a specific architecture and composition of the server side. As shown in FIG. 1a, system 100 includes at least one mobile terminal 110, at least one web terminal 120, and a remotely located server side 130 for enabling interconnection between mobile terminal 110 and web terminal 120 for interactive communication. . The mobile terminal 110 and the web terminal 120 are respectively connected to the server side 130 through the first network 140, and the mobile terminal 110 and the web terminal 120 are connected to each other through the second network 150. For illustrative purposes, FIG. 1 shows only one mobile terminal 110 and one web terminal 120. However, it will be appreciated that in other embodiments, system 100 can include more mobile terminals 110 and/or more web terminals 120. In one embodiment in accordance with the present invention, when system 100 has multiple mobile terminals 110 and multiple web terminals 120, each mobile terminal 110 has a unique web terminal 120 that uniquely corresponds to it.
移动终端110和web终端120可分别经过任意类型的第一网络140与服务器端130之间进行双向通信。所述第一网络140例如选自诸如 内联网之类的局域网(“LAN”)和诸如互联网之类的广域网(“WAN”)。第一网络140可被配置为支持利用多种协议设置格式的信息的传输。另外,第一网络140可以是公共网络、专用网络或其组合。第一网络140还可以利用任何一种或多种类型的物理介质来实现,其中包括与多个服务提供商相关联的有线通信路径和无线通信路径。无线通信方式例如WiFi或WLAN、GPRS、蜂窝网络,例如GSM网络、3G网络、LTE网络或CDMA网络。The mobile terminal 110 and the web terminal 120 can communicate bidirectionally with the server side 130 via any type of first network 140, respectively. The first network 140 is selected, for example, from something such as A local area network ("LAN") such as an intranet and a wide area network ("WAN") such as the Internet. The first network 140 can be configured to support the transmission of information using a plurality of protocol setting formats. Additionally, the first network 140 can be a public network, a private network, or a combination thereof. The first network 140 can also be implemented using any one or more types of physical media, including wired communication paths and wireless communication paths associated with multiple service providers. Wireless communication methods such as WiFi or WLAN, GPRS, cellular networks, such as GSM networks, 3G networks, LTE networks, or CDMA networks.
移动终端110和web终端120之间也可以之间建立直接的网络连接,通过第二网络150进行双向通信。所述第二网络150采用的协议方式例如是http轮询结合WebSocket直连的方式。A direct network connection can also be established between the mobile terminal 110 and the web terminal 120, and two-way communication is performed through the second network 150. The protocol mode adopted by the second network 150 is, for example, a manner in which http polling is combined with WebSocket direct connection.
移动终端110可以是智能电话、个人数字助理(PDA)、平板电脑、多功能移动终端或者包括计算功能和数据通信能力的任何其他移动设备。移动终端110包括app接口应用111(如图1b所示)及其包含的预览模块112。App应用111例如定制应用(app),用于与具备web能力的应用进行双向通信。The mobile terminal 110 can be a smart phone, a personal digital assistant (PDA), a tablet, a multi-function mobile terminal, or any other mobile device that includes computing functionality and data communication capabilities. The mobile terminal 110 includes an app interface application 111 (shown in FIG. 1b) and a preview module 112 included therein. The App application 111 is, for example, a custom application (app) for two-way communication with web-enabled applications.
预览模块112用于接收用户在移动终端110上所发出的特定操作指令,并发送至web终端120,以便对web终端120进行同步操作。预览模块112还可以用于触发移动终端110与web终端120的同步显示。具体的同步操控和同步显示的方法步骤将在下文描述本发明的方法流程时详细介绍。The preview module 112 is configured to receive a specific operation instruction issued by the user on the mobile terminal 110 and send it to the web terminal 120 to perform a synchronization operation on the web terminal 120. The preview module 112 can also be used to trigger a synchronized display of the mobile terminal 110 and the web terminal 120. The specific method steps of synchronous manipulation and synchronous display will be described in detail below when describing the method flow of the present invention.
移动终端110包括一个或多个计算设备,该一个或多个计算设备可以从用户接收输入的操控指令,并可呈现输出,因此移动终端110还包括I/O接口(输入/输出接口)112,可接收一个或多个输入并呈现输出。例如,输入接口可包括摄像头、触摸板、触摸屏、触屏笔、麦克风中的一个或多个。另外,通过输出接口可呈现输出,以输出用户的控制操作指令或来自其他用户的反馈信息等。输出接口包括显示屏、一个或多个扬声器和触觉接口中的一个或多个。The mobile terminal 110 includes one or more computing devices that can receive input manipulation instructions from a user and can present an output, and thus the mobile terminal 110 further includes an I/O interface (input/output interface) 112, Can receive one or more inputs and present the output. For example, the input interface can include one or more of a camera, a touchpad, a touch screen, a stylus, and a microphone. In addition, an output can be presented through the output interface to output a user's control operation instructions or feedback information from other users, and the like. The output interface includes one or more of a display screen, one or more speakers, and a tactile interface.
web终端120可以是台式计算机、膝上型计算机、笔记本电脑、平板电脑、游戏机、智能电视等任何支持web协议的终端设备。web终端120包括web接口121和缓存122(如图1b所示)。web接口121例如web浏览器。在一些实施例中,相应web终端120包括用于请求、解析、显示、执行网页以及执行包括在网页中的应用的浏览器应用。浏览器应用128可以是允许用户搜索、浏览和/或使用URL(统一资源 定位符)或URI(统一资源标识符)所识别的资源(例如,网页和web服务)的任何应用。“URL”在本文用来意指文档的网络地址或位置。在该情形下,“文档”指可以由web浏览器或其他应用使用的任何格式的任何文档或内容,包括但不限于:字处理文档、电子表格文档、演示文档、绘图、网页、文本、图像、音频、视频等。The web terminal 120 can be any terminal device that supports a web protocol, such as a desktop computer, a laptop computer, a notebook computer, a tablet computer, a game console, a smart TV, and the like. The web terminal 120 includes a web interface 121 and a cache 122 (as shown in Figure 1b). The web interface 121 is, for example, a web browser. In some embodiments, the respective web terminal 120 includes a browser application for requesting, parsing, displaying, executing a web page, and executing an application included in the web page. The browser application 128 can be a user that allows users to search, browse, and/or use URLs (uniform resources) Any application of a resource (eg, a web page and a web service) identified by a locator or URI (Uniform Resource Identifier). "URL" is used herein to mean the network address or location of a document. In this context, "document" refers to any document or content in any format that can be used by a web browser or other application, including but not limited to: word processing documents, spreadsheet documents, presentation documents, drawings, web pages, text, images. , audio, video, etc.
缓存122用于缓存从移动终端110发来的文件,以便用于实现移动终端110对web终端120的同步操控和同步显示功能。当显示或操控结束后,缓存122可以自动清空其中缓存的文件。The cache 122 is used to cache files sent from the mobile terminal 110 for use in implementing the synchronous manipulation and synchronous display functions of the mobile terminal 110 to the web terminal 120. When the display or manipulation ends, the cache 122 can automatically clear the files cached therein.
图1b示出了包含服务器端的具体架构和组成的系统框图。如图1b所示,服务器端130包括二维码模块131、网络接入模块132、网络状况标志符133和地址生成模块134。Figure 1b shows a system block diagram containing the specific architecture and composition of the server side. As shown in FIG. 1b, the server side 130 includes a two-dimensional code module 131, a network access module 132, a network status identifier 133, and an address generation module 134.
二维码模块131用于生成供移动终端110扫描的二维码。根据本发明的一个实施例,二维码包含了通用唯一识别码(UUID),UUID是唯一标识码。移动终端110通过扫描该二维码表应的UUID连接到服务器端130以请求获取唯一的连接地址和会话(session)。The two-dimensional code module 131 is configured to generate a two-dimensional code for scanning by the mobile terminal 110. According to one embodiment of the invention, the two-dimensional code contains a Universally Unique Identifier (UUID), which is a unique identification code. The mobile terminal 110 connects to the server side 130 by scanning the UUID of the two-dimensional code table to request acquisition of a unique connection address and session.
网络接入模块132用于相应移动终端110扫描二维码成功后判断移动终端110和web终端120各自的网络连接状况,以针对不同的网络连接状况进行移动终端110和web终端120之间的适配性连接,从而建立移动终端110和web终端120之间的连接。优选地,所建立的连接为http长连接。该连接可以连续发送多个数据包,在连接保持期间,如果没有数据包发送,为了确保两个终端保持连接,会在规定间隔时间内发送检测数据包(即心跳包),移动终端110和web终端120之间需要发送检测数据包以维持此连接。The network access module 132 is configured to determine the network connection status of the mobile terminal 110 and the web terminal 120 after the corresponding mobile terminal 110 scans the two-dimensional code, so as to adapt the mobile terminal 110 and the web terminal 120 according to different network connection conditions. The connections are made to establish a connection between the mobile terminal 110 and the web terminal 120. Preferably, the established connection is an http long connection. The connection can continuously send multiple data packets. If there is no data packet transmission during the connection hold period, in order to ensure that the two terminals remain connected, the detection data packet (ie, heartbeat packet) is sent within a predetermined interval, the mobile terminal 110 and the web. A detection packet needs to be sent between the terminals 120 to maintain the connection.
具体地,网络接入模块132获取移动终端110和web终端120各自连接到服务器端130的网络状态,判断移动终端110和web终端120的网络连接是否处于同一网络下。根据本发明的同一网络是指在同一个路由器下同一网段能直接连接,而不需要经过外网。Specifically, the network access module 132 obtains the network status that the mobile terminal 110 and the web terminal 120 are respectively connected to the server end 130, and determines whether the network connection of the mobile terminal 110 and the web terminal 120 are under the same network. The same network according to the present invention means that the same network segment can be directly connected under the same router without going through the external network.
并针对是否处于同一局域网络将网络状况标志符133设置不同的状态。例如,若处于同一网络内,则在网络状况标志符133中设置一标识,例如数字1;若不处于同一网络,则不在网络状况标志符133中设置标识,或者设置另一不同的标识,例如数字0。The network status indicator 133 is set to a different state depending on whether it is in the same local area network. For example, if it is in the same network, an identifier, such as the number 1, is set in the network status indicator 133; if not in the same network, the identifier is not set in the network status indicator 133, or another different identifier is set, for example The number is 0.
根据本发明的一个实施例,网络接入模块132会定期地获取移动终端110和web终端120各自连接到服务器的网络状态,以判断移动终 端110和web终端120的网络连接是否处于同一局域网下的状态是否发生变化,并针对变化了的网络状态更新网络状况标志符133。所述定期获取的频率例如可以是每30秒一次。该定期发送的信号也被称为“心跳信号”,该信号还可以用来检测移动终端110和web终端120是否仍连接到服务器端130。例如当未接收到移动终端110或web终端120反馈的心跳响应信号超过一定的次数,服务器端130即可判断移动终端110或web终端120已经断开与服务器端130的连接。According to an embodiment of the present invention, the network access module 132 periodically acquires the network status of each of the mobile terminal 110 and the web terminal 120 connected to the server to determine the mobile terminal. Whether the network connection between the terminal 110 and the web terminal 120 is in the same state under the same local area network changes, and the network status indicator 133 is updated for the changed network status. The frequency of the periodic acquisition may be, for example, once every 30 seconds. The periodically transmitted signal is also referred to as a "heartbeat signal" and can also be used to detect whether the mobile terminal 110 and the web terminal 120 are still connected to the server side 130. For example, when the heartbeat response signal fed back by the mobile terminal 110 or the web terminal 120 is not received for a certain number of times, the server 130 can determine that the mobile terminal 110 or the web terminal 120 has disconnected from the server end 130.
网络状况标志符133用于存储移动终端110和web终端120之间由于不同的网络连接状况而产生适配性连接的标识。例如,移动终端110和web终端120处于同一网络内,网络状况标志符133中设置一标识;若不处于同一网络,则设置另一不同的标识。The network status indicator 133 is used to store an identification of the adaptive connection between the mobile terminal 110 and the web terminal 120 due to different network connection conditions. For example, the mobile terminal 110 and the web terminal 120 are in the same network, and an identifier is set in the network status identifier 133; if not in the same network, another different identifier is set.
地址生成模块134,用于生成需要在移动终端110和web终端120之间传送的文件地址。当移动终端110和web终端120之间根据本发明的方法建立了连接之后,用户可以选择通过移动终端110上传文件至Web终端120,或者从Web终端120下载文件到移动终端110上。当用户发出此类移动文件的请求时,地址生成模块134为所传送的文件生成基于网络的地址,例如URL,传送给需要下载文件的移动终端110或web终端120,移动终端110和web终端120只需访问该地址即可下载到该文件,从而实现文件的传送。The address generation module 134 is configured to generate a file address that needs to be transferred between the mobile terminal 110 and the web terminal 120. After the connection is established between the mobile terminal 110 and the web terminal 120 in accordance with the method of the present invention, the user may select to upload a file to the web terminal 120 via the mobile terminal 110 or download the file from the web terminal 120 to the mobile terminal 110. When the user issues such a request to move the file, the address generation module 134 generates a network-based address, such as a URL, for the transmitted file, to the mobile terminal 110 or web terminal 120 that needs to download the file, the mobile terminal 110 and the web terminal 120. Simply access the address to download the file to transfer the file.
交互方式interactive mode
图2示出了用户通过移动终端110借助服务器端130与web终端120进行交互连接的方法流程图。如图2所示,2 shows a flow chart of a method for a user to interact with the web terminal 120 via the server terminal 130 via the mobile terminal 110. as shown in picture 2,
在步骤205,用户通过web终端120向服务器端130发出连接请求。具体地,用户可以通过启动web终端120上的浏览器,并在浏览器地址栏中输入www.****.cc的地址信息来发送连接请求。At step 205, the user sends a connection request to the server side 130 via the web terminal 120. Specifically, the user can send a connection request by launching a browser on the web terminal 120 and entering address information of www.****.cc in the browser address bar.
接着,在步骤210,服务器端130会应web终端120发出的连接请求发送二维码信息给web终端120,并在步骤220中在web终端120上呈现该二维码信息。所述二维码信息包含了通用唯一识别码(UUID),UUID是唯一标识码。移动终端110通过扫描该二维码表应的UUID连接到服务器端130以请求获取唯一的连接地址和会话(session)。Next, in step 210, the server 130 sends the QR code information to the web terminal 120 in response to the connection request sent by the web terminal 120, and presents the two-dimensional code information on the web terminal 120 in step 220. The two-dimensional code information includes a universal unique identification code (UUID), and the UUID is a unique identification code. The mobile terminal 110 connects to the server side 130 by scanning the UUID of the two-dimensional code table to request acquisition of a unique connection address and session.
接下来,在步骤225,用户通过移动终端110扫描web终端120 上的二维码信息。例如,通过移动终端110上带有的摄像头进行扫描。具体地,用户启动移动终端110上的app软件,app软件会提示用户扫描二维码从而实现连接。Next, at step 225, the user scans the web terminal 120 through the mobile terminal 110. QR code information on. For example, scanning is performed by a camera carried on the mobile terminal 110. Specifically, the user activates the app software on the mobile terminal 110, and the app software prompts the user to scan the two-dimensional code to implement the connection.
接着,响应于用户扫描二维码的操作,移动终端110和web终端120分别在步骤230a和步骤230b向服务器端发起连接请求,并将自身的网络连接状况发送给服务器端130。具体的,所述网络连接状况为通过何种网络连接至服务器端。Next, in response to the user's operation of scanning the two-dimensional code, the mobile terminal 110 and the web terminal 120 initiate a connection request to the server side in steps 230a and 230b, respectively, and transmit their own network connection status to the server side 130. Specifically, the network connection status is a network connection to the server end.
在步骤235,服务器端130通过获取的移动终端110和web终端120各自连接到服务器的网络状况,判断移动终端110和web终端120的网络连接是否处于同一局域网下,并针对是否处于同一局域网络将网络状况标志符设置不同的状态。例如,若处于同一网络内,则在网络状况标志符133中设置一标识,例如数字1;若不处于同一网络,则不在网络状况标志符133中设置标识,或者设置另一不同的标识,例如数字0。In step 235, the server side 130 determines whether the network connection of the mobile terminal 110 and the web terminal 120 is under the same local area network by acquiring the network status of the mobile terminal 110 and the web terminal 120 respectively connected to the server, and whether the network connection is in the same local area network. The network status indicator sets a different status. For example, if it is in the same network, an identifier, such as the number 1, is set in the network status indicator 133; if not in the same network, the identifier is not set in the network status indicator 133, or another different identifier is set, for example The number is 0.
接着,服务器端130分别在步骤240a和步骤240b向移动终端110和web终端120发送连接建立许可,从而在移动终端110和web终端120之间建立连接。优选地,建立http长连接。Next, the server side 130 transmits a connection establishment permission to the mobile terminal 110 and the web terminal 120 in steps 240a and 240b, respectively, thereby establishing a connection between the mobile terminal 110 and the web terminal 120. Preferably, a http long connection is established.
接着,在步骤245,在移动终端110呈现连接后的界面。图3a示意性地示出了根据本发明一个实施例的示例性移动终端110的连接界面。如图3a所示,移动终端110的呈现界面中,分为位于界面顶部的项目栏301和位于项目栏301下方的文件示例栏302。在项目栏301中,将可以同步传输的文件示意性地分为“照片”、“图库”、“音乐”、“视频”、“文档”等项目,用户可以在不同项目之间进行切换。本领域技术人员可以理解的是,上述项目仅仅是示例性的,可以根据不同需求增加或减少新的项目。在每个选中的项目下,会按照时间、文件大小等不同的分类排序方式对属于该项目的文件进行展示,优选以缩略图、文件名、文件图标等方式进行展示。Next, at step 245, the connected interface is presented at the mobile terminal 110. FIG. 3a schematically illustrates a connection interface of an exemplary mobile terminal 110 in accordance with one embodiment of the present invention. As shown in FIG. 3a, the presentation interface of the mobile terminal 110 is divided into an item column 301 located at the top of the interface and a file example column 302 located below the item column 301. In the item column 301, files that can be synchronously transferred are schematically classified into items such as "photograph", "gallery", "music", "video", "document", and the like, and the user can switch between different items. Those skilled in the art can understand that the above items are merely exemplary, and new items can be added or reduced according to different needs. Under each selected item, the files belonging to the item will be displayed according to different sorting methods such as time and file size, preferably by thumbnail, file name, file icon, and the like.
根据本发明的一个实施例,在步骤245之后还可以进一步显示更多的移动终端110和web终端120之间的同步信息。如图2所示,在步骤250,将移动终端110要进行同步传送的文件的统计信息发送至服务器端130,再在步骤255中经服务器端130将这些信息转发至web终端120。优选地,所述同步统计信息包括要进行同步连接传送的文件数目、文件种类、每个种类各自的文件数目。还可以包括移动终端110的 一些基本信息,如操作系统型号、手机用户基本信息、版本型号等等。According to an embodiment of the present invention, more synchronization information between the mobile terminal 110 and the web terminal 120 may be further displayed after step 245. As shown in FIG. 2, in step 250, the statistical information of the file to be synchronously transmitted by the mobile terminal 110 is transmitted to the server side 130, and then the information is forwarded to the web terminal 120 via the server side 130 in step 255. Preferably, the synchronization statistics information includes the number of files to be transferred by the synchronous connection, the file type, and the number of files of each category. Can also include the mobile terminal 110 Some basic information, such as operating system model, basic information of mobile phone users, version models, and so on.
接着在步骤260,在web终端120呈现连接后的界面,并同时呈现经服务器端130转发的同步统计信息。图3b示意性地示出了根据本发明一个实施例的示例性web终端120的连接呈现界面。如图3b所示,在web终端120的呈现界面中,分为位于界面左侧的导航栏303和位于导航栏303右侧的文件统计栏304。在导航栏303中,将可以同步传输的文件示意性地分为“照片”、“图库”、“音乐”、“视频”、“文档”、“短信”、“文件夹”、“应用”等项目,用户可以在不同项目之间进行切换。还可以增加“主页”项目以浏览总体的文件统计信息。本领域技术人员可以理解的是,上述项目仅仅是示例性的,可以根据不同需求增加或减少新的项目。在“主页”项目下,在文件统计栏304中会按照文件的类型展示各种文件的数量。例如图3b中示例性的音乐图标305a,以及其下方的音乐数量(39)图标305b。另外,还可以呈现所传送的移动终端110的一些基本信息,例如在文件统计栏304中下方的306处呈现的移动终端110的存储容量信息,以便于用户通过web终端120管理移动终端110。Next, at step 260, the connected interface is presented at the web terminal 120, and the synchronization statistics forwarded by the server 130 are simultaneously presented. FIG. 3b schematically illustrates a connection presentation interface of an exemplary web terminal 120 in accordance with one embodiment of the present invention. As shown in FIG. 3b, in the presentation interface of the web terminal 120, the navigation bar 303 located on the left side of the interface and the file statistics column 304 located on the right side of the navigation bar 303 are divided. In the navigation bar 303, files that can be synchronously transmitted are schematically classified into "photograph", "gallery", "music", "video", "document", "sms", "folder", "application", and the like. Project, users can switch between different projects. You can also add a Home page item to view overall file statistics. Those skilled in the art can understand that the above items are merely exemplary, and new items can be added or reduced according to different needs. Under the "Home" item, the number of various files is displayed in the file statistics column 304 according to the type of the file. For example, the exemplary music icon 305a in Figure 3b, and the number of music (39) icons 305b below it. In addition, some basic information of the transmitted mobile terminal 110, such as the storage capacity information of the mobile terminal 110 presented at 306 below in the file statistics column 304, may also be presented to facilitate the user managing the mobile terminal 110 through the web terminal 120.
当用户需要将web终端120和移动终端110断开连接时,可以通过关闭web终端120的web接口(例如浏览器)或者关闭app应用任意一者或二者来实现断开。When the user needs to disconnect the web terminal 120 and the mobile terminal 110, the disconnection can be achieved by closing the web interface of the web terminal 120 (e.g., a browser) or by closing either or both of the app.
根据本发明的另一实施例,当用户未主动断开连接时,或者用户断开移动终端110或web终端120任意一者的网络连接时,服务器端130也可以通过向移动终端110和web终端120发送心跳信号来检验是否仍然保持连接。例如,当未接收到移动终端110或web终端120反馈的心跳响应信号超过一定的次数,服务器端130即可判断移动终端110或web终端120已经断开与服务器端130的连接。服务器端130于是可以断开移动终端110和web终端120之间的连接。具体地,当服务器端130判断出移动终端110或web终端120已经断开与服务器端130的连接后,服务器端130向web终端120发送命令,web终端120返回到初始未连接的状态,例如,呈现二维码的页面状态。服务器端130同时还向移动终端110发送命令,使得移动终端110也返回至初始未连接的状态。也即,当服务器端130检测到移动终端110或web终端120其中任意一者断开连接时,会立即同时断开另一者,以确保信息的安全。According to another embodiment of the present invention, when the user does not actively disconnect, or the user disconnects the network connection of any of the mobile terminal 110 or the web terminal 120, the server 130 may also pass to the mobile terminal 110 and the web terminal. 120 sends a heartbeat signal to verify if the connection is still maintained. For example, when the heartbeat response signal fed back by the mobile terminal 110 or the web terminal 120 is not received for a certain number of times, the server 130 can determine that the mobile terminal 110 or the web terminal 120 has disconnected from the server end 130. The server side 130 can then disconnect the connection between the mobile terminal 110 and the web terminal 120. Specifically, when the server 130 determines that the mobile terminal 110 or the web terminal 120 has disconnected from the server 130, the server 130 sends a command to the web terminal 120, and the web terminal 120 returns to the initial unconnected state, for example, The page state of the QR code. The server side 130 also simultaneously sends a command to the mobile terminal 110 such that the mobile terminal 110 also returns to the initially unconnected state. That is, when the server side 130 detects that any one of the mobile terminal 110 or the web terminal 120 is disconnected, the other party is immediately disconnected at the same time to ensure the security of the information.
根据本发明的一个实施例,当移动终端110或web终端120以移 动网络方式(例如GPRS、3G、4G等)连接到服务器端130时,服务器端120可以在检测心跳信号时,同时检测移动终端110或web终端120所处的移动网络小区状况。当移动终端110或web终端120其中任意一者所连接的小区发生切换时,可以判断出移动终端110或web终端120已经离开另一者一段物理距离。为了确保文件传送的安全性,可以设定在移动终端110和web终端120两者离开特定的距离后,断开两者之间的连接。According to an embodiment of the present invention, when the mobile terminal 110 or the web terminal 120 moves When the mobile network mode (for example, GPRS, 3G, 4G, etc.) is connected to the server side 130, the server end 120 can simultaneously detect the mobile network cell condition in which the mobile terminal 110 or the web terminal 120 is located when detecting the heartbeat signal. When the cell connected by any one of the mobile terminal 110 or the web terminal 120 is switched, it can be determined that the mobile terminal 110 or the web terminal 120 has left the other party for a physical distance. In order to ensure the security of file transfer, it may be set to disconnect the connection between the mobile terminal 110 and the web terminal 120 after leaving a certain distance.
同步操控和显示方式Synchronous control and display
图4示出了通过移动终端110同步操控web终端120以及在web终端120和移动终端110之间进行同步显示的方法流程图。如图4所示,4 shows a flow diagram of a method of synchronously manipulating a web terminal 120 by the mobile terminal 110 and synchronizing display between the web terminal 120 and the mobile terminal 110. As shown in Figure 4,
在步骤405,通过移动终端110选择要预览的文件。图5a和图5b显示了两个示例性方式。图5a示出了预览图片格式文件的示意图,图5b示出了预览文档格式文件的示意图。用户可以通过点击屏幕来选中要进行预览的文件。At step 405, the file to be previewed is selected by the mobile terminal 110. Figures 5a and 5b show two exemplary ways. Fig. 5a shows a schematic diagram of a preview picture format file, and Fig. 5b shows a schematic diagram of a preview document format file. The user can select the file to preview by clicking on the screen.
在步骤410a,通过移动终端110向服务器端发出请求预览的指令。根据本发明的一个实施例,可以通过点击移动终端110上的任意按钮来触发这一操作请求。例如,点击图5b中屏幕下方的“预览”按钮。At step 410a, an instruction to request preview is issued to the server by the mobile terminal 110. According to one embodiment of the invention, this operational request can be triggered by clicking on any button on the mobile terminal 110. For example, click on the "Preview" button at the bottom of the screen in Figure 5b.
在步骤410b,在移动终端110显示要预览的文件。根据本发明的一个实施例,当所预览的文件只需单屏显示时(例如图片文件),可以直接呈现该文件;当所预览的文件需要多屏显示时(例如为多页的文档文件),则可以显示该文件的首页。At step 410b, the file to be previewed is displayed at the mobile terminal 110. According to an embodiment of the present invention, when the previewed file only needs to be displayed on a single screen (for example, a picture file), the file can be directly presented; when the previewed file needs to be displayed in multiple screens (for example, a document file of multiple pages), The first page of the file can be displayed.
步骤410a和步骤410b可以同时进行,即通过用户发出预览请求的指令,同时触发步骤410a和步骤410b。或者,步骤410a和步骤410b也可以按顺序进行,步骤的先后顺序可任意调换。 Steps 410a and 410b may be performed simultaneously, that is, by the user issuing an instruction to preview the request, and simultaneously triggering step 410a and step 410b. Alternatively, step 410a and step 410b may also be performed in sequence, and the order of the steps may be arbitrarily changed.
在步骤415,基于用户发出的预览请求,服务器端130向web终端120转发该预览的请求。At step 415, based on the preview request issued by the user, the server 130 forwards the request for the preview to the web terminal 120.
在步骤420,web终端120收到该请求,触发生成长连接地址,同时,web终端120开启web服务以用来接收传送的文件。优选地,该长连接为http长连接。At step 420, the web terminal 120 receives the request, triggering the generation of a long connection address, while the web terminal 120 opens the web service for receiving the transferred file. Preferably, the long connection is a http long connection.
在步骤425,web终端120将该长连接地址发送给移动终端110。根据本发明的一个实施例,该长连接地址可以通过服务器端130进行中 转后发送给移动终端110。At step 425, web terminal 120 transmits the long connection address to mobile terminal 110. According to an embodiment of the present invention, the long connection address can be performed through the server end 130. After being transferred, it is sent to the mobile terminal 110.
在步骤430,移动终端110将当前的预览文件根据所接收到的长连接地址,发送给web终端120。At step 430, the mobile terminal 110 transmits the current preview file to the web terminal 120 based on the received long connection address.
根据本发明的另一实施例,预览文件的传输也可以经过服务器端130的中转来进行。具体地,移动终端110可以将预览文件先传输至服务器端130为其开辟的存储区域中,然后服务器端130再将预览文件转发给web终端120。或者,服务器端130也可以中转预览文件的存储地址给web终端120,web终端120再按照该地址访问去下载所需的预览文件。According to another embodiment of the present invention, the transmission of the preview file may also be performed by the relay of the server side 130. Specifically, the mobile terminal 110 may first transmit the preview file to the storage area opened by the server end 130, and then the server end 130 forwards the preview file to the web terminal 120. Alternatively, the server 130 may also transfer the storage address of the preview file to the web terminal 120, and the web terminal 120 accesses the address to download the desired preview file.
在步骤435,web终端120将所接收到的预览文件进行缓存,并在web终端120中呈现该文件。此时,实现了web终端120与移动终端110之间的同步显示。图5c示出了示例性的web终端120的显示文档文件的示意图。At step 435, web terminal 120 caches the received preview file and presents the file in web terminal 120. At this time, synchronous display between the web terminal 120 and the mobile terminal 110 is achieved. Figure 5c shows a schematic diagram of a display document file of an exemplary web terminal 120.
根据本发明的一个实施例,当所预览的文件只需单屏显示时,可以直接呈现缓存的文件;当所预览的文件需要多屏显示时(例如为多页的文档文件),则可以显示该文件的首页。According to an embodiment of the present invention, when the previewed file only needs to be displayed on a single screen, the cached file can be directly presented; when the previewed file needs to be displayed in multiple screens (for example, a multi-page document file), the file can be displayed. Home page.
接着,在步骤440,在移动终端110对预览文件进行操控。根据本发明的实施例,所述操控指令包括但不限于对文件进行放大、缩小、翻页、滚屏、选择特定段落等。Next, at step 440, the preview file is manipulated at the mobile terminal 110. According to an embodiment of the invention, the manipulation instructions include, but are not limited to, zooming in, zooming out, turning pages, scrolling, selecting a particular paragraph, and the like.
在步骤445,将该操控指令发送至web终端120。根据本发明的一个实施例,该操控指令也可以通过服务器端130进行中转后发送给web终端120。At step 445, the manipulation command is sent to the web terminal 120. According to an embodiment of the present invention, the manipulation instruction may also be transmitted to the web terminal 120 after being relayed by the server 130.
在步骤450,web终端120接收该指令,进行解析并转化为对当前呈现的缓存中的文件进行相同操作的指令,并对该文件进行相同的操作。这样,即实现了移动终端110与web终端120的同步操控,用户可以仅通过操控移动终端110实现了对web终端120的同步操控和同步显示。At step 450, the web terminal 120 receives the instruction, parses it and converts it into an instruction to perform the same operation on the currently rendered file in the cache, and performs the same operation on the file. In this way, synchronous operation of the mobile terminal 110 and the web terminal 120 is realized, and the user can implement synchronous control and synchronous display of the web terminal 120 only by manipulating the mobile terminal 110.
根据本发明的一个实施例,当移动终端110发出连续多个操控指令时,web终端120可以将收到的这些指令以“先进先出”的队列方式进行存储,再按照接收指令的时间顺序从队列中取出相应的指令进行解析转换。According to an embodiment of the present invention, when the mobile terminal 110 issues a plurality of consecutive manipulation commands, the web terminal 120 may store the received instructions in a "first in, first out" queue manner, and then follow the order of receiving instructions. The corresponding instruction is taken out from the queue for parsing and conversion.
根据本发明的另一个实施例,当移动终端110发出的操控指令涉及到对当前预览文件之外的其他文件进行操控时,返回步骤430,将新的 预览文件发送至web终端120,并进行步骤435,在web终端120呈现新的预览文件。例如,当用户在移动终端110发出的操控指令为对图片文件进行翻页操作时,在移动终端110将显示下一张图片。此时,需返回步骤430,将下一张图片发送至web终端120进行预览显示。According to another embodiment of the present invention, when the manipulation instruction issued by the mobile terminal 110 involves manipulating other files than the current preview file, returning to step 430, the new one is The preview file is sent to web terminal 120 and step 435 is presented to present a new preview file at web terminal 120. For example, when the user's manipulation command issued by the mobile terminal 110 is a page turning operation on the picture file, the next picture will be displayed at the mobile terminal 110. At this point, it is necessary to return to step 430 to send the next picture to the web terminal 120 for preview display.
根据本发明的另一个实施例,当用户在移动终端110结束所有操控时,web终端120可以清空本地缓存中的文件。According to another embodiment of the present invention, when the user ends all manipulations at the mobile terminal 110, the web terminal 120 may clear the files in the local cache.
根据图4中描述的方法,通过本发明的同步操控指令的方法,用户可以很好地体验通过移动终端110操控web终端120的效果。通过在移动终端110和web终端120之间建立长连接,可以确保指令和预览文件的连续发送,从而使得用户在移动终端110中发出的操控指令可以立即同步到web终端。另外,通过事先缓存预览文件,也可以避免在操控过程中传输文件所造成的延迟和卡顿,从而实现无缝的良好同步体验。According to the method described in FIG. 4, the user can well experience the effect of manipulating the web terminal 120 through the mobile terminal 110 by the method of synchronously manipulating instructions of the present invention. By establishing a long connection between the mobile terminal 110 and the web terminal 120, continuous transmission of instructions and preview files can be ensured so that manipulation commands issued by the user in the mobile terminal 110 can be immediately synchronized to the web terminal. In addition, by caching the preview file in advance, it is also possible to avoid delays and jams caused by transferring files during the manipulation process, thereby achieving a seamless and good synchronization experience.
根据本发明的方法和系统,用户可以在移动电子设备和具备web接口的web终端之间实现可靠、高速、稳定、用户交互体验更好的同步操控和同步显示的方案。According to the method and system of the present invention, a user can implement a reliable, high-speed, stable, user interaction experience with better synchronization control and synchronous display between the mobile electronic device and the web terminal having the web interface.
结合这里披露的本发明的说明和实践,本发明的其他实施例对于本领域技术人员都是易于想到和理解的。说明和实施例仅被认为是示例性的,本发明的真正范围和主旨均由权利要求所限定。 Other embodiments of the invention will be apparent to those skilled in the <RTIgt; The description and the examples are to be considered as illustrative only, and the true scope and spirit of the invention are defined by the claims.

Claims (10)

  1. 一种用于在移动设备和web终端之间进行同步预览显示的方法,所述移动终端和web终端通过网络分别与位于云端的服务器端通信连接,所述方法包括以下步骤:A method for synchronous preview display between a mobile device and a web terminal, wherein the mobile terminal and the web terminal are respectively connected to a server end located in the cloud through a network, the method comprising the following steps:
    a)通过所述移动终端选择要预览显示的文件;a) selecting, by the mobile terminal, a file to be previewed for display;
    b)通过所述移动终端向所述服务器端发送请求预览的指令,在所述移动终端显示要预览的文件;b) sending, by the mobile terminal, an instruction for requesting preview to the server, and displaying a file to be previewed on the mobile terminal;
    c)所述服务器端向所述web终端转发该预览的请求;c) the server forwards the request for the preview to the web terminal;
    d)所述web终端收到该请求,触发生成长连接地址,并开启web服务以用来接收传送的文件;d) the web terminal receives the request, triggers generation of a long connection address, and opens a web service for receiving the transmitted file;
    e)所述web终端将该长连接地址发送给移动终端;e) the web terminal sends the long connection address to the mobile terminal;
    f)移动终端将当前的预览文件根据所接收到的长连接地址,发送给web终端;f) the mobile terminal sends the current preview file to the web terminal according to the received long connection address;
    g)web终端将所接收到的预览文件进行缓存,并在web终端中呈现该文件;g) the web terminal caches the received preview file and presents the file in the web terminal;
    h)在移动终端接收对预览文件的操控指令;h) receiving a manipulation instruction for the preview file at the mobile terminal;
    i)将该操控指令发送至web终端;i) sending the manipulation command to the web terminal;
    j)web终端接收该指令,解析并转化为对当前呈现的缓存中的文件进行相同操作的指令,并对该文件进行相同的操作。j) The web terminal receives the instruction, parses and converts it into an instruction to perform the same operation on the file in the currently rendered cache, and performs the same operation on the file.
  2. 如权利要求1所述的方法,其中所述步骤d中的长连接为http长连接。The method of claim 1 wherein said long connection in step d is an http long connection.
  3. 如权利要求1所述的方法,其中所述步骤d中的长连接地址或步骤f中的文件通过服务器端进行中转后发送。The method of claim 1, wherein the long connection address in step d or the file in step f is transmitted after being relayed by the server.
  4. 如权利要求1所述的方法,其中当所预览的文件只需单屏显示时,直接呈现该文件;当所预览的文件需要多屏显示时,显示该文件的首页。The method of claim 1, wherein the file is directly presented when the previewed file only needs to be displayed on a single screen; and when the previewed file requires multi-screen display, the first page of the file is displayed.
  5. 如权利要求1所述的方法,其中所述操控指令选自对文件进行放大、缩小、翻页、滚屏、选择特定段落。The method of claim 1 wherein said manipulation command is selected from the group consisting of zooming in, zooming out, turning pages, scrolling, selecting a particular paragraph.
  6. 如权利要求1所述的方法,其中所述步骤b中的发送和显示同时进行或依次进行。The method of claim 1 wherein said transmitting and displaying in step b are performed simultaneously or sequentially.
  7. 如权利要求1所述的方法,其中当移动终端发出连续多个操控 指令时,web终端将收到的这些指令以先进先出的队列方式进行存储,再按照接收指令的时间顺序从队列中取出相应的指令进行解析转换。The method of claim 1 wherein the mobile terminal issues a plurality of consecutive controls When the instruction is executed, the web terminal stores the received instructions in a first-in, first-out queue manner, and then takes out corresponding instructions from the queue according to the time sequence of receiving the instructions for parsing and converting.
  8. 如权利要求1所述的方法,其中当移动终端发出的操控指令涉及对当前预览文件之外的其他文件进行操控时,返回步骤f,接着执行步骤g。The method of claim 1, wherein when the manipulation command issued by the mobile terminal involves manipulation of a file other than the current preview file, the process returns to step f, and then step g is performed.
  9. 如权利要求1所述的方法,其中当在移动终端结束所有操控时,web终端清空本地缓存中的文件。The method of claim 1 wherein the web terminal empties files in the local cache when all manipulations are terminated at the mobile terminal.
  10. 如权利要求1所述的方法,其中在所述步骤a)之前,所述web终端和所述移动终端之间通过下列步骤建立连接:The method of claim 1 wherein prior to said step a), the connection is established between said web terminal and said mobile terminal by the following steps:
    a01)由所述web终端向所述服务器端发出连接请求;A01) issuing, by the web terminal, a connection request to the server end;
    a02)所述服务器端向所述web终端发送二维码信息;A02) the server sends the two-dimensional code information to the web terminal;
    a03)通过所述移动终端扫描所述二维码信息;A03) scanning the two-dimensional code information by using the mobile terminal;
    a04)响应于所述扫描二维码的操作,所述移动终端和所述web终端分别向所述服务器端发送自身的网络连接状况;A04) in response to the operation of scanning the two-dimensional code, the mobile terminal and the web terminal respectively send their own network connection status to the server end;
    a05)所述服务器端获取所述移动终端和所述web终端各自连接到服务器端的网络状况,判断所述移动终端和所述web终端的网络连接是否处于同一局域网下,并针对是否处于同一局域网络将网络状况标志符设置不同的状态;A05) The server obtains a network status that the mobile terminal and the web terminal are respectively connected to the server, and determines whether the network connection between the mobile terminal and the web terminal is under the same local area network, and whether the network connection is in the same local area network. Set the network status indicator to a different state;
    a06)所述服务器端分别向所述移动终端和所述web终端发送连接建立许可,在所述移动终端和所述web终端之间建立连接。 A06) The server side sends a connection establishment permission to the mobile terminal and the web terminal, respectively, and establishes a connection between the mobile terminal and the web terminal.
PCT/CN2014/090425 2014-11-06 2014-11-06 Method for implementing synchronous preview display between mobile terminal and web terminal WO2016070373A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/090425 WO2016070373A1 (en) 2014-11-06 2014-11-06 Method for implementing synchronous preview display between mobile terminal and web terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/090425 WO2016070373A1 (en) 2014-11-06 2014-11-06 Method for implementing synchronous preview display between mobile terminal and web terminal

Publications (1)

Publication Number Publication Date
WO2016070373A1 true WO2016070373A1 (en) 2016-05-12

Family

ID=55908390

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/090425 WO2016070373A1 (en) 2014-11-06 2014-11-06 Method for implementing synchronous preview display between mobile terminal and web terminal

Country Status (1)

Country Link
WO (1) WO2016070373A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017206377A1 (en) * 2016-05-30 2017-12-07 深圳Tcl数字技术有限公司 Method and device for synchronous playback of program
CN107566346A (en) * 2017-08-10 2018-01-09 腾讯科技(深圳)有限公司 Transmission method, device and the storage medium of 3D game datas, electronic installation
CN108256114A (en) * 2018-02-09 2018-07-06 金蝶软件(中国)有限公司 The online method for previewing of document, device, computer equipment and storage medium
CN109951560A (en) * 2019-03-27 2019-06-28 努比亚技术有限公司 Improve method, terminal and the storage medium of application service concurrency and application speed

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101057227A (en) * 2004-10-06 2007-10-17 同步加株式会社 Synchronization system and synchronization program
CN103024588A (en) * 2012-11-15 2013-04-03 长春指南针科技有限公司 Multi-screen interactive system and method
CN103200698A (en) * 2013-04-14 2013-07-10 朱攀 Method and system for network terminal communication establishment
CN103248952A (en) * 2013-05-08 2013-08-14 青岛快乐视界数字传媒有限公司 Multi-screen interaction method for intelligent terminal and intelligent television
CN103491179A (en) * 2013-09-27 2014-01-01 百视通网络电视技术发展有限责任公司 Multi-screen interaction method and system based on Web
CN103516787A (en) * 2013-09-03 2014-01-15 深圳市创维软件有限公司 Method, terminal and system for synchronous display
CN104394200A (en) * 2014-11-06 2015-03-04 北京安奇智联科技有限公司 A method for performing simultaneous preview and display between a mobile device and a web terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101057227A (en) * 2004-10-06 2007-10-17 同步加株式会社 Synchronization system and synchronization program
CN103024588A (en) * 2012-11-15 2013-04-03 长春指南针科技有限公司 Multi-screen interactive system and method
CN103200698A (en) * 2013-04-14 2013-07-10 朱攀 Method and system for network terminal communication establishment
CN103248952A (en) * 2013-05-08 2013-08-14 青岛快乐视界数字传媒有限公司 Multi-screen interaction method for intelligent terminal and intelligent television
CN103516787A (en) * 2013-09-03 2014-01-15 深圳市创维软件有限公司 Method, terminal and system for synchronous display
CN103491179A (en) * 2013-09-27 2014-01-01 百视通网络电视技术发展有限责任公司 Multi-screen interaction method and system based on Web
CN104394200A (en) * 2014-11-06 2015-03-04 北京安奇智联科技有限公司 A method for performing simultaneous preview and display between a mobile device and a web terminal

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017206377A1 (en) * 2016-05-30 2017-12-07 深圳Tcl数字技术有限公司 Method and device for synchronous playback of program
CN107566346A (en) * 2017-08-10 2018-01-09 腾讯科技(深圳)有限公司 Transmission method, device and the storage medium of 3D game datas, electronic installation
CN107566346B (en) * 2017-08-10 2020-08-11 腾讯科技(深圳)有限公司 3D game data transmission method and device, storage medium and electronic device
CN108256114A (en) * 2018-02-09 2018-07-06 金蝶软件(中国)有限公司 The online method for previewing of document, device, computer equipment and storage medium
CN108256114B (en) * 2018-02-09 2021-02-02 金蝶软件(中国)有限公司 Document online preview method and device, computer equipment and storage medium
CN109951560A (en) * 2019-03-27 2019-06-28 努比亚技术有限公司 Improve method, terminal and the storage medium of application service concurrency and application speed
CN109951560B (en) * 2019-03-27 2023-11-14 努比亚技术有限公司 Method, terminal and storage medium for improving concurrency and application speed of application service

Similar Documents

Publication Publication Date Title
US9438697B2 (en) User interface content state synchronization across devices
US11134113B2 (en) User interface content state synchronization across devices
US9231902B2 (en) Method and electronic device for content sharing
CN104394200B (en) The method shown for synchronizing preview between mobile device and web terminals
WO2021027610A1 (en) Communication protocol switching method, apparatus and system
US20140379821A1 (en) Method and system for synchronizing duplicated contents in multiple terminals
US10897435B2 (en) Instant messaging method and system, and electronic apparatus
WO2023070993A1 (en) Display control method, display system, electronic device, and readable storage medium
CN106658103A (en) Method for sharing video stream data, source equipment and electronic equipment
US20240195857A1 (en) User Interface Content State Synchronization Across Devices
CN104320491A (en) Method for synchronous display between mobile device and web terminal
WO2016070373A1 (en) Method for implementing synchronous preview display between mobile terminal and web terminal
WO2017050021A1 (en) File sharing method and device
CN116249975A (en) Display device and file synchronization method
US9326306B2 (en) Interactive remote windows between applications operating within heterogeneous operating systems on mobile and stationary devices
WO2014056427A1 (en) Method and apparatus for displaying multiple images, home network system and mobile terminal
CN104378425B (en) The method of interconnection and synchronous communication information between mobile terminal and web terminal
WO2013016949A1 (en) User interface content state synchronization across devices
WO2016070372A1 (en) Method for implementing synchronous display between mobile terminal and web terminal
WO2016070371A1 (en) Method for mobile terminal and web terminal interconnection and streaming and streaming media playback
JP2012156726A (en) Information processor, information processing method, and program
TWI525530B (en) Method, system and device of synchronously displaying operating information
WO2016070370A1 (en) Method for mobile terminal and web terminal interconnection based on two-dimensional code and network adaptation
WO2016070374A1 (en) Method for interaction and synchronous communication of information between mobile terminal and web terminal
WO2017161651A1 (en) Data transmission method, and first terminal, second terminal and system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14905615

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05/09/2017)

122 Ep: pct application non-entry in european phase

Ref document number: 14905615

Country of ref document: EP

Kind code of ref document: A1