[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2022100304A1 - Method and apparatus for transferring application content across devices, and electronic device - Google Patents

Method and apparatus for transferring application content across devices, and electronic device Download PDF

Info

Publication number
WO2022100304A1
WO2022100304A1 PCT/CN2021/120963 CN2021120963W WO2022100304A1 WO 2022100304 A1 WO2022100304 A1 WO 2022100304A1 CN 2021120963 W CN2021120963 W CN 2021120963W WO 2022100304 A1 WO2022100304 A1 WO 2022100304A1
Authority
WO
WIPO (PCT)
Prior art keywords
application
target
identification information
transfer
information
Prior art date
Application number
PCT/CN2021/120963
Other languages
French (fr)
Chinese (zh)
Inventor
杨俊拯
毕浩
何�轩
谭柯
钟卫东
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2022100304A1 publication Critical patent/WO2022100304A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/764Media network packet handling at the destination 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W28/00Network traffic management; Network resource management
    • H04W28/02Traffic management, e.g. flow control or congestion control
    • H04W28/10Flow control between communication endpoints

Definitions

  • the present application relates to the field of computer technologies, and in particular, to a method and device for transferring application content across devices, and an electronic device.
  • users may have multiple devices at the same time, and the devices may have various forms, such as mobile phones, computers, tablets, TVs, watches, etc., and different devices may be equipped with different operating systems, software and hardware architectures, etc.
  • a computer can be equipped with a system such as Windows or Mac
  • a mobile phone can be equipped with a system such as Android or IOS.
  • the application streaming technology is a technology that transmits the content (such as picture, text or audio, etc.) of an application currently running on one or more devices to another or more devices so that the content of the application can be run. Therefore, there are still some problems that need to be solved on how to transfer the application content across the devices through the application transfer technology, so as to realize the content of the application running on the different devices or systems.
  • Embodiments of the present application provide a method, apparatus, and electronic device for cross-device flow of application content, so as to determine different application flow strategies according to different application types of target applications to realize cross-device flow of different application content, thereby ensuring application content Diversity of flow across devices, and improve the efficiency and experience of application flow.
  • an embodiment of the present application provides a method for cross-device streaming of application content, which is applied to a streaming source device, and the method includes:
  • the content of the target application is transferred to the transfer target device according to the application transfer policy.
  • an embodiment of the present application provides a method for cross-device streaming of application content, which is applied to a first streaming target device, and the method includes:
  • the content of the target application is transferred to the second transfer target device according to the application transfer policy.
  • an embodiment of the present application provides an apparatus for cross-device streaming of application content, which is applied to a streaming source device; the device includes:
  • an application information module used to obtain the application type of the target application currently running on the circulation source device
  • a flow strategy module configured to determine an application flow strategy for the target application according to the application type
  • the application flow module is configured to flow the content of the target application to the flow target device according to the application flow strategy.
  • the device for cross-device flow of application content determines different application flow strategies according to different application types of the target application to realize cross-device flow of different application content, thereby ensuring the diversity of cross-device flow of application content, and Improve the efficiency and user experience of application circulation.
  • an embodiment of the present application provides an apparatus for cross-device flow of application content, which is applied to a first flow source device; the apparatus includes:
  • an application information module configured to obtain the application type of the target application on the first transfer target device, and the target application is transferred from the transfer source device to the first transfer target device;
  • a flow strategy module configured to determine an application flow strategy for the target application according to the application type
  • the application flow module is configured to flow the content of the target application to the second flow target device according to the application flow strategy.
  • the device for cross-device flow of application content determines different application flow strategies according to different application types of the target application to realize cross-device flow of different application content, thereby ensuring the diversity of cross-device flow of application content, and Improve the efficiency and user experience of application circulation.
  • an embodiment of the present application provides an electronic device, the electronic device is a flow source device, including a processor, a memory, and a communication interface, the memory stores one or more programs, and the one or more programs A program is executed by the processor, and the one or more programs are used to execute instructions of the steps in the first aspect of the embodiments of the present application.
  • the electronic device determines different application circulation strategies according to different application types of the target application to realize the cross-device circulation of different application contents, thereby ensuring the diversity of application content circulation across devices, and improving application circulation. Efficiency and user experience.
  • an embodiment of the present application provides an electronic device, where the electronic device is a first transfer target device, and includes a processor, a memory, and a communication interface, the memory stores one or more programs, and the one or more programs are stored in the memory. A plurality of programs are executed by the processor, and the one or more programs are used to execute instructions of the steps in the second aspect of the embodiments of the present application.
  • the electronic device determines different application circulation strategies according to different application types of the target application to realize the cross-device circulation of different application contents, thereby ensuring the diversity of application content circulation across devices, and improving application circulation. Efficiency and user experience.
  • the embodiments of the present application provide a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, and the computer program is operable to cause a computer to execute the embodiments of the present application some or all of the steps described in the first aspect or the second aspect.
  • an embodiment of the present application provides a computer program product, wherein the computer program product includes a computer program, and the computer program is operable to cause a computer to execute the description in the first aspect or the second aspect of the embodiment of the present application some or all of the steps.
  • the computer program product may be a software installation package.
  • FIG. 1 is a schematic diagram of the architecture of a communication system for application content flow provided by an embodiment of the present application
  • FIG. 2 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a software structure of an electronic device provided by an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • FIG. 5 is a schematic flowchart of a method for transferring application content across devices provided by an embodiment of the present application
  • FIG. 6 is a schematic structural diagram of cross-device flow of application content provided by an embodiment of the present application.
  • FIG. 7 is a schematic structural diagram of another cross-device flow of application content provided by an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of another cross-device flow of application content provided by an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of another cross-device flow of application content provided by an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of another cross-device flow of application content provided by an embodiment of the present application.
  • FIG. 11 is a schematic structural diagram of another application content flow across devices provided by an embodiment of the present application.
  • FIG. 12 is a schematic structural diagram of another application content flow across devices provided by an embodiment of the present application.
  • FIG. 13 is a schematic flowchart of a method for transferring application content across devices provided by an embodiment of the present application
  • FIG. 14 is a schematic structural diagram of another application content flow across devices provided by an embodiment of the present application.
  • FIG. 15 is a block diagram showing the composition of functional modules of an apparatus for transferring application content across devices provided by an embodiment of the present application;
  • FIG. 16 is a block diagram of functional modules of another device for cross-device flow of application content provided by an embodiment of the present application.
  • 17 is a schematic structural diagram of another electronic device provided by an embodiment of the present application.
  • FIG. 18 is a schematic structural diagram of another electronic device provided by an embodiment of the present application.
  • the application streaming technology in the embodiment of the present application is to transmit the content (such as picture, text or audio, etc.) of the application currently running on one or more devices to another or more devices so that the content of the application can be run.
  • the application flow technology may include an application screen projection technology, an application handoff technology, an application distribution technology, and the like.
  • the application screen projection technology is to project the content of the application running on one device to the display screen or display medium of another device for display, which is a typical information synchronization method;
  • application distribution technology is a back-end running an application on one device (such as processing the display business logic function of the user interface UI interface), and in the Another device runs the application's front-end (such as a user interface UI interface), and needs to access the application's back-end in real time.
  • the device that initiates the streaming of the content of the application is referred to as the streaming source device, and the device that receives the content of the application is referred to as the streaming target device.
  • the application flow technology involved in the present application may include a wired manner and a wireless manner.
  • the wired method is to establish a wired connection between the streaming source device and the streaming target device through a high-definition multimedia interface (HDMI) data cable, a universal serial bus (USB) data cable, etc. to transmit media data; wireless;
  • the method is to establish a wireless connection between the streaming source device and the streaming destination device through the digital living network alliance (DLNA) protocol, wireless display sharing (Miracast) or airplay (AirPlay) protocol to transmit media data.
  • DLNA digital living network alliance
  • Miracast wireless display sharing
  • AirPlay airplay
  • the streaming source device can compress the video stream in the current video player and send it to the streaming destination device after encoding and compressing the data; then, the streaming destination device decodes the video stream data and displays it on its display screen. the video stream.
  • the transfer source device and the transfer target device may be collectively referred to as electronic devices.
  • the electronic device in this embodiment of the present application may be a handheld device, a vehicle-mounted device, a wearable device, an augmented reality (AR) device, a virtual reality (VR) device, a projection device, a projector, or a wireless
  • Other devices of the modem can also be various specific forms of user equipment (UE), terminal device (terminal device), mobile phone (smart phone), smart screen, smart TV, smart watch, notebook computer, smart audio, Camera, gamepad, microphone, station (STA), access point (AP), mobile station (mobile Station, MS), personal digital assistant (PDA), personal computer (personal computer, PC) or relay equipment, etc.
  • two electronic devices a computer and a mobile phone
  • a computer and a mobile phone are connected to each other through wireless communication technologies (such as Bluetooth, Wi-Fi, Zigbee, near field communication, etc.) or data lines (such as USB data lines)
  • wireless communication technologies such as Bluetooth, Wi-Fi, Zigbee, near field communication, etc.
  • data lines such as USB data lines
  • the mobile phone acts as a streaming source device to transfer its
  • the content of the running application is transmitted to the computer, and the computer is used as the transfer target device at this time; or, the computer is used as the transfer source device to transmit the content of the running application to the mobile phone, and the mobile phone is used as the transfer target device at this time.
  • the application content streaming communication system 10 may include at least two electronic devices 110 .
  • the at least two electronic devices 110 may include electronic device 110A, electronic device 110B, electronic device 110C, electronic device 110D, electronic device 110E and electronic device 110F. Meanwhile, each of the at least two electronic devices 110 may be connected to each other through wireless network or wired data communication.
  • the wireless network may include a mobile cellular network (such as a fifth-generation 5G mobile communication network), a wireless local area network (WLAN), a wide area network (WAN), Bluetooth, wireless security True (wireless fidelity, Wi-Fi), Zigbee (Zigbee), near field communication (near field communication, NFC) or ultra wide band (ultra wide band, UWB), etc.; wired data can include HDMI data lines, USB data lines, etc. .
  • a mobile cellular network such as a fifth-generation 5G mobile communication network
  • WLAN wireless local area network
  • WAN wide area network
  • Bluetooth wireless security True (wireless fidelity, Wi-Fi), Zigbee (Zigbee), near field communication (near field communication, NFC) or ultra wide band (ultra wide band, UWB), etc.
  • wired data can include HDMI data lines, USB data lines, etc.
  • each electronic device in the at least two electronic devices 110 may be a device under the same user account.
  • the at least two electronic devices 110 include the mobile phone, desktop computer, smart screen, notebook computer, medium The relay device and the smart watch, and the mobile phone, desktop computer, smart screen, notebook computer, relay device and smart watch can communicate with each other through a wireless network.
  • each of the at least two electronic devices 110 may be connected to the same WLAN network through a relay device (eg, a router).
  • a relay device eg, a router
  • the at least two electronic devices 110 include the mobile phone, desktop computer, smart screen, notebook computer Computer, relay device and smart watch, and the mobile phone, desktop computer, smart screen, notebook computer, relay device and smart watch form a WLAN network, so that each device in the WLAN network can communicate with each other through the relay device .
  • each of the at least two electronic devices 110 may form a peer-to-peer (P2P) network through wireless communication (such as Bluetooth, Zigbee, NFC, UWB, etc.).
  • P2P peer-to-peer
  • a user can form a P2P network with devices such as mobile phones, laptops, and smart watches by scanning NFC tags, and all devices in the P2P network can communicate with each other.
  • one or more electronic devices in the at least two electronic devices 110 can be used as a transfer source device, and other electronic devices can be used as a transfer target device.
  • the streaming source device can transmit the content of the running application to the streaming target device.
  • the streaming destination device can run simultaneously by establishing multiple processes or display it simultaneously in a split-screen manner.
  • the electronic device 110A casts the screen to the electronic device 110B and the electronic device 110C
  • the electronic device 110D casts the screen to the electronic device 110C and the electronic device 110F.
  • the electronic device 11C can simultaneously display the mirror images from the electronic device 110A and the electronic device 110D in a split-screen manner.
  • application content flow communication system 10 may also include other electronic devices, which are not specifically limited herein.
  • the structure of the electronic device in the embodiment of the present application will be described in detail below with reference to FIG. 2. It can be understood that the structure shown in FIG. 2 does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may further include more or less components than those shown in FIG. 2 , or combine some components, or separate some components, or arrange different components. In addition, the components illustrated in FIG. 2 may be implemented by hardware, software, or a combination of software and hardware.
  • the electronic device may include a processor 210, an antenna 1, an antenna 2, a mobile communication module 220, a wireless communication module 230, an audio module 240, a sensor module 250, a display module 260, a camera module 270, a charging management module 280, Internal memory 2901 and external memory interface 2902, etc.
  • the processor 210 may include one or more processing units.
  • the processor 210 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, Video codec, digital signal processor (DSP), field programmable gate array (FPGA), baseband processor and/or neural-network processing unit (NPU) )Wait.
  • AP application processor
  • GPU graphics processing unit
  • ISP image signal processor
  • controller a memory
  • Video codec digital signal processor
  • DSP digital signal processor
  • FPGA field programmable gate array
  • NPU neural-network processing unit
  • different processing units may be independent devices, or may be integrated in one or more processors.
  • a memory may also be provided in the processor 210 for storing instructions and data.
  • the memory in processor 210 is cache memory.
  • the memory may hold instructions or data that have just been used or recycled by the processor 210 . If the processor 210 needs to use the instruction or data again, it can be directly called from the memory, thereby avoiding repeated access, reducing the waiting time of the processor 210 and improving the system efficiency.
  • the processor 210 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface and/ or USB interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • the wireless communication function of the electronic device may be implemented by the antenna 1 , the antenna 2 , the mobile communication module 220 , the wireless communication module 230 , the modulation and demodulation processor, the baseband processor, and the like.
  • the antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals.
  • Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands.
  • different antennas can also be multiplexed to improve the utilization of the antennas.
  • the antenna 1 is multiplexed as a diversity antenna of the wireless local area network.
  • the mobile communication module 220 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device.
  • the mobile communication module 220 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like.
  • LNA low noise amplifier
  • the mobile communication module 220 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 220 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 .
  • the mobile communication module 220 can realize the communication connection between the transfer source device and the transfer target device in the technical solution of the present application.
  • At least some functional modules of the mobile communication module 220 may be provided in the processor 210; or, at least some functional modules of the mobile communication module 220 may be provided in the same device as some modules of the processor 210.
  • the wireless communication module 230 can provide applications on electronic devices including Bluetooth (BT), wireless local area networks (WLAN), wireless fidelity (Wi-Fi) networks, and short-range wireless communication. (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • BT Bluetooth
  • WLAN wireless local area networks
  • Wi-Fi wireless fidelity
  • short-range wireless communication near field communication, NFC
  • infrared technology infrared, IR
  • the wireless communication module 230 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 230 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the system-on-chip 210 .
  • the wireless communication module 230 can also receive the signal to be sent from the processor 210, perform frequency modulation and amplification on the signal, and then convert it into electromagnetic waves by the antenna 2 and radiate it out.
  • the wireless communication module 230 can realize the communication connection between the transfer source device and the transfer target device in the technical solution of the present application.
  • the electronic device may implement audio functions through the audio module 240 , the speaker 2401 , the receiver 2402 , the microphone 2403 , the headphone interface 2404 , the processor 210 , and the like. For example, music playback, recording, video playback, etc.
  • the audio module 240 can be used to convert digital audio information into analog audio signal output, and can also be used to convert analog audio input into digital audio signal. Additionally, the audio module 240 may also be used to encode and decode audio signals. In a possible example, the audio module 240 may be provided in the processor 210 , or some functional modules of the audio module 240 may be provided in the processor 210 .
  • the speaker 2401 can be used to convert audio electrical signals into sound signals.
  • the electronic device can listen to music through the speaker 2301, or listen to a hands-free call.
  • the receiver 2402 can be used to convert audio electrical signals into sound signals. For example, when an electronic device answers a call or a voice message, the receiver 2402 can be placed close to the human ear to receive the voice.
  • the microphone 2403 can be used to convert sound signals into electrical signals. For example, when making a call or sending a voice message, the user can make a sound by approaching the microphone 2403 through a human mouth, and input the sound signal into the microphone 2403 .
  • the electronic device may be provided with at least one microphone 2403 .
  • the electronic device may be provided with two microphones 2403, which can implement noise reduction function in addition to collecting sound signals; in a possible example, the electronic device may be provided with three, four or more microphones 2403 , to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions, etc., which are not limited.
  • the earphone interface 2404 can be used to connect a wired earphone.
  • the earphone interface 2404 can be a USB interface 2703, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface, etc. .
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the sensor module 250 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, an ultra-high Bandwidth UWB sensors, near field communication NFC sensors, laser sensors and visible light sensors, etc.
  • the electronic device may implement the display function through the GPU, the display module 260, the processor 210, and the like.
  • the GPU can be used to perform mathematical and geometric calculations and perform graphics rendering.
  • the GPU can be a microprocessor for image processing, and is connected to the display module 260 and the processor 210 .
  • Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display module 260 may be a display screen, which is used to display images, videos, texts, and the like.
  • the display screen 260 may include a display panel.
  • the display panel may adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode, or an active matrix organic light emitting diode (active-matrix organic light emitting diode). diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
  • the electronic device may include one or more display modules 260 .
  • the electronic device may implement the shooting function through the ISP, the camera module 270, the video codec, the GPU, the display module 260, the processor 210, and the like.
  • the ISP may be used to process the data fed back by the camera module 270 .
  • the shutter is first opened, and then the light is transmitted to the camera photosensitive element through the lens to convert the light signal into an electrical signal, and finally the electrical signal is transmitted to the ISP through the camera photosensitive element for processing to convert it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera module 270 .
  • the camera module 270 may be a camera, which is used to capture still images or videos, and the like.
  • the optical image generated by the object is projected to the photosensitive element through the lens, and the photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the electronic device may include one or more camera modules 270 .
  • the charging management module 280 is configured to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 280 may receive charging input from the wired charger through the USB interface 2803 .
  • the charging management module 280 may receive wireless charging input through a wireless charging coil of the electronic device. While the charging management module 280 charges the battery 2801 , it can also supply power to the electronic device through the power management module 2802 .
  • the power management module 2802 is used to connect the battery 2801 , the charging management module 2802 and the processor 210 .
  • the power management module 2802 receives input from the battery 2801 and/or the charging management module 280, and supplies power to each module in the electronic device, the processor 210, and the like.
  • the power management module 2802 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance).
  • the power management module 2802 may also be provided in the processor 210; in a possible example, the power management module 2802 and the charging management module 280 may also be provided in the same device.
  • the internal memory 2901 may be used to store computer executable program codes, where the executable program codes include instructions.
  • the processor 210 executes various functional applications and data processing of the electronic device by executing the instructions stored in the internal memory 2901 .
  • the internal memory 2901 stores program codes for executing the technical solutions of the embodiments of the present application.
  • the internal memory 2901 may include a program storage area and a data storage area.
  • the storage program area may store an operating system, an application program required for at least one function (for example, a sound playback function and an image playback function, etc.), and the like.
  • the storage data area can store data (eg, audio data, phone book, etc.) created during the use of the electronic device, and the like.
  • the internal memory 2901 may include high-speed random access memory, and may also include non-volatile memory. For example, at least one disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the external memory interface 2902 can be used to connect an external memory card, such as a micro SD card, to expand the storage capacity of the electronic device.
  • the external memory card communicates with the processor 210 through the external memory interface 2902 to realize the data storage function. For example, save files such as music, videos, etc. on an external memory card.
  • the software system of the electronic device may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the following embodiments of the present application take an Android system with a layered architecture as an example to exemplarily describe the software structure of an electronic device.
  • the internal memory 2901 may store the kernel layer 320 , the system runtime layer 340 , the application framework layer 360 and the application layer 380 .
  • the layers communicate with each other through software interfaces, and the kernel layer 320 , the system runtime layer 340 and the application framework layer 360 belong to the operating system space.
  • the application layer 380 belongs to the user space, and at least one application program (or “application” for short) runs in the application layer 380.
  • application programs may be native applications provided by the operating system, or may be third-party developers developed third-party applications.
  • the application layer 380 may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.
  • a streaming application may also be installed in the application layer. Users can open streaming apps from the desktop, settings, or drop-down menus.
  • the streaming application can be used as a bridge between the streaming source device and the streaming target device during content streaming, and transmit the content of the application that needs to be streamed in the streaming source device to the streaming target device.
  • the streaming application can receive the streaming event reported by the application framework layer 360, so as to use the streaming application to interact with a running application (such as a video player), and then use the streaming application to display or play the content as streaming content through Wi-Fi and other wireless communication methods to send to the transfer target device.
  • the user can also use the flow application to set the binding relationship between the NFC or UWB tag and one or more electronic devices. For example, set an option for binding NFC or UWB tags in the streaming application.
  • the streaming application may display a list of electronic devices to be bound. After the user selects one or more electronic devices to be bound on the list, he brings it close to the NFC tag. In this way, after the NFC signal is transmitted, the identifier of the electronic device selected by the user on the streaming application can be written into the NFC tag, thereby establishing a binding relationship between the NFC tag and one or more electronic devices in the NFC tag .
  • the application framework layer 360 provides various application programming interfaces (APIs) and programming frameworks that may be used when constructing applications of the application layer, so that developers can use these APIs to construct their own Third-party applications. For example, window manager, content providers, view system, telephony manager, resource manager, notification manager, message manager, activity Manager (activity manager), package manager (package manager), location management (location manager) and NFC services, etc.
  • APIs application programming interfaces
  • programming frameworks may be used when constructing applications of the application layer, so that developers can use these APIs to construct their own Third-party applications. For example, window manager, content providers, view system, telephony manager, resource manager, notification manager, message manager, activity Manager (activity manager), package manager (package manager), location management (location manager) and NFC services, etc.
  • a window manager can be used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock screen, screen capture, etc.
  • the content provider can be used to store and obtain data, and make the data accessible to applications.
  • the data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, and the like.
  • a content provider may enable an application to access another application's data, such as a contact database, or to share their own data.
  • the view system includes visual controls. For example, controls that display text and controls that display pictures, etc. View systems can be used to build applications.
  • a display interface can consist of one or more views.
  • the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide the communication function of the electronic device. For example, the management of call status (such as connecting, hanging up, etc.).
  • the resource manager can provide various resources for the application. For example, localized strings, icons, pictures, layout files, video files, etc.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a short stay without user interaction.
  • the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also display notifications in the status bar at the top of the system in the form of a graphic or scroll bar text.
  • the notification of the application running in the background can also be a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.
  • the message manager can be used to store the data of the messages reported by each application program, and process the data reported by each application program.
  • the activity manager can be used to manage the application life cycle and provide the usual navigation and fallback functions.
  • the message manager may be part of the notification manager.
  • the application framework layer 360 may run an NFC service (NFCservice).
  • NFCservice NFC service
  • the NFC service can be started to run in the application framework layer.
  • the NFC service can call the NFC driver at the kernel layer to read the binding relationship stored in the NFC tag, thereby obtaining the transfer target device for this content transfer.
  • the NFC service can report the streaming event to the above-mentioned content streaming, thereby triggering the streaming application to transmit the content that the mobile phone is running or playing as the streaming content to the streaming target device to start the content streaming process.
  • system runtime layer 340 provides main feature support for the Android system through some C/C++ libraries.
  • the SQLite library provides database support
  • the OpenGL/ES library provides 3D drawing support
  • the Webkit library provides browser kernel support.
  • An Android runtime library (Android Runtime) is also provided in the system runtime library layer 340, which mainly provides some core libraries, which can allow developers to use Java language to write Android applications.
  • the kernel layer 320 can provide underlying drivers for various hardware of electronic devices, such as display drivers, audio drivers, camera drivers, Bluetooth drivers, Wi-Fi drivers, power management, NFC drivers, UWB drivers, and application flow drivers , speech recognition driver, gesture recognition driver, image recognition driver, human body recognition driver, facial motion recognition driver, human motion recognition driver, etc.
  • the application flow framework may include an information acquisition module 410 , a source and target determination module 420 , a connection management module 430 , an application information module 440 , a flow strategy module 450 and an application flow module 460 .
  • the information acquisition module 410 may include a sensor recognition module, a voice recognition module, a gesture recognition module, an image recognition module, a human gesture recognition module, a facial motion recognition module, and/or a human motion recognition module, etc.
  • the application flow module 460 may include a distribution Type application framework, screen projection service framework, relay application framework, common application framework and screen projection application framework, etc.
  • the acquiring information module 410 may be used to acquire the identity (ID) of one or more electronic devices through sensor recognition, voice recognition, gesture recognition, image recognition, human gesture recognition, facial motion recognition, human motion recognition, etc. information, and send the ID information of the one or more electronic devices to the source and target determination module 420 .
  • the above-mentioned sensors may include UWB sensors, NFC sensors, laser sensors and/or visible light sensors, etc.
  • the above-mentioned ID information may include Internet Protocol (Internet Protocol, IP) addresses, media access control (media access control, MAC) addresses, UWB tags, NFC tags, etc.
  • IP Internet Protocol
  • MAC media access control
  • UWB sensors are installed on both the mobile phone and the laptop, and each has a UWB tag (that is, ID information), when the user moves the mobile phone so that the distance between the mobile phone and the laptop is close, the UWB sensor on the mobile phone will acquire to the UWB tag of the laptop.
  • UWB tag that is, ID information
  • both the mobile phone and the laptop are equipped with NFC sensors, and each has an NFC tag (that is, ID information), when the user touches the mobile phone by touching or leaning against the laptop, the NFC sensor on the mobile phone will The NFC tag of the laptop will be acquired.
  • NFC tag that is, ID information
  • the acquisition information module 410 analyzes the angle of the gesture in the gesture action image captured by each (such as the gesture is frontal, instead of an offset angle), the size of the gesture (such as the size of the gesture occupying the entire screen), etc., so as to select the device that meets the preset conditions from the mobile phone and laptop as the transfer source device or transfer target device, and obtain the transfer ID information of the source device or ID information of the transfer destination device.
  • the real flow source device captures images with more gestures facing the front, rather than having an offset angle; or, the gestures in the captured images
  • the source and target determination module 420 may be configured to determine the ID information corresponding to the transfer source device and the ID information corresponding to the transfer target device from the ID information of the one or more electronic devices from the information acquisition module 410 .
  • the ID information sent by the information acquisition module 410 to the source and target determination module 420 may contain ambiguous transfer source devices and transfer target devices (ie, transfer objects), resulting in inability to perform application transfer. At this time, it needs to be judged by the source and target judgment module 420 . If there is a clear result of the transfer source device and the transfer target device, the result is sent to the transfer strategy module 440 to execute the application transfer strategy from the transfer source device to the transfer target device; if there is no clear transfer source device and transfer target device. As a result, the connection management module 430 is accessed. The following takes a mobile phone as the circulation source device for illustration.
  • the voice recognition module in the mobile phone recognizes the voice and transmits the recognition result to the source and target determination modules. Since there may be communication connections between the mobile phone and multiple devices (such as notebook computers, desktop computers, etc.), the source and target determination modules in the mobile phone cannot determine a clear transfer target device from the identification result.
  • connection management module 430 may be configured to acquire ID information of all devices connected to the circulation source device under the same user account or the same network. Wherein, the connection management module 430 can access the remote or cloud server or other electronic devices to obtain the above ID information, can access the internal memory of the local end to obtain the above ID information, and can also access the external memory interface to obtain the above ID information. No specific restrictions are imposed.
  • the application information module 440 may be used to identify a currently running application to obtain application information of the application.
  • the application information may include an application name, an application type, and the like. It should be noted that the application information module 440 can obtain application information of the application currently running on the front end (eg, UI interface) or the back end by accessing a process or thread.
  • screen-casting applications refer to applications that continue to run on the streaming source device, and are projected from the streaming source device to the streaming target device, and then run by the streaming target device; distributed applications refer to the front-end and back-end of the application.
  • Applications that can realize separate operation operations on different devices; relay applications refer to applications that can realize storage, recovery or sharing operations on different devices through the file service on the local end; common applications refer to screen projection technology.
  • Applications that implement display operations on different devices, and ordinary applications can include screen-casting applications.
  • the flow strategy module 450 may be configured to determine the application flow strategy from the flow source device to the flow target device according to the application type, and transmit it to the application flow module 460 . It should be noted that the circulation strategy module 450 can access the application information module 440 to learn the application type of the currently running application, so as to determine different application circulation strategies according to different application types.
  • the application flow module 460 may be configured to perform cross-device flow of application content according to an application flow policy.
  • different application flow strategies need to be adopted for different application types, and different application flow strategies correspond to different application frameworks. For example, when performing application transfer for distributed applications, a distributed application framework needs to be used; when performing application transfer for relay-type applications, a relay-type application framework needs to be used; when performing application transfer for screen-casting applications, it is necessary to adopt a relay-type application framework. screen service framework or screen-casting application framework; when performing application transfer for common applications, the screen-casting service framework or common application framework needs to be used.
  • the solution for the cross-device flow of application content only supports a single software and hardware, and there is no module or framework to integrate multiple software and hardware to achieve collaborative operation.
  • the current solution only supports screen projection or simple data transmission, and cannot support the flow of richer distributed applications or relay applications, and cannot support the flow of applications between different application types at the same time. Therefore, through the application transfer framework shown in FIG. 4 , the embodiment of the present application can obtain information through different identification modules, and determine the ID information of the transfer source device and the ID information of the transfer target device from the acquired information to determine the transfer object, Then, different application flow strategies are adopted according to the application type of the currently running application, so as to realize more convenient flow of application content across devices, and to improve the efficiency of application flow and use experience.
  • the following embodiments of the present application will be specifically described in terms of method examples.
  • FIG. 5 is a schematic flowchart of a cross-device flow method for application content provided by an embodiment of the present application, which is applied to a flow source device.
  • the method includes: S510 : Obtain an application type of a target application currently running on the flow source device.
  • a target application is currently running on the streaming source device in the embodiment of the present application, and the target application may be an application program or media data running on the application layer of the streaming source device, such as photos, videos, audios, games, Gallery, document or multimedia, etc.
  • the circulation source device can run the target application on the front end, and can also run the target application on the back end.
  • the display screen of the streaming source device may display the current content of the target application; when the streaming source device runs the target application at the back end, the display screen of the streaming source device may not display the target application.
  • the current content of the target application, and the target application continues to be executed in the background.
  • the method may further include the following steps: acquiring first information, and judging whether the first information carries identification information of the transfer target device.
  • the first information may satisfy at least one of the following manners: the first information is acquired by sensor recognition, the first information is acquired by voice recognition, the first information is acquired by gesture recognition, the first information is acquired by image Recognition and acquisition, the first information is acquired through human gesture recognition, the first information is acquired through facial motion recognition, and the first information is acquired through human motion recognition;
  • the above sensors may include at least one of the following: ultra-bandwidth UWB sensor, near field communication NFC sensor, laser sensor, visible light sensor.
  • the transfer object ie the transfer source device and/or the transfer target device
  • the transfer source device obtains the first information, and determines whether the first information carries the identification information of the transfer target device, so as to realize The transfer destination device is determined by the transfer source device.
  • the embodiment of the present application can obtain the first information through the information obtaining module in the flow source device, and determine the first information through the source and target determination module in the flow source device. Whether the information carries the identification information of the transfer target device.
  • an example is given by taking the transfer source device as a mobile phone as an example.
  • a UWB sensor when a UWB sensor is installed on a mobile phone, the user places the mobile phone near a laptop and a smart watch that are also equipped with UWB sensors, so as to obtain the UWB tag of the laptop and the UWB tag of the smart watch.
  • laptops and smartwatches can be considered as candidate transfer target devices.
  • the display of the phone can then display a list of options including the laptop and the smartwatch through pop-up windows, drop-down menus, and the like.
  • the user can select one or more devices from the option list as the transfer target device, so that the mobile phone obtains the specific ID information of the transfer target device (ie UWB tag, MAC address or IP address, etc.).
  • the user touches the mobile phone by touching (or leaning against, etc.) a laptop and a smart watch that are also equipped with an NFC sensor, so as to obtain the NFC tag of the laptop.
  • NFC tags for smartwatches can be considered as candidate transfer target devices.
  • the display screen of the mobile phone can display a list of options including the laptop computer and the smart watch by means of pop-up windows, drop-down menus, and the like.
  • the user can select one or more devices from the option list as the transfer target device, so that the mobile phone obtains the specific ID information (ie NFC tag, MAC address or IP address, etc.) of the transfer target device.
  • the specific ID information ie NFC tag, MAC address or IP address, etc.
  • the mobile phone can issue an instruction to make the laptop computer turn on the camera.
  • the laptop computer captures the user's current gesture action image (such as gesture release action, gesture capture action, hand wave action, left-right hand wave action, "OK" gesture action, etc.)
  • the laptop computer analyzes the captured gesture Whether the motion image meets the preset gesture conditions. If the preset gesture conditions are met, the notebook computer is used as the transfer target device, and the notebook computer sends its own MAC address or IP address to the mobile phone, so that the mobile phone obtains the clear ID information of the transfer target device (that is, the MAC address). address or IP address, etc.).
  • the user when the user really needs to stream the content of the application running on the mobile phone to the laptop, the user will explicitly perform a gesture action in the direction of the camera facing the laptop. Therefore, when analyzing the gesture action images captured by the notebook computer, the real flow target device captures images with more gestures facing the front, rather than having an offset angle; or, gestures occupy more of the captured images The larger the ratio, the more likely it is the real transfer target device. Therefore, the preset gesture condition can be understood as the more positive the gesture in the picture is, or the larger the proportion of the gesture in the picture, etc.
  • the first information acquired by the transfer source device may directly carry the ID information of the transfer target device.
  • the first information acquired by the information acquisition module in the transfer source device by recognizing voice, image, human posture, facial motion, human motion, etc. may not carry the identification information of the transfer target device.
  • an example is given by taking the transfer source device as a mobile phone as an example.
  • the mobile phone when the mobile phone recognizes a piece of voice inputted by the user that "transfer the video screen of the machine to the computer", if there is a communication connection between the mobile phone and multiple devices (such as laptop computers, desktop computers, etc.), the mobile phone will recognize The voice is used to obtain the first information, but it cannot be clearly identified from the first information to which computer or computers the video image stream of the local machine is transferred to, so that the mobile phone cannot be determined from the first information.
  • the transfer target device when the mobile phone recognizes a piece of voice inputted by the user that "transfer the video screen of the machine to the computer"
  • the mobile phone can issue an instruction to make the laptop computer A and the laptop computer B turn on the cameras.
  • both laptop computer A and laptop computer B have captured the current facial motion picture of the user (such as a smile, pursed lips, etc.)
  • both laptop computer A and laptop computer B will analyze the facial motion pictures captured by them. Whether the preset face conditions are met. If neither of the preset face conditions are met, neither laptop A nor laptop B will send their respective MAC addresses or IP addresses to the mobile phone, so that the mobile phone cannot obtain the clear ID information of the target device (that is, the MAC address). address or IP address, etc.).
  • the preset face condition can be understood as the more frontal the face in the picture faces, or the larger the proportion of the face in the picture, etc.
  • the method further includes the following steps: when the first information does not carry the identification information of the transfer target device, obtain the current user of the transfer source device Identification information of all devices connected to the transfer source device under the account; the identification information of the transfer target device is determined from the identification information of all devices.
  • the embodiment of the present application considers transferring the content of the target application currently running on the transfer source device, if the first information obtained by the transfer source device does not carry the ID information of the transfer target device, in conjunction with the above Figure 4
  • the application transfer framework in the embodiment of the present application can obtain the ID information of all devices connected to the transfer source device under the current user account of the transfer source device through the connection management module in the transfer source device.
  • the source device can access the server at the remote end or in the cloud. to obtain the above-mentioned ID information; or, because other remote electronic devices (such as routers or relay devices, etc.) store the identification information of all devices connected to the source device under the current user account of the source device, this
  • the circulation source device can access other remote electronic devices to obtain the above-mentioned ID information; or, because the above-mentioned server or the above-mentioned other electronic equipment can directly issue the above-mentioned ID information to the internal memory of the circulation source device for caching to improve access efficiency, so
  • the streaming source device can directly access the internal memory of the local end to obtain the above ID information; or, since the above ID information can be copied to the external memory, the streaming source device can access the external memory interface to obtain the above ID information.
  • the ID information of all devices under the same user account as the source device is obtained through the above different access methods to determine the target device, so as to ensure the more convenient realization of the cross-device transfer of application content and improve the efficiency of application transfer. , variety and experience.
  • each electronic device in the at least two electronic devices 110 can be a device under the same user account.
  • the at least two electronic devices 110 include the mobile phones, desktop computers, and smart watches, and the mobile phone, desktop computers, and smart watches. Devices can communicate with each other over a wireless network.
  • the circulation source device may be understood as one of the at least two electronic devices 110 .
  • the method further includes: when the first information does not carry the identification information of the transfer target device, obtaining the network and the network where the transfer source device is located.
  • the identification information of all devices connected to the transfer source device; the identification information of the transfer target device is determined from the identification information of all devices.
  • the embodiment of the present application when the embodiment of the present application considers transferring the content of the target application currently running on the transfer source device, if the first information obtained by the transfer source device does not carry the ID information of the transfer target device. At this time, in conjunction with the application flow framework in FIG. 4, the embodiment of the present application can obtain the ID information of all devices connected to the flow source device in the network where the flow source device is located through the connection management module in the flow source device .
  • each electronic device in the at least two electronic devices 110 can be connected to the same device through a relay device (such as a router). in a WLAN network.
  • each of the at least two electronic devices 110 may form a peer-to-peer (P2P) network through wireless communication (eg, Bluetooth, Zigbee, NFC, UWB, etc.). Therefore, the network where the transfer source device is located may be a WLAN network or a P2P network formed by a relay device or a wireless communication method.
  • P2P peer-to-peer
  • the transfer source device can access the remote relay device to obtain the above ID information; or, the remote relay device directly sends the above ID information to the transfer device Cached on the internal memory of the source device, the streaming source device can directly access the internal memory of the local end to obtain the above ID information.
  • the transfer source device can access the main electronic device in the P2P network (such as a device with strong computing power, the device closest to the transfer source device, or the main control device in the P2P network, etc.) To obtain the above-mentioned ID information; or, the main electronic device directly sends the above-mentioned ID information to the internal memory of the circulation source device to be cached, and the circulation source device can directly access the internal memory of the local end to obtain the above-mentioned ID information. If the above-mentioned ID information can be copied to the external memory, the streaming source device can access the external memory interface to obtain the above-mentioned ID information.
  • the main electronic device directly sends the above-mentioned ID information to the internal memory of the circulation source device to be cached, and the circulation source device can directly access the internal memory of the local end to obtain the above-mentioned ID information.
  • the streaming source device can access the external memory interface to obtain the above-mentioned ID information.
  • the ID information of all devices connected to the source device in the network where the source device is located can be obtained through the different access methods described above to determine the target device, so as to ensure a more convenient transfer of application content across devices and improve application performance. Efficiency, variety and user experience of circulation.
  • the following embodiments of the present application will specifically describe how the transfer source device determines the identification information of the transfer target device from the identification information of all devices.
  • determining the identification information of the transfer target device from the identification information of all devices may include the following steps: if the identification information of all devices except the identification information of the transfer source device only has the identification information of one device, then the device The identification information of the transfer target device is used as the identification information of the transfer target device.
  • the embodiment of the present application may consider The device is used as the streaming target device, and the ID information of the device is acquired, so that the streaming source device can realize the streaming of the content of the currently running target application to the device.
  • determining the identification information of the transfer target device from the identification information of all the devices may include the following steps: if the identification information of all the devices contains the identification information of at least two devices in addition to the identification information of the transfer source device, obtain the identification information for the transfer target device.
  • the embodiment of the present application considers that a list of options including the multiple devices is displayed on the display screen of the streaming source device by means of a pop-up window, a drop-down menu, or the like.
  • the user can then select one or more devices from the list of options as the streaming target device. That is to say, the streaming source device can obtain a selection operation instruction for the plurality of device ID information, so as to determine the ID of the streaming target device according to the selection operation instruction, and realize the content of the currently running target application by the streaming source device. Streaming to the streaming target device.
  • an example is given by taking the transfer source device as a mobile phone as an example.
  • FIGS. 6 and 7 Illustratively, as shown in FIGS. 6 and 7 .
  • a music player ie, a target application
  • the user needs to stream the song "don't think of me” (that is, the content of the target application) currently playing on the music player to the laptop for playback.
  • the user starts to prepare for the cross-device flow of the application content by clicking the "transfer application” option on the mobile phone.
  • Fig. 7 after the user clicks the "transfer application” on the mobile phone shown in Fig.
  • the user accesses the network from a wide area network (all devices under the same user account are connected through a wide area network) or a local area network (such as a WLAN network or a P2P network).
  • Laptop A and Laptop B are found.
  • the MAC address of laptop A ie 00:0C:29:26:BC:07
  • the MAC address of laptop B ie 00:0C:29:F3:54:1D
  • a list of options including the MAC address of the laptop computer A and the MAC address of the laptop computer B is displayed on the mobile phone by means of a pop-up window.
  • the user can select Laptop A as the streaming target device from the list of options.
  • the user can select the multiple devices to determine the streaming target device, thereby improving the use experience of application content streaming across devices.
  • determining the identification information of the transfer target device from the identification information of all the devices may include the following steps: if the identification information of all the devices contains the identification information of at least two devices in addition to the identification information of the transfer source device, according to the predetermined
  • the priority policy is to use the identification information with the highest priority among the identification information of at least two devices as the identification information of the transfer target device.
  • the embodiment of the present application Consider determining the identification information of the transfer target device from the identification information of all devices according to a preset priority policy.
  • the preset priority policy may include judging from at least two devices the time at which application circulation has occurred with the circulation source device in history, and setting the device with the closest time among the times when application circulation has occurred with the circulation source device as priority. highest level.
  • the smart watch has the highest priority.
  • the preset priority policy may include judging from at least two devices the number of times that the application circulation has occurred with the circulation source device in history, and the number of times the application circulation has occurred with the circulation source device is the highest. The device is set to the highest priority.
  • all devices in the same network as the mobile phone include notebook computers and smart watches.
  • the number of times that the notebook computer has had an application flow with the mobile phone in the history is 1, and the number of times that the smart watch has had an application flow with the mobile phone in the history is 0. Therefore, according to the above preset priority policy, the laptop has the highest priority.
  • the preset priority policy may include setting all devices in the P2P network (ie, a network formed by wireless communication methods such as Bluetooth, Zigbee, NFC, UWB) where the transfer source device is located as the highest priority.
  • the mobile phone and the notebook computer form a P2P network by means of Bluetooth, and the mobile phone and the smart watch form a WLAN network by connecting to the same router. Therefore, according to the above preset priority policy, the laptop has the highest priority.
  • the preset priority policy may include setting all devices in the WLAN network where the flow source device is located (ie, a network formed by the same relay device or router) as the highest priority.
  • the mobile phone and the notebook computer form a P2P network by means of Bluetooth, and the mobile phone and the smart watch form a WLAN network by connecting to the same router. Therefore, according to the above preset priority strategy, the smart watch has the highest priority.
  • the preset priority policy may include setting all devices under the same user account as the transfer source device to have the highest priority.
  • the mobile phone and the laptop are two devices under the same user account, and the mobile phone and the laptop are connected to each other, and the mobile phone and the smart watch are connected to the same Routers form a WLAN network. Therefore, according to the above preset priority policy, the laptop has the highest priority.
  • the preset priority policy may include preferentially selecting all devices in the P2P network where the source device is located, and then determining the identification information of the destination device from all the above-mentioned devices according to the selection operation instruction; or, preferentially selecting the location where the source device is located. All devices in the P2P network, and then determine the time of application transfer with the transfer source device in history from all the above devices, and set the device with the latest time in the time of application transfer with the transfer source device as the highest priority.
  • the embodiment of the present application can determine the identification information of the transfer target device from the identification information of all devices through the above different implementations, thereby improving the efficiency and use experience of the application content transfer across devices.
  • S510 in this embodiment of the present application may include the following steps: when the first information carries the identification information of the transfer target device, obtain the application type of the target application currently running on the transfer source device.
  • the embodiment of the present application considers transferring the content of the target application currently running on the transfer source device, if the first information obtained by the transfer source device carries the ID information of the transfer target device, in combination with the above-mentioned FIG. 4
  • the application circulation framework of this application embodiment can identify the currently running target application through the application information module in the circulation source device to obtain application information (such as application name, application type, etc.) of the target application.
  • the application information module in the transfer source device can access the process or thread on the operating system of the transfer source device to obtain the application type of the target application.
  • the application type of the target application may include at least one of the following: distributed application, relay application, and common application.
  • the distributed application can be used to instruct the front end of the target application and the back end of the target application to implement separate running operations on different devices.
  • the target application when the target application is a distributed application, the backend of the target application needs to be run on the source device, and the frontend of the target application is transferred to the target device, and the target device runs the frontend of the target application. , without having to re-run the source device.
  • the relay application can be used to instruct the target application to implement storage, transfer, recovery or sharing operations on different devices through the file service on the streaming source device.
  • the file server (fileServer) on the streaming source device can stream the content of the target application (such as data stream, video stream, audio stream, etc.) to the streaming target device, and then The streaming target device accesses the file service on the streaming source device to restore the content of the target application.
  • the file service can provide an http access address, and provide it to an external application or a third-party cooperative application in the form of a data stream.
  • an external application or a third-party cooperative application can access the local multimedia data through the http access address.
  • a video player in the mobile phone is playing a local video file.
  • the mobile phone transmits data stream information such as the video name of the local video file, the http address of the video, and the playback progress through the relay application framework. to that laptop.
  • a notification box pops up, and the user is prompted through the notification box whether to relay the video from the mobile phone.
  • the laptop will run the video player on the local end, and the video player will access the file service on the mobile phone through the http address of the video in the received data stream information to obtain the local video
  • the file is restored (for example, the video is resumed), and the playback of the local video file is stopped on the mobile phone.
  • the common application can be used to instruct the target application to implement display operations on different devices through the screen projection technology.
  • the streaming source device can project the content of the target application to the display screen or display medium of the streaming target device for display, thereby displaying the synchronous display of the content.
  • the application information module can be accessed through the circulation policy module in the circulation source device to learn the application type of the target application, so as to determine the corresponding application circulation policy according to the application type of the target application.
  • determining an application flow strategy for the target application according to the application type may include the following steps: determining an application flow strategy according to the distributed application; wherein the application flow strategy is used to execute The following steps: Pause the front end of the target application from running on the streaming source device, and the streaming target device accesses the back end of the target application running on the streaming source device to start running the front end of the target application.
  • the application flow strategy can be: the backend of the target application continues to run on the source device, and the front end of the target application is transferred to the target device, and stops running the target itself.
  • the following takes two electronic devices, a mobile phone and a notebook computer, as examples for illustration.
  • the phone is currently running distributed application X.
  • the UI interface and server side of application X are both running.
  • the mobile phone points to the laptop through UWB, after passing through the distributed application framework, the mobile phone suspends the running of the UI interface of the application X, and the laptop starts to run the UI interface of the application X by accessing the server of the application X on the mobile phone.
  • the UBW identification module in the mobile phone shown in Fig. 8 obtains the UWB label of the notebook computer, and sends the UWB label of the notebook computer to the source and target determination modules. Then, the source and target determination module transmits the UWB tag of the mobile phone and the UWB tag of the notebook computer to the circulation strategy module, and the circulation strategy module accesses the application information module to know that the application X currently running on the mobile phone is a distributed application.
  • the flow strategy module initiates an application flow request to the distributed application framework in the application flow module, so as to suspend the UI interface of the application on the mobile phone through the distributed application framework, pull up the UI interface of the application X on the laptop, and notify the notebook
  • the computer starts to run the UI interface of application X, it accesses the server of application X on the mobile phone, so as to complete the cross-device transfer process of application X.
  • determining the application flow strategy for the target application according to the application type may include the following steps: determining the application flow strategy according to the relay application; wherein, the application flow strategy is used to execute The following steps: Pause the target application from running on the streaming source device, and the streaming target device accesses the file service of the streaming source device to start running the target application.
  • the application transfer strategy may be: the file service on the transfer source device transfers the content of the target application (such as data stream, video stream, audio stream, etc.) to the transfer target device;
  • the streaming target device accesses the file service on the streaming source device to start running the content of the target application.
  • the file service can provide an http access address, and provide it to an external application or a third-party cooperative application in the form of a data stream.
  • the following takes two electronic devices, a mobile phone and a notebook computer, as examples for illustration.
  • FIG. 9 Run a video player on the phone to play a local video file.
  • the mobile phone analyzes the voice to learn that the source device of the stream is a laptop.
  • the mobile phone pauses to play the local video file on the local video player, and the laptop starts playing (or continues to play) the video file on the local video player by accessing the file service on the mobile phone.
  • Local video files i.e. the laptop plays the same video as the phone).
  • the speech recognition module in the mobile phone shown in FIG. 9 recognizes the “playing on the laptop” speech, and transmits the recognition result to the source and target determination modules.
  • the source and target determination modules access the connection management module to query all devices connected to the mobile phone within the same user account or the same network. ID information.
  • the source and target determination module obtains the ID information of the laptop, and transmits the ID information of the mobile phone and the laptop to the circulation strategy module.
  • the circulation strategy module accesses the application information module to know that the video player currently running on the mobile phone is a relay application.
  • the flow strategy module initiates an application flow request to the relay application framework in the application flow module, so as to pause the video playback on the video player of the mobile phone through the relay application framework, and the laptop accesses the file service on the mobile phone to play the video
  • the video player on the local end continues to play the same video as that on the mobile phone.
  • determining an application flow strategy for the target application according to the application type may include the following steps: determining the application flow strategy according to the common application; wherein the application flow strategy is used to execute The following operations: If there is an application compatible with the target application and the content of the target application to be synchronized on the streaming target device, suspend the target application from running on the streaming source device, and project the content of the target application to the display screen or display medium of the streaming target device Or, if there is no application compatible with the target application on the streaming target device or does not support synchronizing the content of the target application, continue the target application to run on the streaming source device, and project the content of the target application to the display screen of the streaming target device or displayed on the display medium.
  • the application transfer strategy may be: the source device of the transfer projects the content of the target application to the display screen or display medium of the target device for display through the screen projection service framework, and judges that the content of the target application is displayed. Whether there is an application compatible with the running of the target application and supports synchronization of the content of the target application on the streaming target device; if there is an application that is compatible and supports synchronization, the streaming source device can suspend running the target application; if no application is compatible or supports synchronization, the streaming source device The target application can continue to run.
  • the target application of this embodiment of the present application may be an application program or media data running on the application layer of the streaming source device, such as photos, videos, audios, games, gallery, documents, or multimedia.
  • the circulation source device can run the target application on the front end, and can also run the target application on the back end.
  • the display screen of the streaming source device can display the content of the target application; when the streaming source device runs the target application at the back end, the display screen of the streaming source device may not display the target application The content of the application, while the target application is executed in the background.
  • the following takes two electronic devices, a mobile phone and a notebook computer, as examples for illustration.
  • the phone is currently running the normal application Y.
  • the mobile phone touches the notebook computer through NFC, after passing the screen casting service framework, the mobile phone projects the content of the running application Y to the display screen of the notebook computer for display. Since there is no compatible app running with app Y on the laptop, the phone needs to continue running app Y.
  • the content projected by the streaming source device on the display screen of the streaming target device may be referred to as a mirror image, and the mirror image may present all or part of the content of the target application.
  • the mirror image may be a picture presented after relevant operations such as resolution adjustment, display size adjustment, pixel adjustment, and image quality adjustment in the process of screen projection.
  • the following is an example description by taking the transfer source device as a notebook computer and the transfer target device as a mobile phone.
  • FIGS. 11 and 12 Illustratively, see FIGS. 11 and 12 .
  • the user opens a photo of "cat.jpg” through the “Gallery” application on the laptop, and uses the screen mirroring service framework or the normal application framework to transfer the content of the "Gallery” application on the laptop (ie Photo screen) is projected to the mobile phone.
  • the screencast content displayed on the display screen of the mobile phone is the same as the content of the "Gallery” application on the laptop computer (that is, the mirror image can present the entire screen of the content of the target application).
  • the user can screen only the "cat.jpg” opened by the "Gallery” application on the laptop to the mobile phone by setting the relevant screen projection options.
  • the screencast content displayed on the display screen of the mobile phone is only a partial picture of the content of the "Gallery” application (that is, the mirror image can present a partial picture of the content of the target application), such as showing the whole body or part of the entire "cat".
  • the embodiment of the present application considers determining different application circulation strategies according to different application types of target applications, so as to determine different application circulation strategies according to different application circulation strategies. Realize the flow of different application content across devices, ensure the diversity of application content flow across devices, and improve the efficiency and experience of application flow.
  • the transfer source device obtains the first information and determines whether the first information carries the identification information of the transfer target device; then, when the first information carries the identification information of the transfer target device, obtains the transfer The application type of the target application currently running on the source device, and the application flow strategy for the target application is determined according to the application type; finally, the content of the target application is flowed to the flow target device according to the application flow strategy. Since a target application is currently running on the circulation source device in the embodiment of the present application, in order to realize the transfer of the target application from the circulation source device to the circulation target device, the implementation of the present application considers that the circulation source device obtains the first information first, and judges the first information.
  • the implementation of the present application considers acquiring the application type of the target application, and determines different application transfer strategies according to the different application types of the target application.
  • the circulation strategy realizes the circulation of different application content across devices, ensures the diversity of application content circulation across devices, and improves the efficiency and user experience of application circulation.
  • FIG. 13 is a schematic flowchart of another method for transferring application content across devices provided by an embodiment of the present application, which is applied to the first transfer target device, and the method includes:
  • a target application runs on the circulation source device in the embodiment of the present application, and the target application is streamed to the first circulation target device by the circulation source device.
  • the target application exists on the first transfer target device.
  • the target application may be an application program or media data running on the application layer of the streaming source device, such as photos, videos, audios, games, gallery, documents or multimedia.
  • the circulation source device can run the target application on the front end, and can also run the target application on the back end.
  • the display screen of the streaming source device may display the current content of the target application; when the streaming source device runs the target application at the back end, the display screen of the streaming source device may not display the target application.
  • the current content of the target application, and the target application continues to be executed in the background.
  • the first circulation target device may run the target application circulated by the circulation source device at the front end, and may also run the target application circulated by the circulation source device at the back end.
  • the method may further include the following steps: acquiring the first information, and judging whether the first information carries the identification information of the second transfer target device.
  • the first information may satisfy at least one of the following manners: the first information is acquired by sensor recognition, the first information is acquired by voice recognition, the first information is acquired by gesture recognition, the first information is acquired by image Recognition and acquisition, the first information is acquired through human gesture recognition, the first information is acquired through facial motion recognition, and the first information is acquired through human motion recognition;
  • the above sensors may include at least one of the following: ultra-bandwidth UWB sensor, near field communication NFC sensor, laser sensor, visible light sensor.
  • the embodiment of the present application needs to further realize the flow of the target application from the flow source device to the second flow target device through the first flow target device.
  • the first information may be acquired through an information acquisition module in the first transfer target device, and the source and The target determination module determines whether the first information carries the identification information of the second transfer target device, so as to realize that the second transfer target device is determined by the first transfer target device.
  • the first information acquired by the first transfer target device may directly carry the ID information of the second transfer target device.
  • the first information acquired by the information acquisition module in the first transfer target device by recognizing voice, image, human posture, facial movement, human body motion, etc. may not carry the identification information of the second transfer target device.
  • the method may further include the following steps: when the first information does not carry the identification information of the second transfer target device, obtain the first information Identification information of all devices connected to the first transfer target device under the current user account of the transfer target device; or, obtain identification information of all devices connected to the first transfer target device in the network where the first transfer target device is located ; Determine the identification information of the transfer target device from the identification information of all devices.
  • the connection management module in the first circulation target device can obtain the current user account of the first circulation target device and the connection between the first circulation target device and the first circulation target device. ID information of all connected devices; or, obtain ID information of all devices connected to the first transfer target device in the network where the first transfer target device is located through a connection management module in the first transfer target device.
  • the current user account of the first transfer target device and the current user account of the transfer source device are the same;
  • the network where the first transfer target device is located may be a WLAN network formed by a relay device or a wireless communication method. or a P2P network, and the transfer source device is also located in the network where the first transfer target device is located.
  • the different access methods described in the above embodiments can be specifically referred to to obtain the ID information of the same user account as the first transfer target device or the ID information of all devices under the same network to determine the second transfer target devices, so as to ensure more convenient transfer of application content across devices, and improve the efficiency, diversity and experience of application transfer.
  • the following embodiments of the present application will specifically describe how the first transfer target device determines the identification information of the second transfer target device from the identification information of all devices.
  • determining the identification information of the second transfer target device from the identification information of all the devices may include the following steps: if the identification information of all devices except the identification information of the transfer source device and the identification information of the first transfer target device, only There is identification information of a device, then the identification information of the device is used as the identification information of the second transfer target device; or, if the identification information of all devices exists in addition to the identification information of the transfer source device and the identification information of the first transfer target device The identification information of the at least two devices, then obtain the selection operation instruction for the identification information of the at least two devices; determine the identification information of the second transfer target device from the identification information of the at least two devices according to the selection operation instruction; or, if all In the identification information of the device, in addition to the identification information of the transfer source device and the identification information of the first transfer destination device, there are identification information of at least two devices, then according to the preset priority policy, the identification information of the at least two devices has the highest priority.
  • the identification information of the second transfer target device is used as the identification information
  • the The device acts as the second streaming target device and obtains the ID information of the device, so that the streaming source device can stream the content of the currently running target application to the device, and suspend the first streaming target device to run the target application.
  • a list of options including the multiple devices can be displayed on the display screen of the first transfer target device through a pop-up window, a drop-down menu, etc., and then the user can select one or more devices from the list of options as the second device. Stream the target device.
  • S1310 in this embodiment of the present application may specifically include the following steps: when the first information carries the identification information of the second transfer target device, obtain the application type of the target application on the first transfer target device, and the target application is transferred by the transfer source device. to the first flow target device.
  • the embodiment of the present application when the embodiment of the present application considers that the target application is transferred from the transfer source device to the second transfer target device through the first transfer target device, if the first information obtained by the first transfer target device carries the second transfer target
  • the ID information of the device combined with the application flow framework in the above-mentioned FIG. 4, the embodiment of the present application can identify the target application it runs through the application information module in the first flow target device to obtain the application information of the target application (such as the application name). , application type, etc.).
  • the application information module in the first transfer target device may access a process or thread on the operating system of the first transfer target device to obtain the application type of the target application.
  • the application type of the target application may include at least one of the following: a screen-casting application, a distributed application, a relay application, and a common application; wherein the screen-casting application is used to instruct the target application to continue to run on the transfer source device , and the streaming source device suspends the content of the target application to display on the first streaming target device, and projects the content of the target application to the display screen or display medium of the second streaming target device for display; the distributed application is used to instruct the The front-end of the target application and the back-end of the target application are operated separately on different devices; the relay application is used to instruct the target application to be stored, restored or shared on different devices through the file service on the streaming source device; common The application is used to instruct the target application to realize the display operation on different devices through the screen casting technology.
  • the embodiment of the present application when the embodiment of the present application considers that the target application is transferred from the transfer source device to the second transfer target device through the first transfer target device, if the first transfer target device has already obtained the ID information of the second transfer target device. , in conjunction with the application flow framework in the above-mentioned FIG. 4, the embodiment of the present application can access the application information module through the flow strategy module in the first flow target device to learn the application type of the target application, so as to determine its corresponding application type according to the application type of the target application. application flow strategy.
  • determining the application circulation strategy for the target application according to the application type may include the following steps: determining the application circulation strategy according to the screen-casting application; wherein, the application circulation strategy uses and performing the following steps: suspending the target application from running on the first streaming target device through the screen projection service framework, and projecting the content of the target application to the display screen or display medium of the second streaming target device for display.
  • the application transfer strategy may be: the first transfer target device feeds back information to the transfer source device to save it; the transfer source device then suspends the transfer of the target application through the screen-casting service framework.
  • the content is projected to the display screen of the first flow target device for display, and the content of the target application is projected to the display screen or display medium of the second flow target device for display.
  • the screen of the smart watch is showing the screen-casting application Z projected by the mobile phone through the screen-casting service framework.
  • the mobile phone suspends projecting the content of Application Z to the display of the smartwatch through the screen casting service framework, and projects the content of Application Z to the display of the laptop for display.
  • determining an application flow strategy for the target application according to the application type may include the following steps: determining the application flow strategy according to the distributed application; wherein the application flow strategy is used to execute The following steps: suspend the front end of the target application from running on the first streaming target device, and access the back end of the target application running on the streaming source device by the second streaming target device to start running the front end of the target application.
  • the application transfer strategy may be: the first transfer target device first feeds back information to the backend of the target application on the transfer source device to save it; the target application continues to run on the transfer source device the back end of the target application, and then transfer the front end of the target application to the second transfer target device, and stop the first transfer target device from running the front end of the target application; the second transfer target device accesses the back end of the target application running on the transfer source device to Start running the front end of the target application.
  • determining an application flow strategy for the target application according to the application type may include the following steps: determining an application flow strategy according to the relay application; wherein the application flow strategy is used to execute The following steps: suspend the target application from running on the first streaming target device, and access the file service of the streaming source device by the second streaming target device to start running the target application.
  • the application transfer strategy may be: the first transfer target device first feeds back information to the file service on the transfer source device to save it; the file service on the transfer source device then transfers the target application.
  • the content of the stream is transferred to the second transfer target device; the second transfer target device accesses the file service on the transfer source device to start running the content of the target application.
  • the file service can provide an http access address, and provide it to an external application or a third-party cooperative application in the form of a data stream.
  • determining an application flow strategy for the target application according to the application type may include the following steps: determining an application flow strategy according to the common application; wherein the application flow strategy is used to execute The following steps: if the second streaming target device has an application compatible with the target application and supports the content of the synchronization target application, suspend the running of the target application on the first streaming target device, and project the content of the target application to the second streaming target device. Display on the display screen or display medium; or, if the second streaming target device does not have an application compatible with the target application or does not support synchronizing the content of the target application, continue the target application to run on the first streaming target device, and transfer the target application's content. The content is projected on the display screen or display medium of the second streaming target device for display.
  • the application transfer strategy may be: the first transfer target device first feeds back information to the transfer source device for saving; the transfer source device then projects the content of the target application through the screen projection service framework Display it on the display screen or display medium of the second streaming target device, and determine whether there is an application compatible with the running of the target application and the content of the target application that supports synchronization on the second streaming target device; if there is an application that is compatible and supports synchronization, the streaming The source device can suspend running the target application; if no application is compatible or supports synchronization, the streaming source device can continue running the target application.
  • the embodiment of the present application considers determining different application circulation strategies according to different application types of target applications, so as to Different application flow strategies realize the cross-device flow of different application contents, ensure the diversity of cross-device flow of application content, and improve application flow and efficiency and user experience.
  • the first transfer target device obtains the first information and determines whether the first information carries the identification information of the second transfer target device; then, the first information carries the identification information of the second transfer target device.
  • the application type of the target application currently running on the first circulation source device is obtained, and the application circulation strategy for the target application is determined according to the application type; finally, the content of the target application is streamed to the second circulation target device according to the application circulation strategy.
  • the implementation of this application considers that the first transfer target device first obtains the first information, and determines whether the first information carries the identification information of the second transfer target device, so that the first transfer target device can determine the first transfer target device. Second stream target device.
  • the present application considers acquiring the application type of the target application, and determines different applications according to the different application types of the target application.
  • Circulation strategy so as to realize the cross-device circulation of different application contents through different application circulation strategies, ensure the diversity of application content circulation across devices, and improve the efficiency and use experience of application circulation.
  • the electronic device includes corresponding hardware structures and/or software modules for executing each function.
  • the present application can be implemented in hardware or in the form of a combination of hardware and computer software, in combination with the units and algorithm steps of each example described in the embodiments provided herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.
  • the electronic device may be divided into functional modules according to the foregoing method examples.
  • each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing unit.
  • the processing unit may be a processor or a controller, such as a CPU, a general-purpose processor, a DSP, an ASIC, an FPGA, a transistor logic device, a hardware component, or any combination thereof. It can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a DSP and a microprocessor, so that the processing unit can implement or execute various exemplary logic blocks, modules described in conjunction with the above. and circuit.
  • the processing unit may be used to perform any step performed by the electronic device in the above method embodiments, and when performing data transmission such as sending, the communication unit may be selectively invoked to complete the corresponding operation, and the communication unit may It is a communication interface, a transceiver and a transceiver circuit.
  • the above-mentioned integrated modules can be implemented in either the form of hardware or the form of software. It should be noted that, the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division manners in actual implementation.
  • FIG. 15 shows a block diagram of the functional modules of an apparatus for transferring application content across devices.
  • the apparatus 1500 for transferring application content across devices is applied to a transferring source device, and specifically includes: an application information module 1510 , a transferring policy module 1520 and an application transferring module 1530 .
  • the application information module 1510 is used to obtain the application type of the target application currently running on the circulation source device;
  • the circulation strategy module 1520 is used to determine the application circulation strategy for the target application according to the application type;
  • the application circulation module 1530 is used to The content of the target application is streamed to the stream target device.
  • the device for cross-device flow of application content determines different application flow strategies according to different application types of the target application to realize cross-device flow of different application content, thereby ensuring the diversity of cross-device flow of application content. , and improve the efficiency and user experience of application circulation.
  • the application type includes at least one of the following: a distributed application, a relay application, and a common application; wherein the distributed application is used to indicate the front end of the target application and the target The back-end of the application implements separate running operations on different devices; the relay application is used to instruct the target application to implement storage, recovery or sharing operations on different devices through the file service on the streaming source device; the The common application is used to instruct the target application to implement display operations on different devices through the screen projection technology.
  • the flow strategy module 1620 is specifically configured to: according to the distributed application The application determines the application flow strategy; wherein the application flow strategy is used to perform the following steps: suspend the front end of the target application from running on the flow source device, and the flow target device accesses the flow source device Running on the backend of the target application to start running the frontend of the target application.
  • the flow strategy module 1620 is specifically configured to: according to the relay type The application determines the application circulation strategy; wherein the application circulation strategy is used to perform the following steps: suspend the target application from running on the circulation source device, and the circulation target device accesses the file of the circulation source device service to start running the target application.
  • the flow policy module 1620 is specifically configured to: according to the common application
  • the application determines the application flow strategy; wherein, the application flow strategy is used to perform the following steps: if there is an application on the flow target device that is compatible with the target application and supports synchronizing the content of the target application, suspend the target application
  • the application runs on the streaming source device, and projects the content of the target application to the display screen or display medium of the streaming target device for display; or, if no application on the streaming target device is compatible with the target application or does not support synchronizing the content of the target application, then continue to run the target application on the streaming source device, and project the content of the target application to the display screen or display medium of the streaming target device. show.
  • the apparatus 1500 for transferring applications across devices further includes an information acquisition module and a determination information module; wherein, the information acquisition module is used to acquire first information; the determination information module is used to determine whether the first information is carried The identification information of the transfer target device.
  • the apparatus 1500 for transferring applications across devices further includes a connection management module; wherein the connection management module is configured to acquire the transfer source when the first information does not carry the identification information of the transfer target device Identification information of all devices connected to the circulation source device under the current user account of the device; or, obtain identification information of all devices connected to the circulation source device in the network where the circulation source device is located; determination information The module is further configured to determine the identification information of the transfer target device from the identification information of all the devices.
  • the determining information module is specifically configured to: if the identification information of all the devices excludes the transfer source device In addition to the identification information of the device, there is only the identification information of one device, then the identification information of the device is used as the identification information of the transfer target device; or, if the identification information of all the devices is excluding the identification information of the transfer source device If the identification information of at least two devices exists outside, a selection operation instruction for the identification information of the at least two devices is obtained; the transfer target device is determined from the identification information of the at least two devices according to the selection operation instruction.
  • the identification information of the at least two devices is assigned according to the preset priority policy.
  • the identification information with the highest priority in the information is used as the identification information of the transfer target device.
  • the information acquisition module may include at least one of the following: a sensor recognition module, a voice recognition module, a gesture recognition module, an image recognition module, a human gesture recognition module, a facial motion recognition module, and a human motion recognition module; wherein , the sensor includes at least one of the following: an ultra-wideband UWB sensor, a near field communication NFC sensor, a laser sensor, and a visible light sensor.
  • FIG. 16 shows a block diagram of the functional modules of an apparatus for transferring application content across devices.
  • the apparatus 1600 for transferring application content across devices is applied to the first transferring target device, and specifically includes: an application information module 1610 , a transferring strategy module 1620 and an application transferring module 1630 .
  • the application information module 1610 is configured to obtain the application type of the target application on the first transfer target device when the first information carries the identification information of the second transfer target device, and the target application is transferred from the transfer source device to the first transfer target device;
  • the flow strategy module 1620 is used to determine an application flow strategy for the target application according to the application type; the application flow module 1630 is used to flow the content of the target application to the second flow target device according to the application flow strategy.
  • the device for cross-device flow of application content determines different application flow strategies according to different application types of the target application to realize cross-device flow of different application content, thereby ensuring the diversity of cross-device flow of application content. , and improve the efficiency and user experience of application circulation.
  • the following introduces a schematic structural diagram of another electronic device 1700 provided by an embodiment of the present application, as shown in FIG. 17 .
  • the electronic device 1700 is a streaming source device, and the electronic device 1700 includes a processor 1710 , a memory 1720 , a communication interface 1730 and at least one communication bus for connecting the processor 1710 , the memory 1720 , and the communication interface 1730 .
  • Processor 1710 may be one or more central processing units (CPUs). In the case where the processor 1710 is a CPU, the CPU may be a single-core CPU or a multi-core CPU.
  • the memory 1720 includes, but is not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM) or portable Read-only memory (Compact Disc Read-Only Memory, CD-ROM), and the memory 1720 is used for related instructions and data.
  • Communication interface 1730 is used to receive and transmit data.
  • the processor 1710 in the electronic device 1700 is configured to read one or more programs 1721 stored in the memory 1720 to perform the following steps: obtain the application type of the target application currently running on the streaming source device; determine the application type for the target application according to the application type. Apply the circulation strategy; according to the application circulation strategy, the content of the target application is circulated to the circulation target device.
  • the electronic device determines different application flow strategies according to different application types of the target application to realize the cross-device flow of different application contents, thereby ensuring the diversity of the cross-device flow of application content, and improving the application content. Circulation efficiency and user experience.
  • the following introduces a schematic structural diagram of another electronic device 1800 provided by an embodiment of the present application, as shown in FIG. 18 .
  • the electronic device 1800 is the first transfer target device, and the electronic device 1800 includes a processor 1810 , a memory 1820 , a communication interface 1830 and at least one communication bus for connecting the processor 1810 , the memory 1820 , and the communication interface 1830 .
  • Processor 1810 may be one or more central processing units (CPUs). In the case where the processor 1810 is a CPU, the CPU may be a single-core CPU or a multi-core CPU.
  • Memory 1820 includes, but is not limited to, RAM, ROM, EPROM, or CD-ROM, and is used for related instructions and data.
  • Communication interface 1830 is used to receive and transmit data.
  • the processor 1810 in the electronic device 1800 is configured to read one or more programs 1821 stored in the memory 1820 to perform the following steps: obtain the application type of the target application on the first streaming target device, and the target application is streamed from the streaming source device to The first circulation target device; the application circulation strategy for the target application is determined according to the application type; the content of the target application is circulated to the second circulation target device according to the application circulation strategy.
  • the electronic device determines different application flow strategies according to different application types of the target application to realize the cross-device flow of different application contents, thereby ensuring the diversity of the cross-device flow of application content, and improving the application content. Circulation efficiency and user experience.
  • Embodiments of the present application further provide a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, and the computer program is operable to cause a computer to execute any of the methods described in the foregoing method embodiments. some or all of the steps of a method.
  • Embodiments of the present application further provide a computer program product, wherein the computer program product includes a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any method described in the above method embodiments.
  • the computer program product may be a software installation package.
  • the above modules or units are implemented in the form of software functions and sold or used as independent products, they may be stored in a computer-readable storage medium.
  • the technical solution of the present application (the part of the technical solution that contributes to the prior art or the whole or part of the technical solution) can be embodied in the form of a computer software product.
  • the computer software product is stored in a memory, and includes several instructions for causing a computer device (personal computer, server, or network device, etc.) to execute all or part of the steps of the embodiments of the present application.
  • the above-mentioned computer-readable storage medium may be stored in various memories such as U disk, ROM, RAM, removable hard disk, magnetic disk, or optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Embodiments of the present application disclose a method and an apparatus for transferring application content across devices, and an electronic device. Said method comprises: acquiring an application type of a target application currently running in a transferring source device; determining an application transferring policy for the target application according to the application type; and transferring, according to the application transferring policy, content of the target application to a transferring target device. Hence, in the embodiments of the present application, different application transferring policies are determined according to different application types of target applications, so that different application content is transferred across devices by means of different application transferring policies, thereby ensuring the diversity of application content transferring across devices, and improving the efficiency of application transferring and use experience.

Description

应用内容跨设备流转方法与装置、电子设备Method and device for transferring application content across devices, and electronic device
本发明要求2020年11月16日递交的发明名称为“应用内容跨设备流转方法与装置、电子设备”的申请号202011282590.3的在先申请优先权,上述在先申请的内容以引入的方式并入本文本中。The present invention claims the priority of the prior application filed on November 16, 2020, entitled "Method and Apparatus for Circulating Application Contents across Devices, Electronic Devices", and the priority of the prior application, the contents of which are incorporated by way of introduction in this text.
技术领域technical field
本申请涉及计算机技术领域,具体涉及一种应用内容跨设备流转方法与装置、电子设备。The present application relates to the field of computer technologies, and in particular, to a method and device for transferring application content across devices, and an electronic device.
背景技术Background technique
目前,用户可能同时拥有多个设备,而设备可能有多种形态,如手机、电脑、平板、电视、手表等,并且不同设备上可能搭载不同操作系统、软硬件架构等。例如,电脑上可搭载Windows或Mac等系统,手机上可搭载Android或IOS等系统。At present, users may have multiple devices at the same time, and the devices may have various forms, such as mobile phones, computers, tablets, TVs, watches, etc., and different devices may be equipped with different operating systems, software and hardware architectures, etc. For example, a computer can be equipped with a system such as Windows or Mac, and a mobile phone can be equipped with a system such as Android or IOS.
另外,应用流转技术是一种将一个或多个设备上当前运行的应用的内容(如画面、文字或音频等)传输到另一个或多个设备以使其运行该应用的内容的技术。因此,如何将不同设备或系统上运行的应用通过应用流转技术进行应用内容跨设备流转,从而实现在不同设备或系统上运行应用的内容,仍然存在一些需要解决的问题。In addition, the application streaming technology is a technology that transmits the content (such as picture, text or audio, etc.) of an application currently running on one or more devices to another or more devices so that the content of the application can be run. Therefore, there are still some problems that need to be solved on how to transfer the application content across the devices through the application transfer technology, so as to realize the content of the application running on the different devices or systems.
发明内容SUMMARY OF THE INVENTION
本申请实施例提供了一种应用内容跨设备流转方法与装置、电子设备,以期望根据目标应用的应用类型的不同确定不同的应用流转策略以实现不同的应用内容跨设备流转,从而保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。Embodiments of the present application provide a method, apparatus, and electronic device for cross-device flow of application content, so as to determine different application flow strategies according to different application types of target applications to realize cross-device flow of different application content, thereby ensuring application content Diversity of flow across devices, and improve the efficiency and experience of application flow.
第一方面,本申请实施例提供一种应用内容跨设备流转方法,应用于流转源设备,所述方法包括:In a first aspect, an embodiment of the present application provides a method for cross-device streaming of application content, which is applied to a streaming source device, and the method includes:
获取所述流转源设备当前运行的目标应用的应用类型;Obtain the application type of the target application currently running on the circulation source device;
根据所述应用类型确定针对所述目标应用的应用流转策略;Determine an application flow strategy for the target application according to the application type;
按照所述应用流转策略将所述目标应用的内容流转至流转目标设备。The content of the target application is transferred to the transfer target device according to the application transfer policy.
第二方面,本申请实施例提供一种应用内容跨设备流转方法,应用于第一流转目标设备,所述方法包括:In a second aspect, an embodiment of the present application provides a method for cross-device streaming of application content, which is applied to a first streaming target device, and the method includes:
获取所述第一流转目标设备上目标应用的应用类型,所述目标应用由流转源设备流转至所述第一流转目标设备;acquiring the application type of the target application on the first transfer target device, where the target application is transferred from the transfer source device to the first transfer target device;
根据所述应用类型确定针对所述目标应用的应用流转策略;Determine an application flow strategy for the target application according to the application type;
按照所述应用流转策略将所述目标应用的内容流转至第二流转目标设备。The content of the target application is transferred to the second transfer target device according to the application transfer policy.
第三方面,本申请实施例提供一种应用内容跨设备流转装置,应用于流转源设备;所述装置包括:In a third aspect, an embodiment of the present application provides an apparatus for cross-device streaming of application content, which is applied to a streaming source device; the device includes:
应用信息模块,用于获取所述流转源设备当前运行的目标应用的应用类型;an application information module, used to obtain the application type of the target application currently running on the circulation source device;
流转策略模块,用于根据所述应用类型确定针对所述目标应用的应用流转策略;a flow strategy module, configured to determine an application flow strategy for the target application according to the application type;
应用流转模块,用于按照所述应用流转策略将所述目标应用的内容流转至流转目标设备。The application flow module is configured to flow the content of the target application to the flow target device according to the application flow strategy.
可见,本申请实施例中,应用内容跨设备流转装置根据目标应用的应用类型的不同确定不同的应用流转策略以实现不同的应用内容跨设备流转,从而保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。It can be seen that, in the embodiment of the present application, the device for cross-device flow of application content determines different application flow strategies according to different application types of the target application to realize cross-device flow of different application content, thereby ensuring the diversity of cross-device flow of application content, and Improve the efficiency and user experience of application circulation.
第四方面,本申请实施例提供一种应用内容跨设备流转装置,应用于第一流转源设备;所述装置包括:In a fourth aspect, an embodiment of the present application provides an apparatus for cross-device flow of application content, which is applied to a first flow source device; the apparatus includes:
应用信息模块,用于获取所述第一流转目标设备上目标应用的应用类型,所述目标应用由流转源设备流转至所述第一流转目标设备;an application information module, configured to obtain the application type of the target application on the first transfer target device, and the target application is transferred from the transfer source device to the first transfer target device;
流转策略模块,用于根据所述应用类型确定针对所述目标应用的应用流转策略;a flow strategy module, configured to determine an application flow strategy for the target application according to the application type;
应用流转模块,用于按照所述应用流转策略将所述目标应用的内容流转至第二流转目标设备。The application flow module is configured to flow the content of the target application to the second flow target device according to the application flow strategy.
可见,本申请实施例中,应用内容跨设备流转装置根据目标应用的应用类型的不同确定不同的应用流转策略以实现不同的应用内容跨设备流转,从而保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。It can be seen that, in the embodiment of the present application, the device for cross-device flow of application content determines different application flow strategies according to different application types of the target application to realize cross-device flow of different application content, thereby ensuring the diversity of cross-device flow of application content, and Improve the efficiency and user experience of application circulation.
第五方面,本申请实施例提供一种电子设备,所述电子设备为流转源设备,包括处理器、存储器和通信接口,所述存储器存储有一个或多个程序,并且所述一个或多个程序由所述处理器执行,所述一个 或多个程序用于执行本申请实施例第一方面中的步骤的指令。In a fifth aspect, an embodiment of the present application provides an electronic device, the electronic device is a flow source device, including a processor, a memory, and a communication interface, the memory stores one or more programs, and the one or more programs A program is executed by the processor, and the one or more programs are used to execute instructions of the steps in the first aspect of the embodiments of the present application.
可见,本申请实施例中,电子设备根据目标应用的应用类型的不同确定不同的应用流转策略以实现不同的应用内容跨设备流转,从而保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。It can be seen that, in the embodiment of the present application, the electronic device determines different application circulation strategies according to different application types of the target application to realize the cross-device circulation of different application contents, thereby ensuring the diversity of application content circulation across devices, and improving application circulation. Efficiency and user experience.
第六方面,本申请实施例提供一种电子设备,所述电子设备为第一流转目标设备,包括处理器、存储器和通信接口,所述存储器存储有一个或多个程序,并且所述一个或多个程序由所述处理器执行,所述一个或多个程序用于执行本申请实施例第二方面中的步骤的指令。In a sixth aspect, an embodiment of the present application provides an electronic device, where the electronic device is a first transfer target device, and includes a processor, a memory, and a communication interface, the memory stores one or more programs, and the one or more programs are stored in the memory. A plurality of programs are executed by the processor, and the one or more programs are used to execute instructions of the steps in the second aspect of the embodiments of the present application.
可见,本申请实施例中,电子设备根据目标应用的应用类型的不同确定不同的应用流转策略以实现不同的应用内容跨设备流转,从而保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。It can be seen that, in the embodiment of the present application, the electronic device determines different application circulation strategies according to different application types of the target application to realize the cross-device circulation of different application contents, thereby ensuring the diversity of application content circulation across devices, and improving application circulation. Efficiency and user experience.
第七方面,本申请实施例提供一种计算机可读存储介质,其中,所述计算机可读存储介质存储用于电子数据交换的计算机程序,所述计算机程序可操作来使得计算机执行本申请实施例第一方面或第二方面中所描述的部分或全部步骤。In a seventh aspect, the embodiments of the present application provide a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, and the computer program is operable to cause a computer to execute the embodiments of the present application some or all of the steps described in the first aspect or the second aspect.
第八方面,本申请实施例提供一种计算机程序产品,其中,所述计算机程序产品包括计算机程序,所述计算机程序可操作来使得计算机执行本申请实施例第一方面或第二方面中所描述的部分或全部步骤。所述计算机程序产品可以为一个软件安装包。In an eighth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a computer program, and the computer program is operable to cause a computer to execute the description in the first aspect or the second aspect of the embodiment of the present application some or all of the steps. The computer program product may be a software installation package.
附图说明Description of drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍。显而易见地,下面描述的附图仅仅是本申请的一些实施例。对于本领域技术人员而言,在不付出创造性劳动的前提下,还可以根据这些附图获得其他附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings that are required to be used in the description of the embodiments or the prior art. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.
图1是本申请实施例提供的一种应用内容流转通信系统的架构示意图;1 is a schematic diagram of the architecture of a communication system for application content flow provided by an embodiment of the present application;
图2是本申请实施例提供的一种电子设备的硬件结构示意图;2 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application;
图3是本申请实施例提供的一种电子设备的软件结构示意图;3 is a schematic diagram of a software structure of an electronic device provided by an embodiment of the present application;
图4是本申请实施例提供的一种电子设备的结构示意图;4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;
图5是本申请实施例提供的一种应用内容跨设备流转方法的流程示意图;5 is a schematic flowchart of a method for transferring application content across devices provided by an embodiment of the present application;
图6是本申请实施例提供的一种应用内容跨设备流转的结构示意图;6 is a schematic structural diagram of cross-device flow of application content provided by an embodiment of the present application;
图7是本申请实施例提供的又一种应用内容跨设备流转的结构示意图;7 is a schematic structural diagram of another cross-device flow of application content provided by an embodiment of the present application;
图8是本申请实施例提供的又一种应用内容跨设备流转的结构示意图;8 is a schematic structural diagram of another cross-device flow of application content provided by an embodiment of the present application;
图9是本申请实施例提供的又一种应用内容跨设备流转的结构示意图;FIG. 9 is a schematic structural diagram of another cross-device flow of application content provided by an embodiment of the present application;
图10是本申请实施例提供的又一种应用内容跨设备流转的结构示意图;FIG. 10 is a schematic structural diagram of another cross-device flow of application content provided by an embodiment of the present application;
图11是本申请实施例提供的又一种应用内容跨设备流转的结构示意图;11 is a schematic structural diagram of another application content flow across devices provided by an embodiment of the present application;
图12是本申请实施例提供的又一种应用内容跨设备流转的结构示意图;12 is a schematic structural diagram of another application content flow across devices provided by an embodiment of the present application;
图13是本申请实施例提供的一种应用内容跨设备流转方法的流程示意图;13 is a schematic flowchart of a method for transferring application content across devices provided by an embodiment of the present application;
图14是本申请实施例提供的又一种应用内容跨设备流转的结构示意图;14 is a schematic structural diagram of another application content flow across devices provided by an embodiment of the present application;
图15是本申请实施例提供的一种应用内容跨设备流转装置的功能模块组成框图;FIG. 15 is a block diagram showing the composition of functional modules of an apparatus for transferring application content across devices provided by an embodiment of the present application;
图16是本申请实施例提供的又一种应用内容跨设备流转装置的功能模块组成框图;FIG. 16 is a block diagram of functional modules of another device for cross-device flow of application content provided by an embodiment of the present application;
图17是本申请实施例提供的又一种电子设备的结构示意图;17 is a schematic structural diagram of another electronic device provided by an embodiment of the present application;
图18是本申请实施例提供的又一种电子设备的结构示意图。FIG. 18 is a schematic structural diagram of another electronic device provided by an embodiment of the present application.
具体实施方式Detailed ways
为了本技术领域人员更好理解本申请的技术方案,下面结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本申请的部分实施例,而并非全部的实施例。基于本申请实施例的描述,本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请所保护的范围。In order for those skilled in the art to better understand the technical solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only the Some embodiments of the application, but not all embodiments. Based on the description of the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.
在对本申请实施例的技术方案进行描述之前,下面先对本申请可能涉及的相关概念、应用内容流转通信系统、电子设备的软硬件结构等进行介绍。Before describing the technical solutions of the embodiments of the present application, related concepts, application content transfer communication systems, and software and hardware structures of electronic devices that may be involved in the present application are introduced below.
本申请实施例的应用流转技术是将一个或多个设备上当前运行的应用的内容(如画面、文字或音频等)传输到另一个或多个设备以使其运行该应用的内容。此外,该应用流转技术可以包括应用投屏技术、应用接力(handoff)技术、应用分布技术等。其中,应用投屏技术是将一个设备上运行的应用的内容投射到另一设备的显示屏或显示介质上进行显示,是典型的信息同步方式;应用接力技术是一种将一个 设备上运行的应用的内容存储、传递或者共享给另一个设备的技术;应用分布技术是一种在一个设备上运行某个应用的后端(如为用户接口UI界面的展示业务逻辑功能做处理),而在另一个设备上运行该应用的前端(如用户接口UI界面),并且需要实时访问该应用的后端。The application streaming technology in the embodiment of the present application is to transmit the content (such as picture, text or audio, etc.) of the application currently running on one or more devices to another or more devices so that the content of the application can be run. In addition, the application flow technology may include an application screen projection technology, an application handoff technology, an application distribution technology, and the like. Among them, the application screen projection technology is to project the content of the application running on one device to the display screen or display medium of another device for display, which is a typical information synchronization method; Application content storage, transmission or sharing technology to another device; application distribution technology is a back-end running an application on one device (such as processing the display business logic function of the user interface UI interface), and in the Another device runs the application's front-end (such as a user interface UI interface), and needs to access the application's back-end in real time.
需要说明的是,本申请实施例将发起流转其应用的内容的设备称为流转源设备,而将接收该应用的内容的设备称为流转目标设备。It should be noted that, in this embodiment of the present application, the device that initiates the streaming of the content of the application is referred to as the streaming source device, and the device that receives the content of the application is referred to as the streaming target device.
其次,本申请所涉及的应用流转技术可以包括有线方式和无线方式。其中,有线方式是通过高清多媒体接口(highdefinitionmultimediainterface,HDMI)数据线、通用串行总线(universal serial bus,USB)数据线等建立流转源设备与流转目标设备之间的有线连接以传输媒体数据;无线方式是通过数字生活网络联盟(digistal living network alliance,DLNA)协议、无线显示分享(Miracast)或隔空播放(AirPlay)协议等建立流转源设备与流转目标设备之间的无线连接以传输媒体数据。Secondly, the application flow technology involved in the present application may include a wired manner and a wireless manner. Among them, the wired method is to establish a wired connection between the streaming source device and the streaming target device through a high-definition multimedia interface (HDMI) data cable, a universal serial bus (USB) data cable, etc. to transmit media data; wireless; The method is to establish a wireless connection between the streaming source device and the streaming destination device through the digital living network alliance (DLNA) protocol, wireless display sharing (Miracast) or airplay (AirPlay) protocol to transmit media data.
示例性的,在应用流转时,流转源设备可以把当前视频播放器中的视频流通过数据编码压缩之后发送到流转目标设备;然后,流转目标设备解码视频流数据,并在其显示屏上显示该视频流。Exemplarily, when applying streaming, the streaming source device can compress the video stream in the current video player and send it to the streaming destination device after encoding and compressing the data; then, the streaming destination device decodes the video stream data and displays it on its display screen. the video stream.
另外,本申请实施例可以将流转源设备和流转目标设备统称为电子设备。其中,本申请实施例的电子设备可以是手持设备、车载设备、可穿戴设备、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、投影设备、投影仪或者连接到无线调制解调器的其他设备,也可以是各种具体形式的用户设备(user equipment,UE)、终端设备(terminal device)、手机(smart phone)、智慧屏、智慧电视、智能手表、笔记本电脑、智能音响、摄像头、游戏手柄、麦克风、站点(station,STA)、接入点(access point,AP)、移动台(mobile Station,MS)、个人数字助理(personal digital assistant,PDA)、个人计算机(personal computer,PC)或者中继设备等。In addition, in this embodiment of the present application, the transfer source device and the transfer target device may be collectively referred to as electronic devices. The electronic device in this embodiment of the present application may be a handheld device, a vehicle-mounted device, a wearable device, an augmented reality (AR) device, a virtual reality (VR) device, a projection device, a projector, or a wireless Other devices of the modem can also be various specific forms of user equipment (UE), terminal device (terminal device), mobile phone (smart phone), smart screen, smart TV, smart watch, notebook computer, smart audio, Camera, gamepad, microphone, station (STA), access point (AP), mobile station (mobile Station, MS), personal digital assistant (PDA), personal computer (personal computer, PC) or relay equipment, etc.
示例性的,以电脑和手机这两种电子设备为例。当电脑和手机通过无线通信技术(如蓝牙、无线保真、紫蜂、近场通信等)或数据线(如USB数据线)相互连接时,通过应用流转技术,该手机作为流转源设备将其运行的应用的内容传输到电脑上,此时该电脑作为流转目标设备;或者,该电脑作为流转源设备将其运行的应用的内容传输到该手机上,此时该手机作为流转目标设备。Illustratively, two electronic devices, a computer and a mobile phone, are taken as examples. When a computer and a mobile phone are connected to each other through wireless communication technologies (such as Bluetooth, Wi-Fi, Zigbee, near field communication, etc.) or data lines (such as USB data lines), by applying the streaming technology, the mobile phone acts as a streaming source device to transfer its The content of the running application is transmitted to the computer, and the computer is used as the transfer target device at this time; or, the computer is used as the transfer source device to transmit the content of the running application to the mobile phone, and the mobile phone is used as the transfer target device at this time.
下面本申请实施例的技术方案可以应用于如图1所示的应用内容流转通信系统10。其中,应用内容流转通信系统10可以包括至少两个电子设备110。其中,至少两个电子设备110可以包括电子设备110A、电子设备110B、电子设备110C、电子设备110D、电子设备110E和电子设备110F。同时,至少两个电子设备110中的每个电子设备之间可以通过无线网络或有线数据相互通信连接。The following technical solutions in the embodiments of the present application may be applied to the application content streaming communication system 10 shown in FIG. 1 . Wherein, the application content streaming communication system 10 may include at least two electronic devices 110 . The at least two electronic devices 110 may include electronic device 110A, electronic device 110B, electronic device 110C, electronic device 110D, electronic device 110E and electronic device 110F. Meanwhile, each of the at least two electronic devices 110 may be connected to each other through wireless network or wired data communication.
需要说明的是,无线网络可以包括移动蜂窝网络(如第五代5G移动通信网络)、无线局域网(wireless local area network,WLAN)、广域网(wide area network,WAN)、蓝牙(Bluetooth)、无线保真(wireless fidelity,Wi-Fi)、紫蜂(Zigbee)、近场通信(near field communication,NFC)或者超宽带(ultra wide band,UWB)等;有线数据可以包括HDMI数据线、USB数据线等。It should be noted that the wireless network may include a mobile cellular network (such as a fifth-generation 5G mobile communication network), a wireless local area network (WLAN), a wide area network (WAN), Bluetooth, wireless security True (wireless fidelity, Wi-Fi), Zigbee (Zigbee), near field communication (near field communication, NFC) or ultra wide band (ultra wide band, UWB), etc.; wired data can include HDMI data lines, USB data lines, etc. .
具体的,该至少两个电子设备110中的每个电子设备可以为同一个用户账号下的设备。例如,当用户使用同一个用户账号登录手机、台式电脑、智慧屏、笔记本电脑、中继设备和智能手表时,该至少两个电子设备110包括该手机、台式电脑、智慧屏、笔记本电脑、中继设备和智能手表,并且该手机、台式电脑、智慧屏、笔记本电脑、中继设备和智能手表之间可以通过无线网络互相通信。Specifically, each electronic device in the at least two electronic devices 110 may be a device under the same user account. For example, when the user uses the same user account to log in to the mobile phone, desktop computer, smart screen, notebook computer, relay device and smart watch, the at least two electronic devices 110 include the mobile phone, desktop computer, smart screen, notebook computer, medium The relay device and the smart watch, and the mobile phone, desktop computer, smart screen, notebook computer, relay device and smart watch can communicate with each other through a wireless network.
具体的,该至少两个电子设备110中的每个电子设备可以通过中继设备(如路由器)连接到同一个WLAN网络中。例如,当用户将手机、台式电脑、智慧屏、笔记本电脑和智能手表接入由中继设备提供的Wi-Fi网络时,该至少两个电子设备110包括该手机、台式电脑、智慧屏、笔记本电脑、中继设备和智能手表,并且该手机、台式电脑、智慧屏、笔记本电脑、中继设备和智能手表形成一个WLAN网络,从而WLAN网络内的各个设备之间可以通过中继设备实现相互通信。Specifically, each of the at least two electronic devices 110 may be connected to the same WLAN network through a relay device (eg, a router). For example, when the user connects the mobile phone, desktop computer, smart screen, notebook computer and smart watch to the Wi-Fi network provided by the relay device, the at least two electronic devices 110 include the mobile phone, desktop computer, smart screen, notebook computer Computer, relay device and smart watch, and the mobile phone, desktop computer, smart screen, notebook computer, relay device and smart watch form a WLAN network, so that each device in the WLAN network can communicate with each other through the relay device .
具体的,该至少两个电子设备110中的每个电子设备可以通过无线通信方式(如蓝牙、Zigbee、NFC、UWB等)组成一个对等(Peer to Peer,P2P)网络。例如,用户通过扫描NFC标签的方式将手机、笔记本电脑和智能手表等设备组成一个P2P网络,并且该P2P网络内的所有设备之间可以是实现相互通信。Specifically, each of the at least two electronic devices 110 may form a peer-to-peer (P2P) network through wireless communication (such as Bluetooth, Zigbee, NFC, UWB, etc.). For example, a user can form a P2P network with devices such as mobile phones, laptops, and smart watches by scanning NFC tags, and all devices in the P2P network can communicate with each other.
进一步的,该至少两个电子设备110中的一个或多个电子设备可以作为流转源设备,而其他电子设备可以作为流转目标设备。此时,流转源设备可将其运行的应用的内容传输至流转目标设备中。另外,当流转目标设备需要同时运行或显示由多个投屏源设备传输的应用的内容时,流转目标设备可以通过建立多个进程来同时运行或者通过分屏方式来同时显示。例如,电子设备110A向电子设备110B和电子设备110C进行投屏,并且电子设备110D向电子设备110C和电子设备110F进行投屏。此时,电子设备11C可以通过分屏方式来同时显示来自电子设备110A和电子设备110D的投屏镜像。Further, one or more electronic devices in the at least two electronic devices 110 can be used as a transfer source device, and other electronic devices can be used as a transfer target device. At this time, the streaming source device can transmit the content of the running application to the streaming target device. In addition, when the streaming target device needs to run or display the content of the application transmitted by multiple screen casting source devices at the same time, the streaming destination device can run simultaneously by establishing multiple processes or display it simultaneously in a split-screen manner. For example, the electronic device 110A casts the screen to the electronic device 110B and the electronic device 110C, and the electronic device 110D casts the screen to the electronic device 110C and the electronic device 110F. At this time, the electronic device 11C can simultaneously display the mirror images from the electronic device 110A and the electronic device 110D in a split-screen manner.
进一步的,应用内容流转通信系统10还可以包括其他数量的电子设备,在此不作具体限定。Further, the application content flow communication system 10 may also include other electronic devices, which are not specifically limited herein.
下面结合图2对本申请实施例中的电子设备的结构进行详细说明,可以理解的是,图2示意的结构并 不构成对电子设备的具体限定。在本申请另一些实施例中,电子设备还可以包括比图2示意更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。另外,图2示意的部件可以通过硬件、软件或软件与硬件的组合来实现。The structure of the electronic device in the embodiment of the present application will be described in detail below with reference to FIG. 2. It can be understood that the structure shown in FIG. 2 does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may further include more or less components than those shown in FIG. 2 , or combine some components, or separate some components, or arrange different components. In addition, the components illustrated in FIG. 2 may be implemented by hardware, software, or a combination of software and hardware.
请参阅图2,电子设备可以包括处理器210、天线1、天线2、移动通信模块220、无线通信模块230、音频模块240、传感器模块250、显示模块260、摄像模块270、充电管理模块280、内部存储器2901和外部存储器接口2902等。Referring to FIG. 2, the electronic device may include a processor 210, an antenna 1, an antenna 2, a mobile communication module 220, a wireless communication module 230, an audio module 240, a sensor module 250, a display module 260, a camera module 270, a charging management module 280, Internal memory 2901 and external memory interface 2902, etc.
具体的,处理器210可以包括一个或多个处理单元。例如,处理器210可以包括应用处理器(application processor,AP)、调制解调处理器、图形处理器(graphics processingunit,GPU)、图像信号处理器(image signal processor,ISP)、控制器、存储器、视频编解码器、数字信号处理器(digital signal processor,DSP)、现场可编程逻辑门阵列(field programmable gate array,FPGA)、基带处理器和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。Specifically, the processor 210 may include one or more processing units. For example, the processor 210 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, Video codec, digital signal processor (DSP), field programmable gate array (FPGA), baseband processor and/or neural-network processing unit (NPU) )Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
进一步的,处理器210中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器210中的存储器为高速缓冲存储器。该存储器可以保存处理器210刚用过或循环使用的指令或数据。如果处理器210需要再次使用该指令或数据,则可以从所述存储器中直接调用,从而避免重复存取,减少处理器210的等待时间以提高系统效率。Further, a memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in processor 210 is cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 210 . If the processor 210 needs to use the instruction or data again, it can be directly called from the memory, thereby avoiding repeated access, reducing the waiting time of the processor 210 and improving the system efficiency.
进一步的,处理器210可以包括一个或多个接口。该接口可以包括集成电路(inter-integrated circuit,I2C)接口、集成电路内置音频(inter-integrated circuitsound,I2S)接口、脉冲编码调制(pulse code modulation,PCM)接口、通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口、移动产业处理器接口(mobile industry processor interface,MIPI)、通用输入输出(general-purpose input/output,GPIO)接口、用户标识模块(subscriber identity module,SIM)接口和/或USB接口等。Further, the processor 210 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface and/ or USB interface, etc.
需要说明的是,电子设备的无线通信功能可以通过天线1、天线2、移动通信模块220、无线通信模块230、调制解调处理器和基带处理器等实现。其中,天线1和天线2用于发射和接收电磁波信号。电子设备中的每个天线可用于覆盖单个或多个通信频带。另外,不同的天线还可以复用以提高天线的利用率。例如,将天线1复用为无线局域网的分集天线。It should be noted that the wireless communication function of the electronic device may be implemented by the antenna 1 , the antenna 2 , the mobile communication module 220 , the wireless communication module 230 , the modulation and demodulation processor, the baseband processor, and the like. Among them, the antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. In addition, different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 is multiplexed as a diversity antenna of the wireless local area network.
具体的,移动通信模块220可以提供应用于电子设备上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块220可以包括至少一个滤波器、开关、功率放大器和低噪声放大器(lownoise amplifier,LNA)等。Specifically, the mobile communication module 220 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device. The mobile communication module 220 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like.
进一步的,移动通信模块220可以由天线1接收电磁波,并对接收的电磁波进行滤波、放大等处理,再传送至调制解调处理器进行解调。另外,移动通信模块220还可以对经调制解调处理器调制后的信号放大,再经天线1转为电磁波辐射出去。在本申请实施例中,移动通信模块220能够实现本申请技术方案中流转源设备与流转目标设备之间的通信连接。Further, the mobile communication module 220 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. In addition, the mobile communication module 220 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 . In the embodiment of the present application, the mobile communication module 220 can realize the communication connection between the transfer source device and the transfer target device in the technical solution of the present application.
进一步的,移动通信模块220的至少部分功能模块可以被设置于处理器210中;或者,移动通信模块220的至少部分功能模块可以与处理器210的部分模块设置在同一个器件中。Further, at least some functional modules of the mobile communication module 220 may be provided in the processor 210; or, at least some functional modules of the mobile communication module 220 may be provided in the same device as some modules of the processor 210.
具体的,无线通信模块230可以提供应用在电子设备上的包括蓝牙(Bluetooth,BT)、无线局域网(wirelesslocal area networks,WLAN)、无线保真(wireless fidelity,Wi-Fi)网络、近距离无线通信(near field communication,NFC)、红外技术(infrared,IR)等无线通信的解决方案。Specifically, the wireless communication module 230 can provide applications on electronic devices including Bluetooth (BT), wireless local area networks (WLAN), wireless fidelity (Wi-Fi) networks, and short-range wireless communication. (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
进一步的,无线通信模块230可以是集成至少一个通信处理模块的一个或多个器件。另外,无线通信模块230经由天线2接收电磁波,将电磁波信号调频以及滤波处理,再将处理后的信号发送到系统级芯片210。无线通信模块230还可以从处理器210接收待发送的信号,对其进行调频和放大,再由天线2转为电磁波辐射出去。在本申请实施例中,无线通信模块230能够实现本申请技术方案中流转源设备与流转目标设备之间的通信连接。Further, the wireless communication module 230 may be one or more devices integrating at least one communication processing module. In addition, the wireless communication module 230 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the system-on-chip 210 . The wireless communication module 230 can also receive the signal to be sent from the processor 210, perform frequency modulation and amplification on the signal, and then convert it into electromagnetic waves by the antenna 2 and radiate it out. In the embodiment of the present application, the wireless communication module 230 can realize the communication connection between the transfer source device and the transfer target device in the technical solution of the present application.
需要说明的是,电子设备可以通过音频模块240、扬声器2401、受话器2402、麦克风2403、耳机接口2404以及处理器210等实现音频功能。例如,音乐播放、录音、视频播放等。It should be noted that the electronic device may implement audio functions through the audio module 240 , the speaker 2401 , the receiver 2402 , the microphone 2403 , the headphone interface 2404 , the processor 210 , and the like. For example, music playback, recording, video playback, etc.
具体的,音频模块240可以用于将数字音频信息转换成模拟音频信号输出,也可以用于将模拟音频输入转换为数字音频信号。另外,音频模块240还可以用于对音频信号编码和解码。在一个可能的示例中,音频模块240可以设置于处理器210中,或将音频模块240的部分功能模块设置于处理器210中。Specifically, the audio module 240 can be used to convert digital audio information into analog audio signal output, and can also be used to convert analog audio input into digital audio signal. Additionally, the audio module 240 may also be used to encode and decode audio signals. In a possible example, the audio module 240 may be provided in the processor 210 , or some functional modules of the audio module 240 may be provided in the processor 210 .
具体的,扬声器2401可以用于将音频电信号转换为声音信号。电子设备可以通过扬声器2301收听音乐,或者收听免提通话。Specifically, the speaker 2401 can be used to convert audio electrical signals into sound signals. The electronic device can listen to music through the speaker 2301, or listen to a hands-free call.
具体的,受话器2402可以用于将音频电信号转换成声音信号。例如,电子设备接听电话或语音信息时,可以通过将受话器2402靠近人耳接听语音。Specifically, the receiver 2402 can be used to convert audio electrical signals into sound signals. For example, when an electronic device answers a call or a voice message, the receiver 2402 can be placed close to the human ear to receive the voice.
具体的,麦克风2403可以用于将声音信号转换为电信号。例如,当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风2403发声,将声音信号输入到麦克风2403。另外,电子设备可以设置至少一个麦克风2403。在一个可能的示例中,电子设备可以设置两个麦克风2403,除了采集声音信号,还可以实现降噪功能;在一个可能的示例中,电子设备还可以设置三个,四个或更多麦克风2403,实现采集声音信号、降噪,还可以识别声音来源,实现定向录音功能等,对此不作具体限制。Specifically, the microphone 2403 can be used to convert sound signals into electrical signals. For example, when making a call or sending a voice message, the user can make a sound by approaching the microphone 2403 through a human mouth, and input the sound signal into the microphone 2403 . In addition, the electronic device may be provided with at least one microphone 2403 . In a possible example, the electronic device may be provided with two microphones 2403, which can implement noise reduction function in addition to collecting sound signals; in a possible example, the electronic device may be provided with three, four or more microphones 2403 , to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions, etc., which are not limited.
具体的,耳机接口2404可以用于连接有线耳机。耳机接口2404可以是USB接口2703,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口等。Specifically, the earphone interface 2404 can be used to connect a wired earphone. The earphone interface 2404 can be a USB interface 2703, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface, etc. .
具体的,传感器模块250中可以包括压力传感器、陀螺仪传感器、气压传感器、磁传感器、加速度传感器、距离传感器、接近光传感器、指纹传感器、温度传感器、触摸传感器、环境光传感器、骨传导传感器、超带宽UWB传感器、近场通信NFC传感器、激光传感器和可见光传感器等。Specifically, the sensor module 250 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, an ultra-high Bandwidth UWB sensors, near field communication NFC sensors, laser sensors and visible light sensors, etc.
需要说明的是,电子设备可以通过GPU、显示模块260以及处理器210等实现显示功能。其中,GPU可以用于执行数学和几何计算,并进行图形渲染。另外,GPU可以为图像处理的微处理器,并连接显示模块260和处理器210。处理器210可以包括一个或多个GPU,其执行程序指令以生成或改变显示信息。It should be noted that, the electronic device may implement the display function through the GPU, the display module 260, the processor 210, and the like. Among them, the GPU can be used to perform mathematical and geometric calculations and perform graphics rendering. In addition, the GPU can be a microprocessor for image processing, and is connected to the display module 260 and the processor 210 . Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.
具体的,显示模块260可以为显示屏,其用于显示图像、视频或文字等。其中,显示屏260可以包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD)、有机发光二极管(organic light-emittingdiode,OLED)、有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED)、柔性发光二极管(flex light-emitting diode,FLED)、量子点发光二极管(quantum dot lightemitting diodes,QLED)等。在一个可能的示例中,电子设备可以包括一个或多个显示模块260。Specifically, the display module 260 may be a display screen, which is used to display images, videos, texts, and the like. Wherein, the display screen 260 may include a display panel. The display panel may adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode, or an active matrix organic light emitting diode (active-matrix organic light emitting diode). diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on. In one possible example, the electronic device may include one or more display modules 260 .
需要说明的是,电子设备可以通过ISP、摄像模块270、视频编解码器、GPU、显示模块260以及处理器210等实现拍摄功能。其中,ISP可以用于处理摄像模块270反馈的数据。例如,在拍照时,先打开快门,再由光线通过镜头传递到摄像头感光元件上,实现光信号转换为电信号,最终通过摄像头感光元件将该电信号传递给ISP处理以转化为肉眼可见的图像。另外,ISP还可以对图像的噪点、亮度、肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一个可能的示例中,ISP可以设置在摄像模块270中。It should be noted that, the electronic device may implement the shooting function through the ISP, the camera module 270, the video codec, the GPU, the display module 260, the processor 210, and the like. The ISP may be used to process the data fed back by the camera module 270 . For example, when taking a photo, the shutter is first opened, and then the light is transmitted to the camera photosensitive element through the lens to convert the light signal into an electrical signal, and finally the electrical signal is transmitted to the ISP through the camera photosensitive element for processing to convert it into an image visible to the naked eye. . In addition, ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In one possible example, the ISP may be provided in the camera module 270 .
具体的,摄像模块270可以为摄像头,其用于捕获静态图像或视频等。其中,物体通过镜头生成光学图像投射到感光元件,而感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,再将该电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB、YUV等格式的图像信号。在一个可能的示例中,电子设备可以包括一个或多个摄像模块270。Specifically, the camera module 270 may be a camera, which is used to capture still images or videos, and the like. The optical image generated by the object is projected to the photosensitive element through the lens, and the photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In one possible example, the electronic device may include one or more camera modules 270 .
具体的,充电管理模块280用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块280可以通过USB接口2803接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块280可以通过电子设备的无线充电线圈接收无线充电输入。充电管理模块280为电池2801充电的同时,还可以通过电源管理模块2802为电子设备供电。Specifically, the charging management module 280 is configured to receive charging input from the charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 280 may receive charging input from the wired charger through the USB interface 2803 . In some wireless charging embodiments, the charging management module 280 may receive wireless charging input through a wireless charging coil of the electronic device. While the charging management module 280 charges the battery 2801 , it can also supply power to the electronic device through the power management module 2802 .
需要说明的是,电源管理模块2802用于连接电池2801、充电管理模块2802和处理器210。其中,电源管理模块2802接收电池2801和/或充电管理模块280的输入,为电子设备中的各个模块和处理器210等供电。It should be noted that the power management module 2802 is used to connect the battery 2801 , the charging management module 2802 and the processor 210 . The power management module 2802 receives input from the battery 2801 and/or the charging management module 280, and supplies power to each module in the electronic device, the processor 210, and the like.
具体的,电源管理模块2802还可以用于监测电池容量、电池循环次数、电池健康状态(漏电、阻抗)等参数。在一个可能的示例中,电源管理模块2802也可以设置于处理器210中;在一个可能的示例中,电源管理模块2802和充电管理模块280也可以设置于同一个器件中。Specifically, the power management module 2802 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance). In a possible example, the power management module 2802 may also be provided in the processor 210; in a possible example, the power management module 2802 and the charging management module 280 may also be provided in the same device.
需要说明的是,内部存储器2901可以用于存储计算机可执行程序代码,该可执行程序代码包括指令。其中,处理器210通过运行存储在内部存储器2901的指令,从而执行电子设备的各种功能应用以及数据处理。在一个可能的示例中,内部存储器2901存储执行本申请实施例的技术方案的程序代码。It should be noted that the internal memory 2901 may be used to store computer executable program codes, where the executable program codes include instructions. The processor 210 executes various functional applications and data processing of the electronic device by executing the instructions stored in the internal memory 2901 . In a possible example, the internal memory 2901 stores program codes for executing the technical solutions of the embodiments of the present application.
具体的,内部存储器2901可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(例如,声音播放功能和图像播放功能等)等。存储数据区可存储电子设备使用过程中所创建的数据(例如,音频数据和电话本等)等。另外,内部存储器2901可以包括高速随机存取存储器,还可以包括非易失性存储器。例如,至少一个磁盘存储器件、闪存器件、通用闪存存储器(universal flash storage,UFS)等。Specifically, the internal memory 2901 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program required for at least one function (for example, a sound playback function and an image playback function, etc.), and the like. The storage data area can store data (eg, audio data, phone book, etc.) created during the use of the electronic device, and the like. In addition, the internal memory 2901 may include high-speed random access memory, and may also include non-volatile memory. For example, at least one disk storage device, flash memory device, universal flash storage (UFS), and the like.
具体的,外部存储器接口2902可以用于连接外部存储卡,例如micro SD卡,实现扩展电子设备的存 储能力。外部存储卡通过外部存储器接口2902与处理器210通信,实现数据存储功能。例如,将音乐、视频等文件保存在外部存储卡中。Specifically, the external memory interface 2902 can be used to connect an external memory card, such as a micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 210 through the external memory interface 2902 to realize the data storage function. For example, save files such as music, videos, etc. on an external memory card.
本申请实施例中,电子设备的软件系统可以采用分层架构、事件驱动架构、微核架构、微服务架构或云架构。下面本申请实施例以分层架构的Android系统为例,示例性说明电子设备的软件结构。In the embodiments of the present application, the software system of the electronic device may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The following embodiments of the present application take an Android system with a layered architecture as an example to exemplarily describe the software structure of an electronic device.
如图3所示的设置有Android系统的软硬件系统的架构示意图。其中,内部存储器2901中可存储有内核层320、系统运行库层340、应用框架层360和应用层380。其中,层与层之间通过软件接口通信,并且内核层320、系统运行库层340和应用框架层360属于操作系统空间。As shown in FIG. 3 , a schematic diagram of the architecture of a software and hardware system provided with an Android system is provided. The internal memory 2901 may store the kernel layer 320 , the system runtime layer 340 , the application framework layer 360 and the application layer 380 . The layers communicate with each other through software interfaces, and the kernel layer 320 , the system runtime layer 340 and the application framework layer 360 belong to the operating system space.
具体的,应用层380属于用户空间,应用层380中运行有至少一个应用程序(或简称为“应用”),这些应用程序可以是操作系统自带的原生应用程序,也可以是第三方开发者所开发的第三方应用程序。例如,应用层380可以包括相机、图库、日历、通话、地图、导航、WLAN、蓝牙、音乐、视频和短信息等应用程序。Specifically, the application layer 380 belongs to the user space, and at least one application program (or “application” for short) runs in the application layer 380. These application programs may be native applications provided by the operating system, or may be third-party developers developed third-party applications. For example, the application layer 380 may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.
在本申请实施例中,应用层中还可以安装流转应用。用户可以从桌面、设置功能或下拉菜单等方式打开流转应用。其中,该流转应用可作为内容流转时流转源设备与流转目标设备之间的桥梁,并将流转源设备中需要流转的应用的内容传输给流转目标设备。例如,流转应用可接收应用框架层360上报的流转事件,从而利用流转应用与正在运行的应用(如视频播放器)交互,再将该应用中正在显示或播放的内容作为流转内容通过Wi-Fi等无线通信方式发送给流转目标设备。In this embodiment of the present application, a streaming application may also be installed in the application layer. Users can open streaming apps from the desktop, settings, or drop-down menus. The streaming application can be used as a bridge between the streaming source device and the streaming target device during content streaming, and transmit the content of the application that needs to be streamed in the streaming source device to the streaming target device. For example, the streaming application can receive the streaming event reported by the application framework layer 360, so as to use the streaming application to interact with a running application (such as a video player), and then use the streaming application to display or play the content as streaming content through Wi-Fi and other wireless communication methods to send to the transfer target device.
另外,用户还可以使用该流转应用设置NFC或UWB标签与一个或多个电子设备之间的绑定关系。例如,在流转应用中设置一个用于绑定NFC或UWB标签的选项。当电子设备检测到用户打开该选项时,流转应用可显示待绑定的电子设备的列表。用户在该列表上选中需要绑定的一个或多个电子设备后,将其靠近NFC标签。这样,通过NFC信号等传输后,可将用户在流转应用上选中的电子设备的标识写入NFC标签中,从而在NFC标签内建立该NFC标签与一个或多个电子设备之间的绑定关系。In addition, the user can also use the flow application to set the binding relationship between the NFC or UWB tag and one or more electronic devices. For example, set an option for binding NFC or UWB tags in the streaming application. When the electronic device detects that the user has turned on this option, the streaming application may display a list of electronic devices to be bound. After the user selects one or more electronic devices to be bound on the list, he brings it close to the NFC tag. In this way, after the NFC signal is transmitted, the identifier of the electronic device selected by the user on the streaming application can be written into the NFC tag, thereby establishing a binding relationship between the NFC tag and one or more electronic devices in the NFC tag .
需要说明的是,应用框架层360提供构建应用层的应用时可能用到的各种应用编程接口(application programming interface,API)和编程框架,从而使得开发者可以通过使用这些API来构建自身或第三方应用。例如,窗口管理器(window manager)、内容提供器(content providers)、视图系统(view system)、电话管理器(telephony manager)、资源管理器、通知管理器(notification manager)、消息管理器、活动管理器(activity manager)、包管理器(package manager)、位置管理(location manager)和NFC服务等。It should be noted that the application framework layer 360 provides various application programming interfaces (APIs) and programming frameworks that may be used when constructing applications of the application layer, so that developers can use these APIs to construct their own Third-party applications. For example, window manager, content providers, view system, telephony manager, resource manager, notification manager, message manager, activity Manager (activity manager), package manager (package manager), location management (location manager) and NFC services, etc.
具体的,窗口管理器可以用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏、锁定屏幕、截取屏幕等。Specifically, a window manager can be used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock screen, screen capture, etc.
具体的,内容提供器可以用于存放和获取数据,并使该数据可以被应用程序访问。其中,该数据可以包括视频、图像、音频、拨打和接听的电话、浏览历史和书签、电话簿等。另外,内容提供器可以使得应用程序可以访问另一个应用程序的数据,如联系人数据库,或者共享它们自己的数据。Specifically, the content provider can be used to store and obtain data, and make the data accessible to applications. Among them, the data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, and the like. Additionally, a content provider may enable an application to access another application's data, such as a contact database, or to share their own data.
具体的,视图系统包括可视控件。例如,显示文字的控件和显示图片的控件等。视图系统可以用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。Specifically, the view system includes visual controls. For example, controls that display text and controls that display pictures, etc. View systems can be used to build applications. A display interface can consist of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
具体的,电话管理器用于提供电子设备的通信功能。例如,通话状态的管理(如接通、挂断等)。Specifically, the phone manager is used to provide the communication function of the electronic device. For example, the management of call status (such as connecting, hanging up, etc.).
具体的,资源管理器可以为应用程序提供各种资源。比如,本地化字符串、图标、图片、布局文件、视频文件等。Specifically, the resource manager can provide various resources for the application. For example, localized strings, icons, pictures, layout files, video files, etc.
具体的,通知管理器使得应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如,通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知。另外,后台运行的应用程序的通知还可以是以对话窗口形式出现在屏幕上的通知。例如,在状态栏提示文本信息,发出提示音,电子设备振动、指示灯闪烁等。Specifically, the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also display notifications in the status bar at the top of the system in the form of a graphic or scroll bar text. In addition, the notification of the application running in the background can also be a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.
具体的,消息管理器可以用于存储各个应用程序上报的消息的数据,并对各个应用程序上报的数据进行处理。Specifically, the message manager can be used to store the data of the messages reported by each application program, and process the data reported by each application program.
具体的,活动管理器可以用于管理应用程序生命周期并提供常用的导航回退功能。在一种可能的示例中,消息管理器可以是通知管理器的一部分。Specifically, the activity manager can be used to manage the application life cycle and provide the usual navigation and fallback functions. In one possible example, the message manager may be part of the notification manager.
在本申请实施例中,应用框架层360中可以运行NFC服务(NFCservice)。In this embodiment of the present application, the application framework layer 360 may run an NFC service (NFCservice).
示例性的,手机开启NFC功能后可在应用框架层中开始运行NFC服务。当手机靠近或触碰NFC标签时,NFC服务可调用内核层的NFC驱动读取NFC标签中存储的绑定关系,从而获取到进行本次内容流转的流转目标设备。进而,NFC服务可向上述内容流转上报流转事件,从而触发流转应用将手机正在运行 或播放的内容作为流转内容传输给流转目标设备以开始本次内容流转过程。Exemplarily, after the mobile phone enables the NFC function, the NFC service can be started to run in the application framework layer. When the mobile phone approaches or touches the NFC tag, the NFC service can call the NFC driver at the kernel layer to read the binding relationship stored in the NFC tag, thereby obtaining the transfer target device for this content transfer. Further, the NFC service can report the streaming event to the above-mentioned content streaming, thereby triggering the streaming application to transmit the content that the mobile phone is running or playing as the streaming content to the streaming target device to start the content streaming process.
需要说明的是,系统运行库层340通过一些C/C++库来为Android系统提供了主要的特性支持。如SQLite库提供了数据库的支持,OpenGL/ES库提供了3D绘图的支持,Webkit库提供了浏览器内核的支持等。在系统运行库层340中还提供有安卓运行时库(Android Runtime),其主要提供了一些核心库,能够允许开发者使用Java语言来编写Android应用。It should be noted that the system runtime layer 340 provides main feature support for the Android system through some C/C++ libraries. For example, the SQLite library provides database support, the OpenGL/ES library provides 3D drawing support, and the Webkit library provides browser kernel support. An Android runtime library (Android Runtime) is also provided in the system runtime library layer 340, which mainly provides some core libraries, which can allow developers to use Java language to write Android applications.
具体的,内核层320可以为电子设备的各种硬件提供了底层的驱动,如显示驱动、音频驱动、摄像头驱动、蓝牙驱动、Wi-Fi驱动、电源管理、NFC驱动、UWB驱动、应用流转驱动、语音识别驱动、手势识别驱动、图像识别驱动、人体识别驱动、脸部动作识别驱动、人体动作识别驱动等。Specifically, the kernel layer 320 can provide underlying drivers for various hardware of electronic devices, such as display drivers, audio drivers, camera drivers, Bluetooth drivers, Wi-Fi drivers, power management, NFC drivers, UWB drivers, and application flow drivers , speech recognition driver, gesture recognition driver, image recognition driver, human body recognition driver, facial motion recognition driver, human motion recognition driver, etc.
下面对本申请实施例的应用流转框架作一个具体介绍。如图4所示,应用流转框架可以包括获取信息模块410、源和目标判定模块420、连接管理模块430、应用信息模块440、流转策略模块450和应用流转模块460。其中,获取信息模块410可以包括传感器识别模块、语音识别模块、手势识别模块、图像识别模块、人体姿态识别模块、脸部动作识别模块和/或人体动作识别模块等;应用流转模块460可以包括分布式应用框架、投屏服务框架、接力式应用框架、普通式应用框架和投屏式应用框架等。The following is a specific introduction to the application flow framework of the embodiment of the present application. As shown in FIG. 4 , the application flow framework may include an information acquisition module 410 , a source and target determination module 420 , a connection management module 430 , an application information module 440 , a flow strategy module 450 and an application flow module 460 . The information acquisition module 410 may include a sensor recognition module, a voice recognition module, a gesture recognition module, an image recognition module, a human gesture recognition module, a facial motion recognition module, and/or a human motion recognition module, etc.; the application flow module 460 may include a distribution Type application framework, screen projection service framework, relay application framework, common application framework and screen projection application framework, etc.
具体的,获取信息模块410可以用于通过传感器识别、语音识别、手势识别、图像识别、人体姿态识别、脸部动作识别、人体动作识别等获取一个或多个电子设备的标识(identity,ID)信息,并将该一个或多个电子设备的ID信息发送给源和目标判定模块420。其中,上述传感器可以包括UWB传感器、NFC传感器、激光传感器和/或可见光传感器等;上述ID信息可以包括互联网协议(Internet Protocol,IP)地址、媒体接入控制(media access control,MAC)地址、UWB标签、NFC标签等。下面以手机和笔记本电脑这两个电子设备为例进行举例说明。Specifically, the acquiring information module 410 may be used to acquire the identity (ID) of one or more electronic devices through sensor recognition, voice recognition, gesture recognition, image recognition, human gesture recognition, facial motion recognition, human motion recognition, etc. information, and send the ID information of the one or more electronic devices to the source and target determination module 420 . Wherein, the above-mentioned sensors may include UWB sensors, NFC sensors, laser sensors and/or visible light sensors, etc.; the above-mentioned ID information may include Internet Protocol (Internet Protocol, IP) addresses, media access control (media access control, MAC) addresses, UWB tags, NFC tags, etc. The following takes two electronic devices, a mobile phone and a notebook computer, as examples for illustration.
例如,如果手机和笔记本电脑上都安装有UWB传感器,并且各自具有UWB标签(即ID信息),当用户移动手机以使得手机与笔记本电脑之间的距离较近时,手机上的UWB传感器将获取到笔记本电脑的UWB标签。For example, if UWB sensors are installed on both the mobile phone and the laptop, and each has a UWB tag (that is, ID information), when the user moves the mobile phone so that the distance between the mobile phone and the laptop is close, the UWB sensor on the mobile phone will acquire to the UWB tag of the laptop.
又例如,如果手机和笔记本电脑上都安装有NFC传感器,并且各自具有NFC标签(即ID信息),当用户将手机通过碰一碰或靠一靠等方式触碰笔记本时,手机上的NFC传感器将获取到笔记本电脑的NFC标签。For another example, if both the mobile phone and the laptop are equipped with NFC sensors, and each has an NFC tag (that is, ID information), when the user touches the mobile phone by touching or leaning against the laptop, the NFC sensor on the mobile phone will The NFC tag of the laptop will be acquired.
又例如,如果手机和笔记本电脑都开启摄像头,当手机和笔记本电脑都拍摄到用户当前的手势动作图像时,通过获取信息模块410分析各自拍摄的手势动作图像中手势的角度(如手势是正面,而不是有偏移角)、手势的大小(如手势占据整个画面的大小)等,以便从手机和笔记本电脑中选择出满足预设条件的设备作为流转源设备或流转目标设备,并获取到流转源设备的ID信息或流转目标设备的ID信息。比如,在各自拍摄的手势动作图像中,真正的流转源设备(流转目标设备)所拍摄到的是更多手势朝向正面的图像,而不是有偏移角;或者,所拍摄到的图像中手势占比越大的,越有可能是真正的流转源设备(流转目标设备)。因此,预设条件可以理解为图像中手势朝向越偏向正面,或者图像中手势占比越大等。For another example, if both the mobile phone and the notebook computer have their cameras turned on, when both the mobile phone and the notebook computer capture the current gesture action image of the user, the acquisition information module 410 analyzes the angle of the gesture in the gesture action image captured by each (such as the gesture is frontal, instead of an offset angle), the size of the gesture (such as the size of the gesture occupying the entire screen), etc., so as to select the device that meets the preset conditions from the mobile phone and laptop as the transfer source device or transfer target device, and obtain the transfer ID information of the source device or ID information of the transfer destination device. For example, in the respective captured gesture action images, the real flow source device (the flow target device) captures images with more gestures facing the front, rather than having an offset angle; or, the gestures in the captured images The larger the proportion is, the more likely it is the real source device (target device). Therefore, the preset condition can be understood as the gesture orientation in the image is more toward the front, or the gesture occupies a larger proportion in the image, etc.
具体的,源和目标判定模块420可以用于从来自获取信息模块410的该一个或多个电子设备的ID信息中判断出作为流转源设备对应的ID信息和作为流转目标设备对应的ID信息。需要说明的是,由获取信息模块410发送给源和目标判定模块420的ID信息中可能存在不明确的流转源设备和流转目标设备(即流转对象),导致无法执行应用流转。此时,需要由源和目标判定模块420进行判断。如果有明确的流转源设备和流转目标设备的结果,则将该结果发送给流转策略模块440以执行流转源设备到流转目标设备的应用流转策略;如果没有明确的流转源设备和流转目标设备的结果,则访问连接管理模块430。下面以手机为流转源设备进行举例说明。Specifically, the source and target determination module 420 may be configured to determine the ID information corresponding to the transfer source device and the ID information corresponding to the transfer target device from the ID information of the one or more electronic devices from the information acquisition module 410 . It should be noted that the ID information sent by the information acquisition module 410 to the source and target determination module 420 may contain ambiguous transfer source devices and transfer target devices (ie, transfer objects), resulting in inability to perform application transfer. At this time, it needs to be judged by the source and target judgment module 420 . If there is a clear result of the transfer source device and the transfer target device, the result is sent to the transfer strategy module 440 to execute the application transfer strategy from the transfer source device to the transfer target device; if there is no clear transfer source device and transfer target device. As a result, the connection management module 430 is accessed. The following takes a mobile phone as the circulation source device for illustration.
例如,当手机识别到用户输入的一段“将本机的视频画面流转到电脑上”的语音时,手机中的语音识别模块识别该语音,并将识别结果传输给源和目标判定模块。由于手机可能与多个设备(如笔记本电脑、台式电脑等)之间存在通信连接,因此手机中的源和目标判定模块无法从该识别结果中确定出明确的流转目标设备。For example, when the mobile phone recognizes a piece of voice input by the user that "transfer the video image of the machine to the computer", the voice recognition module in the mobile phone recognizes the voice and transmits the recognition result to the source and target determination modules. Since there may be communication connections between the mobile phone and multiple devices (such as notebook computers, desktop computers, etc.), the source and target determination modules in the mobile phone cannot determine a clear transfer target device from the identification result.
具体的,连接管理模块430可以用于获取同一个用户账号或同一个网络下与流转源设备所连接的所有设备的ID信息。其中,连接管理模块430可以访问远端或云端的服务器或其他电子设备以获取上述ID信息,可以访问本端的内部存储器以获取上述ID信息,也可以访问外部存储器接口以获取上述ID信息,对此不作具体限制。Specifically, the connection management module 430 may be configured to acquire ID information of all devices connected to the circulation source device under the same user account or the same network. Wherein, the connection management module 430 can access the remote or cloud server or other electronic devices to obtain the above ID information, can access the internal memory of the local end to obtain the above ID information, and can also access the external memory interface to obtain the above ID information. No specific restrictions are imposed.
具体的,应用信息模块440可以用于对当前运行的应用进行识别以获取该应用的应用信息。其中,应用信息可以包括应用名称、应用类型等。需要说明的是,应用信息模块440可以通过访问进程或线程等方式以获取前端(如UI界面)或后端上当前运行的应用的应用信息。Specifically, the application information module 440 may be used to identify a currently running application to obtain application information of the application. The application information may include an application name, an application type, and the like. It should be noted that the application information module 440 can obtain application information of the application currently running on the front end (eg, UI interface) or the back end by accessing a process or thread.
另外,本申请实施例将上述应用类型划分为以下四类:投屏式应用、分布式应用、接力式应用、普通式应用。其中,投屏式应用是指继续运行在流转源设备上,并由流转源设备投屏到流转目标设备上,再由流转目标设备开始运行的应用;分布式应用是指应用的前端和后端能够在不同设备上实现分离运行操作的应用;接力式应用是指通过本端上的文件服务能够在不同设备上实现存储、恢复或者共享操作的应用;普通式应用是指通过投屏技术能够在不同设备上实现显示操作的应用,并且普通式应用可以包含投屏式应用。In addition, the embodiments of the present application divide the above application types into the following four categories: screen-casting applications, distributed applications, relay applications, and common applications. Among them, screen-casting applications refer to applications that continue to run on the streaming source device, and are projected from the streaming source device to the streaming target device, and then run by the streaming target device; distributed applications refer to the front-end and back-end of the application. Applications that can realize separate operation operations on different devices; relay applications refer to applications that can realize storage, recovery or sharing operations on different devices through the file service on the local end; common applications refer to screen projection technology. Applications that implement display operations on different devices, and ordinary applications can include screen-casting applications.
具体的,流转策略模块450可以用于根据应用类型确定流转源设备到流转目标设备的应用流转策略,并将其传输给应用流转模块460。需要说明的是,流转策略模块450可以访问应用信息模块440以获知当前运行的应用的应用类型,从而根据应用类型的不同确定不同的应用流转策略。Specifically, the flow strategy module 450 may be configured to determine the application flow strategy from the flow source device to the flow target device according to the application type, and transmit it to the application flow module 460 . It should be noted that the circulation strategy module 450 can access the application information module 440 to learn the application type of the currently running application, so as to determine different application circulation strategies according to different application types.
具体的,应用流转模块460可以用于按照应用流转策略执行应用内容跨设备流转。需要说明的是,由于不同的应用类型需要采用不同的应用流转策略,而不同的应用流转策略对应不用的应用框架。例如,在对分布式应用执行应用流转时,需要采用分布式应用框架;在对接力式应用执行应用流转时,需要采用接力式应用框架;在对投屏式应用执行应用流转时,需要采用投屏服务框架或投屏式应用框架;在对普通式应用执行应用流转时,需要采用投屏服务框架或普通式应用框架。Specifically, the application flow module 460 may be configured to perform cross-device flow of application content according to an application flow policy. It should be noted that different application flow strategies need to be adopted for different application types, and different application flow strategies correspond to different application frameworks. For example, when performing application transfer for distributed applications, a distributed application framework needs to be used; when performing application transfer for relay-type applications, a relay-type application framework needs to be used; when performing application transfer for screen-casting applications, it is necessary to adopt a relay-type application framework. screen service framework or screen-casting application framework; when performing application transfer for common applications, the screen-casting service framework or common application framework needs to be used.
目前,针对应用内容跨设备流转的方案仅支持单一软硬件,并没有一个模块或框架来整合多种软硬件以实现协同作业。同时,目前方案仅支持投屏或简单的数据传输,无法支持更为丰富的分布式应用的流转或者接力式应用的流转等,以及无法同时支持不同应用类型之间的应用流转。因此,通过图4所示的应用流转框架,本申请实施例可以通过不同识别模块进行信息获取,并从获取的信息中判定流转源设备的ID信息和流转目标设备的ID信息以确定流转对象,再根据当前运行的应用的应用类型采用不同的应用流转策略,从而实现更加便捷的应用内容跨设备流转,以及提高应用流转效率和使用体验。下面本申请实施例将结合方法示例的角度进行具体说明。At present, the solution for the cross-device flow of application content only supports a single software and hardware, and there is no module or framework to integrate multiple software and hardware to achieve collaborative operation. At the same time, the current solution only supports screen projection or simple data transmission, and cannot support the flow of richer distributed applications or relay applications, and cannot support the flow of applications between different application types at the same time. Therefore, through the application transfer framework shown in FIG. 4 , the embodiment of the present application can obtain information through different identification modules, and determine the ID information of the transfer source device and the ID information of the transfer target device from the acquired information to determine the transfer object, Then, different application flow strategies are adopted according to the application type of the currently running application, so as to realize more convenient flow of application content across devices, and to improve the efficiency of application flow and use experience. The following embodiments of the present application will be specifically described in terms of method examples.
结合上述描述,下面将从方法示例的角度介绍应用内容跨设备流转方法的执行步骤,请参阅图5。图5是本申请实施例提供的一种应用内容跨设备流转方法的流程示意图,应用于流转源设备,该方法包括:S510、获取流转源设备当前运行的目标应用的应用类型。In combination with the above description, the following describes the execution steps of the method for transferring application content across devices from the perspective of a method example, please refer to FIG. 5 . 5 is a schematic flowchart of a cross-device flow method for application content provided by an embodiment of the present application, which is applied to a flow source device. The method includes: S510 : Obtain an application type of a target application currently running on the flow source device.
需要说明的是,本申请实施例的流转源设备上当前运行有目标应用,该目标应用可以为该流转源设备的应用层上运行的应用程序或媒体数据,如照片、视频、音频、游戏、图库、文档或多媒体等。另外,流转源设备可以在前端运行该目标应用,也可以在后端运行该目标应用。当流转源设备在前端运行该目标应用时,流转源设备的显示屏可以显示该目标应用的当前内容;当流转源设备在后端运行该目标应用时,流转源设备的显示屏可以不显示该目标应用的当前内容,而由后台继续执行该目标应用。It should be noted that a target application is currently running on the streaming source device in the embodiment of the present application, and the target application may be an application program or media data running on the application layer of the streaming source device, such as photos, videos, audios, games, Gallery, document or multimedia, etc. In addition, the circulation source device can run the target application on the front end, and can also run the target application on the back end. When the streaming source device runs the target application at the front end, the display screen of the streaming source device may display the current content of the target application; when the streaming source device runs the target application at the back end, the display screen of the streaming source device may not display the target application. The current content of the target application, and the target application continues to be executed in the background.
在一个可能的示例中,在S510之前,该方法还可以包括以下步骤:获取第一信息,并判断第一信息是否携带流转目标设备的标识信息。In a possible example, before S510, the method may further include the following steps: acquiring first information, and judging whether the first information carries identification information of the transfer target device.
具体的,第一信息可以满足以下至少一种方式:第一信息是通过传感器识别获取的、第一信息是通过语音识别获取的、第一信息是通过手势识别获取的、第一信息是通过图像识别获取、第一信息是通过人体姿态识别获取的、第一信息是通过脸部动作识别获取的、第一信息是通过人体动作识别获取的;其中,上述传感器可以包括以下至少一种:超带宽UWB传感器、近场通信NFC传感器、激光传感器、可见光传感器。Specifically, the first information may satisfy at least one of the following manners: the first information is acquired by sensor recognition, the first information is acquired by voice recognition, the first information is acquired by gesture recognition, the first information is acquired by image Recognition and acquisition, the first information is acquired through human gesture recognition, the first information is acquired through facial motion recognition, and the first information is acquired through human motion recognition; wherein, the above sensors may include at least one of the following: ultra-bandwidth UWB sensor, near field communication NFC sensor, laser sensor, visible light sensor.
需要说明的是,本申请实施例为了实现流转源设备与流转目标设备之间的应用内容跨设备流转,需要先确定出流转对象(即流转源设备和/或流转目标设备)。因此,当本申请实施例考虑将流转源设备当前运行的目标应用的内容进行流转时,通过由流转源设备获取第一信息,并判断第一信息中是否携带流转目标设备的标识信息,从而实现由流转源设备来确定出流转目标设备。此时,结合上述图4中的应用流转框架,本申请实施例可以通过该流转源设备中的获取信息模块来获取第一信息,并通过该流转源设备中的源和目标判定模块判断第一信息中是否携带流转目标设备的标识信息。下面以流转源设备为手机为例进行示例说明。It should be noted that, in order to realize the cross-device transfer of application content between the transfer source device and the transfer target device in this embodiment of the present application, the transfer object (ie the transfer source device and/or the transfer target device) needs to be determined first. Therefore, when the embodiment of the present application considers transferring the content of the target application currently running on the transfer source device, the transfer source device obtains the first information, and determines whether the first information carries the identification information of the transfer target device, so as to realize The transfer destination device is determined by the transfer source device. At this time, in combination with the application flow framework in FIG. 4, the embodiment of the present application can obtain the first information through the information obtaining module in the flow source device, and determine the first information through the source and target determination module in the flow source device. Whether the information carries the identification information of the transfer target device. In the following, an example is given by taking the transfer source device as a mobile phone as an example.
例如,当手机上安装有UWB传感器时,用户将该手机靠近同样安装有UWB传感器的笔记本电脑和智能手表,从而获取到笔记本电脑的UWB标签,以及智能手表的UWB标签。此时,笔记本电脑和智能手表可以作为候选的流转目标设备。然后,该手机的显示屏可以通过弹窗、下拉菜单等方式显示出包含该笔记本电脑和该智能手表的选项列表。最终,用户可以从该选项列表中选择一个或多个设备作为流转目标设备,从而该手机获取到明确的流转目标设备的ID信息(即UWB标签、MAC地址或IP地址等)。For example, when a UWB sensor is installed on a mobile phone, the user places the mobile phone near a laptop and a smart watch that are also equipped with UWB sensors, so as to obtain the UWB tag of the laptop and the UWB tag of the smart watch. At this point, laptops and smartwatches can be considered as candidate transfer target devices. The display of the phone can then display a list of options including the laptop and the smartwatch through pop-up windows, drop-down menus, and the like. Finally, the user can select one or more devices from the option list as the transfer target device, so that the mobile phone obtains the specific ID information of the transfer target device (ie UWB tag, MAC address or IP address, etc.).
又例如,当手机上安装有NFC传感器时,用户将该手机通过碰一碰(或靠一靠等)方式触碰同样安装有NFC传感器的笔记本电脑和智能手表,从而获取到笔记本电脑的NFC标签,以及智能手表的NFC标签。此时,笔记本电脑和智能手表可以作为候选的流转目标设备。然后,该手机的的显示屏可以通过弹 窗、下拉菜单等方式显示出包含该笔记本电脑和该智能手表的选项列表。最终,用户可以从该选项列表中选择一个或多个设备作为流转目标设备,从而该手机获取到明确的流转目标设备的ID信息(即NFC标签、MAC地址或IP地址等)。For another example, when an NFC sensor is installed on a mobile phone, the user touches the mobile phone by touching (or leaning against, etc.) a laptop and a smart watch that are also equipped with an NFC sensor, so as to obtain the NFC tag of the laptop. , and NFC tags for smartwatches. At this point, laptops and smartwatches can be considered as candidate transfer target devices. Then, the display screen of the mobile phone can display a list of options including the laptop computer and the smart watch by means of pop-up windows, drop-down menus, and the like. Finally, the user can select one or more devices from the option list as the transfer target device, so that the mobile phone obtains the specific ID information (ie NFC tag, MAC address or IP address, etc.) of the transfer target device.
又例如,当手机的当前用户账号下还连接有笔记本电脑时,手机可以通过下发指令让笔记本电脑开启摄像头。此时,如果该笔记本电脑拍摄到用户当前的手势动作图像(如手势释放动作、手势抓取动作、摆手动作、左右摇手动作、“OK”手势动作等),则该笔记本电脑分析其拍摄的手势动作图像是否满足预设手势条件。若满足预设手势条件,则该笔记本电脑作为流转目标设备,并由该笔记本电脑将自身的MAC地址或IP地址发送给该手机,从而该手机获取到明确的流转目标设备的ID信息(即MAC地址或IP地址等)。需要说明的是,当用户真正需要将该手机上运行的应用的内容流转到该笔记本电脑上时,用户会明确在面向该笔记本电脑的摄像头的方向上做手势动作。因此,在分析由该笔记本电脑拍摄的手势动作图像时,真正的流转目标设备所拍摄到的是更多手势朝向正面的画面,而不是有偏移角;或者,所拍摄到的画面中手势占比越大的,越有可能是真正的流转目标设备。因此,预设手势条件可以理解为画面中手势朝向越正面,或者画面中手势占比越大等。For another example, when a laptop computer is connected to the current user account of the mobile phone, the mobile phone can issue an instruction to make the laptop computer turn on the camera. At this time, if the laptop computer captures the user's current gesture action image (such as gesture release action, gesture capture action, hand wave action, left-right hand wave action, "OK" gesture action, etc.), the laptop computer analyzes the captured gesture Whether the motion image meets the preset gesture conditions. If the preset gesture conditions are met, the notebook computer is used as the transfer target device, and the notebook computer sends its own MAC address or IP address to the mobile phone, so that the mobile phone obtains the clear ID information of the transfer target device (that is, the MAC address). address or IP address, etc.). It should be noted that when the user really needs to stream the content of the application running on the mobile phone to the laptop, the user will explicitly perform a gesture action in the direction of the camera facing the laptop. Therefore, when analyzing the gesture action images captured by the notebook computer, the real flow target device captures images with more gestures facing the front, rather than having an offset angle; or, gestures occupy more of the captured images The larger the ratio, the more likely it is the real transfer target device. Therefore, the preset gesture condition can be understood as the more positive the gesture in the picture is, or the larger the proportion of the gesture in the picture, etc.
从上述三个示例可知,流转源设备获取的第一信息中可以直接携带有流转目标设备的ID信息。但是,流转源设备中的获取信息模块通过识别语音、图像、人体姿态、脸部动作、人体动作等以获取的第一信息中可能没有携带流转目标设备的标识信息。下面以流转源设备为手机为例进行示例说明。It can be seen from the above three examples that the first information acquired by the transfer source device may directly carry the ID information of the transfer target device. However, the first information acquired by the information acquisition module in the transfer source device by recognizing voice, image, human posture, facial motion, human motion, etc. may not carry the identification information of the transfer target device. In the following, an example is given by taking the transfer source device as a mobile phone as an example.
例如,当手机识别到用户输入的一段“将本机的视频画面流转到电脑上”的语音时,如果手机与多个设备(如笔记本电脑、台式电脑等)之间具有通信连接,手机通过识别该语音以获取第一信息,但无法从该第一信息中明确识别出具体将本机的视频画面流转到哪一台或哪些电脑上,从而导致该手机无法从该第一信息中确定出明确的流转目标设备。For example, when the mobile phone recognizes a piece of voice inputted by the user that "transfer the video screen of the machine to the computer", if there is a communication connection between the mobile phone and multiple devices (such as laptop computers, desktop computers, etc.), the mobile phone will recognize The voice is used to obtain the first information, but it cannot be clearly identified from the first information to which computer or computers the video image stream of the local machine is transferred to, so that the mobile phone cannot be determined from the first information. The transfer target device.
又例如,当手机的当前用户账号下还连接有笔记本电脑A和笔记本电脑B时,手机可以通过下发指令让笔记本电脑A和笔记本电脑B都开启摄像头。此时,如果笔记本电脑A和笔记本电脑B都拍摄到用户当前的脸部动作画面(如微笑动作、抿嘴动作等),则笔记本电脑A和笔记本电脑B都各自分析其拍摄的脸部动作画面是否满足预设脸部条件。若都不满足预设脸部条件,则笔记本电脑A和笔记本电脑B都不将各自的MAC地址或IP地址发送给该手机,从而该手机无法获取到明确的流转目标设备的ID信息(即MAC地址或IP地址等)。需要说明的是,当用户真正需要将该手机上运行的应用的内容流转到笔记本电脑A上时,用户会明确在面向笔记本电脑A的摄像头的方向上做脸部动作。此时,笔记本电脑A所拍摄到的是更多脸部朝向正面的画面,而不是有偏移角;或者,所拍摄到的画面中脸部占比越大。然而,由于用户不是面向笔记本电脑B的摄像头的方向上做脸部动作,因此笔记本电脑B所拍摄到的画面中脸部是有较大的斜角等。因此,预设脸部条件可以理解为画面中脸部朝向越正面,或者画面中脸部占比越大等。For another example, when the current user account of the mobile phone is also connected to the laptop computer A and the laptop computer B, the mobile phone can issue an instruction to make the laptop computer A and the laptop computer B turn on the cameras. At this point, if both laptop computer A and laptop computer B have captured the current facial motion picture of the user (such as a smile, pursed lips, etc.), both laptop computer A and laptop computer B will analyze the facial motion pictures captured by them. Whether the preset face conditions are met. If neither of the preset face conditions are met, neither laptop A nor laptop B will send their respective MAC addresses or IP addresses to the mobile phone, so that the mobile phone cannot obtain the clear ID information of the target device (that is, the MAC address). address or IP address, etc.). It should be noted that when the user really needs to stream the content of the application running on the mobile phone to the laptop computer A, the user will make a facial action in the direction of the camera facing the laptop computer A. At this time, the pictures with more faces facing the front are captured by the laptop computer A instead of having an offset angle; or, the larger the proportion of faces in the captured pictures. However, since the user does not perform facial movements in the direction facing the camera of the notebook computer B, the face captured by the notebook computer B has a large oblique angle and the like. Therefore, the preset face condition can be understood as the more frontal the face in the picture faces, or the larger the proportion of the face in the picture, etc.
下面本申请实施例将对第一信息没有携带流转目标设备的标识信息的情况作一个示例说明。In the following embodiments of the present application, an example will be described for the case where the first information does not carry the identification information of the transfer target device.
在一个可能的示例中,在判断第一信息是否携带流转目标设备的标识信息之后,该方法还包括以下步骤:在第一信息没有携带流转目标设备的标识信息时,获取流转源设备的当前用户账号下与流转源设备所连接的所有设备的标识信息;从所有设备的标识信息中确定流转目标设备的标识信息。In a possible example, after judging whether the first information carries the identification information of the transfer target device, the method further includes the following steps: when the first information does not carry the identification information of the transfer target device, obtain the current user of the transfer source device Identification information of all devices connected to the transfer source device under the account; the identification information of the transfer target device is determined from the identification information of all devices.
需要说明的是,当本申请实施例考虑将流转源设备当前运行的目标应用的内容进行流转时,如果该流转源设备获取的第一信息中没有携带流转目标设备的ID信息,结合上述图4中的应用流转框架,本申请实施例可以通过该流转源设备中的连接管理模块获取该流转源设备的当前用户账号下与该流转源设备所连接的所有设备的ID信息。It should be noted that, when the embodiment of the present application considers transferring the content of the target application currently running on the transfer source device, if the first information obtained by the transfer source device does not carry the ID information of the transfer target device, in conjunction with the above Figure 4 The application transfer framework in the embodiment of the present application can obtain the ID information of all devices connected to the transfer source device under the current user account of the transfer source device through the connection management module in the transfer source device.
进一步需要说明的是,由于远端或云端的服务器上存储有流转源设备的当前用户账号下与流转源设备所连接的所有设备的标识信息,因此该流转源设备可以访问远端或云端的服务器以获取上述ID信息;或者,由于远端的其他电子设备(如路由器或中继设备等)上存储有流转源设备的当前用户账号下与流转源设备所连接的所有设备的标识信息,因此该流转源设备可以访问远端的其他电子设备以获取上述ID信息;或者,由于上述服务器或上述其他电子设备可以直接将上述ID信息下发到流转源设备的内部存储器上缓存以提高访问效率,因此流转源设备可以直接访问本端的内部存储器以获取上述ID信息;或者,由于上述ID信息可以拷贝到外部存储器中,因此流转源设备可以访问外部存储器接口以获取上述ID信息。It should be further noted that, since the identification information of all devices connected to the source device under the current user account of the source device is stored on the server at the remote end or in the cloud, the source device can access the server at the remote end or in the cloud. to obtain the above-mentioned ID information; or, because other remote electronic devices (such as routers or relay devices, etc.) store the identification information of all devices connected to the source device under the current user account of the source device, this The circulation source device can access other remote electronic devices to obtain the above-mentioned ID information; or, because the above-mentioned server or the above-mentioned other electronic equipment can directly issue the above-mentioned ID information to the internal memory of the circulation source device for caching to improve access efficiency, so The streaming source device can directly access the internal memory of the local end to obtain the above ID information; or, since the above ID information can be copied to the external memory, the streaming source device can access the external memory interface to obtain the above ID information.
可见,通过上述不同的访问方式来获取与流转源设备的同一个用户账号下的所有设备的ID信息以确定出流转目标设备,从而保证更加便捷的实现应用内容跨设备流转,提高应用流转的效率、多样性和使用体验。It can be seen that the ID information of all devices under the same user account as the source device is obtained through the above different access methods to determine the target device, so as to ensure the more convenient realization of the cross-device transfer of application content and improve the efficiency of application transfer. , variety and experience.
另外,针对流转源设备的当前用户账号,通过上述描述的应用内容流转通信系统10可知,至少两个 电子设备110中的每个电子设备可以为同一个用户账号下的设备。例如,当用户使用同一个用户账号登录手机、台式电脑和智能手表等设备时,该至少两个电子设备110包括该手机、台式电脑和智能手表等设备,并且该手机、台式电脑和智能手表等设备之间可以通过无线网络互相通信。此时,流转源设备可以理解为该至少两个电子设备110中的一个设备。In addition, for the current user account of the transfer source device, it can be known from the application content transfer communication system 10 described above that each electronic device in the at least two electronic devices 110 can be a device under the same user account. For example, when the user uses the same user account to log in to devices such as mobile phones, desktop computers, and smart watches, the at least two electronic devices 110 include the mobile phones, desktop computers, and smart watches, and the mobile phone, desktop computers, and smart watches. Devices can communicate with each other over a wireless network. At this time, the circulation source device may be understood as one of the at least two electronic devices 110 .
在一个可能的示例中,在判断第一信息是否携带流转目标设备的标识信息之后,该方法还包括:在第一信息没有携带流转目标设备的标识信息时,获取流转源设备所在的网络内与流转源设备所连接的所有设备的标识信息;从所有设备的标识信息中确定流转目标设备的标识信息。In a possible example, after judging whether the first information carries the identification information of the transfer target device, the method further includes: when the first information does not carry the identification information of the transfer target device, obtaining the network and the network where the transfer source device is located. The identification information of all devices connected to the transfer source device; the identification information of the transfer target device is determined from the identification information of all devices.
需要说明的是,当本申请实施例考虑将流转源设备当前运行的目标应用的内容进行流转时,如果该流转源设备获取的第一信息中没有携带流转目标设备的ID信息。此时,结合上述图4中的应用流转框架,本申请实施例可以通过该流转源设备中的连接管理模块获取该流转源设备所在的网络内与该流转源设备所连接的所有设备的ID信息。It should be noted that, when the embodiment of the present application considers transferring the content of the target application currently running on the transfer source device, if the first information obtained by the transfer source device does not carry the ID information of the transfer target device. At this time, in conjunction with the application flow framework in FIG. 4, the embodiment of the present application can obtain the ID information of all devices connected to the flow source device in the network where the flow source device is located through the connection management module in the flow source device .
进一步需要说明的是,针对流转源设备所在的网络,通过上述描述的应用内容流转通信系统10可知,至少两个电子设备110中的每个电子设备可以通过中继设备(如路由器)连接到同一个WLAN网络中。或者,该至少两个电子设备110中的每个电子设备可以通过无线通信方式(如蓝牙、Zigbee、NFC、UWB等)组成一个对等(Peer to Peer,P2P)网络。因此,流转源设备所在的网络可以为通过中继设备或无线通信方式组成的WLAN网络或P2P网络。It should be further noted that, with respect to the network where the transfer source device is located, it can be known from the application content transfer communication system 10 described above that each electronic device in the at least two electronic devices 110 can be connected to the same device through a relay device (such as a router). in a WLAN network. Alternatively, each of the at least two electronic devices 110 may form a peer-to-peer (P2P) network through wireless communication (eg, Bluetooth, Zigbee, NFC, UWB, etc.). Therefore, the network where the transfer source device is located may be a WLAN network or a P2P network formed by a relay device or a wireless communication method.
另外,如果流转源设备所在的网络为WLAN网络,该流转源设备可以访问远端的中继设备以获取上述ID信息;或者,该远端的中继设备直接将上述ID信息下发到该流转源设备的内部存储器上缓存,该流转源设备可以直接访问本端的内部存储器以获取上述ID信息。如果流转源设备所在的网络为P2P网络,该流转源设备可以访问P2P网络中的主电子设备(如计算能力强的设备、距离流转源设备设备最近的设备或P2P网络中的主控设备等)以获取上述ID信息;或者,该主电子设备直接将上述ID信息下发到该流转源设备的内部存储器上缓存,该流转源设备可以直接访问本端的内部存储器以获取上述ID信息。如果上述ID信息可以拷贝到外部存储器中,则该流转源设备可以访问外部存储器接口以获取上述ID信息。In addition, if the network where the transfer source device is located is a WLAN network, the transfer source device can access the remote relay device to obtain the above ID information; or, the remote relay device directly sends the above ID information to the transfer device Cached on the internal memory of the source device, the streaming source device can directly access the internal memory of the local end to obtain the above ID information. If the network where the transfer source device is located is a P2P network, the transfer source device can access the main electronic device in the P2P network (such as a device with strong computing power, the device closest to the transfer source device, or the main control device in the P2P network, etc.) To obtain the above-mentioned ID information; or, the main electronic device directly sends the above-mentioned ID information to the internal memory of the circulation source device to be cached, and the circulation source device can directly access the internal memory of the local end to obtain the above-mentioned ID information. If the above-mentioned ID information can be copied to the external memory, the streaming source device can access the external memory interface to obtain the above-mentioned ID information.
可见,通过上述不同的访问方式来获取流转源设备所在的网络内与流转源设备所连接的所有设备的ID信息以确定出流转目标设备,从而保证更加便捷的实现应用内容跨设备流转,提高应用流转的效率、多样性和使用体验。It can be seen that the ID information of all devices connected to the source device in the network where the source device is located can be obtained through the different access methods described above to determine the target device, so as to ensure a more convenient transfer of application content across devices and improve application performance. Efficiency, variety and user experience of circulation.
下面本申请实施例将对流转源设备如何从所有设备的标识信息中确定流转目标设备的标识信息进行具体说明。The following embodiments of the present application will specifically describe how the transfer source device determines the identification information of the transfer target device from the identification information of all devices.
具体的,从所有设备的标识信息中确定流转目标设备的标识信息,可以包括以下步骤:若所有设备的标识信息中除流转源设备的标识信息外只存在一个设备的标识信息,则将该设备的标识信息作为流转目标设备的标识信息。Specifically, determining the identification information of the transfer target device from the identification information of all devices may include the following steps: if the identification information of all devices except the identification information of the transfer source device only has the identification information of one device, then the device The identification information of the transfer target device is used as the identification information of the transfer target device.
需要说明的是,当同一个用户账号下与流转源设备所连接的所有设备只有一个设备,或者同一个网络内与该流转源设备所连接的所有设备只有一个设备时,本申请实施例考虑可以将该设备作为流转目标设备,并获取到该设备的ID信息,从而流转源设备可以实现将当前运行的目标应用的内容流转至该设备上。It should be noted that when there is only one device for all devices connected to the circulation source device under the same user account, or when there is only one device for all the devices connected to the circulation source device in the same network, the embodiment of the present application may consider The device is used as the streaming target device, and the ID information of the device is acquired, so that the streaming source device can realize the streaming of the content of the currently running target application to the device.
具体的,从所有设备的标识信息中确定流转目标设备的标识信息,可以包括以下步骤:若所有设备的标识信息中除流转源设备的标识信息外存在至少两个设备的标识信息,则获取针对至少两个设备的标识信息的选择操作指令;根据选择操作指令从至少两个设备的标识信息中确定流转目标设备的标识信息。Specifically, determining the identification information of the transfer target device from the identification information of all the devices may include the following steps: if the identification information of all the devices contains the identification information of at least two devices in addition to the identification information of the transfer source device, obtain the identification information for the transfer target device. A selection operation instruction for the identification information of at least two devices; the identification information of the transfer target device is determined from the identification information of the at least two devices according to the selection operation instruction.
需要说明的是,当同一个用户账号下与流转源设备所连接的所有设备有至少两个(即多个)设备,或者同一个网络内与该流转源设备所连接的所有设备有多个设备时,本申请实施例考虑在流转源设备的显示屏上通过弹窗、下拉菜单等方式显示出包含该多个设备的选项列表。然后,用户可以从该选项列表中选择一个或多个设备作为流转目标设备。也就是说,该流转源设备可以获取到针对该多个设备ID信息的选择操作指令,从而根据该选择操作指令确定出流转目标设备的ID,实现该流转源设备将当前运行的目标应用的内容流转至流转目标设备上。下面以流转源设备为手机为例进行示例说明。It should be noted that when there are at least two (ie multiple) devices for all devices connected to the source device under the same user account, or there are multiple devices for all devices connected to the source device in the same network , the embodiment of the present application considers that a list of options including the multiple devices is displayed on the display screen of the streaming source device by means of a pop-up window, a drop-down menu, or the like. The user can then select one or more devices from the list of options as the streaming target device. That is to say, the streaming source device can obtain a selection operation instruction for the plurality of device ID information, so as to determine the ID of the streaming target device according to the selection operation instruction, and realize the content of the currently running target application by the streaming source device. Streaming to the streaming target device. In the following, an example is given by taking the transfer source device as a mobile phone as an example.
示例性的,如图6和图7所示。在图6中,手机上当前运行有音乐播放器(即目标应用)。此时,用户需要将该音乐播放器上正在播放的歌曲“你就不要想起我”(即目标应用的内容)流转到笔记本电脑上播放。此时,用户通过点击该手机上的“流转应用”选项,开始准备进行应用内容跨设备流转。在图7中,用户在点击图6所示的手机上的“流转应用”之后,从广域网络(同一个用户账号下的所有设备通过广域网连接)或局域网络(如WLAN网络或P2P网络)中搜索到笔记本电脑A和笔记本电脑B。此时,通过上述网络将笔记本电脑A的MAC地址(即00:0C:29:26:BC:07)和笔记本电脑B的MAC地址(即00:0C:29:F3:54:1D)传输给该手机。然后,该手机上通过弹窗方式显示出包含笔记本电脑A的MAC地址 和笔记本电脑B的MAC地址的选项列表。最后,用户可以从该选项列表中选择笔记本电脑A作为流转目标设备。Illustratively, as shown in FIGS. 6 and 7 . In Fig. 6, a music player (ie, a target application) is currently running on the mobile phone. At this point, the user needs to stream the song "don't think of me" (that is, the content of the target application) currently playing on the music player to the laptop for playback. At this point, the user starts to prepare for the cross-device flow of the application content by clicking the "transfer application" option on the mobile phone. In Fig. 7, after the user clicks the "transfer application" on the mobile phone shown in Fig. 6, the user accesses the network from a wide area network (all devices under the same user account are connected through a wide area network) or a local area network (such as a WLAN network or a P2P network). Laptop A and Laptop B are found. At this time, the MAC address of laptop A (ie 00:0C:29:26:BC:07) and the MAC address of laptop B (ie 00:0C:29:F3:54:1D) are transmitted through the above network to the phone. Then, a list of options including the MAC address of the laptop computer A and the MAC address of the laptop computer B is displayed on the mobile phone by means of a pop-up window. Finally, the user can select Laptop A as the streaming target device from the list of options.
可见,在存在多个设备时,本申请实施例可以由用户对该多个设备进行选择以确定出流转目标设备,从而提高应用内容跨设备流转的使用体验。It can be seen that when there are multiple devices, in this embodiment of the present application, the user can select the multiple devices to determine the streaming target device, thereby improving the use experience of application content streaming across devices.
具体的,从所有设备的标识信息中确定流转目标设备的标识信息,可以包括以下步骤:若所有设备的标识信息中除流转源设备的标识信息外存在至少两个设备的标识信息,则按照预设优先级策略将至少两个设备的标识信息中优先级最高的标识信息作为流转目标设备的标识信息。Specifically, determining the identification information of the transfer target device from the identification information of all the devices may include the following steps: if the identification information of all the devices contains the identification information of at least two devices in addition to the identification information of the transfer source device, according to the predetermined The priority policy is to use the identification information with the highest priority among the identification information of at least two devices as the identification information of the transfer target device.
需要说明的是,当同一个用户账号下与流转源设备所连接的所有设备有多个设备,或者同一个网络内与该流转源设备所连接的所有设备有多个设备时,本申请实施例考虑按照预设优先级策略从所有设备的标识信息中确定出流转目标设备的标识信息。It should be noted that when there are multiple devices for all devices connected to the circulation source device under the same user account, or when there are multiple devices for all the devices connected to the circulation source device in the same network, the embodiment of the present application Consider determining the identification information of the transfer target device from the identification information of all devices according to a preset priority policy.
下面对本申请实施例的预设优先级策略的几种实施方式进行具体说明。Several implementations of the preset priority policy in the embodiment of the present application will be specifically described below.
方式1:Way 1:
进一步的,预设优先级策略可以包括从至少两个设备中判断历史上与流转源设备发生过应用流转的时间,并将与流转源设备发生过应用流转的时间中时间最近的设备设置为优先级最高。Further, the preset priority policy may include judging from at least two devices the time at which application circulation has occurred with the circulation source device in history, and setting the device with the closest time among the times when application circulation has occurred with the circulation source device as priority. highest level.
示例性的,以手机为流转源设备为例,与该手机为同一个用户账号下的所有设备包括笔记本电脑和智能手表。其中,该笔记本电脑与该手机于2020年11月6日16:00时发生过最近的一次应用流转,而该智能手表与该手机于2020年11月7日12:00时发生过最近的一次应用流转。因此,按照上述预设优先策略,该智能手表的优先级最高。Exemplarily, taking a mobile phone as the transfer source device as an example, all devices under the same user account as the mobile phone include laptop computers and smart watches. Among them, the laptop and the mobile phone had the most recent application transfer at 16:00 on November 6, 2020, and the smartwatch and the mobile phone had the most recent application at 12:00 on November 7, 2020 Application flow. Therefore, according to the above preset priority strategy, the smart watch has the highest priority.
方式2:Way 2:
进一步的,预设优先级策略预设优先级策略可以包括从至少两个设备中判断历史上与流转源设备发生过应用流转的次数,并将与流转源设备发生过应用流转的次数中次数最多的设备设置为优先级最高。Further, the preset priority policy The preset priority policy may include judging from at least two devices the number of times that the application circulation has occurred with the circulation source device in history, and the number of times the application circulation has occurred with the circulation source device is the highest. The device is set to the highest priority.
示例性的,以手机为流转源设备为例,与该手机为同一个网络内的所有设备包括笔记本电脑和智能手表。其中,该笔记本电脑历史上与该手机发生过应用流转的次数为1,而该智能手表历史上与该手机发生过应用流转的次数为0。因此,按照上述预设优先策略,该笔记本电脑的优先级最高。Exemplarily, taking a mobile phone as the transfer source device as an example, all devices in the same network as the mobile phone include notebook computers and smart watches. Among them, the number of times that the notebook computer has had an application flow with the mobile phone in the history is 1, and the number of times that the smart watch has had an application flow with the mobile phone in the history is 0. Therefore, according to the above preset priority policy, the laptop has the highest priority.
方式3:Way 3:
进一步的,预设优先级策略可以包括将流转源设备所在的P2P网络(即通过蓝牙、Zigbee、NFC、UWB等无线通信方式组成的网络)中的所有设备设置为优先级最高。Further, the preset priority policy may include setting all devices in the P2P network (ie, a network formed by wireless communication methods such as Bluetooth, Zigbee, NFC, UWB) where the transfer source device is located as the highest priority.
示例性的,以手机为流转源设备为例,该手机与笔记本电脑通过蓝牙方式组成一个P2P网络,而该手机与智能手表通过接入同一个路由器组成一个WLAN网络。因此,按照上述预设优先策略,该笔记本电脑的优先级最高。Illustratively, taking a mobile phone as the source device for circulation as an example, the mobile phone and the notebook computer form a P2P network by means of Bluetooth, and the mobile phone and the smart watch form a WLAN network by connecting to the same router. Therefore, according to the above preset priority policy, the laptop has the highest priority.
方式4:Way 4:
进一步的,预设优先级策略可以包括将流转源设备所在的WLAN网络(即通过同一个中继设备或路由器组成的网络)中的所有设备设置为优先级最高。Further, the preset priority policy may include setting all devices in the WLAN network where the flow source device is located (ie, a network formed by the same relay device or router) as the highest priority.
示例性的,以手机为流转源设备为例,该手机与笔记本电脑通过蓝牙方式组成一个P2P网络,而该手机与智能手表通过接入同一个路由器组成一个WLAN网络。因此,按照上述预设优先策略,该智能手表的优先级最高。Illustratively, taking a mobile phone as the source device for circulation as an example, the mobile phone and the notebook computer form a P2P network by means of Bluetooth, and the mobile phone and the smart watch form a WLAN network by connecting to the same router. Therefore, according to the above preset priority strategy, the smart watch has the highest priority.
方式5:Way 5:
进一步的,预设优先级策略可以包括将与流转源设备为同一个用户账号下的所有设备设置为优先级最高。Further, the preset priority policy may include setting all devices under the same user account as the transfer source device to have the highest priority.
示例性的,以手机为流转源设备为例,该手机与笔记本电脑为同一个用户账号下的两个设备,并且该手机与该笔记本电脑相互连接,而该手机与智能手表通过接入同一个路由器组成一个WLAN网络。因此,按照上述预设优先策略,该笔记本电脑的优先级最高。Exemplarily, taking a mobile phone as the source device for circulation as an example, the mobile phone and the laptop are two devices under the same user account, and the mobile phone and the laptop are connected to each other, and the mobile phone and the smart watch are connected to the same Routers form a WLAN network. Therefore, according to the above preset priority policy, the laptop has the highest priority.
方式6:Way 6:
进一步的,预设优先级策略可以包括优先选择流转源设备所在的P2P网络中的所有设备,再根据选择操作指令从上述所有设备中确定流转目标设备的标识信息;或者,优先选择流转源设备所在的P2P网络中的所有设备,再从上述所有设备中判断历史上与流转源设备发生过应用流转的时间,并将与流转源设备发生过应用流转的时间中时间最近的设备设置为优先级最高;或者,优先选择流转源设备所在的P2P网络中的所有设备,再从上述所有设备中判断历史上与流转源设备发生过应用流转的次数,并将与流转源设备发生过应用流转的次数中次数最多的设备设置为优先级最高。Further, the preset priority policy may include preferentially selecting all devices in the P2P network where the source device is located, and then determining the identification information of the destination device from all the above-mentioned devices according to the selection operation instruction; or, preferentially selecting the location where the source device is located. All devices in the P2P network, and then determine the time of application transfer with the transfer source device in history from all the above devices, and set the device with the latest time in the time of application transfer with the transfer source device as the highest priority. ; Or, give priority to all devices in the P2P network where the source device is located, and then judge the number of times the application has been transferred with the source device in history from all the above-mentioned devices, and the number of times the application has been transferred with the source device will be counted. The device with the highest number of times is set to have the highest priority.
需要说明的是,本申请实施例可以将上述各种实施方式之间进行组合以确定预设优先级策略,对此不再具体赘述。It should be noted that, in this embodiment of the present application, the above various implementation manners may be combined to determine a preset priority policy, which will not be described in detail.
可见,本申请实施例可以通过上述不同的实施方式从所有设备的标识信息中确定流转目标设备的标识信息,从而提高应用内容跨设备流转的效率和使用体验。It can be seen that the embodiment of the present application can determine the identification information of the transfer target device from the identification information of all devices through the above different implementations, thereby improving the efficiency and use experience of the application content transfer across devices.
结合上述描述,本申请实施例的S510可以包括以下步骤:在第一信息携带流转目标设备的标识信息时,获取流转源设备当前运行的目标应用的应用类型。With reference to the above description, S510 in this embodiment of the present application may include the following steps: when the first information carries the identification information of the transfer target device, obtain the application type of the target application currently running on the transfer source device.
需要说明的是,当本申请实施例考虑将流转源设备当前运行的目标应用的内容进行流转时,如果该流转源设备获取的第一信息中携带流转目标设备的ID信息,结合上述图4中的应用流转框架,本申请实施例可以通过该流转源设备中的应用信息模块对其当前运行的目标应用进行识别以获取目标应用的应用信息(如应用名称、应用类型等)。另外,流转源设备中的应用信息模块可以访问该流转源设备的操作系统上的进程或线程等以获取目标应用的应用类型。It should be noted that, when the embodiment of the present application considers transferring the content of the target application currently running on the transfer source device, if the first information obtained by the transfer source device carries the ID information of the transfer target device, in combination with the above-mentioned FIG. 4 The application circulation framework of this application embodiment can identify the currently running target application through the application information module in the circulation source device to obtain application information (such as application name, application type, etc.) of the target application. In addition, the application information module in the transfer source device can access the process or thread on the operating system of the transfer source device to obtain the application type of the target application.
具体的,目标应用的应用类型可以包括以下至少一种:分布式应用、接力式应用、普通式应用。Specifically, the application type of the target application may include at least one of the following: distributed application, relay application, and common application.
进一步的,分布式应用可以用于指示将目标应用的前端和目标应用的后端在不同设备上实现分离运行操作。Further, the distributed application can be used to instruct the front end of the target application and the back end of the target application to implement separate running operations on different devices.
需要说明的是,当目标应用为分布式应用时,流转源设备上需要运行目标应用的后端,而将目标应用的前端流转至流转目标设备上,并由流转目标设备运行该目标应用的前端,而无需流转源设备再运行。It should be noted that when the target application is a distributed application, the backend of the target application needs to be run on the source device, and the frontend of the target application is transferred to the target device, and the target device runs the frontend of the target application. , without having to re-run the source device.
进一步的,接力式应用可以用于指示通过流转源设备上的文件服务将目标应用在不同设备上实现存储、传递、恢复或者共享操作。Further, the relay application can be used to instruct the target application to implement storage, transfer, recovery or sharing operations on different devices through the file service on the streaming source device.
需要说明的是,当目标应用为接力式应用时,流转源设备上的文件服务(fileServer)可以将目标应用的内容(如数据流、视频流、音频流等)流转至流转目标设备,然后由流转目标设备访问流转源设备上的文件服务对该目标应用的内容进行恢复。其中,文件服务可以提供一个http访问地址,并以数据流的方式提供给外部应用或第三方合作应用。例如,外部应用或第三方合作应用可以通过该http访问地址来访问本端的多媒体数据。It should be noted that when the target application is a relay application, the file server (fileServer) on the streaming source device can stream the content of the target application (such as data stream, video stream, audio stream, etc.) to the streaming target device, and then The streaming target device accesses the file service on the streaming source device to restore the content of the target application. Among them, the file service can provide an http access address, and provide it to an external application or a third-party cooperative application in the form of a data stream. For example, an external application or a third-party cooperative application can access the local multimedia data through the http access address.
示例性的,以手机为流转源设备为例,手机中的视频播放器正在播放一个本地视频文件。当用户需要将其视频播放器上播放的该本地视频文件接力到笔记本电脑上时,该手机通过接力式应用框架将该本地视频文件的视频名称、视频的http地址、播放进度等数据流信息传输给该笔记本电脑。然而,该笔记本电脑接收到该数据流信息后弹出一个通知框,并通过该通知框提示用户是否执行接力来自该手机的视频等。如果用户确定执行接力,则该笔记本电脑将运行本端的视频播放器,并由该视频播放器通过接收到的该数据流信息中的视频的http地址访问该手机上的文件服务以对该本地视频文件进行恢复(如续播视频),而该手机上停止该本地视频文件的播放。Exemplarily, taking a mobile phone as the streaming source device as an example, a video player in the mobile phone is playing a local video file. When the user needs to relay the local video file played on the video player to the laptop, the mobile phone transmits data stream information such as the video name of the local video file, the http address of the video, and the playback progress through the relay application framework. to that laptop. However, after the notebook computer receives the data stream information, a notification box pops up, and the user is prompted through the notification box whether to relay the video from the mobile phone. If the user decides to execute the relay, the laptop will run the video player on the local end, and the video player will access the file service on the mobile phone through the http address of the video in the received data stream information to obtain the local video The file is restored (for example, the video is resumed), and the playback of the local video file is stopped on the mobile phone.
进一步的,普通式应用可以用于指示通过投屏技术将目标应用在不同设备上实现显示操作。Further, the common application can be used to instruct the target application to implement display operations on different devices through the screen projection technology.
需要说明的是,当目标应用为普通式应用时,流转源设备可以将目标应用的内容投射到流转目标设备的显示屏或显示介质上进行显示,从而显示内容的同步显示。It should be noted that when the target application is a common application, the streaming source device can project the content of the target application to the display screen or display medium of the streaming target device for display, thereby displaying the synchronous display of the content.
S520、根据应用类型确定针对目标应用的应用流转策略。S520. Determine an application flow strategy for the target application according to the application type.
需要说明的是,当本申请实施例考虑将流转源设备当前运行的目标应用的内容进行流转时,如果该流转源设备已获知流转目标设备的ID信息,结合上述图4中的应用流转框架,本申请实施例可以通过该流转源设备中的流转策略模块访问应用信息模块以获知目标应用的应用类型,从而根据目标应用的应用类型确定其对应的应用流转策略。It should be noted that when the embodiment of the present application considers transferring the content of the target application currently running on the transfer source device, if the transfer source device has already learned the ID information of the transfer target device, in combination with the application transfer framework in FIG. 4 above, In this embodiment of the present application, the application information module can be accessed through the circulation policy module in the circulation source device to learn the application type of the target application, so as to determine the corresponding application circulation policy according to the application type of the target application.
下面本申请实施例通过目标应用的应用类型的不同确定不同的应用流转策略的几种实施方式进行具体说明。The following embodiments of the present application specifically describe several implementation manners in which different application flow strategies are determined by different application types of target applications.
方式1:Way 1:
在一个可能的示例中,若应用类型包括分布式应用,则根据应用类型确定针对目标应用的应用流转策略,可以包括以下步骤:根据分布式应用确定应用流转策略;其中,应用流转策略用于执行以下步骤:暂停目标应用的前端在流转源设备上运行,并由流转目标设备访问流转源设备上运行的目标应用的后端以开始运行目标应用的前端。In a possible example, if the application type includes a distributed application, determining an application flow strategy for the target application according to the application type may include the following steps: determining an application flow strategy according to the distributed application; wherein the application flow strategy is used to execute The following steps: Pause the front end of the target application from running on the streaming source device, and the streaming target device accesses the back end of the target application running on the streaming source device to start running the front end of the target application.
需要说明的是,当目标应用为分布式应用时,应用流转策略可以是:流转源设备上继续运行目标应用的后端,而将目标应用的前端流转至流转目标设备上,并停止自身运行目标应用的前端;流转目标设备访问流转源设备上运行的目标应用的后端以开始运行该目标应用的前端。下面以手机和笔记本电脑这两个电子设备为例进行示例说明。It should be noted that when the target application is a distributed application, the application flow strategy can be: the backend of the target application continues to run on the source device, and the front end of the target application is transferred to the target device, and stops running the target itself. The front end of the application; the streaming target device accesses the back end of the target application running on the streaming source device to start running the front end of the target application. The following takes two electronic devices, a mobile phone and a notebook computer, as examples for illustration.
示例性的,请参阅图8。手机当前正在运行分布式应用X。其中,应用X的UI界面和服务端均在运行。当手机通过UWB指向笔记本电脑时,通过分布式应用框架后,手机暂停应用X的UI界面的运行,而笔记本电脑通过访问手机上应用X的服务端以开始运行应用X的UI界面。For example, see Figure 8. The phone is currently running distributed application X. Among them, the UI interface and server side of application X are both running. When the mobile phone points to the laptop through UWB, after passing through the distributed application framework, the mobile phone suspends the running of the UI interface of the application X, and the laptop starts to run the UI interface of the application X by accessing the server of the application X on the mobile phone.
另外,结合图4中的应用流转框架,图8所示的手机中的UBW识别模块获取到笔记本电脑的UWB标 签,并向源和目标判定模块发送笔记本电脑的UWB标签。然后,源和目标判定模块将手机的UWB标签和笔记本电脑的UWB标签传输给流转策略模块,并由流转策略模块访问应用信息模块以获知手机当前运行的应用X为分布式应用。最后,流转策略模块向应用流转模块中的分布式应用框架发起一次应用流转请求,从而通过分布式应用框架暂停手机上应用的UI界面,并拉起笔记本电脑上应用X的UI界面,以及通知笔记本电脑在开始运行应用X的UI界面时访问手机上应用X的服务端,从而完成应用X的跨设备流转过程。In addition, combined with the application flow framework in Fig. 4, the UBW identification module in the mobile phone shown in Fig. 8 obtains the UWB label of the notebook computer, and sends the UWB label of the notebook computer to the source and target determination modules. Then, the source and target determination module transmits the UWB tag of the mobile phone and the UWB tag of the notebook computer to the circulation strategy module, and the circulation strategy module accesses the application information module to know that the application X currently running on the mobile phone is a distributed application. Finally, the flow strategy module initiates an application flow request to the distributed application framework in the application flow module, so as to suspend the UI interface of the application on the mobile phone through the distributed application framework, pull up the UI interface of the application X on the laptop, and notify the notebook When the computer starts to run the UI interface of application X, it accesses the server of application X on the mobile phone, so as to complete the cross-device transfer process of application X.
方式2:Way 2:
在一个可能的示例中,若应用类型包括接力式应用,则根据应用类型确定针对目标应用的应用流转策略,可以包括以下步骤:根据接力式应用确定应用流转策略;其中,应用流转策略用于执行以下步骤:暂停目标应用在流转源设备上运行,并由流转目标设备访问流转源设备的文件服务以开始运行目标应用。In a possible example, if the application type includes a relay application, determining the application flow strategy for the target application according to the application type may include the following steps: determining the application flow strategy according to the relay application; wherein, the application flow strategy is used to execute The following steps: Pause the target application from running on the streaming source device, and the streaming target device accesses the file service of the streaming source device to start running the target application.
需要说明的是,当目标应用为接力式应用时,应用流转策略可以是:流转源设备上的文件服务将目标应用的内容(如数据流、视频流、音频流等)流转至流转目标设备;流转目标设备访问流转源设备上的文件服务以开始运行该目标应用的内容。其中,文件服务可以提供一个http访问地址,并以数据流的方式提供给外部应用或第三方合作应用。下面以手机和笔记本电脑这两个电子设备为例进行示例说明。It should be noted that when the target application is a relay application, the application transfer strategy may be: the file service on the transfer source device transfers the content of the target application (such as data stream, video stream, audio stream, etc.) to the transfer target device; The streaming target device accesses the file service on the streaming source device to start running the content of the target application. Among them, the file service can provide an http access address, and provide it to an external application or a third-party cooperative application in the form of a data stream. The following takes two electronic devices, a mobile phone and a notebook computer, as examples for illustration.
示例性的,请参阅图9。手机中运行视频播放器以播放一个本地视频文件。当用户通过手机的麦克风向手机录入“在笔记本电脑上播放”的语音。手机通过分析该语音以获知流转源设备为笔记本电脑。最后,通过接力式应用框架后,手机暂停在本端的视频播放器上播放该本地视频文件,而笔记本电脑通过访问手机上的文件服务以在本端的视频播放器上开始播放(或继续播放)该本地视频文件(即笔记本电脑与手机播放相同的视频)。For example, see Figure 9. Run a video player on the phone to play a local video file. When the user enters the voice of "playing on the laptop" into the mobile phone through the microphone of the mobile phone. The mobile phone analyzes the voice to learn that the source device of the stream is a laptop. Finally, after passing the relay application framework, the mobile phone pauses to play the local video file on the local video player, and the laptop starts playing (or continues to play) the video file on the local video player by accessing the file service on the mobile phone. Local video files (i.e. the laptop plays the same video as the phone).
另外,结合图4中的应用流转框架,图9所示的手机中的语音识别模块识别该“在笔记本电脑上播放”的语音,并将识别结果传输给源和目标判定模块。其次,由于源和目标判定模块无法通过该识别结果具体获知笔记本电脑的ID信息,因此源和目标判定模块访问连接管理模块以查询在同一个用户账号或同一个网络内与手机所连接的所有设备的ID信息。再次,由于只有一台笔记本电脑与手机连接,因此源和目标判定模块获取到该笔记本电脑的ID信息,并将手机的ID信息和笔记本电脑的ID信息传输给流转策略模块。接着,流转策略模块访问应用信息模块以获知手机当前运行的视频播放器为接力式应用。最后,流转策略模块向应用流转模块中的接力式应用框架发起一次应用流转请求,从而通过接力式应用框架暂停在手机的视频播放器上播放视频,而笔记本电脑通过访问手机上的文件服务以在本端的视频播放器上续播与手机上相同的视频。In addition, combined with the application flow framework in FIG. 4 , the speech recognition module in the mobile phone shown in FIG. 9 recognizes the “playing on the laptop” speech, and transmits the recognition result to the source and target determination modules. Secondly, since the source and target determination modules cannot know the ID information of the laptop through the identification result, the source and target determination modules access the connection management module to query all devices connected to the mobile phone within the same user account or the same network. ID information. Thirdly, since there is only one laptop connected to the mobile phone, the source and target determination module obtains the ID information of the laptop, and transmits the ID information of the mobile phone and the laptop to the circulation strategy module. Next, the circulation strategy module accesses the application information module to know that the video player currently running on the mobile phone is a relay application. Finally, the flow strategy module initiates an application flow request to the relay application framework in the application flow module, so as to pause the video playback on the video player of the mobile phone through the relay application framework, and the laptop accesses the file service on the mobile phone to play the video The video player on the local end continues to play the same video as that on the mobile phone.
方式3:Way 3:
在一个可能的示例中,若应用类型包括普通式应用,则根据应用类型确定针对目标应用的应用流转策略,可以包括以下步骤:根据普通式应用确定应用流转策略;其中,应用流转策略用于执行以下操作:若流转目标设备上有应用兼容目标应用以及支持同步目标应用的内容,则暂停目标应用在流转源设备上运行,并将目标应用的内容投射到流转目标设备的显示屏或显示介质上进行显示;或者,若流转目标设备上没有应用兼容目标应用或者不支持同步目标应用的内容,则继续目标应用在流转源设备上运行,并将目标应用的内容投射到流转目标设备的显示屏或显示介质上进行显示。In a possible example, if the application type includes a common application, determining an application flow strategy for the target application according to the application type may include the following steps: determining the application flow strategy according to the common application; wherein the application flow strategy is used to execute The following operations: If there is an application compatible with the target application and the content of the target application to be synchronized on the streaming target device, suspend the target application from running on the streaming source device, and project the content of the target application to the display screen or display medium of the streaming target device Or, if there is no application compatible with the target application on the streaming target device or does not support synchronizing the content of the target application, continue the target application to run on the streaming source device, and project the content of the target application to the display screen of the streaming target device or displayed on the display medium.
需要说明的是,当目标应用为普通式应用时,应用流转策略可以是:流转源设备通过投屏服务框架将目标应用的内容投射到流转目标设备的显示屏或显示介质上进行显示,并判断流转目标设备上是否有应用兼容目标应用的运行和支持同步目标应用的内容;如果有应用兼容和支持同步,则流转源设备可以暂停运行目标应用;如果没有应用兼容或支持同步,则流转源设备可以继续运行目标应用。It should be noted that when the target application is a common application, the application transfer strategy may be: the source device of the transfer projects the content of the target application to the display screen or display medium of the target device for display through the screen projection service framework, and judges that the content of the target application is displayed. Whether there is an application compatible with the running of the target application and supports synchronization of the content of the target application on the streaming target device; if there is an application that is compatible and supports synchronization, the streaming source device can suspend running the target application; if no application is compatible or supports synchronization, the streaming source device The target application can continue to run.
另外,本申请实施例的目标应用可以为流转源设备的应用层上运行的应用程序或媒体数据,如照片、视频、音频、游戏、图库、文档或多媒体等。同时,流转源设备可以在前端运行该目标应用,也可以在后端运行该目标应用。当流转源设备在前端运行该目标应用时,流转源设备的显示屏可以显示该目标应用的内容;当流转源设备在后端运行该目标应用时,流转源设备的显示屏可以不显示该目标应用的内容,而由后台执行目标应用。下面以手机和笔记本电脑这两个电子设备为例进行示例说明。In addition, the target application of this embodiment of the present application may be an application program or media data running on the application layer of the streaming source device, such as photos, videos, audios, games, gallery, documents, or multimedia. At the same time, the circulation source device can run the target application on the front end, and can also run the target application on the back end. When the streaming source device runs the target application at the front end, the display screen of the streaming source device can display the content of the target application; when the streaming source device runs the target application at the back end, the display screen of the streaming source device may not display the target application The content of the application, while the target application is executed in the background. The following takes two electronic devices, a mobile phone and a notebook computer, as examples for illustration.
示例性的,请参阅图10。手机当前正在运行普通式应用Y。当手机通过NFC触碰笔记本电脑时,通过投屏服务框架后,手机将运行的应用Y的内容投射到笔记本电脑的显示屏上进行显示。由于笔记本电脑上没有兼容应用Y运行的应用,因此手机需要继续运行应用Y。For example, see Figure 10. The phone is currently running the normal application Y. When the mobile phone touches the notebook computer through NFC, after passing the screen casting service framework, the mobile phone projects the content of the running application Y to the display screen of the notebook computer for display. Since there is no compatible app running with app Y on the laptop, the phone needs to continue running app Y.
进一步需要说明的是,本申请实施例可以将流转目标设备的显示屏上显示由投流转源设备投屏的内容称为镜像,并且该镜像可以呈现出目标应用的内容的全部画面或者部分画面。同时,该镜像可以是在投屏过程中经过相关的分辨率调整、显示大小调整、像素调整、画质调整等操作之后呈现的画面。下面以流转源设备为笔记本电脑以及流转目标设备为手机进行示例说明。It should be further noted that, in this embodiment of the present application, the content projected by the streaming source device on the display screen of the streaming target device may be referred to as a mirror image, and the mirror image may present all or part of the content of the target application. At the same time, the mirror image may be a picture presented after relevant operations such as resolution adjustment, display size adjustment, pixel adjustment, and image quality adjustment in the process of screen projection. The following is an example description by taking the transfer source device as a notebook computer and the transfer target device as a mobile phone.
示例性的,请参阅图11和图12。在图11中,用户通过笔记本电脑上中的“图库”应用打开一张“猫.jpg”的照片,并利用投屏服务框架或普通式应用框架将笔记本电脑上“图库”应用的内容(即照片画面)投屏到手机上。此时,手机的显示屏上显示的投屏内容与笔记本电脑上“图库”应用的内容相同(即镜像可以呈现出目标应用的内容的全部画面)。然而,在图12中,用户可以通过设置相关投屏选项,只将笔记本电脑上的“图库”应用打开的“猫.jpg”投屏到手机上。此时,手机的显示屏上显示的投屏内容只是图库”应用的内容中的部分画面(即镜像可以呈现出目标应用的内容的部分画面),比如显示出整个“猫”的全身或者局部。Illustratively, see FIGS. 11 and 12 . In Figure 11, the user opens a photo of "cat.jpg" through the "Gallery" application on the laptop, and uses the screen mirroring service framework or the normal application framework to transfer the content of the "Gallery" application on the laptop (ie Photo screen) is projected to the mobile phone. At this time, the screencast content displayed on the display screen of the mobile phone is the same as the content of the "Gallery" application on the laptop computer (that is, the mirror image can present the entire screen of the content of the target application). However, in Fig. 12, the user can screen only the "cat.jpg" opened by the "Gallery" application on the laptop to the mobile phone by setting the relevant screen projection options. At this time, the screencast content displayed on the display screen of the mobile phone is only a partial picture of the content of the "Gallery" application (that is, the mirror image can present a partial picture of the content of the target application), such as showing the whole body or part of the entire "cat".
综上所述,通过上述“方式1”、“方式2”和“方式3”描述,本申请实施例考虑根据目标应用的应用类型的不同确定不同的应用流转策略,从而根据不同的应用流转策略实现不同的应用内容跨设备流转,保证应用内容跨设备流转的多样性,提高应用流转的效率和使用体验。To sum up, according to the above descriptions of "Mode 1", "Mode 2", and "Mode 3", the embodiment of the present application considers determining different application circulation strategies according to different application types of target applications, so as to determine different application circulation strategies according to different application circulation strategies. Realize the flow of different application content across devices, ensure the diversity of application content flow across devices, and improve the efficiency and experience of application flow.
S530、按照应用流转策略将目标应用的内容流转至流转目标设备。S530. Circulate the content of the target application to the circulation target device according to the application circulation policy.
可以看出,本申请实施例中,流转源设备通过获取第一信息,并判断第一信息是否携带流转目标设备的标识信息;然后,在第一信息携带流转目标设备的标识信息时,获取流转源设备当前运行的目标应用的应用类型,并根据应用类型确定针对目标应用的应用流转策略;最后,按照应用流转策略将目标应用的内容流转至流转目标设备。由于本申请实施例的流转源设备上当前运行有目标应用,因此为了实现将目标应用由流转源设备流转至流转目标设备,本申请实施考虑先由流转源设备获取第一信息,并判断第一信息中是否携带流转目标设备的标识信息,从而实现由流转源设备来确定出流转目标设备。另外,为了实现将目标应用由流转源设备流转至流转目标设备,本申请实施考虑获取目标应用的应用类型,并根据目标应用的应用类型的不同确定出不同的应用流转策略,从而通过不同的应用流转策略实现不同的应用内容跨设备流转,保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。It can be seen that, in the embodiment of the present application, the transfer source device obtains the first information and determines whether the first information carries the identification information of the transfer target device; then, when the first information carries the identification information of the transfer target device, obtains the transfer The application type of the target application currently running on the source device, and the application flow strategy for the target application is determined according to the application type; finally, the content of the target application is flowed to the flow target device according to the application flow strategy. Since a target application is currently running on the circulation source device in the embodiment of the present application, in order to realize the transfer of the target application from the circulation source device to the circulation target device, the implementation of the present application considers that the circulation source device obtains the first information first, and judges the first information. Whether the information carries the identification information of the transfer target device, so that the transfer source device can determine the transfer target device. In addition, in order to realize the transfer of the target application from the transfer source device to the transfer target device, the implementation of the present application considers acquiring the application type of the target application, and determines different application transfer strategies according to the different application types of the target application. The circulation strategy realizes the circulation of different application content across devices, ensures the diversity of application content circulation across devices, and improves the efficiency and user experience of application circulation.
与上述实施例一致,请参阅图13,图13是本申请实施例提供又一种应用内容跨设备流转方法的流程示意图,应用于第一流转目标设备,该方法包括:Consistent with the above-mentioned embodiments, please refer to FIG. 13. FIG. 13 is a schematic flowchart of another method for transferring application content across devices provided by an embodiment of the present application, which is applied to the first transfer target device, and the method includes:
S1310、获取第一流转目标设备上目标应用的应用类型,目标应用由流转源设备流转至第一流转目标设备。S1310. Acquire the application type of the target application on the first transfer target device, and the target application is transferred from the transfer source device to the first transfer target device.
需要说明的是,本申请实施例的流转源设备上运行有目标应用,并由流转源设备将目标应用流转至第一流转目标设备。此时,第一流转目标设备上有该目标应用。其中,该目标应用可以为该流转源设备的应用层上运行的应用程序或媒体数据,如照片、视频、音频、游戏、图库、文档或多媒体等。另外,流转源设备可以在前端运行该目标应用,也可以在后端运行该目标应用。当流转源设备在前端运行该目标应用时,流转源设备的显示屏可以显示该目标应用的当前内容;当流转源设备在后端运行该目标应用时,流转源设备的显示屏可以不显示该目标应用的当前内容,而由后台继续执行该目标应用。同理,第一流转目标设备可以在前端运行由流转源设备流转的该目标应用,也可以在后端运行由流转源设备流转的该目标应用。It should be noted that a target application runs on the circulation source device in the embodiment of the present application, and the target application is streamed to the first circulation target device by the circulation source device. At this time, the target application exists on the first transfer target device. Wherein, the target application may be an application program or media data running on the application layer of the streaming source device, such as photos, videos, audios, games, gallery, documents or multimedia. In addition, the circulation source device can run the target application on the front end, and can also run the target application on the back end. When the streaming source device runs the target application at the front end, the display screen of the streaming source device may display the current content of the target application; when the streaming source device runs the target application at the back end, the display screen of the streaming source device may not display the target application. The current content of the target application, and the target application continues to be executed in the background. Similarly, the first circulation target device may run the target application circulated by the circulation source device at the front end, and may also run the target application circulated by the circulation source device at the back end.
在一个可能的示例中,在S1310之后,该方法还可以包括以下步骤:获取第一信息,并判断第一信息是否携带第二流转目标设备的标识信息。In a possible example, after S1310, the method may further include the following steps: acquiring the first information, and judging whether the first information carries the identification information of the second transfer target device.
具体的,第一信息可以满足以下至少一种方式:第一信息是通过传感器识别获取的、第一信息是通过语音识别获取的、第一信息是通过手势识别获取的、第一信息是通过图像识别获取、第一信息是通过人体姿态识别获取的、第一信息是通过脸部动作识别获取的、第一信息是通过人体动作识别获取的;其中,上述传感器可以包括以下至少一种:超带宽UWB传感器、近场通信NFC传感器、激光传感器、可见光传感器。Specifically, the first information may satisfy at least one of the following manners: the first information is acquired by sensor recognition, the first information is acquired by voice recognition, the first information is acquired by gesture recognition, the first information is acquired by image Recognition and acquisition, the first information is acquired through human gesture recognition, the first information is acquired through facial motion recognition, and the first information is acquired through human motion recognition; wherein, the above sensors may include at least one of the following: ultra-bandwidth UWB sensor, near field communication NFC sensor, laser sensor, visible light sensor.
需要说明的是,本申请实施例在上述描述流转源设备与流转目标设备之间的应用内容跨设备流转的基础上,需要进一步实现将目标应用通过第一流转目标设备由流转源设备流转至第二流转目标设备。另外,为了确定出流转对象(即第二流转目标设备),本申请实施例可以通过第一流转目标设备中的获取信息模块来获取第一信息,并通过该第一流转目标设备中的源和目标判定模块判断第一信息中是否携带第二流转目标设备的标识信息,从而实现由第一流转目标设备来确定出第二流转目标设备。具体示例可以参照上述实施例的描述,对此不再赘述。It should be noted that, on the basis of the above-described cross-device flow of application content between the flow source device and the flow target device, the embodiment of the present application needs to further realize the flow of the target application from the flow source device to the second flow target device through the first flow target device. Second stream target device. In addition, in order to determine the transfer object (that is, the second transfer target device), in this embodiment of the present application, the first information may be acquired through an information acquisition module in the first transfer target device, and the source and The target determination module determines whether the first information carries the identification information of the second transfer target device, so as to realize that the second transfer target device is determined by the first transfer target device. For specific examples, reference may be made to the descriptions of the foregoing embodiments, which will not be repeated here.
进一步需要说明的是,第一流转目标设备获取的第一信息中可以直接携带有第二流转目标设备的ID信息。但是,第一流转目标设备中的获取信息模块通过识别语音、图像、人体姿态、脸部动作、人体动作等以获取的第一信息中可能没有携带第二流转目标设备的标识信息。具体示例可以参照上述实施例的描述,对此不再赘述。It should be further noted that the first information acquired by the first transfer target device may directly carry the ID information of the second transfer target device. However, the first information acquired by the information acquisition module in the first transfer target device by recognizing voice, image, human posture, facial movement, human body motion, etc. may not carry the identification information of the second transfer target device. For specific examples, reference may be made to the descriptions of the foregoing embodiments, which will not be repeated here.
下面本申请实施例将对第一信息没有携带第二流转目标设备的标识信息的情况作一个示例说明。In the following embodiments of the present application, an example will be described in the case where the first information does not carry the identification information of the second transfer target device.
在一个可能的示例中,在判断第一信息是否携带第二流转目标设备的标识信息之后,该方法还可以 包括以下步骤:在第一信息没有携带第二流转目标设备的标识信息时,获取第一流转目标设备的当前用户账号下与第一流转目标设备所连接的所有设备的标识信息;或者,获取第一流转目标设备所在的网络内与第一流转目标设备所连接的所有设备的标识信息;从所有设备的标识信息中确定流转目标设备的标识信息。In a possible example, after judging whether the first information carries the identification information of the second transfer target device, the method may further include the following steps: when the first information does not carry the identification information of the second transfer target device, obtain the first information Identification information of all devices connected to the first transfer target device under the current user account of the transfer target device; or, obtain identification information of all devices connected to the first transfer target device in the network where the first transfer target device is located ; Determine the identification information of the transfer target device from the identification information of all devices.
需要说明的是,当本申请实施例考虑将目标应用的内容通过第一流转目标设备由流转源设备流转至第二流转目标设备时,如果该第一流转目标设备获取的第一信息中没有携带第二流转目标设备的ID信息。此时,结合上述图4中的应用流转框架,本申请实施例可以通过该第一流转目标设备中的连接管理模块获取该第一流转目标设备的当前用户账号下与该第一流转目标设备所连接的所有设备的ID信息;或者,通过该第一流转目标设备中的连接管理模块获取该第一流转目标设备所在的网络内与该第一流转目标设备所连接的所有设备的ID信息。It should be noted that, when the embodiment of the present application considers that the content of the target application is transferred from the transfer source device to the second transfer target device through the first transfer target device, if the first information obtained by the first transfer target device does not carry ID information of the second transfer target device. At this time, in combination with the application circulation framework in FIG. 4 , in this embodiment of the present application, the connection management module in the first circulation target device can obtain the current user account of the first circulation target device and the connection between the first circulation target device and the first circulation target device. ID information of all connected devices; or, obtain ID information of all devices connected to the first transfer target device in the network where the first transfer target device is located through a connection management module in the first transfer target device.
进一步的需要说明的是,第一流转目标设备的当前用户账号和流转源设备的当前用户账号为同一个;第一流转目标设备所在的网络可以为通过中继设备或无线通信方式组成的WLAN网络或P2P网络,并且流转源设备也位于第一流转目标设备所在的网络内。It should be further noted that the current user account of the first transfer target device and the current user account of the transfer source device are the same; the network where the first transfer target device is located may be a WLAN network formed by a relay device or a wireless communication method. or a P2P network, and the transfer source device is also located in the network where the first transfer target device is located.
另外,本申请实施例可以具体参见上述实施例中描述的不同的访问方式来获取与第一流转目标设备的同一个用户账号或同一个网络下的所有设备的ID信息以确定出第二流转目标设备,从而保证更加便捷的实现应用内容跨设备流转,提高应用流转的效率、多样性和使用体验。In addition, in this embodiment of the present application, the different access methods described in the above embodiments can be specifically referred to to obtain the ID information of the same user account as the first transfer target device or the ID information of all devices under the same network to determine the second transfer target devices, so as to ensure more convenient transfer of application content across devices, and improve the efficiency, diversity and experience of application transfer.
下面本申请实施例将对第一流转目标设备如何从所有设备的标识信息中确定第二流转目标设备的标识信息进行具体说明。The following embodiments of the present application will specifically describe how the first transfer target device determines the identification information of the second transfer target device from the identification information of all devices.
具体的,从所有设备的标识信息中确定第二流转目标设备的标识信息,可以包括以下步骤:若所有设备的标识信息中除流转源设备的标识信息和第一流转目标设备的标识信息外只存在一个设备的标识信息,则将设备的标识信息作为第二流转目标设备的标识信息;或者,若所有设备的标识信息中除流转源设备的标识信息和第一流转目标设备的标识信息外存在至少两个设备的标识信息,则获取针对至少两个设备的标识信息的选择操作指令;根据选择操作指令从至少两个设备的标识信息中确定第二流转目标设备的标识信息;或者,若所有设备的标识信息中除流转源设备的标识信息和第一流转目标设备的标识信息外存在至少两个设备的标识信息,则按照预设优先级策略将至少两个设备的标识信息中优先级最高的标识信息作为第二流转目标设备的标识信息。Specifically, determining the identification information of the second transfer target device from the identification information of all the devices may include the following steps: if the identification information of all devices except the identification information of the transfer source device and the identification information of the first transfer target device, only There is identification information of a device, then the identification information of the device is used as the identification information of the second transfer target device; or, if the identification information of all devices exists in addition to the identification information of the transfer source device and the identification information of the first transfer target device The identification information of the at least two devices, then obtain the selection operation instruction for the identification information of the at least two devices; determine the identification information of the second transfer target device from the identification information of the at least two devices according to the selection operation instruction; or, if all In the identification information of the device, in addition to the identification information of the transfer source device and the identification information of the first transfer destination device, there are identification information of at least two devices, then according to the preset priority policy, the identification information of the at least two devices has the highest priority. The identification information of the second transfer target device is used as the identification information of the second transfer target device.
需要说明的是,当同一个用户账号下与第一流转目标设备所连接的所有设备只有一个设备,或者同一个网络内与该第一流转目标设备所连接的所有设备只有一个设备时,可以将该设备作为第二流转目标设备,并获取到该设备的ID信息,从而流转源设备可以实现将当前运行的目标应用的内容流转至该设备上,并暂停第一流转目标设备运行该目标应用。另外,当同一个用户账号下与第一流转目标设备所连接的所有设备有至少两个(即多个)设备,或者同一个网络内与该第一流转目标设备所连接的所有设备有多个设备时,可以在第一流转目标设备的显示屏上通过弹窗、下拉菜单等方式显示出包含该多个设备的选项列表,再由用户从该选项列表中选择一个或多个设备作为第二流转目标设备。It should be noted that when there is only one device for all devices connected to the first transfer target device under the same user account, or when there is only one device for all devices connected to the first transfer target device in the same network, the The device acts as the second streaming target device and obtains the ID information of the device, so that the streaming source device can stream the content of the currently running target application to the device, and suspend the first streaming target device to run the target application. In addition, when there are at least two (that is, multiple) devices in all devices connected to the first transfer target device under the same user account, or there are multiple devices connected to the first transfer target device in the same network When the device is installed, a list of options including the multiple devices can be displayed on the display screen of the first transfer target device through a pop-up window, a drop-down menu, etc., and then the user can select one or more devices from the list of options as the second device. Stream the target device.
进一步需要说明的是,本申请实施例的预设优先级策略可以具体参见上述实施例中的具体描述,在此不再具体赘述。It should be further noted that, for the preset priority policy in this embodiment of the present application, reference may be made to the specific description in the foregoing embodiment, and details are not described herein again.
结合上述描述,本申请实施例的S1310可以具体包括以下步骤在第一信息携带第二流转目标设备的标识信息时,获取第一流转目标设备上目标应用的应用类型,目标应用由流转源设备流转至第一流转目标设备。With reference to the above description, S1310 in this embodiment of the present application may specifically include the following steps: when the first information carries the identification information of the second transfer target device, obtain the application type of the target application on the first transfer target device, and the target application is transferred by the transfer source device. to the first flow target device.
需要说明的是,当本申请实施例考虑将目标应用通过第一流转目标设备由流转源设备流转至第二流转目标设备时,如果第一流转目标设备获取的第一信息中携带第二流转目标设备的ID信息,结合上述图4中的应用流转框架,本申请实施例可以通过第一流转目标设备中的应用信息模块对其运行的目标应用进行识别以获取目标应用的应用信息(如应用名称、应用类型等)。另外,第一流转目标设备中的应用信息模块可以访问该第一流转目标设备的操作系统上的进程或线程等以获取目标应用的应用类型。It should be noted that when the embodiment of the present application considers that the target application is transferred from the transfer source device to the second transfer target device through the first transfer target device, if the first information obtained by the first transfer target device carries the second transfer target The ID information of the device, combined with the application flow framework in the above-mentioned FIG. 4, the embodiment of the present application can identify the target application it runs through the application information module in the first flow target device to obtain the application information of the target application (such as the application name). , application type, etc.). In addition, the application information module in the first transfer target device may access a process or thread on the operating system of the first transfer target device to obtain the application type of the target application.
具体的,目标应用的应用类型可以包括以下至少一种:投屏式应用、分布式应用、接力式应用、普通式应用;其中,投屏式应用用于指示目标应用继续运行在流转源设备上,并由流转源设备暂停目标应用的内容在第一流转目标设备上显示,而将目标应用的内容投射到第二流转目标设备的显示屏或显示介质上进行显示;分布式应用用于指示将目标应用的前端和目标应用的后端在不同设备上实现分离运行操作;接力式应用用于指示通过流转源设备上的文件服务将目标应用在不同设备上实现存储、恢复或者共享操作;普通式应用用于指示通过投屏技术将目标应用在不同设备上实现显示操作。Specifically, the application type of the target application may include at least one of the following: a screen-casting application, a distributed application, a relay application, and a common application; wherein the screen-casting application is used to instruct the target application to continue to run on the transfer source device , and the streaming source device suspends the content of the target application to display on the first streaming target device, and projects the content of the target application to the display screen or display medium of the second streaming target device for display; the distributed application is used to instruct the The front-end of the target application and the back-end of the target application are operated separately on different devices; the relay application is used to instruct the target application to be stored, restored or shared on different devices through the file service on the streaming source device; common The application is used to instruct the target application to realize the display operation on different devices through the screen casting technology.
S1320、根据应用类型确定针对目标应用的应用流转策略。S1320. Determine an application flow strategy for the target application according to the application type.
需要说明的是,当本申请实施例考虑将目标应用通过第一流转目标设备由流转源设备流转至第二流 转目标设备时,如果该第一流转目标设备已获知第二流转目标设备的ID信息,结合上述图4中的应用流转框架,本申请实施例可以通过该第一流转目标设备中的流转策略模块访问应用信息模块以获知目标应用的应用类型,从而根据目标应用的应用类型确定其对应的应用流转策略。It should be noted that, when the embodiment of the present application considers that the target application is transferred from the transfer source device to the second transfer target device through the first transfer target device, if the first transfer target device has already obtained the ID information of the second transfer target device. , in conjunction with the application flow framework in the above-mentioned FIG. 4, the embodiment of the present application can access the application information module through the flow strategy module in the first flow target device to learn the application type of the target application, so as to determine its corresponding application type according to the application type of the target application. application flow strategy.
下面本申请实施例通过目标应用的应用类型的不同确定不同的应用流转策略的几种实施方式进行具体说明。The following embodiments of the present application specifically describe several implementation manners in which different application flow strategies are determined by different application types of target applications.
方式1:Way 1:
在一个可能的示例中,若应用类型包括投屏式应用,则根据应用类型确定针对目标应用的应用流转策略,可以包括以下步骤:根据投屏式应用确定应用流转策略;其中,应用流转策略用于执行以下步骤:通过投屏服务框架暂停目标应用在第一流转目标设备上运行,并将目标应用的内容投射到第二流转目标设备的显示屏或显示介质上进行显示。In a possible example, if the application type includes a screen-casting application, determining the application circulation strategy for the target application according to the application type may include the following steps: determining the application circulation strategy according to the screen-casting application; wherein, the application circulation strategy uses and performing the following steps: suspending the target application from running on the first streaming target device through the screen projection service framework, and projecting the content of the target application to the display screen or display medium of the second streaming target device for display.
需要说明的是,当目标应用为投屏式应用时,应用流转策略可以是:第一流转目标设备先向流转源设备反馈信息以保存;流转源设备再通过投屏服务框架暂停将目标应用的内容投射到第一流转目标设备的显示屏进行显示,而将所述目标应用的内容投射到第二流转目标设备的显示屏或显示介质上进行显示。下面以手机、智能手表和笔记本电脑这三个电子设备为例进行示例说明。It should be noted that when the target application is a screen-casting application, the application transfer strategy may be: the first transfer target device feeds back information to the transfer source device to save it; the transfer source device then suspends the transfer of the target application through the screen-casting service framework. The content is projected to the display screen of the first flow target device for display, and the content of the target application is projected to the display screen or display medium of the second flow target device for display. The following three electronic devices, a mobile phone, a smart watch and a laptop, are used as examples for illustration.
示例性的,请参阅图14。智能手表的显示屏上正在显示由手机通过投屏服务框架投射的投屏式应用Z。当智能手表通过NFC触碰笔记本电脑时,手机通过投屏服务框架暂停将应用Z的内容投射到智能手表的显示屏上,而将应用Z的内容投射到笔记本电脑的显示屏上显示。For example, see Figure 14. The screen of the smart watch is showing the screen-casting application Z projected by the mobile phone through the screen-casting service framework. When the smartwatch touches the laptop through NFC, the mobile phone suspends projecting the content of Application Z to the display of the smartwatch through the screen casting service framework, and projects the content of Application Z to the display of the laptop for display.
方式2:Way 2:
在一个可能的示例中,若应用类型包括分布式应用,则根据应用类型确定针对目标应用的应用流转策略,可以包括以下步骤:根据分布式应用确定应用流转策略;其中,应用流转策略用于执行以下步骤:暂停目标应用的前端在第一流转目标设备上运行,并由第二流转目标设备访问流转源设备上运行的目标应用的后端以开始运行目标应用的前端。In a possible example, if the application type includes a distributed application, determining an application flow strategy for the target application according to the application type may include the following steps: determining the application flow strategy according to the distributed application; wherein the application flow strategy is used to execute The following steps: suspend the front end of the target application from running on the first streaming target device, and access the back end of the target application running on the streaming source device by the second streaming target device to start running the front end of the target application.
需要说明的是,当目标应用为分布式应用时,应用流转策略可以是:第一流转目标设备先向流转源设备上的目标应用的后端反馈信息以保存;流转源设备上继续运行目标应用的后端,再将目标应用的前端流转至第二流转目标设备上,并停止第一流转目标设备运行目标应用的前端;第二流转目标设备访问流转源设备上运行的目标应用的后端以开始运行该目标应用的前端。It should be noted that, when the target application is a distributed application, the application transfer strategy may be: the first transfer target device first feeds back information to the backend of the target application on the transfer source device to save it; the target application continues to run on the transfer source device the back end of the target application, and then transfer the front end of the target application to the second transfer target device, and stop the first transfer target device from running the front end of the target application; the second transfer target device accesses the back end of the target application running on the transfer source device to Start running the front end of the target application.
方式3:Way 3:
在一个可能的示例中,若应用类型包括接力式应用,则根据应用类型确定针对目标应用的应用流转策略,可以包括以下步骤:根据接力式应用确定应用流转策略;其中,应用流转策略用于执行以下步骤:暂停目标应用在第一流转目标设备上运行,并由第二流转目标设备访问流转源设备的文件服务以开始运行目标应用。In a possible example, if the application type includes a relay application, determining an application flow strategy for the target application according to the application type may include the following steps: determining an application flow strategy according to the relay application; wherein the application flow strategy is used to execute The following steps: suspend the target application from running on the first streaming target device, and access the file service of the streaming source device by the second streaming target device to start running the target application.
需要说明的是,当目标应用为接力式应用时,应用流转策略可以是:第一流转目标设备先向流转源设备上的文件服务反馈信息以保存;流转源设备上的文件服务再将目标应用的内容流转至第二流转目标设备;第二流转目标设备访问流转源设备上的文件服务以开始运行该目标应用的内容。其中,文件服务可以提供一个http访问地址,并以数据流的方式提供给外部应用或第三方合作应用。It should be noted that, when the target application is a relay application, the application transfer strategy may be: the first transfer target device first feeds back information to the file service on the transfer source device to save it; the file service on the transfer source device then transfers the target application. The content of the stream is transferred to the second transfer target device; the second transfer target device accesses the file service on the transfer source device to start running the content of the target application. Among them, the file service can provide an http access address, and provide it to an external application or a third-party cooperative application in the form of a data stream.
方式4:Way 4:
在一个可能的示例中,若应用类型包括普通式应用,则根据应用类型确定针对目标应用的应用流转策略,可以包括以下步骤:根据普通式应用确定应用流转策略;其中,应用流转策略用于执行以下步骤:若第二流转目标设备上有应用兼容目标应用以及支持同步目标应用的内容,则暂停目标应用在第一流转目标设备上运行,并将目标应用的内容投射到第二流转目标设备的显示屏或显示介质上进行显示;或者,若第二流转目标设备上没有应用兼容目标应用或者不支持同步目标应用的内容,则继续目标应用在第一流转目标设备上运行,并将目标应用的内容投射到第二流转目标设备的显示屏或显示介质上进行显示。In a possible example, if the application type includes a common application, determining an application flow strategy for the target application according to the application type may include the following steps: determining an application flow strategy according to the common application; wherein the application flow strategy is used to execute The following steps: if the second streaming target device has an application compatible with the target application and supports the content of the synchronization target application, suspend the running of the target application on the first streaming target device, and project the content of the target application to the second streaming target device. Display on the display screen or display medium; or, if the second streaming target device does not have an application compatible with the target application or does not support synchronizing the content of the target application, continue the target application to run on the first streaming target device, and transfer the target application's content. The content is projected on the display screen or display medium of the second streaming target device for display.
需要说明的是,当目标应用为普通式应用时,应用流转策略可以是:第一流转目标设备先向流转源设备反馈信息以保存;流转源设备再通过投屏服务框架将目标应用的内容投射到第二流转目标设备的显示屏或显示介质上进行显示,并判断第二流转目标设备上是否有应用兼容目标应用的运行和支持同步目标应用的内容;如果有应用兼容和支持同步,则流转源设备可以暂停运行目标应用;如果没有应用兼容或支持同步,则流转源设备可以继续运行目标应用。It should be noted that when the target application is a common application, the application transfer strategy may be: the first transfer target device first feeds back information to the transfer source device for saving; the transfer source device then projects the content of the target application through the screen projection service framework Display it on the display screen or display medium of the second streaming target device, and determine whether there is an application compatible with the running of the target application and the content of the target application that supports synchronization on the second streaming target device; if there is an application that is compatible and supports synchronization, the streaming The source device can suspend running the target application; if no application is compatible or supports synchronization, the streaming source device can continue running the target application.
综上所述,通过上述“方式1”、“方式2”、“方式3”和“方式4”描述,本申请实施例考虑根据目标应用的应用类型的不同确定不同的应用流转策略,从而根据不同的应用流转策略实现不同的应用内容跨设备流转,保证应用内容跨设备流转的多样性,提高应用流转和效率和使用体验。To sum up, according to the above descriptions of "Mode 1", "Mode 2", "Mode 3" and "Mode 4", the embodiment of the present application considers determining different application circulation strategies according to different application types of target applications, so as to Different application flow strategies realize the cross-device flow of different application contents, ensure the diversity of cross-device flow of application content, and improve application flow and efficiency and user experience.
S1330、按照应用流转策略将目标应用的内容流转至第二流转目标设备。S1330 , according to the application transfer policy, transfer the content of the target application to the second transfer target device.
需要说明的是,由于各个实施例的描述都各有侧重,因此图13所述的具体实施例中没有详述的部分,可以参见图5中的具体实施例的相关描述,在此不再赘述。It should be noted that since the description of each embodiment has its own emphasis, for the part that is not described in detail in the specific embodiment shown in FIG. 13 , you can refer to the relevant description of the specific embodiment in FIG. 5 , which will not be repeated here. .
可以看出,本申请实施例中,第一流转目标设备通过获取第一信息,并判断第一信息是否携带第二流转目标设备的标识信息;然后,在第一信息携带第二流转目标设备的标识信息时,获取第一流转源设备当前运行的目标应用的应用类型,并根据应用类型确定针对目标应用的应用流转策略;最后,按照应用流转策略将目标应用的内容流转至第二流转目标设备。由于本申请实施例的流转源设备上当前运行有目标应用,并且目标应用由流转源设备流转至第一流转目标设备,因此为了实现将目标应用通过第一流转目标设备由流转源设备流转至第二流转目标设备,本申请实施考虑先由第一流转目标设备获取第一信息,并判断第一信息中是否携带第二流转目标设备的标识信息,从而实现由第一流转目标设备来确定出第二流转目标设备。另外,为了实现将目标应用通过第一流转目标设备由流转源设备流转至第二流转目标设备,本申请实施考虑获取目标应用的应用类型,并根据目标应用的应用类型的不同确定出不同的应用流转策略,从而通过不同的应用流转策略实现不同的应用内容跨设备流转,保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。It can be seen that in the embodiment of the present application, the first transfer target device obtains the first information and determines whether the first information carries the identification information of the second transfer target device; then, the first information carries the identification information of the second transfer target device. When identifying the information, the application type of the target application currently running on the first circulation source device is obtained, and the application circulation strategy for the target application is determined according to the application type; finally, the content of the target application is streamed to the second circulation target device according to the application circulation strategy. . Since a target application is currently running on the circulation source device in the embodiment of the present application, and the target application is streamed from the circulation source device to the first circulation target device, in order to realize the flow of the target application from the circulation source device to the first circulation target device through the first circulation target device Second transfer target device, the implementation of this application considers that the first transfer target device first obtains the first information, and determines whether the first information carries the identification information of the second transfer target device, so that the first transfer target device can determine the first transfer target device. Second stream target device. In addition, in order to realize the transfer of the target application from the transfer source device to the second transfer target device through the first transfer target device, the present application considers acquiring the application type of the target application, and determines different applications according to the different application types of the target application. Circulation strategy, so as to realize the cross-device circulation of different application contents through different application circulation strategies, ensure the diversity of application content circulation across devices, and improve the efficiency and use experience of application circulation.
上述主要从方法侧执行过程的角度对本申请实施例的方案进行了介绍。可以理解的是,电子设备为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所提供的实施例描述的各示例的单元及算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。本领域技术人员可以对每个特定的应用使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。The foregoing mainly introduces the solutions of the embodiments of the present application from the perspective of the method-side execution process. It can be understood that, in order to realize the above-mentioned functions, the electronic device includes corresponding hardware structures and/or software modules for executing each function. Those skilled in the art should easily realize that the present application can be implemented in hardware or in the form of a combination of hardware and computer software, in combination with the units and algorithm steps of each example described in the embodiments provided herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.
本申请实施例可以根据上述方法示例对电子设备进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理单元中。其中,该处理单元可以是处理器或控制器,例如CPU、通用处理器、DSP、ASIC、FPGA、晶体管逻辑器件、硬件部件或者其任意组合。也可以是实现计算功能的组合,例如包含一个或多个微处理器组合、DSP和微处理器的组合,从而该处理单元可以实现或执行结合上述描述的各种示例性的逻辑方框、模块和电路。另外,该处理单元可以用于执行如上述方法实施例中由电子设备执行的任一步骤,且在执行诸如发送等数据传输时,可选择的调用通信单元来完成相应操作,而该通信单元可以是通信接口、收发器和收发电路等。In this embodiment of the present application, the electronic device may be divided into functional modules according to the foregoing method examples. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The processing unit may be a processor or a controller, such as a CPU, a general-purpose processor, a DSP, an ASIC, an FPGA, a transistor logic device, a hardware component, or any combination thereof. It can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a DSP and a microprocessor, so that the processing unit can implement or execute various exemplary logic blocks, modules described in conjunction with the above. and circuit. In addition, the processing unit may be used to perform any step performed by the electronic device in the above method embodiments, and when performing data transmission such as sending, the communication unit may be selectively invoked to complete the corresponding operation, and the communication unit may It is a communication interface, a transceiver and a transceiver circuit.
进一步的,上述集成的模块既可以采用硬件的形式实现,也可以采用软件的形式实现。需要说明的是,本申请实施例中对单元的划分是示意性的,只是一种逻辑功能划分,而实际实现时可以有另外的划分方式。Further, the above-mentioned integrated modules can be implemented in either the form of hardware or the form of software. It should be noted that, the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division manners in actual implementation.
在采用集成的功能模块的情况下,图15示出了一种应用内容跨设备流转装置的功能模块组成框图。应用内容跨设备流转装置1500应用于流转源设备,具体包括:应用信息模块1510、流转策略模块1520和应用流转模块1530。其中,应用信息模块1510用于获取流转源设备当前运行的目标应用的应用类型;流转策略模块1520用于根据应用类型确定针对目标应用的应用流转策略;应用流转模块1530用于按照应用流转策略将目标应用的内容流转至流转目标设备。In the case of using integrated functional modules, FIG. 15 shows a block diagram of the functional modules of an apparatus for transferring application content across devices. The apparatus 1500 for transferring application content across devices is applied to a transferring source device, and specifically includes: an application information module 1510 , a transferring policy module 1520 and an application transferring module 1530 . Among them, the application information module 1510 is used to obtain the application type of the target application currently running on the circulation source device; the circulation strategy module 1520 is used to determine the application circulation strategy for the target application according to the application type; the application circulation module 1530 is used to The content of the target application is streamed to the stream target device.
需要说明的是,应用内容跨设备流转装置1500执行的各个操作的具体实现可以参见上述图5所示的方法实施例的相应描述,在此不再赘述。It should be noted that, for the specific implementation of each operation performed by the apparatus 1500 for transferring application content across devices, reference may be made to the corresponding description of the method embodiment shown in FIG. 5 , which will not be repeated here.
可以看出,本申请实施例中,应用内容跨设备流转装置根据目标应用的应用类型的不同确定不同的应用流转策略以实现不同的应用内容跨设备流转,从而保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。It can be seen that, in the embodiment of the present application, the device for cross-device flow of application content determines different application flow strategies according to different application types of the target application to realize cross-device flow of different application content, thereby ensuring the diversity of cross-device flow of application content. , and improve the efficiency and user experience of application circulation.
在一个可能的示例中,所述应用类型包括以下至少一种:分布式应用、接力式应用、普通式应用;其中,所述分布式应用用于指示将所述目标应用的前端和所述目标应用的后端在不同设备上实现分离运行操作;所述接力式应用用于指示通过所述流转源设备上的文件服务将所述目标应用在不同设备上实现存储、恢复或者共享操作;所述普通式应用用于指示通过投屏技术将所述目标应用在不同设备上实现显示操作。In a possible example, the application type includes at least one of the following: a distributed application, a relay application, and a common application; wherein the distributed application is used to indicate the front end of the target application and the target The back-end of the application implements separate running operations on different devices; the relay application is used to instruct the target application to implement storage, recovery or sharing operations on different devices through the file service on the streaming source device; the The common application is used to instruct the target application to implement display operations on different devices through the screen projection technology.
在一个可能的示例中,若所述应用类型包括所述分布式应用,在根据所述应用类型确定针对所述目标应用的应用流转策略方面,流转策略模块1620具体用于:根据所述分布式应用确定所述应用流转策略;其中,所述应用流转策略用于执行以下步骤:暂停所述目标应用的前端在所述流转源设备上运行,并由所述流转目标设备访问所述流转源设备上运行的所述目标应用的后端以开始运行所述目标应用的前端。In a possible example, if the application type includes the distributed application, in terms of determining the application flow strategy for the target application according to the application type, the flow strategy module 1620 is specifically configured to: according to the distributed application The application determines the application flow strategy; wherein the application flow strategy is used to perform the following steps: suspend the front end of the target application from running on the flow source device, and the flow target device accesses the flow source device Running on the backend of the target application to start running the frontend of the target application.
在一个可能的示例中,若所述应用类型包括所述接力式应用,在根据所述应用类型确定针对所述目标应用的应用流转策略方面,流转策略模块1620具体用于:根据所述接力式应用确定所述应用流转策略;其中,所述应用流转策略用于执行以下步骤:暂停所述目标应用在所述流转源设备上运行,并由所述流 转目标设备访问所述流转源设备的文件服务以开始运行所述目标应用。In a possible example, if the application type includes the relay application, in terms of determining the application flow strategy for the target application according to the application type, the flow strategy module 1620 is specifically configured to: according to the relay type The application determines the application circulation strategy; wherein the application circulation strategy is used to perform the following steps: suspend the target application from running on the circulation source device, and the circulation target device accesses the file of the circulation source device service to start running the target application.
在一个可能的示例中,若所述应用类型包括所述普通式应用,在根据所述应用类型确定针对所述目标应用的应用流转策略方面,流转策略模块1620具体用于:根据所述普通式应用确定所述应用流转策略;其中,所述应用流转策略用于执行以下步骤:若所述流转目标设备上有应用兼容所述目标应用以及支持同步所述目标应用的内容,则暂停所述目标应用在所述流转源设备上运行,并将所述目标应用的内容投射到所述流转目标设备的显示屏或显示介质上进行显示;或者,若所述流转目标设备上没有应用兼容所述目标应用或者不支持同步所述目标应用的内容,则继续所述目标应用在所述流转源设备上运行,并将所述目标应用的内容投射到所述流转目标设备的显示屏或显示介质上进行显示。In a possible example, if the application type includes the common application, in terms of determining the application flow policy for the target application according to the application type, the flow policy module 1620 is specifically configured to: according to the common application The application determines the application flow strategy; wherein, the application flow strategy is used to perform the following steps: if there is an application on the flow target device that is compatible with the target application and supports synchronizing the content of the target application, suspend the target application The application runs on the streaming source device, and projects the content of the target application to the display screen or display medium of the streaming target device for display; or, if no application on the streaming target device is compatible with the target application or does not support synchronizing the content of the target application, then continue to run the target application on the streaming source device, and project the content of the target application to the display screen or display medium of the streaming target device. show.
在一个可能的示例中,应用跨设备流转装置1500还包括获取信息模块和判定信息模块;其中,获取信息模块:用于获取第一信息;判定信息模块,用于判断所述第一信息是否携带流转目标设备的标识信息。In a possible example, the apparatus 1500 for transferring applications across devices further includes an information acquisition module and a determination information module; wherein, the information acquisition module is used to acquire first information; the determination information module is used to determine whether the first information is carried The identification information of the transfer target device.
在一个可能的示例中,应用跨设备流转装置1500还包括连接管理模块;其中,连接管理模块,用于在所述第一信息没有携带所述流转目标设备的标识信息时,获取所述流转源设备的当前用户账号下与所述流转源设备所连接的所有设备的标识信息;或者,获取所述流转源设备所在的网络内与所述流转源设备所连接的所有设备的标识信息;判定信息模块,还用于从所述所有设备的标识信息中确定所述流转目标设备的标识信息。In a possible example, the apparatus 1500 for transferring applications across devices further includes a connection management module; wherein the connection management module is configured to acquire the transfer source when the first information does not carry the identification information of the transfer target device Identification information of all devices connected to the circulation source device under the current user account of the device; or, obtain identification information of all devices connected to the circulation source device in the network where the circulation source device is located; determination information The module is further configured to determine the identification information of the transfer target device from the identification information of all the devices.
在一个可能的示例中,在从所述所有设备的标识信息中确定所述流转目标设备的标识信息方面,判定信息模块具体用于:若所述所有设备的标识信息中除所述流转源设备的标识信息外只存在一个设备的标识信息,则将所述设备的标识信息作为所述流转目标设备的标识信息;或者,若所述所有设备的标识信息中除所述流转源设备的标识信息外存在至少两个设备的标识信息,则获取针对所述至少两个设备的标识信息的选择操作指令;根据所述选择操作指令从所述至少两个设备的标识信息中确定所述流转目标设备的标识信息;或者,若所述所有设备的标识信息中除所述流转源设备的标识信息外存在至少两个设备的标识信息,则按照预设优先级策略将所述至少两个设备的标识信息中优先级最高的标识信息作为所述流转目标设备的标识信息。In a possible example, in determining the identification information of the transfer destination device from the identification information of all the devices, the determining information module is specifically configured to: if the identification information of all the devices excludes the transfer source device In addition to the identification information of the device, there is only the identification information of one device, then the identification information of the device is used as the identification information of the transfer target device; or, if the identification information of all the devices is excluding the identification information of the transfer source device If the identification information of at least two devices exists outside, a selection operation instruction for the identification information of the at least two devices is obtained; the transfer target device is determined from the identification information of the at least two devices according to the selection operation instruction. or, if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the transfer source device, the identification information of the at least two devices is assigned according to the preset priority policy. The identification information with the highest priority in the information is used as the identification information of the transfer target device.
在一个可能的示例中,获取信息模块可以包括以下至少一种:传感器识别模块、语音识别模块、手势识别模块、图像识别模块、人体姿态识别模块、脸部动作识别模块、人体动作识别模块;其中,所述传感器包括以下至少一种:超带宽UWB传感器、近场通信NFC传感器、激光传感器、可见光传感器。In a possible example, the information acquisition module may include at least one of the following: a sensor recognition module, a voice recognition module, a gesture recognition module, an image recognition module, a human gesture recognition module, a facial motion recognition module, and a human motion recognition module; wherein , the sensor includes at least one of the following: an ultra-wideband UWB sensor, a near field communication NFC sensor, a laser sensor, and a visible light sensor.
在采用集成的功能模块的情况下,图16示出了一种应用内容跨设备流转装置的功能模块组成框图。应用内容跨设备流转装置1600应用于第一流转目标设备,具体包括:应用信息模块1610、流转策略模块1620和应用流转模块1630。其中,应用信息模块1610用于在第一信息携带第二流转目标设备的标识信息时,获取第一流转目标设备上目标应用的应用类型,目标应用由流转源设备流转至第一流转目标设备;流转策略模块1620用于根据应用类型确定针对目标应用的应用流转策略;应用流转模块1630用于按照应用流转策略将目标应用的内容流转至第二流转目标设备。In the case of using integrated functional modules, FIG. 16 shows a block diagram of the functional modules of an apparatus for transferring application content across devices. The apparatus 1600 for transferring application content across devices is applied to the first transferring target device, and specifically includes: an application information module 1610 , a transferring strategy module 1620 and an application transferring module 1630 . The application information module 1610 is configured to obtain the application type of the target application on the first transfer target device when the first information carries the identification information of the second transfer target device, and the target application is transferred from the transfer source device to the first transfer target device; The flow strategy module 1620 is used to determine an application flow strategy for the target application according to the application type; the application flow module 1630 is used to flow the content of the target application to the second flow target device according to the application flow strategy.
需要说明的是,应用内容跨设备流转装置1600执行的各个操作的具体实现可以参见上述图13和图15所示的方法实施例的相应描述,在此不再赘述。It should be noted that, for the specific implementation of each operation performed by the apparatus 1600 for transferring application content across devices, reference may be made to the corresponding descriptions of the method embodiments shown in FIG. 13 and FIG. 15 , which will not be repeated here.
可以看出,本申请实施例中,应用内容跨设备流转装置根据目标应用的应用类型的不同确定不同的应用流转策略以实现不同的应用内容跨设备流转,从而保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。It can be seen that, in the embodiment of the present application, the device for cross-device flow of application content determines different application flow strategies according to different application types of the target application to realize cross-device flow of different application content, thereby ensuring the diversity of cross-device flow of application content. , and improve the efficiency and user experience of application circulation.
下面介绍本申请实施例提供的又一种电子设备1700的结构示意图,如图17所示。其中,电子设备1700为流转源设备,并且电子设备1700包括处理器1710、存储器1720、通信接口1730和至少一个用于连接处理器1710、存储器1720、通信接口1730的通信总线。The following introduces a schematic structural diagram of another electronic device 1700 provided by an embodiment of the present application, as shown in FIG. 17 . The electronic device 1700 is a streaming source device, and the electronic device 1700 includes a processor 1710 , a memory 1720 , a communication interface 1730 and at least one communication bus for connecting the processor 1710 , the memory 1720 , and the communication interface 1730 .
处理器1710可以是一个或多个中央处理器CPU。在处理器1710是一个CPU的情况下,该CPU可以是单核CPU,也可以是多核CPU。存储器1720包括但不限于是随机存储记忆体(Random Access Memory,RAM)、只读存储器(Read-Only Memory,ROM)、可擦除可编程只读存储器(Erasable Programmable Read Only Memory,EPROM)或便携式只读存储器(Compact Disc Read-Only Memory,CD-ROM),并且存储器1720用于相关指令及数据。通信接口1730用于接收和发送数据。 Processor 1710 may be one or more central processing units (CPUs). In the case where the processor 1710 is a CPU, the CPU may be a single-core CPU or a multi-core CPU. The memory 1720 includes, but is not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM) or portable Read-only memory (Compact Disc Read-Only Memory, CD-ROM), and the memory 1720 is used for related instructions and data. Communication interface 1730 is used to receive and transmit data.
电子设备1700中的处理器1710用于读取存储器1720中存储的一个或多个程序1721用于执行以下步骤:获取流转源设备当前运行的目标应用的应用类型;根据应用类型确定针对目标应用的应用流转策略;按照应用流转策略将目标应用的内容流转至流转目标设备。The processor 1710 in the electronic device 1700 is configured to read one or more programs 1721 stored in the memory 1720 to perform the following steps: obtain the application type of the target application currently running on the streaming source device; determine the application type for the target application according to the application type. Apply the circulation strategy; according to the application circulation strategy, the content of the target application is circulated to the circulation target device.
需要说明的是,电子设备1700执行的各个操作的具体实现可以参见上述图5所示的方法实施例的相应描述,在此不再赘述。It should be noted that, for the specific implementation of each operation performed by the electronic device 1700, reference may be made to the corresponding description of the method embodiment shown in FIG. 5, which is not repeated here.
可以看出,本申请实施例中,电子设备根据目标应用的应用类型的不同确定不同的应用流转策略以实现不同的应用内容跨设备流转,从而保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。It can be seen that, in the embodiment of the present application, the electronic device determines different application flow strategies according to different application types of the target application to realize the cross-device flow of different application contents, thereby ensuring the diversity of the cross-device flow of application content, and improving the application content. Circulation efficiency and user experience.
下面介绍本申请实施例提供的又一种电子设备1800的结构示意图,如图18所示。其中,电子设备1800为第一流转目标设备,并且电子设备1800包括处理器1810、存储器1820、通信接口1830和至少一个用于连接处理器1810、存储器1820、通信接口1830的通信总线。The following introduces a schematic structural diagram of another electronic device 1800 provided by an embodiment of the present application, as shown in FIG. 18 . The electronic device 1800 is the first transfer target device, and the electronic device 1800 includes a processor 1810 , a memory 1820 , a communication interface 1830 and at least one communication bus for connecting the processor 1810 , the memory 1820 , and the communication interface 1830 .
处理器1810可以是一个或多个中央处理器CPU。在处理器1810是一个CPU的情况下,该CPU可以是单核CPU,也可以是多核CPU。存储器1820包括但不限于是RAM、ROM、EPROM或CD-ROM,并且存储器1820用于相关指令及数据。通信接口1830用于接收和发送数据。 Processor 1810 may be one or more central processing units (CPUs). In the case where the processor 1810 is a CPU, the CPU may be a single-core CPU or a multi-core CPU. Memory 1820 includes, but is not limited to, RAM, ROM, EPROM, or CD-ROM, and is used for related instructions and data. Communication interface 1830 is used to receive and transmit data.
电子设备1800中的处理器1810用于读取存储器1820中存储的一个或多个程序1821用于执行以下步骤:获取第一流转目标设备上目标应用的应用类型,目标应用由流转源设备流转至第一流转目标设备;根据应用类型确定针对目标应用的应用流转策略;按照应用流转策略将目标应用的内容流转至第二流转目标设备。The processor 1810 in the electronic device 1800 is configured to read one or more programs 1821 stored in the memory 1820 to perform the following steps: obtain the application type of the target application on the first streaming target device, and the target application is streamed from the streaming source device to The first circulation target device; the application circulation strategy for the target application is determined according to the application type; the content of the target application is circulated to the second circulation target device according to the application circulation strategy.
需要说明的是,电子设备1800执行的各个操作的具体实现可以参见上述图13所示的方法实施例的相应描述,在此不再赘述。It should be noted that, for the specific implementation of each operation performed by the electronic device 1800, reference may be made to the corresponding description of the method embodiment shown in FIG. 13, and details are not repeated here.
可以看出,本申请实施例中,电子设备根据目标应用的应用类型的不同确定不同的应用流转策略以实现不同的应用内容跨设备流转,从而保证应用内容跨设备流转的多样性,以及提高应用流转的效率和使用体验。It can be seen that, in the embodiment of the present application, the electronic device determines different application flow strategies according to different application types of the target application to realize the cross-device flow of different application contents, thereby ensuring the diversity of the cross-device flow of application content, and improving the application content. Circulation efficiency and user experience.
本申请实施例还提供一种计算机可读存储介质,其中,该计算机可读存储介质存储用于电子数据交换的计算机程序,该计算机程序可操作来使得计算机执行如上述方法实施例中记载的任一方法的部分或全部步骤。Embodiments of the present application further provide a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, and the computer program is operable to cause a computer to execute any of the methods described in the foregoing method embodiments. some or all of the steps of a method.
本申请实施例还提供一种计算机程序产品,其中,该计算机程序产品包括计算机程序,该计算机程序可操作来使计算机执行如上述方法实施例中记载的任一方法的部分或全部步骤。该计算机程序产品可以为一个软件安装包。Embodiments of the present application further provide a computer program product, wherein the computer program product includes a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any method described in the above method embodiments. The computer program product may be a software installation package.
需要说明的是,对于上述的各方法实施例,为了简单描述,将其都表述为一系列的动作组合。本领域技术人员应该知悉,本申请不受所描述的动作顺序的限制,因为本申请实施例中的某些步骤可以采用其他顺序或者同时进行。此外,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本申请实施例所必须的。It should be noted that, for the above-mentioned method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. Those skilled in the art should know that the present application is not limited by the described sequence of actions, because some steps in the embodiments of the present application may be performed in other sequences or simultaneously. In addition, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the embodiments of the present application.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.
在本申请所提供的几个实施例中,本领域技术人员应该知悉,所描述的装置可以通过其它的方式实现。可以理解的是,上述描述的装置实施例仅仅是示意性的。例如,上述模块的划分只是一种逻辑功能划分,实际中可以有另外的划分方式。也就是说,多个模块或组件可以结合或集成到另一个软件,以及一些特征可以忽略或不执行。此外,所显示或讨论的相互之间的耦合、直接耦合或通信连接等方式可以是通过一些接口、装置、模块或单元的间接耦合或通信连接,也可以是电性或其它的形式。In the several embodiments provided in this application, those skilled in the art should know that the described apparatus may be implemented in other manners. It should be understood that the device embodiments described above are merely illustrative. For example, the division of the above modules is only a logical function division, and there may be other division methods in practice. That is, multiple modules or components may be combined or integrated into another software, and some features may be omitted or not implemented. In addition, the mutual coupling, direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, modules or units, or may be electrical or other forms.
上述模块或单元如果以软件功能的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。可以理解的是,本申请的技术方案(该技术方案对现有技术做出贡献的部分或者该技术方案的全部或部分)可以通过计算机软件产品的形式体现。该计算机软件产品存储在一个存储器中,包括若干指令用以使得计算机设备(个人计算机、服务器或者网络设备等)执行本申请实施例的全部或部分步骤。另外,上述计算机可读取存储介质可以存储在U盘、ROM、RAM、移动硬盘、磁碟或者光盘等各种存储器中。If the above modules or units are implemented in the form of software functions and sold or used as independent products, they may be stored in a computer-readable storage medium. It can be understood that the technical solution of the present application (the part of the technical solution that contributes to the prior art or the whole or part of the technical solution) can be embodied in the form of a computer software product. The computer software product is stored in a memory, and includes several instructions for causing a computer device (personal computer, server, or network device, etc.) to execute all or part of the steps of the embodiments of the present application. In addition, the above-mentioned computer-readable storage medium may be stored in various memories such as U disk, ROM, RAM, removable hard disk, magnetic disk, or optical disk.
以上对本申请实施例进行了具体介绍,本领域技术人员应该知悉,本申请实施例只是用于帮助理解本申请的技术方案的核心思想,因此本申请实施例在具体实施方式和应用范围上均会有改变之处。至此,本说明书中记载的内容不应理解为对本申请的保护范围的限制。另外,在本申请实施例的技术方案的基础之上,任意所做的任何修改、等同替换、改进等,均应包括在本申请实施例的保护范围之内。The embodiments of the present application have been specifically introduced above. Those skilled in the art should know that the embodiments of the present application are only used to help understand the core idea of the technical solutions of the present application. Something has changed. So far, the contents described in this specification should not be construed as limiting the protection scope of the present application. In addition, on the basis of the technical solutions of the embodiments of the present application, any modifications, equivalent replacements, improvements, etc. that are arbitrarily made shall be included within the protection scope of the embodiments of the present application.

Claims (41)

  1. 一种应用内容跨设备流转方法,其中,应用于流转源设备;所述方法包括:A method for cross-device flow of application content, wherein the method is applied to a flow source device; the method includes:
    获取所述流转源设备当前运行的目标应用的应用类型;Obtain the application type of the target application currently running on the circulation source device;
    根据所述应用类型确定针对所述目标应用的应用流转策略;Determine an application flow strategy for the target application according to the application type;
    按照所述应用流转策略将所述目标应用的内容流转至流转目标设备。The content of the target application is transferred to the transfer target device according to the application transfer policy.
  2. 根据权利要求1所述的方法,其中,所述应用类型包括以下至少一种:分布式应用、接力式应用、普通式应用;The method according to claim 1, wherein the application type includes at least one of the following: distributed application, relay application, and common application;
    其中,所述分布式应用用于指示将所述目标应用的前端和所述目标应用的后端在不同设备上实现分离运行操作;所述接力式应用用于指示通过所述流转源设备上的文件服务将所述目标应用在不同设备上实现存储、恢复或者共享操作;所述普通式应用用于指示通过投屏技术将所述目标应用在不同设备上实现显示操作。Wherein, the distributed application is used to instruct the front end of the target application and the back end of the target application to implement separate running operations on different devices; the relay application is used to instruct the transfer source device through the The file service implements storage, restoration or sharing operations on the target application on different devices; the common application is used to instruct the target application to implement display operations on different devices through the screen projection technology.
  3. 根据权利要求2所述的方法,其中,若所述应用类型包括所述分布式应用,则根据所述应用类型确定针对所述目标应用的应用流转策略,包括:The method according to claim 2, wherein, if the application type includes the distributed application, determining an application flow strategy for the target application according to the application type, comprising:
    根据所述分布式应用确定所述应用流转策略;determining the application flow strategy according to the distributed application;
    其中,所述应用流转策略用于执行以下步骤:暂停所述目标应用的前端在所述流转源设备上运行,并由所述流转目标设备访问所述流转源设备上运行的所述目标应用的后端以开始运行所述目标应用的前端。The application flow strategy is used to perform the following steps: suspend the front end of the target application from running on the flow source device, and the flow target device accesses the target application running on the flow source device. backend to start running the frontend of the target application.
  4. 根据权利要求2所述的方法,其中,若所述应用类型包括所述接力式应用,则根据所述应用类型确定针对所述目标应用的应用流转策略,包括:The method according to claim 2, wherein, if the application type includes the relay application, determining an application flow strategy for the target application according to the application type, comprising:
    根据所述接力式应用确定所述应用流转策略;determining the application flow strategy according to the relay application;
    其中,所述应用流转策略用于执行以下步骤:暂停所述目标应用在所述流转源设备上运行,并由所述流转目标设备访问所述流转源设备的文件服务以开始运行所述目标应用。Wherein, the application transfer strategy is used to perform the following steps: suspend the target application from running on the transfer source device, and the transfer target device accesses the file service of the transfer source device to start running the target application .
  5. 根据权利要求2所述的方法,其中,若所述应用类型包括所述普通式应用,则根据所述应用类型确定针对所述目标应用的应用流转策略,包括:The method according to claim 2, wherein, if the application type includes the common application, determining an application flow policy for the target application according to the application type, comprising:
    根据所述普通式应用确定所述应用流转策略;determining the application flow strategy according to the common application;
    其中,所述应用流转策略用于执行以下步骤:若所述流转目标设备上有应用兼容所述目标应用以及支持同步所述目标应用的内容,则暂停所述目标应用在所述流转源设备上运行,并将所述目标应用的内容投射到所述流转目标设备的显示屏或显示介质上进行显示;或者,Wherein, the application transfer strategy is used to perform the following steps: if there is an application on the transfer target device that is compatible with the target application and supports synchronizing the content of the target application, suspend the target application on the transfer source device run, and project the content of the target application to the display screen or display medium of the streaming target device for display; or,
    若所述流转目标设备上没有应用兼容所述目标应用或者不支持同步所述目标应用的内容,则继续所述目标应用在所述流转源设备上运行,并将所述目标应用的内容投射到所述流转目标设备的显示屏或显示介质上进行显示。If no application on the streaming target device is compatible with the target application or does not support synchronizing the content of the target application, continue the target application to run on the streaming source device, and project the content of the target application to Display is performed on a display screen or a display medium of the flow target device.
  6. 根据权利要求1-5任一项所述的方法,其中,在所述获取所述流转源设备当前运行的目标应用的应用类型之前,所述方法还包括:The method according to any one of claims 1-5, wherein, before acquiring the application type of the target application currently running on the streaming source device, the method further comprises:
    获取第一信息,并判断所述第一信息是否携带流转目标设备的标识信息;acquiring first information, and judging whether the first information carries the identification information of the transfer target device;
    所述获取所述流转源设备当前运行的目标应用的应用类型,包括:The obtaining of the application type of the target application currently running on the circulation source device includes:
    在所述第一信息携带所述流转目标设备的标识信息时,获取所述流转源设备当前运行的所述目标应用的应用类型。When the first information carries the identification information of the transfer target device, the application type of the target application currently running on the transfer source device is acquired.
  7. 根据权利要求6所述的方法,其中,在所述判断所述第一信息是否携带流转目标设备的标识信息之后,所述方法还包括:The method according to claim 6, wherein after judging whether the first information carries the identification information of the transfer target device, the method further comprises:
    在所述第一信息没有携带所述流转目标设备的标识信息时,获取所述流转源设备的当前用户账号下与所述流转源设备所连接的所有设备的标识信息;或者,获取所述流转源设备所在的网络内与所述流转源设备所连接的所有设备的标识信息;When the first information does not carry the identification information of the transfer target device, obtain the identification information of all devices connected to the transfer source device under the current user account of the transfer source device; or, obtain the transfer source device. Identification information of all devices connected to the source device in the network where the source device is located;
    从所述所有设备的标识信息中确定所述流转目标设备的标识信息。The identification information of the transfer target device is determined from the identification information of all the devices.
  8. 根据权利要求7所述的方法,其中,所述从所述所有设备的标识信息中确定所述流转目标设备的标识信息,包括:The method according to claim 7, wherein the determining the identification information of the transfer target device from the identification information of all the devices comprises:
    若所述所有设备的标识信息中除所述流转源设备的标识信息外只存在一个设备的标识信息,则将所述设备的标识信息作为所述流转目标设备的标识信息;或者,If only the identification information of one device exists in the identification information of all the devices except the identification information of the transfer source device, the identification information of the device is used as the identification information of the transfer destination device; or,
    若所述所有设备的标识信息中除所述流转源设备的标识信息外存在至少两个设备的标识信息,则获取针对所述至少两个设备的标识信息的选择操作指令;根据所述选择操作指令从所述至少两个设备的标识信息中确定所述流转目标设备的标识信息;或者,If the identification information of all the devices contains the identification information of at least two devices except the identification information of the source device, obtain a selection operation instruction for the identification information of the at least two devices; according to the selection operation The instruction determines the identification information of the transfer target device from the identification information of the at least two devices; or,
    若所述所有设备的标识信息中除所述流转源设备的标识信息外存在至少两个设备的标识信息,则按 照预设优先级策略将所述至少两个设备的标识信息中优先级最高的标识信息作为所述流转目标设备的标识信息。If identification information of at least two devices exists in the identification information of all the devices except the identification information of the transfer source device, the identification information of the at least two devices with the highest priority is assigned according to a preset priority policy. The identification information is used as the identification information of the transfer target device.
  9. 根据权利要求6所述的方法,其中,所述第一信息满足以下至少一种方式:所述第一信息是通过传感器识别获取的、所述第一信息是通过语音识别获取的、所述第一信息是通过手势识别获取的、所述第一信息是通过图像识别获取、所述第一信息是通过人体姿态识别获取的、所述第一信息是通过脸部动作识别获取的、所述第一信息是通过人体动作识别获取的;The method according to claim 6, wherein the first information satisfies at least one of the following manners: the first information is acquired by sensor recognition, the first information is acquired by voice recognition, the first information is acquired by The first information is obtained through gesture recognition, the first information is obtained through image recognition, the first information is obtained through human gesture recognition, the first information is obtained through facial motion recognition, the first information is obtained through facial motion recognition 1. The information is obtained through human motion recognition;
    其中,所述传感器包括以下至少一种:超带宽UWB传感器、近场通信NFC传感器、激光传感器、可见光传感器。Wherein, the sensor includes at least one of the following: ultra-bandwidth UWB sensor, near field communication NFC sensor, laser sensor, visible light sensor.
  10. 一种应用内容跨设备流转方法,其中,应用于第一流转目标设备;所述方法包括:A cross-device flow method for application content, wherein the method is applied to a first flow target device; the method includes:
    获取所述第一流转目标设备上目标应用的应用类型,所述目标应用由流转源设备流转至所述第一流转目标设备;acquiring the application type of the target application on the first transfer target device, where the target application is transferred from the transfer source device to the first transfer target device;
    根据所述应用类型确定针对所述目标应用的应用流转策略;Determine an application flow strategy for the target application according to the application type;
    按照所述应用流转策略将所述目标应用的内容流转至第二流转目标设备。The content of the target application is transferred to the second transfer target device according to the application transfer policy.
  11. 根据权利要求9所述的方法,其中,所述应用类型包括以下至少一种:投屏式应用、分布式应用、接力式应用、普通式应用;The method according to claim 9, wherein the application type includes at least one of the following: a screen-casting application, a distributed application, a relay application, and a common application;
    其中,所述投屏式应用用于指示所述目标应用继续运行在所述流转源设备上,并由所述流转源设备暂停所述目标应用的内容在所述第一流转目标设备上显示,而将所述目标应用的内容投射到所述第二流转目标设备的显示屏或显示介质上进行显示;所述分布式应用用于指示将所述目标应用的前端和所述目标应用的后端在不同设备上实现分离运行操作;所述接力式应用用于指示通过所述流转源设备上的文件服务将所述目标应用在不同设备上实现存储、恢复或者共享操作;所述普通式应用用于指示通过投屏技术将所述目标应用在不同设备上实现显示操作。The screen-casting application is used to instruct the target application to continue running on the streaming source device, and the streaming source device suspends the display of the content of the target application on the first streaming target device, The content of the target application is projected to the display screen or display medium of the second streaming target device for display; the distributed application is used to instruct the front end of the target application and the back end of the target application to be displayed. Separate running operations are implemented on different devices; the relay application is used to instruct the target application to implement storage, restoration or sharing operations on different devices through the file service on the streaming source device; the common application uses It is used to instruct the target application to implement display operations on different devices through screen projection technology.
  12. 根据权利要求11所述的方法,其中,若所述应用类型包括所述投屏式应用,则根据所述应用类型确定针对所述目标应用的应用流转策略,包括:The method according to claim 11, wherein if the application type includes the screen-casting application, determining an application flow strategy for the target application according to the application type, comprising:
    根据所述投屏式应用确定所述应用流转策略;determining the application circulation strategy according to the screen-casting application;
    其中,所述应用流转策略用于执行以下步骤:暂停所述目标应用的内容在所述第一流转目标设备上显示,并将所述目标应用的内容投射到所述第二流转目标设备的显示屏或显示介质上进行显示。Wherein, the application circulation strategy is used to perform the following steps: pausing the display of the content of the target application on the first circulation target device, and projecting the content of the target application to the display of the second circulation target device display on the screen or display medium.
  13. 根据权利要求11所述的方法,其中,若所述应用类型包括所述分布式应用,则根据所述应用类型确定针对所述目标应用的应用流转策略,包括:The method according to claim 11, wherein if the application type includes the distributed application, determining an application flow strategy for the target application according to the application type, comprising:
    根据所述分布式应用确定所述应用流转策略;determining the application flow strategy according to the distributed application;
    其中,所述应用流转策略用于执行以下操作:暂停所述目标应用的前端在所述第一流转目标设备上运行,并由所述第二流转目标设备访问所述流转源设备上运行的所述目标应用的后端以开始运行所述目标应用的前端。Wherein, the application flow strategy is used to perform the following operations: suspend the front end of the target application from running on the first flow target device, and allow the second flow target device to access all files running on the flow source device. The back end of the target application is started to run the front end of the target application.
  14. 根据权利要求11所述的方法,其中,若所述应用类型包括所述接力式应用,则根据所述应用类型确定针对所述目标应用的应用流转策略,包括:The method according to claim 11, wherein if the application type includes the relay application, determining an application flow strategy for the target application according to the application type, comprising:
    根据所述接力式应用确定所述应用流转策略;determining the application flow strategy according to the relay application;
    其中,所述应用流转策略用于执行以下操作:暂停所述目标应用在所述第一流转目标设备上运行,并由所述第二流转目标设备访问所述流转源设备的文件服务以开始运行所述目标应用。The application flow strategy is used to perform the following operations: suspend the target application from running on the first flow target device, and the second flow target device accesses the file service of the flow source device to start running the target application.
  15. 根据权利要求11所述的方法,其中,若所述应用类型包括所述普通式应用,则根据所述应用类型确定针对所述目标应用的应用流转策略,包括:The method according to claim 11, wherein if the application type includes the common application, determining an application flow policy for the target application according to the application type, comprising:
    根据所述普通式应用确定所述应用流转策略;determining the application flow strategy according to the common application;
    其中,所述应用流转策略用于执行以下操作:若所述第二流转目标设备上有应用兼容所述目标应用以及支持同步所述目标应用的内容,则暂停所述目标应用在所述第一流转目标设备上运行,并将所述目标应用的内容投射到所述第二流转目标设备的显示屏或显示介质上进行显示;或者,Wherein, the application flow strategy is used to perform the following operations: if there is an application on the second flow target device that is compatible with the target application and supports synchronizing the content of the target application, suspend the target application in the first flow run on the streaming target device, and project the content of the target application to the display screen or display medium of the second streaming target device for display; or,
    若所述第二流转目标设备上没有应用兼容所述目标应用或者不支持同步所述目标应用的内容,则继续所述目标应用在所述第一流转目标设备上运行,并将所述目标应用的内容投射到所述第二流转目标设备的显示屏或显示介质上进行显示。If no application on the second streaming target device is compatible with the target application or does not support synchronizing the content of the target application, continue to run the target application on the first streaming target device, and use the target application The content is projected onto the display screen or display medium of the second flow target device for display.
  16. 根据权利要求10-15任一项所述的方法,其中,在所述获取所述第一流转目标设备上目标应用的应用类型之前,所述方法还包括:The method according to any one of claims 10-15, wherein before the acquiring the application type of the target application on the first transfer target device, the method further comprises:
    获取第一信息,并判断所述第一信息是否携带第二流转目标设备的标识信息;obtaining first information, and judging whether the first information carries the identification information of the second transfer target device;
    所述获取所述第一流转目标设备上目标应用的应用类型,包括:The acquiring the application type of the target application on the first transfer target device includes:
    在所述第一信息携带所述第二流转目标设备的标识信息时,获取所述流转源设备上所述目标应用的 应用类型。When the first information carries the identification information of the second transfer target device, the application type of the target application on the transfer source device is acquired.
  17. 根据权利要求16所述的方法,其中,在所述判断所述第一信息是否携带第二流转目标设备的标识信息之后,所述方法还包括:The method according to claim 16, wherein after judging whether the first information carries the identification information of the second transfer target device, the method further comprises:
    在所述第一信息没有携带所述第二流转目标设备的标识信息时,获取所述第一流转目标设备的当前账号下与所述第一流转目标设备所连接的所有设备的标识信息;或者,获取所述第一流转目标设备所在的网络内与所述第一流转目标设备所连接的所有设备的标识信息;When the first information does not carry the identification information of the second transfer target device, obtain the identification information of all devices connected to the first transfer target device under the current account of the first transfer target device; or , to obtain the identification information of all devices connected to the first transfer target device in the network where the first transfer target device is located;
    从所述所有设备的标识信息中确定所述第二流转目标设备的标识信息。The identification information of the second transfer target device is determined from the identification information of all the devices.
  18. 根据权利要求17所述的方法,其中,所述从所述所有设备的标识信息中确定所述第二流转目标设备的标识信息,包括:The method according to claim 17, wherein the determining the identification information of the second transfer target device from the identification information of all the devices comprises:
    若所述所有设备的标识信息中除所述流转源设备的标识信息和所述第一流转目标设备的标识信息外只存在一个设备的标识信息,则将所述设备的标识信息作为所述第二流转目标设备的标识信息;或者,If only the identification information of one device exists in the identification information of all the devices except the identification information of the transfer source device and the identification information of the first transfer destination device, the identification information of the device is used as the first transfer device. The identification information of the second transfer target device; or,
    若所述所有设备的标识信息中除所述流转源设备的标识信息和所述第一流转目标设备的标识信息外存在至少两个设备的标识信息,则获取针对所述至少两个设备的标识信息的选择操作指令;根据所述选择操作指令从所述至少两个设备的标识信息中确定所述第二流转目标设备的标识信息;或者,If identification information of at least two devices exists in the identification information of all the devices except the identification information of the transfer source device and the identification information of the first transfer target device, obtain the identifications for the at least two devices information selection operation instruction; determine the identification information of the second transfer target device from the identification information of the at least two devices according to the selection operation instruction; or,
    若所述所有设备的标识信息中除所述流转源设备的标识信息和所述第一流转目标设备的标识信息外存在至少两个设备的标识信息,则按照预设优先级策略将所述至少两个设备的标识信息中优先级最高的标识信息作为所述第二流转目标设备的标识信息。If identification information of at least two devices exists in the identification information of all devices except the identification information of the transfer source device and the identification information of the first transfer destination device, the at least two devices are assigned according to the preset priority policy. The identification information with the highest priority among the identification information of the two devices is used as the identification information of the second transfer target device.
  19. 根据权利要求16所述的方法,其中,所述第一信息满足以下至少一种方式:所述第一信息是通过传感器识别获取的、所述第一信息是通过语音识别获取的、所述第一信息是通过手势识别获取的、所述第一信息是通过图像识别获取、所述第一信息是通过人体姿态识别获取的、所述第一信息是通过脸部动作识别获取的、所述第一信息是通过人体动作识别获取的;The method according to claim 16, wherein the first information satisfies at least one of the following manners: the first information is acquired by sensor recognition, the first information is acquired by voice recognition, the first information is acquired by The first information is obtained through gesture recognition, the first information is obtained through image recognition, the first information is obtained through human gesture recognition, the first information is obtained through facial motion recognition, the first information is obtained through facial motion recognition 1. The information is obtained through human motion recognition;
    其中,所述传感器包括以下至少一种:超带宽UWB传感器、近场通信NFC传感器、激光传感器、可见光传感器。Wherein, the sensor includes at least one of the following: ultra-bandwidth UWB sensor, near field communication NFC sensor, laser sensor, visible light sensor.
  20. 一种应用内容跨设备流转装置,其中,应用于流转源设备;所述装置包括:An apparatus for transferring application content across devices, which is applied to a transfer source device; the apparatus includes:
    应用信息模块,用于获取所述流转源设备当前运行的目标应用的应用类型;an application information module, used to obtain the application type of the target application currently running on the circulation source device;
    流转策略模块,用于根据所述应用类型确定针对所述目标应用的应用流转策略;a flow strategy module, configured to determine an application flow strategy for the target application according to the application type;
    应用流转模块,用于按照所述应用流转策略将所述目标应用的内容流转至流转目标设备。The application flow module is configured to flow the content of the target application to the flow target device according to the application flow strategy.
  21. 根据权利要求20所述的装置,其中,所述应用类型包括以下至少一种:分布式应用、接力式应用、普通式应用;The apparatus according to claim 20, wherein the application type includes at least one of the following: distributed application, relay application, and common application;
    其中,所述分布式应用用于指示将所述目标应用的前端和所述目标应用的后端在不同设备上实现分离运行操作;所述接力式应用用于指示通过所述流转源设备上的文件服务将所述目标应用在不同设备上实现存储、恢复或者共享操作;所述普通式应用用于指示通过投屏技术将所述目标应用在不同设备上实现显示操作。Wherein, the distributed application is used to instruct the front end of the target application and the back end of the target application to implement separate running operations on different devices; the relay application is used to instruct the transfer source device through the The file service implements storage, restoration or sharing operations on the target application on different devices; the common application is used to instruct the target application to implement display operations on different devices through the screen projection technology.
  22. 根据权利要求21所述的装置,其中,若所述应用类型包括所述分布式应用,则在根据所述应用类型确定针对所述目标应用的应用流转策略方面,所述流转策略模块用于:The apparatus according to claim 21, wherein if the application type includes the distributed application, in terms of determining an application flow strategy for the target application according to the application type, the flow strategy module is configured to:
    根据所述分布式应用确定所述应用流转策略;determining the application flow strategy according to the distributed application;
    其中,所述应用流转策略用于执行以下步骤:暂停所述目标应用的前端在所述流转源设备上运行,并由所述流转目标设备访问所述流转源设备上运行的所述目标应用的后端以开始运行所述目标应用的前端。The application flow strategy is used to perform the following steps: suspend the front end of the target application from running on the flow source device, and the flow target device accesses the target application running on the flow source device. backend to start running the frontend of the target application.
  23. 根据权利要求21所述的装置,其中,若所述应用类型包括所述接力式应用,则在根据所述应用类型确定针对所述目标应用的应用流转策略方面,所述流转策略模块用于:The apparatus according to claim 21, wherein if the application type includes the relay application, in terms of determining an application flow strategy for the target application according to the application type, the flow strategy module is configured to:
    根据所述接力式应用确定所述应用流转策略;determining the application flow strategy according to the relay application;
    其中,所述应用流转策略用于执行以下步骤:暂停所述目标应用在所述流转源设备上运行,并由所述流转目标设备访问所述流转源设备的文件服务以开始运行所述目标应用。Wherein, the application transfer strategy is used to perform the following steps: suspend the target application from running on the transfer source device, and the transfer target device accesses the file service of the transfer source device to start running the target application .
  24. 根据权利要求21所述的装置,其中,若所述应用类型包括所述普通式应用,则在根据所述应用类型确定针对所述目标应用的应用流转策略方面,所述流转策略模块用于:The apparatus according to claim 21, wherein if the application type includes the common application, in terms of determining an application flow strategy for the target application according to the application type, the flow strategy module is configured to:
    根据所述普通式应用确定所述应用流转策略;determining the application flow strategy according to the common application;
    其中,所述应用流转策略用于执行以下步骤:若所述流转目标设备上有应用兼容所述目标应用以及支持同步所述目标应用的内容,则暂停所述目标应用在所述流转源设备上运行,并将所述目标应用的内容投射到所述流转目标设备的显示屏或显示介质上进行显示;或者,Wherein, the application transfer strategy is used to perform the following steps: if there is an application on the transfer target device that is compatible with the target application and supports synchronizing the content of the target application, suspend the target application on the transfer source device run, and project the content of the target application to the display screen or display medium of the streaming target device for display; or,
    若所述流转目标设备上没有应用兼容所述目标应用或者不支持同步所述目标应用的内容,则继续所 述目标应用在所述流转源设备上运行,并将所述目标应用的内容投射到所述流转目标设备的显示屏或显示介质上进行显示。If no application on the streaming target device is compatible with the target application or does not support synchronizing the content of the target application, continue the target application to run on the streaming source device, and project the content of the target application to Display is performed on a display screen or a display medium of the flow target device.
  25. 根据权利要求10-24任一项所述的装置,其中,在所述获取所述流转源设备当前运行的目标应用的应用类型之前,所述装置还包括获取信息模块和判定信息模块;其中,The apparatus according to any one of claims 10-24, wherein, before acquiring the application type of the target application currently running on the circulation source device, the apparatus further comprises an acquiring information module and a determining information module; wherein,
    所述获取信息模块,用于获取第一信息;the information obtaining module is used to obtain the first information;
    所述判定信息模块,用于判断所述第一信息是否携带流转目标设备的标识信息;The determination information module is used to determine whether the first information carries the identification information of the transfer target device;
    在所述获取所述流转源设备当前运行的目标应用的应用类型,所述应用信息模块用于:In the obtaining of the application type of the target application currently running on the circulation source device, the application information module is used for:
    在所述第一信息携带所述流转目标设备的标识信息时,获取所述流转源设备当前运行的所述目标应用的应用类型。When the first information carries the identification information of the transfer target device, the application type of the target application currently running on the transfer source device is acquired.
  26. 根据权利要求25所述的装置,其中,在所述判断所述第一信息是否携带流转目标设备的标识信息之后,所述装置还包括连接管理模块;其中,The apparatus according to claim 25, wherein after judging whether the first information carries the identification information of the transfer target device, the apparatus further comprises a connection management module; wherein,
    所述连接管理模块,用于在所述第一信息没有携带所述流转目标设备的标识信息时,获取所述流转源设备的当前用户账号下与所述流转源设备所连接的所有设备的标识信息;或者,获取所述流转源设备所在的网络内与所述流转源设备所连接的所有设备的标识信息;The connection management module is configured to acquire the identifiers of all devices connected to the transfer source device under the current user account of the transfer source device when the first information does not carry the identification information of the transfer target device information; or, obtain the identification information of all devices connected to the transfer source device in the network where the transfer source device is located;
    所述判定信息模块,还用于从所述所有设备的标识信息中确定所述流转目标设备的标识信息。The determining information module is further configured to determine the identification information of the transfer target device from the identification information of all the devices.
  27. 根据权利要求26所述的装置,其中,在所述从所述所有设备的标识信息中确定所述流转目标设备的标识信息方面,所述判定信息模块用于:The apparatus according to claim 26, wherein, in the aspect of determining the identification information of the transfer target device from the identification information of all the devices, the determination information module is used for:
    若所述所有设备的标识信息中除所述流转源设备的标识信息外只存在一个设备的标识信息,则将所述设备的标识信息作为所述流转目标设备的标识信息;或者,If only the identification information of one device exists in the identification information of all the devices except the identification information of the transfer source device, the identification information of the device is used as the identification information of the transfer destination device; or,
    若所述所有设备的标识信息中除所述流转源设备的标识信息外存在至少两个设备的标识信息,则获取针对所述至少两个设备的标识信息的选择操作指令;根据所述选择操作指令从所述至少两个设备的标识信息中确定所述流转目标设备的标识信息;或者,If the identification information of all the devices contains the identification information of at least two devices except the identification information of the source device, obtain a selection operation instruction for the identification information of the at least two devices; according to the selection operation The instruction determines the identification information of the transfer target device from the identification information of the at least two devices; or,
    若所述所有设备的标识信息中除所述流转源设备的标识信息外存在至少两个设备的标识信息,则按照预设优先级策略将所述至少两个设备的标识信息中优先级最高的标识信息作为所述流转目标设备的标识信息。If identification information of at least two devices exists in the identification information of all the devices except the identification information of the transfer source device, the identification information of the at least two devices with the highest priority is assigned according to a preset priority policy. The identification information is used as the identification information of the transfer target device.
  28. 根据权利要求25所述的装置,其中,所述第一信息满足以下至少一种方式:所述第一信息是通过传感器识别获取的、所述第一信息是通过语音识别获取的、所述第一信息是通过手势识别获取的、所述第一信息是通过图像识别获取、所述第一信息是通过人体姿态识别获取的、所述第一信息是通过脸部动作识别获取的、所述第一信息是通过人体动作识别获取的;The apparatus according to claim 25, wherein the first information satisfies at least one of the following manners: the first information is acquired by sensor recognition, the first information is acquired by voice recognition, the first information is acquired by The first information is obtained through gesture recognition, the first information is obtained through image recognition, the first information is obtained through human gesture recognition, the first information is obtained through facial motion recognition, the first information is obtained through facial motion recognition 1. The information is obtained through human motion recognition;
    其中,所述传感器包括以下至少一种:超带宽UWB传感器、近场通信NFC传感器、激光传感器、可见光传感器。Wherein, the sensor includes at least one of the following: ultra-bandwidth UWB sensor, near field communication NFC sensor, laser sensor, visible light sensor.
  29. 一种应用内容跨设备流转装置,其中,应用于第一流转目标设备;所述装置包括:An apparatus for cross-device flow of application content, wherein the apparatus is applied to a first flow target device; the apparatus includes:
    应用信息模块,用于获取所述第一流转目标设备上目标应用的应用类型,所述目标应用由流转源设备流转至所述第一流转目标设备;an application information module, configured to obtain the application type of the target application on the first transfer target device, and the target application is transferred from the transfer source device to the first transfer target device;
    流转策略模块,用于根据所述应用类型确定针对所述目标应用的应用流转策略;a flow strategy module, configured to determine an application flow strategy for the target application according to the application type;
    应用流转模块,用于按照所述应用流转策略将所述目标应用的内容流转至第二流转目标设备。The application flow module is configured to flow the content of the target application to the second flow target device according to the application flow strategy.
  30. 根据权利要求29所述的装置,其中,所述应用类型包括以下至少一种:投屏式应用、分布式应用、接力式应用、普通式应用;The apparatus according to claim 29, wherein the application types include at least one of the following: screen-casting applications, distributed applications, relay applications, and common applications;
    其中,所述投屏式应用用于指示所述目标应用继续运行在所述流转源设备上,并由所述流转源设备暂停所述目标应用的内容在所述第一流转目标设备上显示,而将所述目标应用的内容投射到所述第二流转目标设备的显示屏或显示介质上进行显示;所述分布式应用用于指示将所述目标应用的前端和所述目标应用的后端在不同设备上实现分离运行操作;所述接力式应用用于指示通过所述流转源设备上的文件服务将所述目标应用在不同设备上实现存储、恢复或者共享操作;所述普通式应用用于指示通过投屏技术将所述目标应用在不同设备上实现显示操作。The screen-casting application is used to instruct the target application to continue running on the streaming source device, and the streaming source device suspends the display of the content of the target application on the first streaming target device, The content of the target application is projected to the display screen or display medium of the second streaming target device for display; the distributed application is used to instruct the front end of the target application and the back end of the target application to be displayed. Separate running operations are implemented on different devices; the relay application is used to instruct the target application to implement storage, restoration or sharing operations on different devices through the file service on the streaming source device; the common application uses It is used to instruct the target application to implement display operations on different devices through screen projection technology.
  31. 根据权利要求30所述的装置,其中,若所述应用类型包括所述投屏式应用,则在根据所述应用类型确定针对所述目标应用的应用流转策略方面,所述流转策略模块用于:The apparatus according to claim 30, wherein if the application type includes the screen-casting application, in terms of determining an application circulation strategy for the target application according to the application type, the circulation strategy module is configured to: :
    根据所述投屏式应用确定所述应用流转策略;determining the application circulation strategy according to the screen-casting application;
    其中,所述应用流转策略用于执行以下步骤:暂停所述目标应用的内容在所述第一流转目标设备上显示,并将所述目标应用的内容投射到所述第二流转目标设备的显示屏或显示介质上进行显示。Wherein, the application circulation strategy is used to perform the following steps: pausing the display of the content of the target application on the first circulation target device, and projecting the content of the target application to the display of the second circulation target device display on the screen or display medium.
  32. 根据权利要求30所述的装置,其中,若所述应用类型包括所述分布式应用,则在根据所述应用类型确定针对所述目标应用的应用流转策略方面,所述流转策略模块用于:The apparatus according to claim 30, wherein if the application type includes the distributed application, in terms of determining an application flow strategy for the target application according to the application type, the flow strategy module is configured to:
    根据所述分布式应用确定所述应用流转策略;determining the application flow strategy according to the distributed application;
    其中,所述应用流转策略用于执行以下操作:暂停所述目标应用的前端在所述第一流转目标设备上运行,并由所述第二流转目标设备访问所述流转源设备上运行的所述目标应用的后端以开始运行所述目标应用的前端。Wherein, the application flow strategy is used to perform the following operations: suspend the front end of the target application from running on the first flow target device, and allow the second flow target device to access all files running on the flow source device. The back end of the target application is started to run the front end of the target application.
  33. 根据权利要求30所述的装置,其中,若所述应用类型包括所述接力式应用,则在根据所述应用类型确定针对所述目标应用的应用流转策略方面,所述流转策略模块用于:The apparatus according to claim 30, wherein if the application type includes the relay application, in terms of determining an application flow strategy for the target application according to the application type, the flow strategy module is configured to:
    根据所述接力式应用确定所述应用流转策略;determining the application flow strategy according to the relay application;
    其中,所述应用流转策略用于执行以下操作:暂停所述目标应用在所述第一流转目标设备上运行,并由所述第二流转目标设备访问所述流转源设备的文件服务以开始运行所述目标应用。The application flow strategy is used to perform the following operations: suspend the target application from running on the first flow target device, and the second flow target device accesses the file service of the flow source device to start running the target application.
  34. 根据权利要求30所述的装置,其中,若所述应用类型包括所述普通式应用,则在根据所述应用类型确定针对所述目标应用的应用流转策略方面,所述流转策略模块用于:The apparatus according to claim 30, wherein if the application type includes the common application, in terms of determining an application flow strategy for the target application according to the application type, the flow strategy module is configured to:
    根据所述普通式应用确定所述应用流转策略;determining the application flow strategy according to the common application;
    其中,所述应用流转策略用于执行以下操作:若所述第二流转目标设备上有应用兼容所述目标应用以及支持同步所述目标应用的内容,则暂停所述目标应用在所述第一流转目标设备上运行,并将所述目标应用的内容投射到所述第二流转目标设备的显示屏或显示介质上进行显示;或者,Wherein, the application flow strategy is used to perform the following operations: if there is an application on the second flow target device that is compatible with the target application and supports synchronizing the content of the target application, suspend the target application in the first flow run on the streaming target device, and project the content of the target application to the display screen or display medium of the second streaming target device for display; or,
    若所述第二流转目标设备上没有应用兼容所述目标应用或者不支持同步所述目标应用的内容,则继续所述目标应用在所述第一流转目标设备上运行,并将所述目标应用的内容投射到所述第二流转目标设备的显示屏或显示介质上进行显示。If no application on the second streaming target device is compatible with the target application or does not support synchronizing the content of the target application, continue to run the target application on the first streaming target device, and use the target application The content is projected onto the display screen or display medium of the second flow target device for display.
  35. 根据权利要求29-34任一项所述的装置,其中,在所述获取所述第一流转目标设备上目标应用的应用类型之前,所述装置还包括获取信息模块和判定信息模块;其中,The apparatus according to any one of claims 29-34, wherein, before the acquiring the application type of the target application on the first transfer target device, the apparatus further comprises an acquiring information module and a determining information module; wherein,
    所述获取信息模块,用于获取第一信息;the information obtaining module is used to obtain the first information;
    所述判定信息模块,用于判断所述第一信息是否携带第二流转目标设备的标识信息;The determination information module is used to determine whether the first information carries the identification information of the second transfer target device;
    在所述获取所述第一流转目标设备上目标应用的应用类型方面,所述应用信息模块用于:In the aspect of acquiring the application type of the target application on the first transfer target device, the application information module is used for:
    在所述第一信息携带所述第二流转目标设备的标识信息时,获取所述流转源设备上所述目标应用的应用类型。When the first information carries the identification information of the second transfer target device, the application type of the target application on the transfer source device is acquired.
  36. 根据权利要求35所述的装置,其中,在所述判断所述第一信息是否携带第二流转目标设备的标识信息之后,所述装置还包括连接管理模块;其中,The apparatus according to claim 35, wherein after judging whether the first information carries the identification information of the second transfer target device, the apparatus further comprises a connection management module; wherein,
    所述连接管理模块,用于在所述第一信息没有携带所述第二流转目标设备的标识信息时,获取所述第一流转目标设备的当前账号下与所述第一流转目标设备所连接的所有设备的标识信息;或者,获取所述第一流转目标设备所在的网络内与所述第一流转目标设备所连接的所有设备的标识信息;The connection management module is configured to acquire, when the first information does not carry the identification information of the second transfer target device, the connection with the first transfer target device under the current account of the first transfer target device The identification information of all devices; or, obtain the identification information of all devices connected to the first transfer target device in the network where the first transfer target device is located;
    从所述所有设备的标识信息中确定所述第二流转目标设备的标识信息。The identification information of the second transfer target device is determined from the identification information of all the devices.
  37. 根据权利要求36所述的装置,其中,在所述从所述所有设备的标识信息中确定所述第二流转目标设备的标识信息方面,所述判定信息模块用于:The apparatus according to claim 36, wherein, in the aspect of determining the identification information of the second transfer target device from the identification information of all the devices, the determination information module is configured to:
    若所述所有设备的标识信息中除所述流转源设备的标识信息和所述第一流转目标设备的标识信息外只存在一个设备的标识信息,则将所述设备的标识信息作为所述第二流转目标设备的标识信息;或者,If only the identification information of one device exists in the identification information of all the devices except the identification information of the transfer source device and the identification information of the first transfer destination device, the identification information of the device is used as the first transfer device. The identification information of the second transfer target device; or,
    若所述所有设备的标识信息中除所述流转源设备的标识信息和所述第一流转目标设备的标识信息外存在至少两个设备的标识信息,则获取针对所述至少两个设备的标识信息的选择操作指令;根据所述选择操作指令从所述至少两个设备的标识信息中确定所述第二流转目标设备的标识信息;或者,If identification information of at least two devices exists in the identification information of all the devices except the identification information of the transfer source device and the identification information of the first transfer target device, obtain the identifications for the at least two devices information selection operation instruction; determine the identification information of the second transfer target device from the identification information of the at least two devices according to the selection operation instruction; or,
    若所述所有设备的标识信息中除所述流转源设备的标识信息和所述第一流转目标设备的标识信息外存在至少两个设备的标识信息,则按照预设优先级策略将所述至少两个设备的标识信息中优先级最高的标识信息作为所述第二流转目标设备的标识信息。If identification information of at least two devices exists in the identification information of all devices except the identification information of the transfer source device and the identification information of the first transfer destination device, the at least two devices are assigned according to the preset priority policy. The identification information with the highest priority among the identification information of the two devices is used as the identification information of the second transfer target device.
  38. 根据权利要求35所述的装置,其中,所述第一信息满足以下至少一种方式:所述第一信息是通过传感器识别获取的、所述第一信息是通过语音识别获取的、所述第一信息是通过手势识别获取的、所述第一信息是通过图像识别获取、所述第一信息是通过人体姿态识别获取的、所述第一信息是通过脸部动作识别获取的、所述第一信息是通过人体动作识别获取的;The apparatus according to claim 35, wherein the first information satisfies at least one of the following manners: the first information is acquired through sensor recognition, the first information is acquired through voice recognition, the first information The first information is obtained through gesture recognition, the first information is obtained through image recognition, the first information is obtained through human gesture recognition, the first information is obtained through facial motion recognition, the first information is obtained through facial motion recognition 1. The information is obtained through human motion recognition;
    其中,所述传感器包括以下至少一种:超带宽UWB传感器、近场通信NFC传感器、激光传感器、可见光传感器。Wherein, the sensor includes at least one of the following: ultra-bandwidth UWB sensor, near field communication NFC sensor, laser sensor, visible light sensor.
  39. 一种电子设备,其特征在于,所述电子设备为流转源设备,包括处理器、存储器和通信接口,所述存储器存储有一个或多个程序,并且所述一个或多个程序由所述处理器执行,所述一个或多个程序包括用于执行如权利要求1-9任一项所述的方法中的步骤的指令。An electronic device, characterized in that the electronic device is a streaming source device, comprising a processor, a memory and a communication interface, the memory stores one or more programs, and the one or more programs are processed by the executable, the one or more programs comprising instructions for performing steps in the method of any of claims 1-9.
  40. 一种电子设备,其特征在于,所述电子设备为第一流转目标设备,包括处理器、存储器和通信 接口,所述存储器存储有一个或多个程序,并且所述一个或多个程序由所述处理器执行,所述一个或多个程序包括用于执行如权利要求10-19任一项所述的方法中的步骤的指令。An electronic device, characterized in that the electronic device is a first transfer target device, comprising a processor, a memory and a communication interface, the memory stores one or more programs, and the one or more programs are executed by the processor, the one or more programs comprising instructions for performing steps in the method of any of claims 10-19.
  41. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储用于电子数据交换的计算机程序,其中,所述计算机程序可操作来使得计算机执行如权利要求1-9或者10-19中任一项所述的方法。A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program is operable to cause a computer to perform the method according to claim 1-9 or 10- The method of any one of 19.
PCT/CN2021/120963 2020-11-16 2021-09-27 Method and apparatus for transferring application content across devices, and electronic device WO2022100304A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011282590.3A CN112398855B (en) 2020-11-16 2020-11-16 Method and device for transferring application contents across devices and electronic device
CN202011282590.3 2020-11-16

Publications (1)

Publication Number Publication Date
WO2022100304A1 true WO2022100304A1 (en) 2022-05-19

Family

ID=74599969

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/120963 WO2022100304A1 (en) 2020-11-16 2021-09-27 Method and apparatus for transferring application content across devices, and electronic device

Country Status (2)

Country Link
CN (1) CN112398855B (en)
WO (1) WO2022100304A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024094115A1 (en) * 2022-11-04 2024-05-10 华为技术有限公司 Content sharing method and related device
WO2024140757A1 (en) * 2022-12-28 2024-07-04 华为技术有限公司 Cross-device screen splitting method and related apparatus
CN118377496A (en) * 2022-11-29 2024-07-23 华为技术有限公司 Application cross-equipment circulation method, related device and communication system

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112398855B (en) * 2020-11-16 2023-04-07 Oppo广东移动通信有限公司 Method and device for transferring application contents across devices and electronic device
CN113179555A (en) * 2021-05-19 2021-07-27 北京小米移动软件有限公司 Screen projection method, screen projection device, screen projection system, electronic device, and storage medium
CN113939007A (en) * 2021-10-09 2022-01-14 上海七十迈数字科技有限公司 Method and equipment for cross-screen synchronous navigation
CN116032942A (en) * 2021-10-25 2023-04-28 华为终端有限公司 Method, device, equipment and storage medium for synchronizing cross-equipment navigation tasks
CN114221909B (en) * 2021-12-13 2024-02-02 杭州逗酷软件科技有限公司 Data transmission method, device, terminal and storage medium
CN114785848B (en) * 2022-03-02 2024-09-27 阿里巴巴(中国)有限公司 Collaborative interaction and collaborative method, device and system between electronic devices
CN117667267A (en) * 2022-08-25 2024-03-08 Oppo广东移动通信有限公司 Application circulation method, device, terminal, storage medium and program product
CN117336700B (en) * 2023-12-01 2024-02-02 润芯微科技(江苏)有限公司 Method and system for locally executing application flow after interconnection

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160134922A1 (en) * 2013-06-14 2016-05-12 Telefonaktiebolaget L M Ericsson (Publ) A method and apparatus for exchanging video between media devices
CN106658159A (en) * 2016-09-05 2017-05-10 努比亚技术有限公司 Control method and first electronic equipment, and target equipment
CN109660842A (en) * 2018-11-14 2019-04-19 华为技术有限公司 A kind of method and electronic equipment playing multi-medium data
CN110958475A (en) * 2019-10-30 2020-04-03 华为终端有限公司 Cross-device content projection method and electronic device
CN111447323A (en) * 2020-03-20 2020-07-24 华为技术有限公司 Application display continuing method and device
CN111726678A (en) * 2020-03-26 2020-09-29 华为技术有限公司 Method for continuously playing multimedia content between devices
CN112398855A (en) * 2020-11-16 2021-02-23 Oppo广东移动通信有限公司 Method and device for transferring application contents across devices and electronic device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102510392B (en) * 2011-10-10 2014-11-05 Tcl集团股份有限公司 Equipment room application sharing method and system, television and mobile terminal
US8764555B2 (en) * 2012-10-02 2014-07-01 Nextbit Systems Inc. Video game application state synchronization across multiple devices
CN114449092B (en) * 2017-06-13 2024-10-18 华为技术有限公司 Display method, terminal, display system and storage medium
CN109646940A (en) * 2018-12-19 2019-04-19 努比亚技术有限公司 Method, terminal and the computer readable storage medium of synchronization applications

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160134922A1 (en) * 2013-06-14 2016-05-12 Telefonaktiebolaget L M Ericsson (Publ) A method and apparatus for exchanging video between media devices
CN106658159A (en) * 2016-09-05 2017-05-10 努比亚技术有限公司 Control method and first electronic equipment, and target equipment
CN109660842A (en) * 2018-11-14 2019-04-19 华为技术有限公司 A kind of method and electronic equipment playing multi-medium data
CN110958475A (en) * 2019-10-30 2020-04-03 华为终端有限公司 Cross-device content projection method and electronic device
CN111447323A (en) * 2020-03-20 2020-07-24 华为技术有限公司 Application display continuing method and device
CN111726678A (en) * 2020-03-26 2020-09-29 华为技术有限公司 Method for continuously playing multimedia content between devices
CN112398855A (en) * 2020-11-16 2021-02-23 Oppo广东移动通信有限公司 Method and device for transferring application contents across devices and electronic device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024094115A1 (en) * 2022-11-04 2024-05-10 华为技术有限公司 Content sharing method and related device
CN118377496A (en) * 2022-11-29 2024-07-23 华为技术有限公司 Application cross-equipment circulation method, related device and communication system
WO2024140757A1 (en) * 2022-12-28 2024-07-04 华为技术有限公司 Cross-device screen splitting method and related apparatus

Also Published As

Publication number Publication date
CN112398855A (en) 2021-02-23
CN112398855B (en) 2023-04-07

Similar Documents

Publication Publication Date Title
WO2022100304A1 (en) Method and apparatus for transferring application content across devices, and electronic device
WO2022100305A1 (en) Cross-device picture display method and apparatus, and electronic device
WO2021078284A1 (en) Content continuation method and electronic device
WO2022257977A1 (en) Screen projection method for electronic device, and electronic device
WO2020014880A1 (en) Multi-screen interaction method and device
WO2021233079A1 (en) Cross-device content projection method, and electronic device
WO2021000807A1 (en) Processing method and apparatus for waiting scenario in application
CN112558825A (en) Information processing method and electronic equipment
WO2021121052A1 (en) Multi-screen cooperation method and system, and electronic device
WO2022121775A1 (en) Screen projection method, and device
WO2021185244A1 (en) Device interaction method and electronic device
WO2022048474A1 (en) Method for multiple applications to share camera, and electronic device
CN112527174B (en) Information processing method and electronic equipment
WO2021258809A1 (en) Data synchronization method, electronic device, and computer readable storage medium
CN114040242B (en) Screen projection method, electronic equipment and storage medium
WO2022143077A1 (en) Photographing method, system, and electronic device
WO2022105445A1 (en) Browser-based application screen projection method and related apparatus
WO2022127661A1 (en) Application sharing method, and electronic device and storage medium
JP7181990B2 (en) Data transmission method and electronic device
WO2022166618A1 (en) Screen projection method and electronic device
WO2023030099A1 (en) Cross-device interaction method and apparatus, and screen projection system and terminal
CN112527222A (en) Information processing method and electronic equipment
WO2022042769A2 (en) Multi-screen interaction system and method, apparatus, and medium
WO2021218544A1 (en) Wireless connection providing system, method, and electronic apparatus
WO2024045801A1 (en) Method for screenshotting, and electronic device, medium and program product

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21890832

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21890832

Country of ref document: EP

Kind code of ref document: A1