[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2018024231A1 - Method and apparatus for interconnecting spliced wall and mobile intelligent terminal - Google Patents

Method and apparatus for interconnecting spliced wall and mobile intelligent terminal Download PDF

Info

Publication number
WO2018024231A1
WO2018024231A1 PCT/CN2017/095809 CN2017095809W WO2018024231A1 WO 2018024231 A1 WO2018024231 A1 WO 2018024231A1 CN 2017095809 W CN2017095809 W CN 2017095809W WO 2018024231 A1 WO2018024231 A1 WO 2018024231A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
video data
intelligent terminal
mobile intelligent
server
Prior art date
Application number
PCT/CN2017/095809
Other languages
French (fr)
Chinese (zh)
Inventor
谢文君
Original Assignee
威创集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 威创集团股份有限公司 filed Critical 威创集团股份有限公司
Publication of WO2018024231A1 publication Critical patent/WO2018024231A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268—Signal distribution or switching

Definitions

  • the invention relates to the field of splicing display technology, in particular to a method and a device for interconnecting a splicing wall and a mobile intelligent terminal.
  • the splicing wall is widely used in a variety of places that need to use large screens for display. Because of its flexible construction, it can meet different needs and different signal input requirements, and can realize various signal switching, splicing into full-screen display or any combination display. Advantages, favored by relevant users.
  • the splicing wall may include a display unit and a splicing wall control system.
  • the splicing wall control system may be connected to a server that controls various work of the splicing wall; the server may send display data or display instructions to the splicing wall control system.
  • a method for interconnecting a splicing wall and a mobile intelligent terminal includes the following steps:
  • the video wall control system acquires video data information of each channel currently played by each display unit in the splicing wall, and sends the information to the server through the network;
  • the server forwards the received video data information to the mobile intelligent terminal through the wireless network
  • the mobile intelligent terminal decodes and displays the video data information
  • the mobile intelligent terminal acquires desktop content according to the underlying desktop video cache information, and sends the content to the server through the wireless network;
  • the server encodes the desktop content through the code box, and sends the information as one channel of video data to the video wall control system, and the video wall control system decodes the desktop content and then dispatches it to the display unit for display;
  • the code box is connected between the server and the control system of the video wall, and is connected to the server through a digital signal line, and is connected to the video wall control system through a network.
  • a device for interconnecting a splicing wall and a mobile intelligent terminal comprising a first acquiring module and a second display module disposed in the splicing wall control system, and the first sending module and the second sending module disposed on the server, are disposed on the mobile intelligent terminal a display module and a second acquisition module;
  • the first obtaining module is configured to obtain video data information of each channel currently played by each display unit in the splicing wall, and send the information to the server through the network;
  • the first sending module is configured to forward the received video data information to the mobile intelligent terminal by using a wireless network
  • the first display module is configured to decode and display the video data information by the mobile intelligent terminal;
  • the second obtaining module is configured to obtain desktop content according to the underlying desktop video cache information, and send the content to the server through a wireless network;
  • the second sending module is configured to encode the desktop content through the code box, and send the information as one channel of video data to the video wall control system;
  • the second display module is configured to decode the desktop content and then dispatch it to the display unit for display; wherein the code box is connected between the server and the control system of the video wall, and is connected to the server through a digital signal line, and is spliced
  • the wall control system is connected via a network.
  • the splicing wall control system can obtain the video data information currently played by each display unit in the splicing wall, and send the video data information to the server through the network, and the server will receive the The video data information is sent to the mobile intelligent terminal for decoding and display; the mobile intelligent terminal can also obtain the desktop content and send it to the server, and the server converts the desktop content into the corresponding video data information and sends it to the video wall for corresponding playback, which effectively simplifies.
  • the interconnection process of the above splicing wall and the mobile intelligent terminal improves the corresponding interconnection efficiency.
  • FIG. 1 is a flow chart of a method for interconnecting a video wall and a mobile intelligent terminal according to an embodiment
  • FIG. 2 is a schematic diagram of connection of a video wall, a server, and a mobile intelligent terminal according to an embodiment
  • FIG. 3 is a schematic structural diagram of a device for interconnecting a splicing wall and a mobile intelligent terminal according to an embodiment.
  • FIG. 1 is a flowchart of a method for interconnecting a video wall and a mobile intelligent terminal according to an embodiment, including the following steps:
  • the splicing wall control system acquires video data information of each channel currently played by each display unit in the splicing wall, and sends the information to the server through the network;
  • the splicing wall 110 may include a splicing wall control system 101 and a display unit 102.
  • the splicing wall control system 101 may transmit video data information to the server 120 through a wireless network, and the server 120 may encode
  • the box 140 sends corresponding video data information to the video wall control system 101.
  • the code box 140 may have an encoding capability, and the code box 140 and the server 120 may be connected by a digital signal line, and between the code box 140 and the video wall control system 101.
  • the video data information of the server can be transmitted to the video wall control system as a video source; the server 120 can also be connected to the mobile intelligent terminal 130 via a wireless network.
  • the above-mentioned video wall control system 101, the server 120, and the mobile intelligent terminal 130 can be connected in the same local area network through a wireless router to perform corresponding communication connections.
  • the server 120 may include an intelligent processing device such as a computer
  • the mobile smart terminal 130 may include a mobile communication device such as a mobile phone or a tablet computer.
  • the above-mentioned video wall control system can capture the first video data currently displayed by the display unit by intercepting the multi-frame image displayed by the display unit, and then grasp the audio data currently played by the display unit.
  • the first audio data is obtained, so as to obtain information about each video data currently played by the video wall.
  • the video wall control system can transmit video data information to the server through wireless communication such as WiFi communication or Bluetooth communication.
  • the server forwards the received video data information to the mobile intelligent terminal by using a wireless network.
  • the server may transmit the corresponding video data information to the mobile intelligent terminal through wireless communication such as WiFi communication or Bluetooth communication.
  • the mobile intelligent terminal decodes and displays the video data information.
  • the mobile intelligent terminal After receiving and decoding the video data information, the mobile intelligent terminal performs decompression, matching, and the like on the decoded first video data and the first audio data to ensure the first video data and The consistency of the first audio data.
  • the above steps can realize the playing or displaying of the video data information of the video wall in the mobile intelligent terminal, thereby effectively improving the convenience of acquiring the video data information.
  • the mobile intelligent terminal acquires desktop content according to the underlying desktop video cache information, and sends the content to the server through a wireless network.
  • the mobile intelligent terminal can obtain the second video data by reading its desktop video buffer, and then grab the currently played audio data to obtain the second audio data, thereby acquiring the desktop content of the mobile intelligent terminal.
  • the mobile intelligent terminal can transmit the above desktop content to the server through wireless communication such as WiFi communication or Bluetooth communication.
  • the server encodes the desktop content through the code box, and sends the information as a video data to the video wall control system, and the video wall control system decodes the desktop content and then dispatches the display to the display unit for display;
  • the code box is connected between the server and the control system of the video wall, and is connected to the server through a digital signal line, and is connected to the video wall control system through a network.
  • the above steps enable the related cached content of the mobile intelligent terminal desktop to be sent to the splicing wall for playing, which can improve the playing effect of the cached content.
  • the splicing wall control system can obtain the video data information currently played by each display unit in the splicing wall, and send the video data information to the server through the network, and the server will receive the Video data information is sent to the mobile intelligent terminal for decoding And displaying; the mobile intelligent terminal can also obtain the desktop content and send it to the server, and the server converts the desktop content into corresponding video data information and sends the information to the splicing wall for corresponding playback, thereby effectively simplifying the interconnection process between the splicing wall and the mobile intelligent terminal. , improve the corresponding interconnection efficiency.
  • the process of obtaining the video data information currently played by each display unit in the splicing wall may include:
  • the multi-frame picture displayed by the display unit is screenshotd by the splicing wall control system to obtain the first video data, and the first audio data currently being played is captured;
  • the video data information is generated according to each of the first video data and the first audio data.
  • the first video data and the first audio data are respectively compressed, and the stability of the first video data and the first audio data during the transmission process can be ensured.
  • the video wall control system compresses the first video data and the first audio data, respectively, generating video data information according to the compressed first video data and the first audio data;
  • the mobile intelligent terminal After the mobile intelligent terminal receives and decodes the video data information, the first video data and the first audio data need to be decompressed separately;
  • the first video data and the first audio data may be matched by an identifier and a time.
  • the first video data and the first audio data corresponding to the same application respectively include a setting identifier corresponding to the application. And matching the first video data and the first audio data corresponding to the application according to the setting identifier, and performing time matching on the first video data and the first audio data according to the same time period, etc., to ensure the video.
  • the process of taking a screenshot of the multi-frame picture displayed by the display unit, obtaining the first video data, and capturing the currently played first audio data may include:
  • Detecting the currently running first application identifying a first display window displayed by each first application in the display unit and a first position parameter of the first display window, respectively, according to each first position parameter, to the first display window Multi-frame picture to take screenshots, get multiple first videos corresponding to the display interface data;
  • multiple first application programs running on the splicing wall are obtained to obtain multiple video data information, so that the multiple video data information can be sent to the mobile intelligent terminal for corresponding playback, which can further improve the splicing wall and the mobile The effect of intelligent terminal interconnection.
  • the foregoing process of performing matching processing on the plurality of first video data and the first audio data may include:
  • the foregoing process of acquiring desktop content according to the bottom desktop video cache information of the mobile intelligent terminal includes:
  • the second video data and the second audio data are respectively compressed to ensure the stability of the desktop content including the second video data and the second audio data during the transmission.
  • the mobile intelligent terminal separately compresses the second video data and the second audio data, generating desktop content according to the compressed second video data and the second audio data;
  • the second video data and the second audio data need to be decompressed separately;
  • the second video data and the second audio data may be matched by an identifier and a time.
  • the second video data and the second audio data corresponding to the same application respectively include a setting identifier corresponding to the application. Matching the second video number corresponding to the application according to the above setting identifier According to the second audio data, the second video data and the second audio data are time-matched according to the same time period, and the like, and the effect of playing the desktop content on the mobile intelligent terminal can be ensured.
  • the process of obtaining the underlying desktop video cache information of the mobile intelligent terminal, obtaining the second video data, and capturing the second audio data currently played by the mobile intelligent terminal includes:
  • the embodiment obtains a plurality of second application programs of the smart mobile terminal, so as to respectively obtain display content (desktop content) corresponding to the plurality of second application programs, so that the plurality of display contents can be sent to the splicing wall for corresponding display.
  • the effect of interconnecting the mobile intelligent terminal and the splicing wall can be further improved.
  • the foregoing process of performing matching processing on the plurality of second video data and the second audio data may include:
  • the splicing wall control system may further include: after obtaining the video data information that is currently played by each display unit in the splicing wall, and sending the data to the server through the network, the method further includes:
  • the server decodes the video data information and displays the decoded video data information.
  • the video data information can also be played by the server, which can improve the convenience of the related user to obtain the video data information.
  • the server decompresses, matches, and the like the decoded first video data and the first audio data to ensure the first video data and the first Consistency of audio data.
  • the method for interconnecting the foregoing splicing wall and the mobile intelligent terminal may further include:
  • the server obtains the current playing data, encodes the playing data through the code box, and sends the data as one channel of video data to the video wall control system, and the video wall control system controls the playing data. After decoding, it is dispatched to the display unit for display.
  • the play data played by the server can be sent to the splicing wall for corresponding play, and the playback effect of the data played by the server can be guaranteed.
  • the method for interconnecting the foregoing splicing wall and the mobile intelligent terminal may further include:
  • the server sends the play data to the mobile intelligent terminal through a wireless network
  • the mobile intelligent terminal decodes and displays the play data.
  • the process of acquiring, by the server, the current playing data includes:
  • the server takes a screenshot of the multi-frame picture of the server display interface, obtains the third video data, and captures the currently played third audio data;
  • the server compresses the third video data and the third audio data, and matches the compressed third video data and the third audio data to obtain a plurality of sets of third video data and third audio data;
  • the server generates playback data according to each of the third video data and the third audio data.
  • the third video data and the third audio data may be separately compressed to ensure that the third video data and the third audio data are included in the transmission process.
  • the stability of the playback data may be separately compressed to ensure that the third video data and the third audio data are included in the transmission process.
  • the server separately compresses the third video data and the third audio data, generating playback data according to the compressed third video data and the third audio data;
  • the third video data and the third audio data need to be decompressed separately;
  • the third video data and the third audio data may be matched with an identifier and a time.
  • the third video data and the third audio data corresponding to the same application respectively include a setting identifier corresponding to the application. And matching the third video data and the third audio data corresponding to the application according to the setting identifier, and performing time matching on the third video data and the third audio data according to the same time period, etc., to ensure the playing.
  • the process of performing matching processing on the plurality of third video data and the third audio data may include:
  • FIG. 3 is a schematic structural diagram of a device for interconnecting a splicing wall and a mobile intelligent terminal according to an embodiment, including a first acquiring module 10 and a second displaying module 60 disposed on the splicing wall control system 101, and is disposed at the server 120.
  • the first sending module 20 and the second sending module 50 are disposed in the first display module 30 and the second acquiring module 40 of the mobile intelligent terminal 130;
  • the first obtaining module 10 is configured to obtain video data information of each channel currently played by each display unit in the splicing wall, and send the information to the server through the network;
  • the first sending module 20 is configured to forward the received video data information to the mobile intelligent terminal by using a wireless network
  • the first display module 30 is configured to decode and display the video data information by the mobile intelligent terminal;
  • the second obtaining module 40 is configured to obtain desktop content according to the underlying desktop video cache information, and send the content to the server through a wireless network;
  • the second sending module 50 is configured to encode the desktop content by using the code box, and send the information as one channel of video data to the video wall control system;
  • the second display module 60 is configured to decode the desktop content and then dispatch it to the display unit for display; wherein the code box is connected between the server and the control system of the video wall, and is connected to the server through a digital signal line, and The video wall control system is connected via a network.
  • the method and device for interconnecting a splicing wall and a mobile intelligent terminal provided by the invention can realize interconnection and intercommunication between a splicing wall and different types of display terminals (smart mobile terminals or servers, etc.), thereby achieving the effect of multi-screen interaction.
  • the mobile intelligent terminal, the server, the code box, the video wall control system and the signal sources can be connected in the same local area network through a router, and the mobile intelligent terminal can view the video content sent by the server through the network, or can also be itself
  • the desktop content is sent to the server for display; one end of the digital signal connection line is connected to the video output port of the server, and the other end is connected to the code box, and the video information of the server can be obtained as a signal source by the splicing wall control system, and the server is connected through the network and splicing Wall control system communication, which can acquire and view each video signal source, thus forming a loop between the server and the video wall control system.
  • the video wall control system is adjusted by the control software.
  • Each signal source is delivered to the display unit display.
  • the splicing wall and the mobile intelligent terminal interconnection device provided by the present invention have a one-to-one correspondence with the splicing wall and the mobile intelligent terminal interconnection method provided by the present invention, and the technical features described in the embodiment of the method for interconnecting the splicing wall and the mobile intelligent terminal are beneficial.
  • the effects are all applicable to the embodiment of the splicing wall and the mobile intelligent terminal interconnection device, and are hereby declared.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Telephonic Communication Services (AREA)

Abstract

A method and an apparatus for interconnecting a spliced wall and a mobile intelligent terminal. The method comprises: a spliced wall control system obtains each video data information currently played on each display unit in a spliced wall, and sends the video data information to a server by using a network (S10); the server forwards the received video data information to a mobile intelligent terminal by using a wireless network (S20); the mobile intelligent terminal decodes and displays the video data information (S30); the mobile intelligent terminal obtains desktop content according to bottom-layer desktop video buffer information of the mobile intelligent terminal, and sends the desktop content to the server by using the wireless network (S40); the server encodes the desktop content by using an encoding box, and sends the desktop content as video data information to the spliced wall control system, and the spliced wall control system decodes the desktop content and schedules the desktop content to the display unit for displaying (S50). The encoding box is connected between the server and the spliced wall control system, is connected to the server by using a digital signal line, and is connected to the spliced wall control system by using the network.

Description

拼接墙与移动智能终端互联方法和装置Method and device for interconnecting splicing wall and mobile intelligent terminal 技术领域Technical field
本发明涉及拼接显示技术领域，特别是涉及一种拼接墙与移动智能终端互联方法和装置。The invention relates to the field of splicing display technology, in particular to a method and a device for interconnecting a splicing wall and a mobile intelligent terminal.
背景技术Background technique
拼接墙广泛应用于多种需要利用大屏进行显示的场所，因其搭建灵活，满足不同使用场合，不同信号输入的需求，可实现各种信号的切换、可拼接成全屏显示或者任意组合显示等优势，深受相关用户青睐。拼接墙可以包括显示单元和拼接墙控制系统，上述拼接墙控制系统可以连接控制相应拼接墙各项工作的服务器；服务器可以向上述拼接墙控制系统发送显示数据或者显示指令等信息。The splicing wall is widely used in a variety of places that need to use large screens for display. Because of its flexible construction, it can meet different needs and different signal input requirements, and can realize various signal switching, splicing into full-screen display or any combination display. Advantages, favored by relevant users. The splicing wall may include a display unit and a splicing wall control system. The splicing wall control system may be connected to a server that controls various work of the splicing wall; the server may send display data or display instructions to the splicing wall control system.
在当前移动信息时代，小而轻便的移动智能终端广泛深入的应用在人们的生活中，然而，若需要将上述移动智能终端上的内容发送至拼接墙中进行显示或者其他处理，需要将相应的源文件通过移动存储设备进行拷贝，使移动智能终端上的内容拷贝至上述拼接墙开展相应工作，同样的，若需要在移动智能终端上显示拼接墙上显示的内容，也需要进行相应源文件的获取和拷贝，导致移动智能终端与拼接墙的互联过程复杂，互联效率低。In the current era of mobile information, small and lightweight mobile intelligent terminals are widely used in people's lives. However, if the content on the above mobile intelligent terminal needs to be sent to the video wall for display or other processing, it is necessary to The source file is copied by the mobile storage device, and the content on the mobile intelligent terminal is copied to the foregoing splicing wall to perform corresponding work. Similarly, if the content displayed on the splicing wall needs to be displayed on the mobile intelligent terminal, the corresponding source file is also required. The acquisition and copying result in a complicated interconnection process between the mobile intelligent terminal and the splicing wall, and the interconnection efficiency is low.
发明内容Summary of the invention
基于此，有必要针对传统方案导致移动智能终端与拼接墙的互联过程复杂，互联效率低的技术问题，提供一种拼接墙与移动智能终端互联方法和装置。Based on this, it is necessary to provide a method and device for interconnecting the splicing wall and the mobile intelligent terminal, aiming at the technical problem that the traditional intelligent solution and the splicing wall are complicated in interconnection and low in interconnection efficiency.
一种拼接墙与移动智能终端互联方法，包括如下步骤：A method for interconnecting a splicing wall and a mobile intelligent terminal includes the following steps:
拼接墙控制系统获取拼接墙中各显示单元当前播放的各路视频数据信息，并通过网络发送至服务器；The video wall control system acquires video data information of each channel currently played by each display unit in the splicing wall, and sends the information to the server through the network;
服务器通过无线网络将接收到的视频数据信息转发至移动智能终端； The server forwards the received video data information to the mobile intelligent terminal through the wireless network;
所述移动智能终端对所述视频数据信息进行解码并显示；The mobile intelligent terminal decodes and displays the video data information;
移动智能终端根据其底层桌面视频缓存信息获取桌面内容，并通过无线网络发送至所述服务器；The mobile intelligent terminal acquires desktop content according to the underlying desktop video cache information, and sends the content to the server through the wireless network;
所述服务器通过编码盒对所桌面内容进行编码，并作为一路视频数据信息发送至拼接墙控制系统，拼接墙控制系统对所述桌面内容进行解码后调度至显示单元上进行显示；其中，所述编码盒连接在服务器与拼接墙的控制系统之间，与服务器通过数字信号线相连，与拼接墙控制系统通过网络连接。The server encodes the desktop content through the code box, and sends the information as one channel of video data to the video wall control system, and the video wall control system decodes the desktop content and then dispatches it to the display unit for display; The code box is connected between the server and the control system of the video wall, and is connected to the server through a digital signal line, and is connected to the video wall control system through a network.
一种拼接墙与移动智能终端互联装置，包括设于拼接墙控制系统的第一获取模块和第二显示模块，设于服务器的第一发送模块和第二发送模块，设于移动智能终端的第一显示模块和第二获取模块；A device for interconnecting a splicing wall and a mobile intelligent terminal, comprising a first acquiring module and a second display module disposed in the splicing wall control system, and the first sending module and the second sending module disposed on the server, are disposed on the mobile intelligent terminal a display module and a second acquisition module;
第一获取模块用于获取拼接墙中各显示单元当前播放的各路视频数据信息，并通过网络发送至服务器；The first obtaining module is configured to obtain video data information of each channel currently played by each display unit in the splicing wall, and send the information to the server through the network;
第一发送模块用于通过无线网络将接收到的视频数据信息转发至移动智能终端；The first sending module is configured to forward the received video data information to the mobile intelligent terminal by using a wireless network;
第一显示模块用于所述移动智能终端对所述视频数据信息进行解码并显示；The first display module is configured to decode and display the video data information by the mobile intelligent terminal;
第二获取模块用于根据其底层桌面视频缓存信息获取桌面内容，并通过无线网络发送至所述服务器；The second obtaining module is configured to obtain desktop content according to the underlying desktop video cache information, and send the content to the server through a wireless network;
第二发送模块用于通过编码盒对所桌面内容进行编码，并作为一路视频数据信息发送至拼接墙控制系统；The second sending module is configured to encode the desktop content through the code box, and send the information as one channel of video data to the video wall control system;
第二显示模块用于对所述桌面内容进行解码后调度至显示单元上进行显示；其中，所述编码盒连接在服务器与拼接墙的控制系统之间，与服务器通过数字信号线相连，与拼接墙控制系统通过网络连接。The second display module is configured to decode the desktop content and then dispatch it to the display unit for display; wherein the code box is connected between the server and the control system of the video wall, and is connected to the server through a digital signal line, and is spliced The wall control system is connected via a network.
上述拼接墙与移动智能终端互联方法和装置中，拼接墙控制系统可以获取拼接墙中各显示单元当前播放的各路视频数据信息，将上述视频数据信息通过网络发送至服务器，服务器将接收到的视频数据信息发送至移动智能终端解码并显示；移动智能终端也可以获取其桌面内容发送至服务器，服务器将上述桌面内容转换为相应的视频数据信息发送至拼接墙进行相应的播放，有效简化了 上述拼接墙与移动智能终端的互联过程，提高了相应的互联效率。In the method and device for interconnecting the splicing wall and the mobile intelligent terminal, the splicing wall control system can obtain the video data information currently played by each display unit in the splicing wall, and send the video data information to the server through the network, and the server will receive the The video data information is sent to the mobile intelligent terminal for decoding and display; the mobile intelligent terminal can also obtain the desktop content and send it to the server, and the server converts the desktop content into the corresponding video data information and sends it to the video wall for corresponding playback, which effectively simplifies. The interconnection process of the above splicing wall and the mobile intelligent terminal improves the corresponding interconnection efficiency.
附图说明DRAWINGS
图1为一个实施例的拼接墙与移动智能终端互联方法流程图；1 is a flow chart of a method for interconnecting a video wall and a mobile intelligent terminal according to an embodiment;
图2为一个实施例的拼接墙、服务器和移动智能终端连接示意图；2 is a schematic diagram of connection of a video wall, a server, and a mobile intelligent terminal according to an embodiment;
图3为一个实施例的拼接墙与移动智能终端互联装置结构示意图。FIG. 3 is a schematic structural diagram of a device for interconnecting a splicing wall and a mobile intelligent terminal according to an embodiment.
具体实施方式detailed description
下面结合附图对本发明的拼接墙与移动智能终端互联方法和装置、拼接墙与移动智能终端互联方法和装置的具体实施方式作详细描述。The specific implementation manners of the method and device for interconnecting the video wall and the mobile intelligent terminal, the method and device for interconnecting the video wall and the mobile intelligent terminal of the present invention are described in detail below with reference to the accompanying drawings.
参考图1，图1所示为一个实施例的拼接墙与移动智能终端互联方法流程图，包括如下步骤：Referring to FIG. 1, FIG. 1 is a flowchart of a method for interconnecting a video wall and a mobile intelligent terminal according to an embodiment, including the following steps:
S10，拼接墙控制系统获取拼接墙中各显示单元当前播放的各路视频数据信息，并通过网络发送至服务器；S10, the splicing wall control system acquires video data information of each channel currently played by each display unit in the splicing wall, and sends the information to the server through the network;
在一个实施例中，如图3所示，上述拼接墙110可以包括拼接墙控制系统101和显示单元102，拼接墙控制系统101可以通过无线网络向服务器120发送视频数据信息，服务器120可以通过编码盒140向拼接墙控制系统101发送相应的视频数据信息，上述编码盒140可以具有编码能力，编码盒140与服务器120之间可以通过数字信号线相连，编码盒140与拼接墙控制系统101之间通过无线网络连接，服务器的视频数据信息可作为一路视频源传送到拼接墙控制系统；上述服务器120还可以与移动智能终端130之间通过无线网络进行相互连接。上述拼接墙控制系统101、服务器120以及移动智能终端130可以通过无线路由器连接在同一个局域网内，进行相应的通信连接。上述服务器120可以包括计算机等智能处理设备，移动智能终端130可以包括手机、平板电脑等移动通信设备。In one embodiment, as shown in FIG. 3, the splicing wall 110 may include a splicing wall control system 101 and a display unit 102. The splicing wall control system 101 may transmit video data information to the server 120 through a wireless network, and the server 120 may encode The box 140 sends corresponding video data information to the video wall control system 101. The code box 140 may have an encoding capability, and the code box 140 and the server 120 may be connected by a digital signal line, and between the code box 140 and the video wall control system 101. Through the wireless network connection, the video data information of the server can be transmitted to the video wall control system as a video source; the server 120 can also be connected to the mobile intelligent terminal 130 via a wireless network. The above-mentioned video wall control system 101, the server 120, and the mobile intelligent terminal 130 can be connected in the same local area network through a wireless router to perform corresponding communication connections. The server 120 may include an intelligent processing device such as a computer, and the mobile smart terminal 130 may include a mobile communication device such as a mobile phone or a tablet computer.
上述拼接墙控制系统可以通过截取显示单元显示的多帧图像，以获取上述显示单元当前显示的第一视频数据，再对显示单元当前播放的音频数据进行抓 取，得到第一音频数据，从而获取拼接墙当前播放的各路视频数据信息。拼接墙控制系统可以通过WiFi通信或者蓝牙通信等无线通信方式将视频数据信息发送至服务器。The above-mentioned video wall control system can capture the first video data currently displayed by the display unit by intercepting the multi-frame image displayed by the display unit, and then grasp the audio data currently played by the display unit. The first audio data is obtained, so as to obtain information about each video data currently played by the video wall. The video wall control system can transmit video data information to the server through wireless communication such as WiFi communication or Bluetooth communication.
S20，服务器通过无线网络将接收到的视频数据信息转发至移动智能终端；S20. The server forwards the received video data information to the mobile intelligent terminal by using a wireless network.
服务器可以通过WiFi通信或者蓝牙通信等无线通信方式将相应的视频数据信息发送至移动智能终端。The server may transmit the corresponding video data information to the mobile intelligent terminal through wireless communication such as WiFi communication or Bluetooth communication.
S30，所述移动智能终端对所述视频数据信息进行解码并显示；S30. The mobile intelligent terminal decodes and displays the video data information.
为了保证上述视频数据信息的播放效果，移动智能终端在接收并解码上述视频数据信息后，对解码得到的第一视频数据和第一音频数据进行解压、匹配等处理，以保证第一视频数据和第一音频数据的一致性。In order to ensure the playback effect of the video data information, after receiving and decoding the video data information, the mobile intelligent terminal performs decompression, matching, and the like on the decoded first video data and the first audio data to ensure the first video data and The consistency of the first audio data.
上述步骤可以实现拼接墙的各路视频数据信息在移动智能终端中的播放或者显示，有效提高了获取上述视频数据信息的便利性。The above steps can realize the playing or displaying of the video data information of the video wall in the mobile intelligent terminal, thereby effectively improving the convenience of acquiring the video data information.
S40，移动智能终端根据其底层桌面视频缓存信息获取桌面内容，并通过无线网络发送至所述服务器；S40. The mobile intelligent terminal acquires desktop content according to the underlying desktop video cache information, and sends the content to the server through a wireless network.
移动智能终端可以通过读取其桌面视频缓存，以获取第二视频数据，再对其当前播放的音频数据进行抓取，得到第二音频数据，从而获取移动智能终端的桌面内容。移动智能终端可以通过WiFi通信或者蓝牙通信等无线通信方式将上述桌面内容发送至服务器。The mobile intelligent terminal can obtain the second video data by reading its desktop video buffer, and then grab the currently played audio data to obtain the second audio data, thereby acquiring the desktop content of the mobile intelligent terminal. The mobile intelligent terminal can transmit the above desktop content to the server through wireless communication such as WiFi communication or Bluetooth communication.
S50，所述服务器通过编码盒对所桌面内容进行编码，并作为一路视频数据信息发送至拼接墙控制系统，拼接墙控制系统对所述桌面内容进行解码后调度至显示单元上进行显示；其中，所述编码盒连接在服务器与拼接墙的控制系统之间，与服务器通过数字信号线相连，与拼接墙控制系统通过网络连接。S50, the server encodes the desktop content through the code box, and sends the information as a video data to the video wall control system, and the video wall control system decodes the desktop content and then dispatches the display to the display unit for display; The code box is connected between the server and the control system of the video wall, and is connected to the server through a digital signal line, and is connected to the video wall control system through a network.
上述步骤使移动智能终端桌面的相关缓存内容可以发送至拼接墙进行播放，可以提高上述缓存内容的播放效果。The above steps enable the related cached content of the mobile intelligent terminal desktop to be sent to the splicing wall for playing, which can improve the playing effect of the cached content.
本发明提供的拼接墙与移动智能终端互联方法，拼接墙控制系统可以获取拼接墙中各显示单元当前播放的各路视频数据信息，将上述视频数据信息通过网络发送至服务器，服务器将接收到的视频数据信息发送至移动智能终端解码 并显示；移动智能终端也可以获取其桌面内容发送至服务器，服务器将上述桌面内容转换为相应的视频数据信息发送至拼接墙进行相应的播放，有效简化了上述拼接墙与移动智能终端的互联过程，提高了相应的互联效率。The method for interconnecting a splicing wall and a mobile intelligent terminal provided by the present invention, the splicing wall control system can obtain the video data information currently played by each display unit in the splicing wall, and send the video data information to the server through the network, and the server will receive the Video data information is sent to the mobile intelligent terminal for decoding And displaying; the mobile intelligent terminal can also obtain the desktop content and send it to the server, and the server converts the desktop content into corresponding video data information and sends the information to the splicing wall for corresponding playback, thereby effectively simplifying the interconnection process between the splicing wall and the mobile intelligent terminal. , improve the corresponding interconnection efficiency.
在一个实施例中，上述获取拼接墙中各显示单元当前播放的各路视频数据信息的过程可以包括：In an embodiment, the process of obtaining the video data information currently played by each display unit in the splicing wall may include:
通过拼接墙控制系统对显示单元显示的多帧图片进行截图，得到第一视频数据，并抓取当前播放的第一音频数据；The multi-frame picture displayed by the display unit is screenshotd by the splicing wall control system to obtain the first video data, and the first audio data currently being played is captured;
分别对所述第一视频数据和第一音频数据进行压缩，对压缩后的第一视频数据和第一音频数据进行匹配，得到多组第一视频数据和第一音频数据；Separating the first video data and the first audio data respectively, and matching the compressed first video data and the first audio data to obtain a plurality of sets of first video data and first audio data;
分别根据各组第一视频数据和第一音频数据生成视频数据信息。The video data information is generated according to each of the first video data and the first audio data.
本实施例分别对第一视频数据和第一音频数据进行压缩，可以保证传输过程中，第一视频数据和第一音频数据的稳定性。In this embodiment, the first video data and the first audio data are respectively compressed, and the stability of the first video data and the first audio data during the transmission process can be ensured.
作为一个实施例，若拼接墙控制系统分别对所述第一视频数据和第一音频数据进行压缩，根据压缩后的第一视频数据和第一音频数据生成视频数据信息；As an embodiment, if the video wall control system compresses the first video data and the first audio data, respectively, generating video data information according to the compressed first video data and the first audio data;
则移动智能终端在接收并解码上述视频数据信息后，需要分别对其中的第一视频数据和第一音频数据进行解压处理；After the mobile intelligent terminal receives and decodes the video data information, the first video data and the first audio data need to be decompressed separately;
此外，还可以对上述第一视频数据和第一音频数据进行标识符、时间的匹配，比如同一个应用程序对应的第一视频数据和第一音频数据均包括该应用程序对应的设定标识符，根据上述设定标识符匹配该应用程序对应的第一视频数据和第一音频数据，再根据相同的时间段对上述第一视频数据和第一音频数据进行时间匹配等等，可以保证上述视频数据信息在移动智能终端进行显示的效果。In addition, the first video data and the first audio data may be matched by an identifier and a time. For example, the first video data and the first audio data corresponding to the same application respectively include a setting identifier corresponding to the application. And matching the first video data and the first audio data corresponding to the application according to the setting identifier, and performing time matching on the first video data and the first audio data according to the same time period, etc., to ensure the video. The effect of data information on the mobile smart terminal.
作为一个实施例，上述对显示单元显示的多帧图片进行截图，得到第一视频数据，并抓取当前播放的第一音频数据的过程可以包括：As an embodiment, the process of taking a screenshot of the multi-frame picture displayed by the display unit, obtaining the first video data, and capturing the currently played first audio data may include:
检测当前运行的第一应用程序，识别各个第一应用程序在显示单元显示的第一显示窗口以及所述第一显示窗口的第一位置参数，分别根据各个第一位置参数对第一显示窗口的多帧图片进行截图，得到显示界面对应的多个第一视频 数据；Detecting the currently running first application, identifying a first display window displayed by each first application in the display unit and a first position parameter of the first display window, respectively, according to each first position parameter, to the first display window Multi-frame picture to take screenshots, get multiple first videos corresponding to the display interface data;
抓取各个第一应用程序对应的第一音频数据；Grab the first audio data corresponding to each first application;
对多个第一视频数据以及第一音频数据进行匹配处理，得到多对第一视频数据以及第一音频数据。Perform matching processing on the plurality of first video data and the first audio data to obtain a plurality of pairs of first video data and first audio data.
本实施例获取拼接墙运行的多个第一应用程序，以分别获取多个视频数据信息，使上述多个视频数据信息均可以发送至移动智能终端进行相应的播放，可以进一步提高拼接墙与移动智能终端互联的效果。In this embodiment, multiple first application programs running on the splicing wall are obtained to obtain multiple video data information, so that the multiple video data information can be sent to the mobile intelligent terminal for corresponding playback, which can further improve the splicing wall and the mobile The effect of intelligent terminal interconnection.
上述对多个第一视频数据以及第一音频数据进行匹配处理的过程可以包括：The foregoing process of performing matching processing on the plurality of first video data and the first audio data may include:
设置各个第一应用程序对应的设定标识符，根据所述设定标识符匹配同一个第一应用程序对应的第一视频数据以及第一音频数据，从而确定多对视频数据信息。Setting a setting identifier corresponding to each first application, and matching the first video data and the first audio data corresponding to the same first application according to the setting identifier, thereby determining a plurality of pairs of video data information.
在一个实施例中，上述根据所述移动智能终端的底层桌面视频缓存信息获取桌面内容的过程包括：In an embodiment, the foregoing process of acquiring desktop content according to the bottom desktop video cache information of the mobile intelligent terminal includes:
获取移动智能终端的底层桌面视频缓存信息，得到第二视频数据，并抓取移动智能终端当前播放的第二音频数据；Obtaining the underlying desktop video cache information of the mobile intelligent terminal, obtaining the second video data, and capturing the second audio data currently played by the mobile intelligent terminal;
分别对所述第二视频数据和第二音频数据进行压缩，对压缩后的第二视频数据和第二音频数据进行匹配，得到多组第二视频数据和第二音频数据；Separating the second video data and the second audio data respectively, and matching the compressed second video data and the second audio data to obtain a plurality of sets of second video data and second audio data;
分别根据各组第二视频数据和第二音频数据获取多个桌面内容。Acquiring a plurality of desktop contents according to each of the second video data and the second audio data.
本实施例分别对第二视频数据和第二音频数据进行压缩，可以保证传输过程中，包括第二视频数据和第二音频数据的桌面内容的稳定性。In this embodiment, the second video data and the second audio data are respectively compressed to ensure the stability of the desktop content including the second video data and the second audio data during the transmission.
作为一个实施例，若移动智能终端分别对所述第二视频数据和第二音频数据进行压缩，根据压缩后的第二视频数据和第二音频数据生成桌面内容；As an embodiment, if the mobile intelligent terminal separately compresses the second video data and the second audio data, generating desktop content according to the compressed second video data and the second audio data;
则拼接墙控制系统接收并解码所述桌面内容后，需要分别对其中的第二视频数据和第二音频数据进行解压处理；After the splicing wall control system receives and decodes the desktop content, the second video data and the second audio data need to be decompressed separately;
此外，还可以对上述第二视频数据和第二音频数据进行标识符、时间的匹配，比如同一个应用程序对应的第二视频数据和第二音频数据均包括该应用程序对应的设定标识符，根据上述设定标识符匹配该应用程序对应的第二视频数 据和第二音频数据，再根据相同的时间段对上述第二视频数据和第二音频数据进行时间匹配等等，可以保证上述桌面内容在移动智能终端进行播放的效果。In addition, the second video data and the second audio data may be matched by an identifier and a time. For example, the second video data and the second audio data corresponding to the same application respectively include a setting identifier corresponding to the application. Matching the second video number corresponding to the application according to the above setting identifier According to the second audio data, the second video data and the second audio data are time-matched according to the same time period, and the like, and the effect of playing the desktop content on the mobile intelligent terminal can be ensured.
作为一个实施例，获取移动智能终端的底层桌面视频缓存信息，得到第二视频数据，并抓取移动智能终端当前播放的第二音频数据的过程包括：As an embodiment, the process of obtaining the underlying desktop video cache information of the mobile intelligent terminal, obtaining the second video data, and capturing the second audio data currently played by the mobile intelligent terminal includes:
检测移动智能终端当前运行的第二应用程序，识别各个第二应用程序分别在底层桌面对应的视频缓存信息，得到多个第二视频数据；Detecting a second application that is currently running by the mobile intelligent terminal, and identifying video cache information corresponding to each of the second application programs on the bottom desktop, to obtain a plurality of second video data;
抓取各个第二应用程序对应的第二音频数据；Grab the second audio data corresponding to each second application;
对多个第二视频数据以及第二音频数据进行匹配处理，得到多组第二视频数据和第二音频数据。Perform matching processing on the plurality of second video data and the second audio data to obtain a plurality of sets of second video data and second audio data.
本实施例获取智能移动终端的多个第二应用程序，以分别获取多个第二应用程序对应的显示内容(桌面内容)，使上述多个显示内容均可以发送至拼接墙进行相应的显示，可以进一步提高移动智能终端与拼接墙互联的效果。The embodiment obtains a plurality of second application programs of the smart mobile terminal, so as to respectively obtain display content (desktop content) corresponding to the plurality of second application programs, so that the plurality of display contents can be sent to the splicing wall for corresponding display. The effect of interconnecting the mobile intelligent terminal and the splicing wall can be further improved.
上述对多个第二视频数据以及第二音频数据进行匹配处理的过程可以包括：The foregoing process of performing matching processing on the plurality of second video data and the second audio data may include:
设置各个第二应用程序对应的设定标识符，根据第二应用程序对应的设定标识符匹配同一个第二应用程序对应的第二视频数据以及第二音频数据，从而确定多对第二视频数据以及第二音频数据。Setting a setting identifier corresponding to each second application, matching the second video data and the second audio data corresponding to the same second application according to the setting identifier corresponding to the second application, thereby determining a plurality of pairs of second videos Data and second audio data.
在一个实施例中，上述拼接墙控制系统获取拼接墙中各显示单元当前播放的各路视频数据信息，并通过网络发送至服务器的过程后，还可以包括：In an embodiment, the splicing wall control system may further include: after obtaining the video data information that is currently played by each display unit in the splicing wall, and sending the data to the server through the network, the method further includes:
服务器解码所述视频数据信息，并对解码后的视频数据信息进行显示。The server decodes the video data information and displays the decoded video data information.
本实施例中，上述视频数据信息还可以通过服务器进行播放，可以提高相关用户获取上述视频数据信息的便利性。In this embodiment, the video data information can also be played by the server, which can improve the convenience of the related user to obtain the video data information.
为了保证上述视频数据信息的播放效果，服务器在接收并解码上述视频数据信息后，对解码得到的第一视频数据和第一音频数据进行解压、匹配等处理，以保证第一视频数据和第一音频数据的一致性。In order to ensure the playback effect of the video data information, after receiving and decoding the video data information, the server decompresses, matches, and the like the decoded first video data and the first audio data to ensure the first video data and the first Consistency of audio data.
在一个实施例中，上述拼接墙与移动智能终端互联方法还可以包括：In an embodiment, the method for interconnecting the foregoing splicing wall and the mobile intelligent terminal may further include:
服务器获取当前的播放数据，通过编码盒对所述播放数据进行编码，并作为一路视频数据信息发送至拼接墙控制系统，拼接墙控制系统对所述播放数据 进行解码后调度至显示单元上进行显示。The server obtains the current playing data, encodes the playing data through the code box, and sends the data as one channel of video data to the video wall control system, and the video wall control system controls the playing data. After decoding, it is dispatched to the display unit for display.
本实施例可以将服务器播放的播放数据发送至拼接墙进行相应的播放，可以保证上述服务器播放数据的播放效果。In this embodiment, the play data played by the server can be sent to the splicing wall for corresponding play, and the playback effect of the data played by the server can be guaranteed.
作为一个实施例，上述拼接墙与移动智能终端互联方法，还可以包括：As an embodiment, the method for interconnecting the foregoing splicing wall and the mobile intelligent terminal may further include:
服务器通过无线网络将所述播放数据发送至移动智能终端；The server sends the play data to the mobile intelligent terminal through a wireless network;
所述移动智能终端对所述播放数据进行解码并显示。The mobile intelligent terminal decodes and displays the play data.
在一个实施例中，上述服务器获取当前的播放数据的过程包括：In an embodiment, the process of acquiring, by the server, the current playing data includes:
服务器对服务器显示界面的多帧图片进行截图，得到第三视频数据，并抓取当前播放的第三音频数据；The server takes a screenshot of the multi-frame picture of the server display interface, obtains the third video data, and captures the currently played third audio data;
服务器分别对所述第三视频数据和第三音频数据进行压缩，对压缩后的第三视频数据和第三音频数据进行匹配，得到多组第三视频数据和第三音频数据；The server compresses the third video data and the third audio data, and matches the compressed third video data and the third audio data to obtain a plurality of sets of third video data and third audio data;
服务器分别根据各组第三视频数据和第三音频数据生成播放数据。The server generates playback data according to each of the third video data and the third audio data.
作为一个实施例，在获取第三视频数据和第三音频数据后，还可以分别对第三视频数据和第三音频数据进行压缩，可以保证传输过程中，包括第三视频数据和第三音频数据的播放数据的稳定性。As an embodiment, after acquiring the third video data and the third audio data, the third video data and the third audio data may be separately compressed to ensure that the third video data and the third audio data are included in the transmission process. The stability of the playback data.
作为一个实施例，若服务器分别对所述第三视频数据和第三音频数据进行压缩，根据压缩后的第三视频数据和第三音频数据生成播放数据；As an embodiment, if the server separately compresses the third video data and the third audio data, generating playback data according to the compressed third video data and the third audio data;
则拼接墙控制系统接收并解码所述播放数据后，需要分别对其中的第三视频数据和第三音频数据进行解压处理；After the splicing wall control system receives and decodes the play data, the third video data and the third audio data need to be decompressed separately;
此外，还可以对上述第三视频数据和第三音频数据进行标识符、时间的匹配，比如同一个应用程序对应的第三视频数据和第三音频数据均包括该应用程序对应的设定标识符，根据上述设定标识符匹配该应用程序对应的第三视频数据和第三音频数据，再根据相同的时间段对上述第三视频数据和第三音频数据进行时间匹配等等，可以保证上述播放数据在移动智能终端进行播放的效果。In addition, the third video data and the third audio data may be matched with an identifier and a time. For example, the third video data and the third audio data corresponding to the same application respectively include a setting identifier corresponding to the application. And matching the third video data and the third audio data corresponding to the application according to the setting identifier, and performing time matching on the third video data and the third audio data according to the same time period, etc., to ensure the playing. The effect of data playback on a mobile smart terminal.
上述对多个第三视频数据以及第三音频数据进行匹配处理的过程可以包括：The process of performing matching processing on the plurality of third video data and the third audio data may include:
设置各个第三应用程序对应的设定标识符，根据第三应用程序对应的设定标识符匹配同一个第三应用程序对应的第三视频数据以及第三音频数据，从而 确定多对第三视频数据以及第三音频数据。Setting a setting identifier corresponding to each third application, and matching the third video data and the third audio data corresponding to the same third application according to the setting identifier corresponding to the third application, thereby A plurality of pairs of third video data and third audio data are determined.
参考图3所示，图3为一个实施例的拼接墙与移动智能终端互联装置结构示意图，包括设于拼接墙控制系统101的第一获取模块10和第二显示模块60，设于服务器120的第一发送模块20和第二发送模块50，设于移动智能终端130的第一显示模块30和第二获取模块40；Referring to FIG. 3, FIG. 3 is a schematic structural diagram of a device for interconnecting a splicing wall and a mobile intelligent terminal according to an embodiment, including a first acquiring module 10 and a second displaying module 60 disposed on the splicing wall control system 101, and is disposed at the server 120. The first sending module 20 and the second sending module 50 are disposed in the first display module 30 and the second acquiring module 40 of the mobile intelligent terminal 130;
第一获取模块10用于获取拼接墙中各显示单元当前播放的各路视频数据信息，并通过网络发送至服务器；The first obtaining module 10 is configured to obtain video data information of each channel currently played by each display unit in the splicing wall, and send the information to the server through the network;
第一发送模块20用于通过无线网络将接收到的视频数据信息转发至移动智能终端；The first sending module 20 is configured to forward the received video data information to the mobile intelligent terminal by using a wireless network;
第一显示模块30用于所述移动智能终端对所述视频数据信息进行解码并显示；The first display module 30 is configured to decode and display the video data information by the mobile intelligent terminal;
第二获取模块40用于根据其底层桌面视频缓存信息获取桌面内容，并通过无线网络发送至所述服务器；The second obtaining module 40 is configured to obtain desktop content according to the underlying desktop video cache information, and send the content to the server through a wireless network;
第二发送模块50用于通过编码盒对所桌面内容进行编码，并作为一路视频数据信息发送至拼接墙控制系统；The second sending module 50 is configured to encode the desktop content by using the code box, and send the information as one channel of video data to the video wall control system;
第二显示模块60用于对所述桌面内容进行解码后调度至显示单元上进行显示；其中，所述编码盒连接在服务器与拼接墙的控制系统之间，与服务器通过数字信号线相连，与拼接墙控制系统通过网络连接。The second display module 60 is configured to decode the desktop content and then dispatch it to the display unit for display; wherein the code box is connected between the server and the control system of the video wall, and is connected to the server through a digital signal line, and The video wall control system is connected via a network.
本发明提供的拼接墙与移动智能终端互联方法和装置，可以实现拼接墙与不同类型的显示终端(智能移动终端或者服务器等)之间互连互通，从而达到多屏互动的效果。其中涉及到的移动智能终端、服务器、编码盒、拼接墙控制系统以及各信号源可以通过路由器连接在同一个局域网内，移动智能终端通过网络可以查看到服务器发送过来的视频内容，也可将本身的桌面内容发送到服务器显示出来；数字信号连接线一端连接服务器的视频输出口，另一端与编码盒相连，服务器的视频信息可作为一路信号源被拼接墙控制系统获取，同时服务器通过网络与拼接墙控制系统通信，可获取并查看各路视频信号源，从而在服务器与拼接墙控制系统之间形成一个回路。拼接墙控制系统通过控制软件调 度各路信号源投放到显示单元显示。The method and device for interconnecting a splicing wall and a mobile intelligent terminal provided by the invention can realize interconnection and intercommunication between a splicing wall and different types of display terminals (smart mobile terminals or servers, etc.), thereby achieving the effect of multi-screen interaction. The mobile intelligent terminal, the server, the code box, the video wall control system and the signal sources can be connected in the same local area network through a router, and the mobile intelligent terminal can view the video content sent by the server through the network, or can also be itself The desktop content is sent to the server for display; one end of the digital signal connection line is connected to the video output port of the server, and the other end is connected to the code box, and the video information of the server can be obtained as a signal source by the splicing wall control system, and the server is connected through the network and splicing Wall control system communication, which can acquire and view each video signal source, thus forming a loop between the server and the video wall control system. The video wall control system is adjusted by the control software. Each signal source is delivered to the display unit display.
本发明提供的拼接墙与移动智能终端互联装置与本发明提供的拼接墙与移动智能终端互联方法一一对应，在所述拼接墙与移动智能终端互联方法的实施例阐述的技术特征及其有益效果均适用于拼接墙与移动智能终端互联装置的实施例中，特此声明。The splicing wall and the mobile intelligent terminal interconnection device provided by the present invention have a one-to-one correspondence with the splicing wall and the mobile intelligent terminal interconnection method provided by the present invention, and the technical features described in the embodiment of the method for interconnecting the splicing wall and the mobile intelligent terminal are beneficial. The effects are all applicable to the embodiment of the splicing wall and the mobile intelligent terminal interconnection device, and are hereby declared.
以上所述实施例的各技术特征可以进行任意的组合，为使描述简洁，未对上述实施例中的各个技术特征所有可能的组合都进行描述，然而，只要这些技术特征的组合不存在矛盾，都应当认为是本说明书记载的范围。The technical features of the above-described embodiments may be arbitrarily combined. For the sake of brevity of description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be considered as the scope of this manual.
以上所述实施例仅表达了本发明的几种实施方式，其描述较为具体和详细，但并不能因此而理解为对发明专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本发明构思的前提下，还可以做出若干变形和改进，这些都属于本发明的保护范围。因此，本发明专利的保护范围应以所附权利要求为准。 The above-described embodiments are merely illustrative of several embodiments of the present invention, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the invention. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be determined by the appended claims.

Claims (10)

  1. 一种拼接墙与移动智能终端互联方法，其特征在于，包括如下步骤：A method for interconnecting a splicing wall and a mobile intelligent terminal, comprising the steps of:
    拼接墙控制系统获取拼接墙中各显示单元当前播放的各路视频数据信息，并通过网络发送至服务器；The video wall control system acquires video data information of each channel currently played by each display unit in the splicing wall, and sends the information to the server through the network;
    服务器通过无线网络将接收到的视频数据信息转发至移动智能终端；The server forwards the received video data information to the mobile intelligent terminal through the wireless network;
    所述移动智能终端对所述视频数据信息进行解码并显示；The mobile intelligent terminal decodes and displays the video data information;
    移动智能终端根据其底层桌面视频缓存信息获取桌面内容，并通过无线网络发送至所述服务器；The mobile intelligent terminal acquires desktop content according to the underlying desktop video cache information, and sends the content to the server through the wireless network;
    所述服务器通过编码盒对所桌面内容进行编码，并作为一路视频数据信息发送至拼接墙控制系统，拼接墙控制系统对所述桌面内容进行解码后调度至显示单元上进行显示；其中，所述编码盒连接在服务器与拼接墙的控制系统之间，与服务器通过数字信号线相连，与拼接墙控制系统通过网络连接。The server encodes the desktop content through the code box, and sends the information as one channel of video data to the video wall control system, and the video wall control system decodes the desktop content and then dispatches it to the display unit for display; The code box is connected between the server and the control system of the video wall, and is connected to the server through a digital signal line, and is connected to the video wall control system through a network.
  2. 根据权利要求1所述的拼接墙与移动智能终端互联方法，其特征在于，所述获取拼接墙中各显示单元当前播放的各路视频数据信息的过程包括：The splicing wall and the mobile intelligent terminal interconnection method according to claim 1, wherein the process of acquiring the video data information currently played by each display unit in the splicing wall comprises:
    通过拼接墙控制系统对显示单元显示的多帧图片进行截图，得到第一视频数据，并抓取当前播放的第一音频数据；The multi-frame picture displayed by the display unit is screenshotd by the splicing wall control system to obtain the first video data, and the first audio data currently being played is captured;
    分别对所述第一视频数据和第一音频数据进行压缩，对压缩后的第一视频数据和第一音频数据进行匹配，得到多组第一视频数据和第一音频数据；Separating the first video data and the first audio data respectively, and matching the compressed first video data and the first audio data to obtain a plurality of sets of first video data and first audio data;
    分别根据各组第一视频数据和第一音频数据生成视频数据信息。The video data information is generated according to each of the first video data and the first audio data.
  3. 根据权利要求2所述的拼接墙与移动智能终端互联方法，其特征在于，对显示单元显示的多帧图片进行截图，得到第一视频数据，并抓取当前播放的第一音频数据的过程包括：The method for interconnecting a video wall and a mobile intelligent terminal according to claim 2, wherein the process of capturing a plurality of frames of the image displayed by the display unit, obtaining the first video data, and capturing the currently played first audio data includes: :
    检测当前运行的第一应用程序，识别各个第一应用程序在显示单元显示的第一显示窗口以及所述第一显示窗口的第一位置参数，分别根据各个第一位置参数对第一显示窗口的多帧图片进行截图，得到显示界面对应的多个第一视频数据；Detecting the currently running first application, identifying a first display window displayed by each first application in the display unit and a first position parameter of the first display window, respectively, according to each first position parameter, to the first display window Multi-frame picture is taken to obtain a plurality of first video data corresponding to the display interface;
    抓取各个第一应用程序对应的第一音频数据； Grab the first audio data corresponding to each first application;
    对多个第一视频数据以及第一音频数据进行匹配处理，得到多对第一视频数据以及第一音频数据。Perform matching processing on the plurality of first video data and the first audio data to obtain a plurality of pairs of first video data and first audio data.
  4. 根据权利要求1所述的拼接墙与移动智能终端互联方法，其特征在于，所述根据所述移动智能终端的底层桌面视频缓存信息获取桌面内容的过程包括：The method for interconnecting a splicing wall and a mobile intelligent terminal according to claim 1, wherein the process of acquiring desktop content according to the underlying desktop video cache information of the mobile intelligent terminal comprises:
    获取移动智能终端的底层桌面视频缓存信息，得到第二视频数据，并抓取移动智能终端当前播放的第二音频数据；Obtaining the underlying desktop video cache information of the mobile intelligent terminal, obtaining the second video data, and capturing the second audio data currently played by the mobile intelligent terminal;
    分别对所述第二视频数据和第二音频数据进行压缩，对压缩后的第二视频数据和第二音频数据进行匹配，得到多组第二视频数据和第二音频数据；Separating the second video data and the second audio data respectively, and matching the compressed second video data and the second audio data to obtain a plurality of sets of second video data and second audio data;
    分别根据各组第二视频数据和第二音频数据获取多个桌面内容。Acquiring a plurality of desktop contents according to each of the second video data and the second audio data.
  5. 根据权利要求4所述的拼接墙与移动智能终端互联方法，其特征在于，获取移动智能终端的底层桌面视频缓存信息，得到第二视频数据，并抓取移动智能终端当前播放的第二音频数据的过程包括：The method for interconnecting a video wall and a mobile intelligent terminal according to claim 4, wherein the bottom-layer desktop video buffer information of the mobile intelligent terminal is obtained, the second video data is obtained, and the second audio data currently played by the mobile intelligent terminal is captured. The process includes:
    检测移动智能终端当前运行的第二应用程序，识别各个第二应用程序分别在底层桌面对应的视频缓存信息，得到多个第二视频数据；Detecting a second application that is currently running by the mobile intelligent terminal, and identifying video cache information corresponding to each of the second application programs on the bottom desktop, to obtain a plurality of second video data;
    抓取各个第二应用程序对应的第二音频数据；Grab the second audio data corresponding to each second application;
    对多个第二视频数据以及第二音频数据进行匹配处理，得到多组第二视频数据和第二音频数据。Perform matching processing on the plurality of second video data and the second audio data to obtain a plurality of sets of second video data and second audio data.
  6. 根据权利要求1所述的拼接墙与移动智能终端互联方法，其特征在于，所述拼接墙控制系统获取拼接墙中各显示单元当前播放的各路视频数据信息，并通过网络发送至服务器的过程后，还包括：The method for interconnecting a video wall and a mobile intelligent terminal according to claim 1, wherein the video wall control system acquires video data of each channel currently played by each display unit in the video wall, and sends the data to the server through the network. After that, it also includes:
    服务器解码所述视频数据信息，并对解码后的视频数据信息进行显示。The server decodes the video data information and displays the decoded video data information.
  7. 根据权利要求1所述的拼接墙与移动智能终端互联方法，其特征在于，还包括：The method for interconnecting a video wall and a mobile intelligent terminal according to claim 1, further comprising:
    服务器获取当前的播放数据，通过编码盒对所述播放数据进行编码，并作为一路视频数据信息发送至拼接墙控制系统，拼接墙控制系统对所述播放数据进行解码后调度至显示单元上进行显示。The server obtains the current playing data, encodes the playing data through the code box, and sends the data as one channel of video data to the video wall control system, and the video wall control system decodes the playing data and dispatches it to the display unit for display. .
  8. 根据权利要求7所述的拼接墙与移动智能终端互联方法，其特征在于， 还包括：The method for interconnecting a video wall and a mobile intelligent terminal according to claim 7, wherein Also includes:
    服务器通过无线网络将所述播放数据发送至移动智能终端；The server sends the play data to the mobile intelligent terminal through a wireless network;
    所述移动智能终端对所述播放数据进行解码并显示。The mobile intelligent terminal decodes and displays the play data.
  9. 根据权利要求7所述的拼接墙与移动智能终端互联方法，其特征在于，所述服务器获取当前的播放数据的过程包括：The method for interconnecting a video wall and a mobile intelligent terminal according to claim 7, wherein the process of acquiring the current play data by the server includes:
    服务器对服务器显示界面的多帧图片进行截图，得到第三视频数据，并抓取当前播放的第三音频数据；The server takes a screenshot of the multi-frame picture of the server display interface, obtains the third video data, and captures the currently played third audio data;
    服务器分别对所述第三视频数据和第三音频数据进行压缩，对压缩后的第三视频数据和第三音频数据进行匹配，得到多组第三视频数据和第三音频数据；The server compresses the third video data and the third audio data, and matches the compressed third video data and the third audio data to obtain a plurality of sets of third video data and third audio data;
    服务器分别根据各组第三视频数据和第三音频数据生成播放数据。The server generates playback data according to each of the third video data and the third audio data.
  10. 一种拼接墙与移动智能终端互联装置，其特征在于，包括设于拼接墙控制系统的第一获取模块和第二显示模块，设于服务器的第一发送模块和第二发送模块，设于移动智能终端的第一显示模块和第二获取模块；A device for interconnecting a splicing wall and a mobile intelligent terminal, comprising: a first acquiring module and a second display module disposed in the splicing wall control system; the first sending module and the second sending module disposed in the server are disposed on the mobile a first display module and a second acquisition module of the smart terminal;
    第一获取模块用于获取拼接墙中各显示单元当前播放的各路视频数据信息，并通过网络发送至服务器；The first obtaining module is configured to obtain video data information of each channel currently played by each display unit in the splicing wall, and send the information to the server through the network;
    第一发送模块用于通过无线网络将接收到的视频数据信息转发至移动智能终端；The first sending module is configured to forward the received video data information to the mobile intelligent terminal by using a wireless network;
    第一显示模块用于所述移动智能终端对所述视频数据信息进行解码并显示；The first display module is configured to decode and display the video data information by the mobile intelligent terminal;
    第二获取模块用于根据其底层桌面视频缓存信息获取桌面内容，并通过无线网络发送至所述服务器；The second obtaining module is configured to obtain desktop content according to the underlying desktop video cache information, and send the content to the server through a wireless network;
    第二发送模块用于通过编码盒对所桌面内容进行编码，并作为一路视频数据信息发送至拼接墙控制系统；The second sending module is configured to encode the desktop content through the code box, and send the information as one channel of video data to the video wall control system;
    第二显示模块用于对所述桌面内容进行解码后调度至显示单元上进行显示；其中，所述编码盒连接在服务器与拼接墙的控制系统之间，与服务器通过数字信号线相连，与拼接墙控制系统通过网络连接。 The second display module is configured to decode the desktop content and then dispatch it to the display unit for display; wherein the code box is connected between the server and the control system of the video wall, and is connected to the server through a digital signal line, and is spliced The wall control system is connected via a network.
PCT/CN2017/095809 2016-08-03 2017-08-03 Method and apparatus for interconnecting spliced wall and mobile intelligent terminal WO2018024231A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610635422.5A CN106227492B (en) 2016-08-03 2016-08-03 Combination and mobile intelligent terminal interconnected method and device
CN201610635422.5 2016-08-03

Publications (1)

Publication Number Publication Date
WO2018024231A1 true WO2018024231A1 (en) 2018-02-08

Family

ID=57547380

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/095809 WO2018024231A1 (en) 2016-08-03 2017-08-03 Method and apparatus for interconnecting spliced wall and mobile intelligent terminal

Country Status (2)

Country Link
CN (1) CN106227492B (en)
WO (1) WO2018024231A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112306246A (en) * 2020-11-25 2021-02-02 北京恒泰实达科技股份有限公司 Visual echo interaction system and method based on WIFI6 technology
CN114245188A (en) * 2021-12-29 2022-03-25 卡莱特云科技股份有限公司 Automatic cascading method of playing box terminal and LED display screen cascading playing method

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106227492B (en) * 2016-08-03 2019-07-26 广东威创视讯科技股份有限公司 Combination and mobile intelligent terminal interconnected method and device
WO2018216178A1 (en) * 2017-05-25 2018-11-29 三菱電機株式会社 Monitoring system
CN109151556B (en) * 2017-06-16 2021-07-09 腾讯科技（深圳）有限公司 Video playing method and device, smart television and storage medium
CN107343098B (en) * 2017-06-30 2020-08-25 西安万像电子科技有限公司 Display system, method and apparatus, storage medium
CN109656495A (en) * 2017-10-12 2019-04-19 阿里巴巴集团控股有限公司 The display methods and device of Mosaic screen, terminal
CN109656494A (en) * 2017-10-12 2019-04-19 阿里巴巴集团控股有限公司 The management method of content is shown in Mosaic screen
CN107734363A (en) * 2017-10-24 2018-02-23 威创集团股份有限公司 The display methods and system of a kind of vision signal
TWI687915B (en) * 2018-07-06 2020-03-11 友達光電股份有限公司 Dynamic video wall and playing method thereof

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104135686A (en) * 2014-08-14 2014-11-05 广东威创视讯科技股份有限公司 Sharing method of signals of spliced wall and user terminal
CN204375393U (en) * 2014-09-29 2015-06-03 广东威创视讯科技股份有限公司 A kind of wireless LED mosaic screen and system
CN104935996A (en) * 2015-06-09 2015-09-23 深圳康荣电子有限公司 Synchronous display method of spliced wall
US20150301780A1 (en) * 2012-10-23 2015-10-22 Zte Corporation Method, mobile terminal and system for implementing multimedia playing
CN106227492A (en) * 2016-08-03 2016-12-14 广东威创视讯科技股份有限公司 Combination and mobile intelligent terminal interconnected method and device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5917830A (en) * 1996-10-18 1999-06-29 General Instrument Corporation Splicing compressed packetized digital video streams
CN103177032A (en) * 2011-12-23 2013-06-26 李云峰 Method for converting existing multi-media tutorials into e-book multi-media files

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150301780A1 (en) * 2012-10-23 2015-10-22 Zte Corporation Method, mobile terminal and system for implementing multimedia playing
CN104135686A (en) * 2014-08-14 2014-11-05 广东威创视讯科技股份有限公司 Sharing method of signals of spliced wall and user terminal
CN204375393U (en) * 2014-09-29 2015-06-03 广东威创视讯科技股份有限公司 A kind of wireless LED mosaic screen and system
CN104935996A (en) * 2015-06-09 2015-09-23 深圳康荣电子有限公司 Synchronous display method of spliced wall
CN106227492A (en) * 2016-08-03 2016-12-14 广东威创视讯科技股份有限公司 Combination and mobile intelligent terminal interconnected method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112306246A (en) * 2020-11-25 2021-02-02 北京恒泰实达科技股份有限公司 Visual echo interaction system and method based on WIFI6 technology
CN114245188A (en) * 2021-12-29 2022-03-25 卡莱特云科技股份有限公司 Automatic cascading method of playing box terminal and LED display screen cascading playing method
CN114245188B (en) * 2021-12-29 2023-09-15 卡莱特云科技股份有限公司 Automatic cascade method of playing box terminal and cascade playing method of LED display screen

Also Published As

Publication number Publication date
CN106227492A (en) 2016-12-14
CN106227492B (en) 2019-07-26

Similar Documents

Publication Publication Date Title
WO2018024231A1 (en) Method and apparatus for interconnecting spliced wall and mobile intelligent terminal
US8803991B2 (en) Snapshot capture in video stream
WO2016124101A1 (en) Information display method, apparatus and system
CN108293104B (en) Information processing system, wireless terminal, and information processing method
CN107357585B (en) Video acquisition method and device, video equipment and storage medium
JP6455138B2 (en) CONFERENCE SYSTEM AND CONTROL METHOD
TWI520051B (en) Mirror display system and mirror display method
US9013540B2 (en) Method for switching shared content in a video conference and a video conference system
WO2016192431A1 (en) Film source pushing method, set-top box and video server
TW201738770A (en) Cooperative provision of personalized user functions using shared and personal devices
US20240259627A1 (en) Same-screen interaction control method and apparatus, and electronic device and non-transitory storage medium
WO2016119504A1 (en) Method and apparatus for sharing media programme
WO2021093882A1 (en) Video meeting method, meeting terminal, server, and storage medium
CN113467741A (en) Screen transmission method, display device and screen transmission system thereof
KR101943456B1 (en) Transcoding Server and Method for Overlaying Added Information to Dynamic Image in Transcoding Server
CN107872683B (en) Video data processing method, device, equipment and storage medium
US20150189231A1 (en) Video conferencing system
CN113630575B (en) Method, system and storage medium for displaying images of multi-person online video conference
CN106101797A (en) A kind of screen recording method and touch TV
CN107480437B (en) Data transmission method and device
CN113573004A (en) Video conference processing method and device, computer equipment and storage medium
CN106339193B (en) Wireless handheld interaction method and handheld interactive multimedia system
CN110599828A (en) Multi-party video interactive teaching system and method for teaching all-in-one machine
TWI557638B (en) Mirror display system and mirror display method
JP6431301B2 (en) Movie processing apparatus, method, and computer program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17836413

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 17/05/2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17836413

Country of ref document: EP

Kind code of ref document: A1