[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN112770078B - Video conference terminal fusion method and device and readable storage medium - Google Patents

Video conference terminal fusion method and device and readable storage medium Download PDF

Info

Publication number
CN112770078B
CN112770078B CN202110015664.5A CN202110015664A CN112770078B CN 112770078 B CN112770078 B CN 112770078B CN 202110015664 A CN202110015664 A CN 202110015664A CN 112770078 B CN112770078 B CN 112770078B
Authority
CN
China
Prior art keywords
communication device
network
audio
video
video data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110015664.5A
Other languages
Chinese (zh)
Other versions
CN112770078A (en
Inventor
尹许梅
冯强
陈立武
柴亚伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Pengchuang Software Co ltd
Original Assignee
Shenzhen Pengchuang Software Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Pengchuang Software Co ltd filed Critical Shenzhen Pengchuang Software Co ltd
Priority to CN202110015664.5A priority Critical patent/CN112770078B/en
Publication of CN112770078A publication Critical patent/CN112770078A/en
Application granted granted Critical
Publication of CN112770078B publication Critical patent/CN112770078B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/155Conference systems involving storage of or access to video conference sessions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268Signal distribution or switching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention discloses a video conference terminal fusion method, which comprises the following steps: the first communication device receives audio and video data uploaded by a participant under a first network; the second communication device receives the audio and video data uploaded by the participants under the second network; the first communication device establishes connection with the second communication device and mutually transmits audio and video data received by the first communication device. In addition, the invention also discloses a video conference terminal fusion device and a computer readable storage substance, the video conference fusion method provided by the invention realizes effective isolation of two networks accessing to a conference in a double-network port mode, reduces the deployment and operation cost of video conference fusion through combination of software and hardware, and can also support two communication protocol fusion modes of multi-protocol fusion and back-to-back fusion.

Description

Video conference terminal fusion method and device and readable storage medium
Technical Field
The invention relates to the field of intelligent communication of the Internet, in particular to a video conference terminal fusion method, a video conference terminal fusion device and a computer readable storage medium.
Background
In the information age, the demand mode of people's communication is more and more various, and video conference scheme is rising thereupon, and video conference is the higher form of internet communication, is a real-time network, can realize the high-definition audio and video real-time transmission of all meeting participants at present, pushes numerous internet applications to the high-definition video, and video conference terminal can let and meeting people can share needs on meeting room screen to only need touch a key and just can realize the sharing experience of content and intention fast, provide very big facility for people's work and life, also reduced the administrative time and the space cost of enterprise greatly simultaneously. However, the terminal side convergence in the traditional video conference often adopts a large-capacity MCU or a cascade of multiple stages of MCUs, and the technical scheme has higher requirements on network topology or bandwidth because the bandwidth required by each MCU is related to the number of access paths, so that the deployment and operation costs are quite high.
Disclosure of Invention
The invention mainly aims to provide a video conference terminal fusion method, which aims to solve the technical problems of complicated base layer deployment and operation and maintenance and high cost of the traditional video conference.
In order to achieve the above object, the present invention provides a method for fusing video conference terminals, which is characterized in that the method is applied to terminal fusion of video conferences under different networks, and the method comprises the following steps:
the first communication device receives audio and video data uploaded by a participant under a first network;
the second communication device receives the audio and video data uploaded by the participants under the second network;
the first communication device establishes connection with the second communication device and mutually transmits audio and video data received by the first communication device.
Preferably, after the step of establishing connection between the first communication device and the second communication device and transmitting the received audio/video data, the method further includes:
the first communication device sends the received audio and video data transmitted by the second communication device to the video conference as the local audio and video data of the first communication device;
and the second communication device transmits the received audio and video data transmitted by the first communication device to the second network lower meeting participant client as the local audio and video data of the second communication device.
Preferably, the first network is different from the second network, the first network is a public mobile network, and the second network is a private mobile network.
Preferably, the step of receiving, by the first communication device, the audio/video data uploaded by the first network lower participant includes:
a first communication interface of the first communication device accesses the first network;
the first network lower meeting participants initiate connection with the first communication device through the first network by triggering the link of the video meeting issued by the video meeting server;
the first network lower participant client uploads local audio and video data to the first communication device.
Preferably, the step of receiving, by the second communication device, the audio/video data uploaded by the second network lower participant includes:
a first communication interface of the second communication device accesses the second network;
the second network lower meeting participants initiate connection with the second communication device through the second network by triggering the link of the video meeting issued by the video meeting server;
and the second network lower meeting participant client uploads local audio and video data to the second communication device.
Preferably, the step of establishing connection between the first communication device and the second communication device and transmitting the received audio/video data to each other includes:
a second multimedia output interface of the first communication device is connected with the second communication device;
the second multimedia output interface of the second communication device is connected with the first communication device through an interface converter;
the audio output interface of the second communication device is connected with the audio input interface of the first communication device.
Preferably, the method further comprises:
the first multimedia output interface of the first communication device and the first multimedia output interface of the second communication device are respectively connected with a display terminal.
Preferably, the method further comprises:
the first communication device and the second communication device are respectively in communication connection with the conference control terminal, and control over the video conference is realized through cooperation of the conference control terminal.
In addition, to achieve the above object, the present invention further provides a video conference terminal fusion device, which includes:
the first communication device is used for receiving the audio and video data uploaded by the participants under the first network;
the second communication device is used for receiving the audio and video data uploaded by the meeting participants under the second network;
a converter for implementing conversion of a multimedia transmission interface between the second communication device and the first communication device;
the display terminal is used for displaying the audio and video data output by the first communication device and the second communication device; and the session control terminal is used for cooperating the first communication device and the second communication device to control the video conference.
In addition, in order to achieve the above object, the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a videoconference terminal fusion program, and the videoconference terminal fusion program when executed by a processor implements the steps of the videoconference terminal fusion method according to any one of the above.
The embodiment of the invention provides a video conference terminal fusion method, which comprises the following steps: the first communication device receives audio and video data uploaded by a participant under a first network; the second communication device receives the audio and video data uploaded by the participants under the second network; the first communication device establishes connection with the second communication device and mutually transmits audio and video data received by the first communication device. According to the invention, one network port is accessed to the first network, the other network port is accessed to the second network, the effective isolation of the first network and the second network is realized, and the integration of video conferences under different networks is realized through the bridging of the first communication device and the second communication device.
Drawings
FIG. 1 is a terminal of a hardware operating environment according to an embodiment of the present invention;
fig. 2 is a flow chart of an embodiment of a video conference terminal fusion method according to the present invention;
fig. 3 is another flow chart of an embodiment of a video conference terminal fusion method according to the present invention;
FIG. 4 is a detailed flowchart of the step S10 in FIG. 2;
FIG. 5 is a detailed flowchart of the step S20 in FIG. 2;
FIG. 6 is a detailed flowchart of the step S30 in FIG. 2;
fig. 7 is a schematic device structure diagram of the video conference terminal fusion method of the present invention;
the achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, fig. 1 is a schematic diagram of a terminal structure of a hardware running environment according to an embodiment of the present invention.
The terminal of the embodiment of the invention can be a PC, or can be a mobile terminal device with a display function, such as a smart phone, a tablet personal computer, an electronic book reader, an MP3 (Moving Picture Experts Group Audio Layer III, dynamic image expert compression standard audio layer 3) player, an MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image expert compression standard audio layer 3) player, a portable computer and the like.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Optionally, the terminal may also include a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and so on. Among other sensors, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the mobile terminal moves to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and the direction when the mobile terminal is stationary, and the mobile terminal can be used for recognizing the gesture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, and the like, which are not described herein.
It will be appreciated by those skilled in the art that the terminal structure shown in fig. 1 is not limiting of the terminal and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a videoconferencing terminal fusion application may be included in the memory 1005, which is a type of computer storage medium.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a background server and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call a videoconference terminal fusion application stored in the memory 1005, and perform the following operations:
the first communication device receives audio and video data uploaded by a participant under a first network;
the second communication device receives the audio and video data uploaded by the participants under the second network;
the first communication device establishes connection with the second communication device and mutually transmits audio and video data received by the first communication device.
Further, the processor 1001 may call a network operation control application program stored in the memory 1005, and further perform the following operations:
the first communication device sends the received audio and video data transmitted by the second communication device to the video conference as the local audio and video data of the first communication device;
and the second communication device transmits the received audio and video data transmitted by the first communication device to the second network lower meeting participant client as the local audio and video data of the second communication device.
Further, the processor 1001 may call a network operation control application program stored in the memory 1005, and further perform the following operations:
a first communication interface of the first communication device accesses the first network;
the first network lower meeting participants initiate connection with the first communication device through the first network by triggering the link of the video meeting issued by the video meeting server;
the first network lower participant client uploads local audio and video data to the first communication device.
Further, the processor 1001 may call a network operation control application program stored in the memory 1005, and further perform the following operations: a first communication interface of the second communication device accesses the second network;
the second network lower meeting participants initiate connection with the second communication device through the second network by triggering the link of the video meeting issued by the video meeting server;
and the second network lower meeting participant client uploads local audio and video data to the second communication device.
Referring to fig. 2, a first embodiment of a video conference terminal fusion method of the present invention provides a video conference terminal fusion method, which includes:
step S10, a first communication device receives audio and video data uploaded by a first network lower participant;
in this embodiment, the first network is different from the second network, and the first network is a public mobile network, and the second network is a private mobile network. That is, the video conference terminal fusion method provided by the invention can be applied to video conferences of two or different networks accessing the public network. Specifically, a participant in the public mobile network uploads real-time audio and video data of the participant's local terminal to the first communication device according to the video conference link trigger issued by the video conference server.
Step S20, the second communication device receives the audio and video data uploaded by the second network lower meeting participants;
specifically, in this embodiment, taking the second network as a private network in an enterprise as an example, a participant under a private mobile network uploads real-time audio and video data of the participant's own terminal to the second communication device through a video conference link trigger issued by the video conference server.
Step S30, the first communication device establishes a connection with the second communication device and mutually transmits the received audio/video data.
Specifically, in this embodiment, the first communication device and the second communication device are a complete communication device capable of being used independently, and can support access of multiple communication protocols, including multiple multimedia output ports, network ports, MIPI (mobile industry processing interface), audio/video input/output interfaces, and the like. The participants under different networks initiate connection to the corresponding communication devices through the network where the participants are positioned; and a connection is established between the first communication device and the second communication device, and local audio and video data which are received by the first communication device and sent by the participants in the corresponding network environment are mutually transmitted, so that the fusion of the real-time audio and video data sent by the participants in the public network environment and the terminal side of the audio and video data sent by the participants in the private network environment is realized.
Further, since the first communication device and the second communication device are a complete conventional communication terminal, in this embodiment, specifically, for example, the second communication device may be An Zhuoduan based on an android platform, and may support SIP and h.323 protocol access modes, and include two interfaces, namely, HDMI output, a network port, a USB port, a MIPI port, and audio input; the second communication device is a traditional terminal based on embedded DSP hardware, supports an H.323 and SIP protocol access mode, and comprises two paths of HDMI output, one path of audio output, two LAN ports, audio input and other interfaces; the conference control terminal CM800 may provide a touch screen operation interface for the first communication motherboard, where the two are connected through a USB cable, or may control the second communication device through a secondary development interface, where the two verify the IP address and the MAC address of the second communication motherboard through a network cable to perform login connection. Thus, the double-span fusion terminal is built. .
Still further, the video conference terminal fusion method further comprises the following steps:
step S40, the first communication device sends the received audio/video data transmitted by the second communication device to the video conference as the local audio/video data of the first communication device;
and step S50, the second communication device sends the received audio and video data transmitted by the first communication device to the second network lower meeting participant client as the local audio and video data of the second communication device.
It should be noted that, the video conference server may be deployed in public cloud or private cloud, and support different social network applications to share resources of the conference control terminal, when deployed in public cloud mode, may support all social network applications to share conference resources of the video conference in an isolated manner such as account number or conference well, so as to share video conference service, and when deployed in private cloud, support the conference server to be deployed in a local area network using a designated manner, so as to ensure the exclusive sharing and isolation of conference resources. Specifically, in this embodiment, the video conference is disposed under the public cloud, in this embodiment, after both step S10 and step S20 are turned on, the h.323 private network terminal will send its own local audio and video code stream to the double-span fusion terminal, the second communication device inside the fusion terminal formed by connecting the first communication device and the second communication device will transmit the received audio and video code stream to the first communication device through its HDMI-OUT-2 and LINE-OUT interface, and the code stream is sent to the public network conference after the first communication device encodes the input audio and video of the first communication device. On the contrary, after the fusion terminal is connected to the public cloud conference through step S20, the first communication device of the fusion terminal transmits the received audio and video code stream sent by the public network conference to the second communication device as the input audio and video of the second communication device, and after the second communication device module codes, the code stream is sent to the h.323 private network terminal, so that the fusion of the h.323/SIP multiprotocol is realized.
In this embodiment, audio and video data uploaded by a participant under a first network is received through a first communication device; the second communication device receives the audio and video data uploaded by the participants under the second network; the first communication device establishes connection with the second communication device and mutually transmits audio and video data received by the first communication device. Through the arrangement of the double communication devices, the effective isolation of the public mobile network and the private mobile network is realized, and finally, the fusion of conference data input by participants under different environments is realized in the double communication devices. The video conference access problem of the terminal side base layer is solved through the simple deployment of two communication devices.
Further, referring to fig. 4, a second embodiment of a method for fusing video conference terminals according to the present invention provides a specific procedure of step S10 in the first embodiment 1, and based on the embodiment shown in fig. 2, the second embodiment includes:
step S101, a first communication interface of the first communication device accesses the first network;
specifically, according to the first embodiment, the first communication device is a mobile network communication device under public cloud, so the public mobile network accesses the WAN port of the first communication device.
Step S102, the first network lower meeting participants initiate connection with the first communication device through the first network by triggering the link of the video meeting issued by the video meeting server;
specifically, in the present embodiment, the conference participant under the first network, that is, the public mobile network, sends the communication connection signaling to the first communication device through the conference participant client, triggered by the conference link issued by the video conference server.
Step S103, the first network lower participant client uploads local audio/video data to the first communication device.
Specifically, in this embodiment, when the meeting participants under the public mobile network access the video conference through the triggering of the conference link, including through account numbers, conference entrances and the like, local audio and video data of the meeting participants are collected through a camera, a microphone and the like of a terminal (mobile phone, a computer, a tablet and the like) used by the meeting participants, and are uploaded to the first communication device in real time through the public mobile network.
Further, referring to fig. 5, a second embodiment of a method for fusing video conference terminals according to the present invention provides a specific procedure of step S20 in the first embodiment 1, and based on the embodiment shown in fig. 2, the second embodiment includes:
step S201, a first communication interface of the second communication device accesses the second network;
specifically, in the present embodiment, as is clear from the first embodiment, the second communication device is a communication terminal of a private mobile network, and therefore, the LAN port of the second communication device accesses the private mobile communication network.
Step S202, the second network lower meeting participants initiate connection with the second communication device through the second network by triggering the link of the video meeting issued by the video meeting server;
specifically, a participant under the private mobile network initiates communication connection signaling to the second communication device under the private mobile network through the video conference client by triggering a video conference link issued by the video conference server.
In step S203, the second network lower participant client uploads the local audio/video data to the second communication device.
Specifically, in this embodiment, when the meeting participants under the private mobile network access the video conference through the triggering of the conference link, including through account numbers, conference entrances, etc., local audio and video data of the meeting participants are collected through modules of a camera, a microphone, etc. of a terminal (mobile phone, a computer, a tablet, etc.) used by the meeting participants, and are uploaded to the second communication device in real time through the public mobile network.
In this embodiment, a first communication interface of the first communication device accesses the first network; the first network lower meeting participants initiate connection with the first communication device through the first network by triggering the link of the video meeting issued by the video meeting server; the first network lower participant client uploads local audio and video data to the first communication device. A first communication interface of the second communication device accesses the second network; the second network lower meeting participants initiate connection with the second communication device through the second network by triggering the link of the video meeting issued by the video meeting server; and the second network lower meeting participant client uploads local audio and video data to the second communication device. The devices for accessing the video conference by the public mobile network participants and the private mobile network participants are independent of each other, so that the complete isolation of the public network and the private network is ensured.
Referring to fig. 6 to 7, fig. 6 is a detailed flowchart of step S30 in the above embodiment 1, fig. 7 is a schematic diagram of an apparatus of a third embodiment of the video conference terminal fusion method, and based on fig. 6 to 7, it can be known that the connection established in step S30 in the above embodiment 1 includes:
step S301, a second multimedia output interface of the first communication device 10 is connected to the second communication device 20;
specifically, IN the present embodiment, the second multimedia output interface HDMI-OUT-2 of the first communication apparatus 10 is connected to the first multimedia input interface HDMI-IN-1 of the second communication apparatus, first inside the videoconferencing integration terminal.
Step S302, a second multimedia output interface of the second communication device 20 is connected to the first communication device 10 through an interface converter;
specifically, in the present embodiment, the second multimedia output interface HDMI-OUT-2 of the second communication device 20 is connected to the interface converter MIPI panel and then to the Mobile Industry Processor Interface (MIPI) of the first communication device 10.
In step S303, the audio output interface of the second communication device 20 is connected to the audio input interface of the first communication device 10.
Specifically, in the present embodiment, audio input and output: the external interfaces are all removed, and only one audio output interface LINE-OUT of the second communication device 20 is reserved and connected to the audio input interface LINE-IN of the first communication device 10, so as to send the audio uploaded by the received participants of the second communication device 20 under the private cloud network to the first communication device 10 (because HDMI to MIPI does not contain audio).
Preferably, the video conference terminal fusion method further comprises the following steps:
the first multimedia output interface of the first communication device 10 and the first multimedia output interface of the second communication device 20 are connected to a display terminal 50, respectively.
Specifically, in this embodiment, the public-private network dual-span terminal formed by bridging the first communication device 10 and the second communication device 20 only retains 2 multimedia interface HDMI video outputs to users in different network environments, one is HDMI-OUT-1 of the second communication device 20, and the other is HDMI-OUT-1 of the first communication device 10, where both video outputs include audio output.
Preferably, the video conference terminal fusion method further comprises the following steps: the first communication device 10 and the second communication device 20 are respectively connected with a conference control terminal 30 in a communication manner, and control of the video conference is realized through cooperation of the conference control terminal 30.
Specifically, in this embodiment, the first communication device 10 and the second communication device 20 are bridged to form a dual-span terminal, the convergence control terminal 30 may provide a touch screen operation interface for the first communication device 10 board, and the two may be connected through a USB cable, or may control the second communication device 20 through a secondary development interface, and the two may be logged in and connected through network verification of the IP address and the MAC address of the second communication device 20. The conference control terminal 30 can be placed on a conference table to meet the requirements of pickup, playback and control of multiple people around the conference table. In addition, in this embodiment, the conference control terminal 30 may control, according to the requirement of the actual conference, the conference management server of the conference control terminal to stop or receive the audio and video data sent by the designated participant according to the operation signaling sent by the conference host under the condition that the conference member accesses the video conference, and perform conference functions such as forbidden speaking, screen sharing, conference locking, conference recording, member speaking, etc. on the designated participant.
Further, the controllable terminal 30 may be a tablet or other terminal device, which is not limited herein, the controllable terminal 30 may perform conventional control of the video conference on the video conference, and the controllable terminal 30 may even automatically convert the controllable instruction of the private cloud into the operation corresponding to the public cloud. The conference control terminal is connected with the first communication device 10 through a USB and performs on-screen control on the first communication device; meanwhile, the intelligent screen recognition application vTouch can be used to control the second communication device 20 through the network cable connection, and the conference control terminal 30 can also control the second communication device 20 through the PC control console. In this embodiment, the conference control terminal 30 adopts an Android system, has a 10.1 inch multi-touch screen, and is connected with a computer, a video conference terminal (such as a first communication device) or a mobile phone through interfaces of Type-C, bluetooth, 3.5mm and the like, so that an EasyControl on-screen control application can be operated and controlled on the first communication device 10, and a Vtouch smart screen recognition application can be operated to control the second communication device 20.
In this embodiment 3, the second communication device is connected through a second multimedia output interface of the first communication device; the second multimedia output interface of the second communication device is connected with the first communication device through an interface converter; the audio output interface of the second communication device is connected with the audio input interface of the first communication device. And the first communication device and the second communication device are respectively in communication connection with the conference control terminal, and control over the video conference is realized through cooperation of the conference control terminal. Therefore, the public and private cloud double-span fusion terminal fused in the bridging mode can support multi-protocol fusion and back-to-back fusion, so that the access problem of the video conference of the base layer is solved, and the deployment and operation cost of the base layer is reduced.
In addition, the invention also provides a video conference terminal fusion device which is used for realizing the fusion of the video conference terminal sides.
Referring to fig. 7, the video conference terminal fusion device provided by the present invention includes:
a first communication device 10, configured to receive audio/video data uploaded by a participant under a first network;
a second communication device 20, configured to receive audio/video data uploaded by a participant under a second network;
a converter 40 for implementing conversion of a multimedia transmission interface between the second communication device 20 and the first communication device 10;
a display terminal 50 for displaying audio/video data output from the first communication device 10 and the second communication device 20; and a session control terminal 30, configured to cooperate with the first communication device 10 and the second communication device 20 to control the video conference.
Specifically, referring to fig. 7, in the present embodiment, a public mobile network lower participant accesses a video conference through a SIP protocol, and a private mobile network lower participant accesses a video conference through an h.323 communication protocol as an example. The method comprises the following steps that a LAN-1 port (IP is 192.168.1.2) corresponding to a public-private network double-span terminal communicates with an H.323 private network terminal (IP is 192.168.1.3) through an H.323 protocol call; a WAN port (IP is 117.116.13.9) corresponding to the public and private network double-span convergence terminal is accessed into a public network conference room through an internet access by an SIP protocol; the h.323 private network terminal will send the own local audio and video code stream to the double-span convergence terminal, and the second communication device 20 in the convergence terminal will transmit the received audio and video code stream to the first communication device 10 via its own HDMI-OUT-2 and LINE-OUT interfaces, and the code stream will be sent to the public network conference after the first communication device 10 encodes the input audio and video signals of the first communication device 10. On the contrary, after the convergence terminal accesses the public cloud conference through the SIP protocol, the first communication device 10 of the convergence terminal transmits the received audio and video code stream sent by the public network conference to the second communication device 20 as the input audio and video of the second communication device 20, and after the second communication device 20 encodes, the code stream is sent to the h.323 private network terminal, so that the convergence of the h.323/SIP multiprotocol is realized.
In addition, the embodiment of the invention also provides a computer readable storage medium, wherein the computer readable storage medium stores a video conference terminal fusion program, and the video conference terminal fusion program realizes the steps of the video conference terminal fusion method according to any one of the embodiments when being executed by a processor.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.

Claims (7)

1. The method is applied to terminal fusion of video conferences under different networks, and comprises the following steps:
the first communication device receives audio and video data uploaded by a participant under a first network;
the second communication device receives audio and video data uploaded by participants under a second network, wherein the first network is different from the second network, the first network is a public mobile network, and the second network is a private mobile network;
the first communication device establishes connection with the second communication device and mutually transmits audio and video data received by the first communication device;
the first communication device sends the received audio and video data transmitted by the second communication device to the video conference as the local audio and video data of the first communication device;
the second communication device sends the received audio and video data transmitted by the first communication device to the second network lower meeting participant client as the local audio and video data of the second communication device;
the first communication device and the second communication device are respectively in communication connection with the conference control terminal, and control of the video conference is achieved through cooperation of the conference control terminal, wherein the conference control terminal can automatically convert a conference control instruction of the private cloud into operation corresponding to the public cloud.
2. The videoconference terminal integration method of claim 1, wherein the step of the first communication device receiving the audio and video data uploaded by the first network lower participant comprises:
a first communication interface of the first communication device accesses the first network;
the first network lower meeting participants initiate connection with the first communication device through the first network by triggering the link of the video meeting issued by the video meeting server;
the first network lower participant client uploads local audio and video data to the first communication device.
3. The method according to claim 1, wherein the step of receiving, by the second communication device, the audio/video data uploaded by the second network lower participant comprises:
a first communication interface of the second communication device accesses the second network;
the second network lower meeting participants initiate connection with the second communication device through the second network by triggering the link of the video meeting issued by the video meeting server;
and the second network lower meeting participant client uploads local audio and video data to the second communication device.
4. The video conference terminal fusion method according to claim 1, wherein the step of the first communication device establishing a connection with the second communication device and transmitting the audio/video data received by itself to each other comprises:
a second multimedia output interface of the first communication device is connected with the second communication device;
the second multimedia output interface of the second communication device is connected with the first communication device through an interface converter;
the audio output interface of the second communication device is connected with the audio input interface of the first communication device.
5. The video conference terminal convergence method according to claim 1, further comprising:
the first multimedia output interface of the first communication device and the first multimedia output interface of the second communication device are respectively connected with a display terminal.
6. A video conference terminal convergence device, the device comprising:
the first communication device is used for receiving the audio and video data uploaded by the participants under the first network;
the second communication device is used for receiving the audio and video data uploaded by the meeting participants under the second network; wherein the first network is different from the second network, the first network is a public mobile network, and the second network is a private mobile network;
a converter for implementing conversion of a multimedia transmission interface between the second communication device and the first communication device; specifically, the first communication device sends the received audio and video data transmitted by the second communication device to the video conference as the local audio and video data of the first communication device; the second communication device sends the received audio and video data transmitted by the first communication device to the second network lower meeting participant client as the local audio and video data of the second communication device;
the display terminal is used for displaying the audio and video data output by the first communication device and the second communication device;
the conference control terminal is used for cooperating the first communication device and the second communication device to control the video conference; specifically, the first communication device and the second communication device are respectively in communication connection with the controllable terminal, and control of the video conference is achieved through cooperation of the controllable terminal, wherein the controllable terminal can automatically convert a controllable instruction of the private cloud into operation corresponding to the public cloud.
7. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a video conference terminal convergence program, which when executed by a processor, implements the steps of the video conference terminal convergence method according to any one of claims 1-5.
CN202110015664.5A 2021-01-06 2021-01-06 Video conference terminal fusion method and device and readable storage medium Active CN112770078B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110015664.5A CN112770078B (en) 2021-01-06 2021-01-06 Video conference terminal fusion method and device and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110015664.5A CN112770078B (en) 2021-01-06 2021-01-06 Video conference terminal fusion method and device and readable storage medium

Publications (2)

Publication Number Publication Date
CN112770078A CN112770078A (en) 2021-05-07
CN112770078B true CN112770078B (en) 2023-06-13

Family

ID=75700360

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110015664.5A Active CN112770078B (en) 2021-01-06 2021-01-06 Video conference terminal fusion method and device and readable storage medium

Country Status (1)

Country Link
CN (1) CN112770078B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113784083B (en) * 2021-07-21 2024-05-28 上海创视通软件技术有限公司 Video conference connection method, device and storage medium
CN113709405A (en) * 2021-10-27 2021-11-26 深圳市鹏创软件有限公司 Video conference fusion method, system, bridge terminal and readable storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2813473B1 (en) * 2000-08-24 2003-08-15 Cit Alcatel SERVER USING WAP WIRELESS APPLICATION PROTOCOL
US20070285504A1 (en) * 2002-02-15 2007-12-13 Hesse Thomas H Systems and methods for conferencing among governed and external participants
CN101335869B (en) * 2008-03-26 2011-11-09 北京航空航天大学 Video conference system based on Soft-MCU
CN111093048B (en) * 2019-12-31 2021-07-20 江苏大恒创科技术有限公司 Novel multimedia video conference system and implementation method
CN112073674A (en) * 2020-08-07 2020-12-11 广东迷听科技有限公司 Conference terminal, remote video conference system, method and storage medium

Also Published As

Publication number Publication date
CN112770078A (en) 2021-05-07

Similar Documents

Publication Publication Date Title
US11477316B2 (en) Information processing system, wireless terminal, and information processing method
US9319229B2 (en) Transmission terminal and method of transmitting display data
WO2017097088A1 (en) Multi-screen projection control method and system, terminal device, and computer storage medium
WO2022242597A1 (en) Processing method, processing device, and storage medium
CN112988102A (en) Screen projection method and device
CN111885252B (en) Mobile phone expansion use method
CN115396521A (en) Method, device and system for switching communication protocol
US20180014063A1 (en) Method and Apparatus for Accessing a Terminal Device Camera to a Target Device
CN111092898B (en) Message transmission method and related equipment
WO2020248627A1 (en) Video call method and display device
CN112770078B (en) Video conference terminal fusion method and device and readable storage medium
WO2019200928A1 (en) Intelligent interactive all-in-one machine
US20160262206A1 (en) Communication system, communication method, relay device, and computer program product
CN109753259B (en) Screen projection system and control method
KR20180035312A (en) Video call device and method using webrtc
US20140362166A1 (en) Incoming call display method, electronic device, and incoming call display system
CN110708494A (en) Video conference display control method, terminal and readable storage medium
US11656834B2 (en) Information processing device, non-transitory recording medium, and information processing system
CN113709405A (en) Video conference fusion method, system, bridge terminal and readable storage medium
TW202218404A (en) An audio-visual content sharing system and method thereof
KR20220114326A (en) Electronic device for transmitting and receiving media stream and method for thereof
CN112104649A (en) Multimedia interaction method and device, electronic equipment, server and storage medium
WO2024139400A1 (en) Method for enabling whiteboard drawing, and related apparatus
WO2024001776A1 (en) Device control method, virtual set top box, physical set top box, and system
WO2023045966A1 (en) Capability sharing method, electronic devices and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant