CN107770564A - The method and device of remote collection audio, video data - Google Patents
The method and device of remote collection audio, video data Download PDFInfo
- Publication number
- CN107770564A CN107770564A CN201610685752.5A CN201610685752A CN107770564A CN 107770564 A CN107770564 A CN 107770564A CN 201610685752 A CN201610685752 A CN 201610685752A CN 107770564 A CN107770564 A CN 107770564A
- Authority
- CN
- China
- Prior art keywords
- video
- audio
- data
- network
- collecting device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/4227—Providing Remote input by a user located remotely from the client device, e.g. at work
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a kind of method of remote collection audio, video data, including：Network connection is established by the network port and remote audio-video collecting device；Virtual local audio/video collecting device, and the data source using the network connection as the virtual local audio/video collecting device are registered in an operating system；The network data being passed to by the network port reception remote audio-video collecting device by the network connection；The network data is passed into the virtual local audio/video collecting device, and exported by the output port of the virtual local audio/video collecting device with stream media format.In addition, the embodiment of the present invention also accordingly discloses a kind of device of remote collection audio, video data.Using the present invention, the operation ease of remote collection audio, video data can be improved.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of method and device of remote collection audio, video data.
Background technology
With the development of stream media technology and internet medium, personal user is supported to issue live webcast website and straight
Broadcast software to arise at the historic moment, personal user is after register account number, it is only necessary to it is (usually used that camera is installed on oneself computer
USB interface) and microphone (usually using COBBAIF), or smart mobile phone (generally with camera and microphone) is used,
Then webcast website is accessed on oneself computer or smart mobile phone or logs in live software, you can easily carries out live, works as master
Broadcast and show self.
However, user, in the webcast website in using conventional art or live software, webcast website or live software lead to
Often video and voice data can only be gathered by the camera and microphone of local, by calling local camera and sound card
Hardware drive program, gather the live video and voice data of typing.And the local camera being used on live computer
Generally connected by USB interface, and the extended line of USB interface is generally shorter, hence in so that using webcast website and live software
User must keep being in shorter distance with live computer, and this allows for live spatial dimension and is restricted, so as to make
Into the deficiency of the convenience of operation.
The content of the invention
Based on this, locally-installed camera can only be used to cause to solve to be used in conventional art live terminal
Live scene be limited, operation ease deficiency technical problem, spy propose a kind of method of remote collection audio, video data.
A kind of method of remote collection audio, video data, including：
Network connection is established by the network port and remote audio-video collecting device；
Virtual local audio/video collecting device is registered in an operating system, and using the network connection as described virtual
The data source of local audio/video collecting device；
The network number being passed to by the network port reception remote audio-video collecting device by the network connection
According to；
The network data is passed into the virtual local audio/video collecting device, and by the virtual local sound/
The output port of video capture device is exported with stream media format.
Optionally, in one of the embodiments, the virtual local audio/video collecting device includes Softcam；
The virtual local audio/video collecting device of registration in an operating system includes：
Softcam equipment is registered in an operating system.
Optionally, in one of the embodiments, the remote audio-video collecting device received is by the net
The form of the incoming network data of network connection is Internet video coded format；
The output port by the virtual local audio/video collecting device is included with stream media format output：
The network data of the Internet video coded format is decoded into by the Softcam equipment described long-range
The stream media format of the original video gathered data of audio-video acquisition equipment.
Optionally, in one of the embodiments, the Internet video stream media format be MPEG, H.264, AVS or
H.265；The stream media format of the original video gathered data is YUV or rgb format.
Optionally, in one of the embodiments, the virtual local audio/video collecting device includes virtual sound card and void
Intend microphone；
The virtual local audio/video collecting device of registration in an operating system includes：
Virtual sound card and virtual microphone are registered in an operating system.
Optionally, in one of the embodiments, the output end by the virtual local audio/video collecting device
Mouth is included with stream media format output：
The network data is decoded into the voice data of the PCM format by the virtual sound card；
By the delivery of audio data of the PCM format for decoding and obtaining to the virtual microphone, pass through the virtual wheat
The output port output of gram wind.
Optionally, in one of the embodiments, the quantity of the network connection is two or more；
It is described the network data is passed into the virtual local audio/video collecting device also to include：
The network connection created is shown, obtains the network connection chosen, by what is be passed to by the network connection chosen
Network data passes to the virtual local audio/video collecting device.
Optionally, in one of the embodiments, the remote audio-video collecting device is the unmanned plane comprising camera,
The network connection is wifi connections.
In addition, locally-installed camera can only be used caused by solve to be used in conventional art live terminal
Live scene is limited, and the technical problem of operation ease deficiency, spy proposes a kind of device of remote collection audio, video data.
A kind of device of remote collection audio, video data, including：
Module is established in network connection, for establishing network connection by the network port and remote audio-video collecting device；
Virtual unit Registering modules, for registering virtual local audio/video collecting device in an operating system, and by described in
Data source of the network connection as the virtual local audio/video collecting device；
Network data receiving module, for receiving the remote audio-video collecting device by described by the network port
The incoming network data of network connection；
Audio, video data output module, set for the network data to be passed into the virtual local audio/video collection
It is standby, and exported by the output port of the virtual local audio/video collecting device with stream media format.
Optionally, in one of the embodiments, the virtual local audio/video collecting device includes Softcam；
The virtual unit Registering modules are additionally operable to register Softcam equipment in an operating system.
Optionally, in one of the embodiments, the remote audio-video collecting device received is by the net
The form of the incoming network data of network connection is Internet video coded format；
The audio, video data output module is additionally operable to encode the Internet video by the Softcam equipment
The network data of form is decoded into the stream media format of the original video gathered data of the remote audio-video collecting device.
Optionally, in one of the embodiments, the Internet video stream media format be MPEG, H.264, AVS or
H.265；The stream media format of the original video gathered data is YUV or rgb format.
Optionally, in one of the embodiments, the virtual local audio/video collecting device includes virtual sound card and void
Intend microphone；
The virtual unit Registering modules are additionally operable to register virtual sound card and virtual microphone in an operating system.
Optionally, in one of the embodiments, the audio, video data output module is additionally operable to by the Virtual Sound
The network data is decoded into the voice data of the PCM format by card；By the voice data of the PCM format for decoding and obtaining
The virtual microphone is passed to, is exported by the output port of the virtual microphone.
Optionally, in one of the embodiments, the quantity of the network connection is two or more；
The audio, video data output module is additionally operable to the network connection that displaying has created, and obtains the network connection chosen,
The network data being passed to by the network connection chosen is passed into the virtual local audio/video collecting device.
Optionally, in one of the embodiments, the remote audio-video collecting device is the unmanned plane comprising camera,
The network connection is wifi connections.
Implement the embodiment of the present invention, will have the advantages that：
After the method and device for employing above-mentioned remote collection audio, video data, live terminal need not be in local access
Camera device, but wireless Wi-Fi connection or internet and long-range unmanned plane, monitoring camera or intelligent hand can be passed through
Machine establishes network connection, then collects what long-range unmanned plane, monitoring camera or smart mobile phone were shot by network connection
Live picture, and by registering Softcam, virtual sound card and virtual microphone, the audio, video data of collection is passed through into simulation
Actual camera device or the corresponding output port of microphone apparatus are passed to live software, and this allows for live terminal and gathered
During live picture, will not be confined to by the camera of traditional USB interface in narrow space, but can use unmanned plane or
Monitoring camera, smart mobile phone collect more abundant live material, so as to improve the convenience of operation.In addition, for
For live software, because data are read by the port of Softcam, virtual sound card and virtual microphone, therefore above-mentioned side
Method and the i.e. achievable adaptation that live software need not be modified, so as to also have preferable suitability.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Wherein：
Fig. 1 is a kind of networking diagram of the system of remote collection audio, video data in one embodiment；
Fig. 2 is a kind of flow chart of the method for remote collection audio, video data in one embodiment；
Fig. 3 is the surface chart for checking Softcam equipment in one embodiment in equipment manager；
Fig. 4 is to select surface chart of the virtual microphone as data source in one embodiment in live software；
Fig. 5 is a kind of schematic diagram of the video acquisition process of live software in one embodiment；
Fig. 6 is a kind of schematic diagram of the audio collection process of live software in one embodiment；
Fig. 7 be one embodiment in a kind of data acquisition of live software to playing process schematic diagram；
Fig. 8 is a kind of structural representation of the device of remote collection audio, video data in one embodiment；
Fig. 9 is that the structure of the computer equipment for the method that foregoing remote collection audio, video data is run in one embodiment is shown
It is intended to.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other under the premise of creative work is not made
Embodiment, belong to the scope of protection of the invention.
For solve conventional art in be used for live terminal can only use locally-installed camera caused by it is live
Scene is limited, and the technical problem of operation ease deficiency, spy proposes a kind of method of remote collection audio, video data.This method
Realization can be dependent on computer program, the computer program can be the driven management program or virtual unit pipe of live software
Manage program.The computer program can run on the computer system based on von Neumann system, and the computer system can be with
It is that there is the terminal devices such as PC, notebook computer, tablet personal computer and the smart mobile phone of network adapter.
As shown in figure 1, in the application scenarios of Fig. 1 displayings, the unmanned plane B of computer A and distal end remains Wi-Fi connection,
Wherein, camera and microphone are installed on unmanned plane B, live software is installed on computer A or is logged in webcast website.At this
In application scenarios, the method that performs foregoing remote collection audio, video data by the computer A for being provided with live APP passes through Wi-Fi
Connection receives the microphone of unmanned plane and the audio, video data of camera collection, then by virtual microphone and Softcam
Port exports, so as to pass to live software.For live software, the data of the port can be used directly, without
Be adapted to, thus need not change third-party live software any program code can automatic adaptation, and unmanned plane B by
In by Wi-Fi and computer A wireless connections, therefore real-time audio, video data can be being gathered apart from computer A remote positions, this
User is allowed in the live software on using computer A, the spatial dimension for gathering audio frequency and video will not be by USB in conventional art
The influence of the connection line length of the camera of interface, and the remote audio-video collecting devices such as unmanned plane can be utilized to be acquired,
So that when using live software, operation ease is more preferable.
Specifically, as shown in Fig. 2 the method for the remote collection audio, video data includes：
Step S102：Network connection is established by the network port and remote audio-video collecting device.
In the present embodiment, remote audio-video collecting device can be the installation such as unmanned plane, monitoring camera, smart mobile phone
There is the RTU of microphone, the first-class audio and video acquisition devices of shooting and network adapter.With reference to shown in figure 1, perform
Network adapter is installed, live terminal passes through network adapter and remote audio-video collecting device in the live terminal of this method
Establish network connection.The Wi-Fi that the network connection can be live terminal with remote audio-video collecting device is directly established is wireless
Connection or live terminal are by netting twine connection route device, via internet or private network and remote audio-video collecting device
(for example, monitoring camera network based on ICP/IP protocol transmission) establishes connection.
Live terminal can by network connection and remote audio-video collecting device based on ICP/IP protocol establish TCP be connected or
UDP connections, for transmitting data.Socket sockets can be used to establish TCP companies with remote audio-video collecting device for live terminal
Connect or UDP connections, operating system can be correspondingly connected distribution port.
Step S104：In an operating system register virtual local audio/video collecting device, and using the network connection as
The data source of the virtual local audio/video collecting device.
Virtual local audio/video collecting device includes virtual local video capture device and virtual local audio collection is set
It is standby.Virtual local video capture device can be Softcam equipment.In an operating system, new entity device insertion terminal
Interface when, can be registered in an operating system according to predefined agreement stack, including device identification and facility information, operating system
In the presence of the driver of the equipment in if, you can realize the read-write to the equipment.And in the present embodiment, it can be simulated by program
The protocol type of camera device registers virtual unit in an operating system, and defines the data that network connection is the virtual unit
Source rather than specific USB line road.With reference to shown in figure 3, if the virtual local video capture device registered as Softcam, and
And the device name registered as " Intergrated Camara ", then it is considerable in the equipment manager of windows operating systems
Observe in registered vision facilities classification and will appear from new equipment " Intergrated Camara ".
Optionally, live terminal can register Softcam equipment in an operating system by DirectShow components.Base
In the development mode of the DirectShow platforms of Microsoft, DirectShow is that the processing of the Streaming Media based on COM that Microsoft releases is opened
Give out a contract for a project, issued together with DirectX kits, need not be related to driver with DirectShow exploitation Softcams writes,
Compact.It can call the corresponding interface function in the kit of the component that registration in an operating system can be achieved virtually to take the photograph
As head, then can using it is foregoing with the socket sockets that unmanned plane, the first-class long-distance video collecting device of monitoring camera are established as
The data source of Softcam.
Optionally, live terminal can register virtual local audio collection in an operating system by avstream drive components
Equipment, and virtual local audio collecting device includes virtual sound card and virtual microphone.Virtual microphone realization principle is to use
The avstream driver frameworks of Microsoft, really realize a virtual microphone and a virtual sound card, virtual sound card data
It is directly communicated to virtual microphone.The internal sound for receiving virtual sound card of driving exports out the virtual microphone to inside.This
Sample client layer only needs the audio for the coding that will be received, and is first decoded into PCM format, is then played using the system audio of standard
API, virtual sound card is played to, so extraneous sound can is output to virtual microphone.
After it have registered Softcam, virtual sound card and virtual microphone, user opens live in live terminal
Software, as shown in Figure 4, you can in the corresponding Softcam equipment of hardware configuration interface configurations or virtual microphone equipment conduct
The camera and microphone of live software, and for live software, it is simultaneously unaware of the camera or microphone as reality
The entity hardware device or virtual unit of insertion, it is only necessary to which data are obtained by corresponding port.This allows for we
The execution of method need not to live software carry out code revision, can be directly adapted to live software, so as to improve autgmentability and
The convenience of operation.
Step S106：The remote audio-video collecting device is received by the network port to be passed to by the network connection
Network data.
Camera device collection far-end field on the unmanned plane, monitoring camera or smart mobile phone of live terminal distal end
The video and audio of scape, are then transferred to live software by network connection, in precedent, can by the TCP connections of foundation or
The socket sockets of UDP connections are by network data transmission to the corresponding network port of live terminal.
Optionally, remote audio-video collecting device is connect with Internet video coded format transmitting network data, i.e., live terminal
The form for the network data that the remote audio-video collecting device received is passed to by the network connection encodes for Internet video
Form.Remote audio-video collecting device is generally for the transmission beneficial to TCP/IP networks, it is necessary to enter to the audio, video data of collection
Row coding, the Internet video coded format of use can be MPEG, H.264, AVS or H.265 in one kind, the network audio of use
Frequency coded format can be ACC forms.
Step S108：Network data is passed into virtual local audio/video collecting device, and passes through virtual local sound/regard
The output port of frequency collecting device is exported with stream media format.
As it was previously stated, after it have registered Softcam, virtual sound card and virtual microphone, live terminal will can connect
The network data received first separates video section and audio-frequency unit, and video section then is passed into Softcam, by audio
Part passes to virtual sound card equipment, then passes through output end by after network data processing by Softcam and virtual sound card
Mouth is exported with stream media format.
In the present embodiment, when registering Softcam, the form conversion side of the data source of definable Softcam
Method, that is, define the method that network data is converted into the stream media format data by output port output by Softcam.Due to
The network data received is network data by Internet video coded format, the corresponding code of definable, when receiving net
During the network data of network video code model, as shown in Figure 5, you can by the Softcam equipment by the Internet video
The network data of coded format is decoded into the stream media format of the original video gathered data of the remote audio-video collecting device,
The stream media format of original video gathered data be YUV (for example, the camera device such as YUV420 forms generally collect it is original
Form) or rgb format.This video for allowing for the output port output of Softcam is the stream medium data of yuv format.
As previously described, because user is the Softcam there is provided camera in live software, therefore can be
Output port corresponding to the Softcam reads to obtain the stream medium data of the yuv format, so as to by live software to it
Handled.For live software, the stream medium data of the yuv format is the data of a camera device collection,
Without being concerned about that the data are gathered from distal end collection or the camera accessed by the USB interface of live terminal local, make
Suitability is obtained to be improved.
And for the network data of audio, then corresponding program code can be added when registering virtual sound card in advance, straight
Broadcast after network data passes to virtual sound card by terminal, corresponding program code is performed, as shown in fig. 6, passing through the Virtual Sound
The network data is decoded into the PCM format by card, and (initial data of microphone collection is usually the coded number of PCM format
According to can carry out ACC codings in network transmission, the original sound that can obtain PCM format can be decoded it in virtual sound card
Frequency evidence) voice data, then again by the obtained delivery of audio data of PCM format that decodes to the virtual Mike
Wind, exported by the output port of the virtual microphone.
As previously described, because user is the virtual microphone there is provided microphone in live software, therefore can be
Output port corresponding to the virtual microphone reads to obtain the stream medium data of the PCM format, so as to by live software to it
Handled.For live software, the stream medium data of the PCM format is that a microphone apparatus for accessing sound card is adopted
The data of collection, without being concerned about that the data are from distal end collection or the Mike accessed by the sound card interface of live terminal local
Elegance collection so that suitability is improved.
After live terminal have read the audio, video data of remote collection by Softcam and virtual microphone, such as scheme
Shown in 7, you can give the server of live platform after encoded by the Internet transmission, the server of live platform is again by the sound
Video data is distributed to multiple live clients, and live client is that unmanned plane can be observed or monitoring camera photographs
Picture.
Further, for same live terminal, also network connection can be established with multiple remote audio-video harvesters, should
Multiple remote audio-video harvesters can gather audio, video data simultaneously and be transferred to live terminal by network connection, and live
Terminal selection can access live software in the audio, video data that the plurality of remote audio-video harvester gathers.
In one embodiment, for each network connection, registrable corresponding virtual local audio/video
Collecting device, i.e. each network connection register a Softcam, a virtual sound card and a virtual microphone, such as
Shown in Fig. 4, user can voluntarily select corresponding Softcam as collection in the video of live software and audio setting
Data source.
And in another embodiment, the administration interface of a virtual unit is may also provide, and in the virtual unit
The network connection created is shown in administration interface, for selection by the user corresponding network connection, when user have selected some net
After network connection, then the network connection chosen is obtained, it is described virtual by being passed to by the incoming network data of the network connection chosen
Local audio/video collecting device.The network connection that will be chosen is as registered Softcam, virtual sound card and virtual wheat
The data source of gram wind.So allow for when remote audio-video collecting device is more, it is only necessary to register Softcam, a void
Onomatopoeia card and virtual microphone, you can the switching of collection picture is realized, so as to save computer resource.
It should be noted that above-mentioned remote collection audio, video data method perform application scenarios can have it is a variety of.
For example, in an application scenarios, remote audio-video collecting device can be unmanned plane, and live terminal can be
Smart mobile phone or portable notebook computer, user can run live software on smart mobile phone, and be surfed the Net by data network
Keep connecting with the server of live platform, and Wi-Fi connection is then used with unmanned plane.User can let unmanned plane fly away and then gather
Live picture is simultaneously transferred to smart mobile phone by Wi-Fi connection, and then smart mobile phone is being put down by data network transmission to live
The server of platform, then be distributed by the server of live platform, then other users can watch unmanned plane shooting in real time
Picture, this can also be used when allowing for user out of doors unmanned plane and smart mobile phone carry out it is live.
In another application scenarios, remote audio-video collecting device can be monitoring camera, and live terminal can be
PC.For example, zoo administration personnel can persistently shoot the garden by erection monitoring camera in some garden at the zoo
Situation, then by laying netting twine by monitoring camera and being located at indoor PC constructing local network, monitoring camera shooting
The ecological video of animal by local network transport give the PC, user runs live software on the PC,
And choose the data source as live software such as Softcam corresponding to the network connection, then live software uploads it in real time
After live platform, other users also can watch the live picture of the zoo garden.
In another application scenarios, remote audio-video collecting device can be smart mobile phone, and live terminal can be
PC positioned at interior, for example, can have multiple user's hand-held intelligent mobile phones to be responsible for location shooting, then passes through data network
The data of location shooting are transferred to the PC of interior by network, and operate the main broadcaster of PC indoors, you can switching is more
The picture of individual responsible location shooting, optionally uploads live platform, and other users watch the main broadcaster it is live when, you can
Switch between the live outdoor scene picture shot in multiple users with mobile phone and browse.
In addition, locally-installed camera can only be used caused by solve to be used in conventional art live terminal
Live scene is limited, the technical problem of operation ease deficiency, in one embodiment, it is also proposed that a kind of remote collection sound regards
The device of frequency evidence, as shown in figure 8, the device of above-mentioned remote collection audio, video data establishes module 102, void including network connection
Intend facility registration module 104, network data receiving module 106 and audio, video data output module 108, wherein：
Module 102 is established in network connection, for establishing network connection by the network port and remote audio-video collecting device；
Virtual unit Registering modules 104, for registering virtual local audio/video collecting device in an operating system, and will
Data source of the network connection as the virtual local audio/video collecting device；
Network data receiving module 106, for by the network port receive the remote audio-video collecting device by
The incoming network data of the network connection；
Audio, video data output module 108, gathered for the network data to be passed into the virtual local audio/video
Equipment, and exported by the output port of the virtual local audio/video collecting device with stream media format.
Optionally, in one embodiment, the virtual local audio/video collecting device includes Softcam；It is described
Virtual unit Registering modules 104 are additionally operable to register Softcam equipment in an operating system.
Optionally, in one embodiment, the remote audio-video collecting device received is connected by the network
The form for connecing incoming network data is Internet video coded format；The audio, video data output module 108 is additionally operable to pass through
The network data of the Internet video coded format is decoded into the remote audio-video collection and set by the Softcam equipment
The stream media format of standby original video gathered data.
Optionally, in one embodiment, the Internet video stream media format be MPEG, H.264, AVS or H.265；
The stream media format of the original video gathered data is YUV or rgb format.
Optionally, in one embodiment, the virtual local audio/video collecting device includes virtual sound card and virtual wheat
Gram wind；The virtual unit Registering modules 104 are additionally operable to register virtual sound card and virtual microphone in an operating system.
Optionally, in one embodiment, the audio, video data output module 108 is additionally operable to by the virtual sound card
The network data is decoded into the voice data of the PCM format；The voice data of the PCM format for decoding and obtaining is passed
The virtual microphone is passed, is exported by the output port of the virtual microphone.
Optionally, in one embodiment, the quantity of the network connection is two or more；The audio frequency and video number
It is additionally operable to show the network connection created according to output module 108, the network connection chosen is obtained, by by the network chosen
The incoming network data of connection passes to the virtual local audio/video collecting device.
Optionally, in one embodiment, the remote audio-video collecting device is the unmanned plane comprising camera, described
Network connection is wifi connections.
After the method and device for employing above-mentioned remote collection audio, video data, live terminal need not be in local access
Camera device, but wireless Wi-Fi connection or internet and long-range unmanned plane, monitoring camera or intelligent hand can be passed through
Machine establishes network connection, then collects what long-range unmanned plane, monitoring camera or smart mobile phone were shot by network connection
Live picture, and by registering Softcam, virtual sound card and virtual microphone, the audio, video data of collection is passed through into simulation
Actual camera device or the corresponding output port of microphone apparatus are passed to live software, and this allows for live terminal and gathered
During live picture, will not be confined to by the camera of traditional USB interface in narrow space, but can use unmanned plane or
Monitoring camera, smart mobile phone collect more abundant live material, so as to improve the convenience of operation.In addition, for
For live software, because data are read by the port of Softcam, virtual sound card and virtual microphone, therefore above-mentioned side
Method and the i.e. achievable adaptation that live software need not be modified, so as to also have preferable suitability.
In one embodiment, as shown in figure 9, Fig. 9 illustrates a kind of side for running above-mentioned remote collection audio, video data
The terminal 10 of the computer system based on von Neumann system of method.The computer system can be smart mobile phone, tablet personal computer,
The terminal devices such as palm PC, notebook computer or PC.Specifically, it may include defeated by the outside of system bus connection
Incoming interface 1001, processor 1002, memory 1003 and output interface 1004.Wherein, outer input interface 1001 optionally may be used
Including at least network interface 10012.Memory 1003 may include external memory 10032 (such as hard disk, CD or floppy disk etc.) and
Built-in storage 10034.Output interface 1004 can comprise at least the equipment such as display screen 10042.
In the present embodiment, the operation of this method is based on computer program, and the program file of the computer program is stored in
In the external memory 10032 of the foregoing computer system 10 based on von Neumann system, built-in storage is operationally loaded into
In 10034, then it is compiled as being transferred in processor 1002 after machine code performing, so that being based on von Neumann system
Computer system 10 in the network connection that is formed in logic establish module 102, virtual unit Registering modules 104, network data
Receiving module 106 and audio, video data output module 108.And in the method implementation procedure of above-mentioned remote collection audio, video data
In, the parameter of input is received by outer input interface 1001, and is transferred in memory 1003 and is cached, and is then input to place
Handled in reason device 1002, the result data of processing or be cached in memory 1003 is subsequently handled, or is passed
Exported to output interface 1004.
Specifically, above-mentioned processor 1002 is additionally operable to perform following steps：
Network connection is established by the network port and remote audio-video collecting device；
Virtual local audio/video collecting device is registered in an operating system, and using the network connection as described virtual
The data source of local audio/video collecting device；
The network number being passed to by the network port reception remote audio-video collecting device by the network connection
According to；
The network data is passed into the virtual local audio/video collecting device, and by the virtual local sound/
The output port of video capture device is exported with stream media format.
Optionally, in one embodiment, processor 1002 is additionally operable to perform：Softcam is registered in an operating system
Equipment.
Optionally, in one embodiment, processor 1002 is additionally operable to perform：By the Softcam equipment by institute
The network data for stating Internet video coded format is decoded into the original video gathered data of the remote audio-video collecting device
Stream media format.
Optionally, in one embodiment, processor 1002 is additionally operable to perform：In an operating system register virtual sound card and
Virtual microphone.
Optionally, in one embodiment, processor 1002 is additionally operable to perform：By the virtual sound card by the network
Data are decoded into the voice data of the PCM format；By the delivery of audio data of the PCM format for decoding and obtaining to the void
Intend microphone, exported by the output port of the virtual microphone.
Optionally, in one embodiment, processor 1002 is additionally operable to perform：The network connection created is shown, is obtained
The network connection chosen, the network data being passed to by the network connection chosen is passed into the virtual local audio/video
Collecting device.
Above disclosure is only preferred embodiment of present invention, can not limit the right model of the present invention with this certainly
Enclose, therefore the equivalent variations made according to the claims in the present invention, still belong to the scope that the present invention is covered.
Claims (16)
- A kind of 1. method of remote collection audio, video data, it is characterised in that including：Network connection is established by the network port and remote audio-video collecting device；Virtual local audio/video collecting device is registered in an operating system, and using the network connection as the virtual local The data source of audio/video collecting device；The network data being passed to by the network port reception remote audio-video collecting device by the network connection；The network data is passed into the virtual local audio/video collecting device, and passes through the virtual local audio/video The output port of collecting device is exported with stream media format.
- 2. the method for remote collection audio, video data according to claim 1, it is characterised in that the virtual local sound/ Video capture device includes Softcam；The virtual local audio/video collecting device of registration in an operating system includes：Softcam equipment is registered in an operating system.
- 3. the method for remote collection audio, video data according to claim 2, it is characterised in that it is described receive it is described The form for the network data that remote audio-video collecting device is passed to by the network connection is Internet video coded format；The output port by the virtual local audio/video collecting device is included with stream media format output：The network data of the Internet video coded format is decoded into the long-range sound by the Softcam equipment to regard The stream media format of the original video gathered data of frequency collecting device.
- 4. the method for remote collection audio, video data according to claim 3, it is characterised in that the network video stream matchmaker Physique formula be MPEG, H.264, AVS or H.265；The stream media format of the original video gathered data is YUV or rgb format.
- 5. the method for remote collection audio, video data according to claim 1, it is characterised in that the virtual local sound/ Video capture device includes virtual sound card and virtual microphone；The virtual local audio/video collecting device of registration in an operating system includes：Virtual sound card and virtual microphone are registered in an operating system.
- 6. the method for remote collection audio, video data according to claim 1, it is characterised in that described by described virtual The output port of local audio/video collecting device is included with stream media format output：The network data is decoded into the voice data of the PCM format by the virtual sound card；By the delivery of audio data of the PCM format for decoding and obtaining to the virtual microphone, pass through the virtual microphone Output port output.
- 7. the method for the remote collection audio, video data according to any one of claim 1 to 6, it is characterised in that the net The quantity of network connection is two or more；It is described the network data is passed into the virtual local audio/video collecting device also to include：The network connection created is shown, obtains the network connection chosen, the network that will be passed to by the network connection chosen Data transfer gives the virtual local audio/video collecting device.
- 8. the method for the remote collection audio, video data according to any one of claim 1 to 6, it is characterised in that described remote Journey audio-video acquisition equipment is the unmanned plane comprising camera, and the network connection is wifi connections.
- A kind of 9. device of remote collection audio, video data, it is characterised in that including：Module is established in network connection, for establishing network connection by the network port and remote audio-video collecting device；Virtual unit Registering modules, for registering virtual local audio/video collecting device in an operating system, and by the network Connect the data source as the virtual local audio/video collecting device；Network data receiving module, for receiving the remote audio-video collecting device by the network by the network port The incoming network data of connection；Audio, video data output module, for the network data to be passed into the virtual local audio/video collecting device, and Exported by the output port of the virtual local audio/video collecting device with stream media format.
- 10. the device of remote collection audio, video data according to claim 9, it is characterised in that the virtual local sound/ Video capture device includes Softcam；The virtual unit Registering modules are additionally operable to register Softcam equipment in an operating system.
- 11. the device of remote collection audio, video data according to claim 10, it is characterised in that the institute received The form for stating the network data that remote audio-video collecting device is passed to by the network connection is Internet video coded format；The audio, video data output module is additionally operable to the Internet video coded format by the Softcam equipment Network data be decoded into the remote audio-video collecting device original video gathered data stream media format.
- 12. the device of remote collection audio, video data according to claim 11, it is characterised in that the network video stream Media formats be MPEG, H.264, AVS or H.265；The stream media format of the original video gathered data is YUV or RGB lattice Formula.
- 13. the device of remote collection audio, video data according to claim 9, it is characterised in that the virtual local sound/ Video capture device includes virtual sound card and virtual microphone；The virtual unit Registering modules are additionally operable to register virtual sound card and virtual microphone in an operating system.
- 14. the device of remote collection audio, video data according to claim 9, it is characterised in that the audio, video data Output module is additionally operable to be decoded into the network data by the virtual sound card voice data of the PCM format；By institute The delivery of audio data for the PCM format that decoding obtains is stated to the virtual microphone, passes through the output end of the virtual microphone Mouth output.
- 15. the device of the remote collection audio, video data according to any one of claim 9 to 14, it is characterised in that described The quantity of network connection is two or more；The audio, video data output module is additionally operable to the network connection that has created of displaying, obtains the network connection chosen, will be by The incoming network data of the network connection chosen passes to the virtual local audio/video collecting device.
- 16. the device of the remote collection audio, video data according to any one of claim 9 to 14, it is characterised in that described Remote audio-video collecting device is the unmanned plane comprising camera, and the network connection is wifi connections.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610685752.5A CN107770564B (en) | 2016-08-18 | 2016-08-18 | Method and device for remotely acquiring audio and video data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610685752.5A CN107770564B (en) | 2016-08-18 | 2016-08-18 | Method and device for remotely acquiring audio and video data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107770564A true CN107770564A (en) | 2018-03-06 |
| CN107770564B CN107770564B (en) | 2021-07-27 |
Family
ID=61262712
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610685752.5A Active CN107770564B (en) | 2016-08-18 | 2016-08-18 | Method and device for remotely acquiring audio and video data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107770564B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109065057A (en) * | 2018-08-29 | 2018-12-21 | 深圳市旭发智能科技有限公司 | Unmanned plane vocal print news method for tracing and system |
| CN112910899A (en) * | 2021-02-02 | 2021-06-04 | 深圳市瑞驰信息技术有限公司 | Audio and video transparent transmission method under android system |
| CN112988249A (en) * | 2021-03-23 | 2021-06-18 | 上海摩勤智能技术有限公司 | Method and device for creating sound card, electronic equipment and storage medium |
| WO2021142998A1 (en) * | 2020-01-19 | 2021-07-22 | 深圳市朗强科技有限公司 | Data sending method and apparatus, data receiving method and apparatus, system, device, and computer storage medium |
| CN113271425A (en) * | 2021-04-19 | 2021-08-17 | 瑞芯微电子股份有限公司 | Interaction system and method based on virtual equipment |
| CN116614650A (en) * | 2023-06-16 | 2023-08-18 | 上海随幻智能科技有限公司 | Voice and picture synchronous private domain live broadcast method, system, equipment, chip and medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101833520A (en) * | 2009-03-11 | 2010-09-15 | 凹凸电子（武汉）有限公司 | Method for simultaneously utilizing one camera by computer system and a plurality of application programs |
| CN101951515A (en) * | 2010-09-21 | 2011-01-19 | 深圳市同洲电子股份有限公司 | Method, system and set-top box for sharing interface of mobile terminal to television |
| CN102143144A (en) * | 2010-10-15 | 2011-08-03 | 华为终端有限公司 | Communication module, remote monitoring system and remote monitoring terminal |
| US20120033743A1 (en) * | 1999-08-31 | 2012-02-09 | At&T Intellectual Property Ii, L.P. | System and method for generating coded video sequences from still media |
| CN102869123A (en) * | 2012-08-02 | 2013-01-09 | Tcl集团股份有限公司 | Virtual peripheral data acquisition method and system applicable to intelligent display equipment |
| CN103327417A (en) * | 2013-07-11 | 2013-09-25 | 亿览在线网络技术（北京）有限公司 | Method and device for directly broadcasting real-time long-distance audio and video frequency |
| CN103686328A (en) * | 2013-12-23 | 2014-03-26 | 乐视致新电子科技（天津）有限公司 | Method and device for adding camera to smart television |
| CN103702175A (en) * | 2013-12-28 | 2014-04-02 | 珠海全志科技股份有限公司 | Multi-screen interactive method and multi-screen interactive device |
| CN104683863A (en) * | 2013-11-28 | 2015-06-03 | 中国移动通信集团公司 | Method and equipment for multimedia data transmission |
| CN105493501A (en) * | 2013-04-30 | 2016-04-13 | 微软技术许可有限责任公司 | Virtual video camera |
-
2016
- 2016-08-18 CN CN201610685752.5A patent/CN107770564B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120033743A1 (en) * | 1999-08-31 | 2012-02-09 | At&T Intellectual Property Ii, L.P. | System and method for generating coded video sequences from still media |
| CN101833520A (en) * | 2009-03-11 | 2010-09-15 | 凹凸电子（武汉）有限公司 | Method for simultaneously utilizing one camera by computer system and a plurality of application programs |
| CN101951515A (en) * | 2010-09-21 | 2011-01-19 | 深圳市同洲电子股份有限公司 | Method, system and set-top box for sharing interface of mobile terminal to television |
| CN102143144A (en) * | 2010-10-15 | 2011-08-03 | 华为终端有限公司 | Communication module, remote monitoring system and remote monitoring terminal |
| CN102869123A (en) * | 2012-08-02 | 2013-01-09 | Tcl集团股份有限公司 | Virtual peripheral data acquisition method and system applicable to intelligent display equipment |
| CN105493501A (en) * | 2013-04-30 | 2016-04-13 | 微软技术许可有限责任公司 | Virtual video camera |
| CN103327417A (en) * | 2013-07-11 | 2013-09-25 | 亿览在线网络技术（北京）有限公司 | Method and device for directly broadcasting real-time long-distance audio and video frequency |
| CN104683863A (en) * | 2013-11-28 | 2015-06-03 | 中国移动通信集团公司 | Method and equipment for multimedia data transmission |
| CN103686328A (en) * | 2013-12-23 | 2014-03-26 | 乐视致新电子科技（天津）有限公司 | Method and device for adding camera to smart television |
| CN103702175A (en) * | 2013-12-28 | 2014-04-02 | 珠海全志科技股份有限公司 | Multi-screen interactive method and multi-screen interactive device |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109065057A (en) * | 2018-08-29 | 2018-12-21 | 深圳市旭发智能科技有限公司 | Unmanned plane vocal print news method for tracing and system |
| CN109065057B (en) * | 2018-08-29 | 2021-05-07 | 何永刚 | Unmanned aerial vehicle voiceprint news tracking method and system |
| WO2021142998A1 (en) * | 2020-01-19 | 2021-07-22 | 深圳市朗强科技有限公司 | Data sending method and apparatus, data receiving method and apparatus, system, device, and computer storage medium |
| CN112910899A (en) * | 2021-02-02 | 2021-06-04 | 深圳市瑞驰信息技术有限公司 | Audio and video transparent transmission method under android system |
| CN112988249A (en) * | 2021-03-23 | 2021-06-18 | 上海摩勤智能技术有限公司 | Method and device for creating sound card, electronic equipment and storage medium |
| CN112988249B (en) * | 2021-03-23 | 2024-05-28 | 上海摩勤智能技术有限公司 | Method and device for creating sound card, electronic equipment and storage medium |
| CN113271425A (en) * | 2021-04-19 | 2021-08-17 | 瑞芯微电子股份有限公司 | Interaction system and method based on virtual equipment |
| CN116614650A (en) * | 2023-06-16 | 2023-08-18 | 上海随幻智能科技有限公司 | Voice and picture synchronous private domain live broadcast method, system, equipment, chip and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107770564B (en) | 2021-07-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107770564A (en) | The method and device of remote collection audio, video data | |
| CN106713852A (en) | Multi-platform wireless vehicle-mounted monitoring system | |
| CN202713458U (en) | Wireless network camera and a mobile terminal for accessing same | |
| CN102984028A (en) | Remote centralized test method for mobile terminals | |
| CN106412681A (en) | Bullet screen video live broadcasting method and device | |
| CN101547342A (en) | System and method for audio-video monitoring based on WLAN | |
| CN104602098A (en) | Video barrage display method and equipment thereof | |
| CN102790764A (en) | Media projection playing method and system | |
| CN104506822B (en) | A kind of remote visible doorbell monitoring method and system based on Android platform | |
| CN101188702B (en) | A weather forecast service system based on TV | |
| CN102291614A (en) | Method, terminal and system for receiving multimedia file played by terminal by using digital television | |
| CN105898620A (en) | Multimedia real-time live broadcast method and device | |
| CN105933738A (en) | Live video streaming method, device and system | |
| CN202444580U (en) | System, terminal and server capable of acquiring television program screenshot | |
| CN104079878A (en) | Mobile audio and video expert system of electric remote operation scene | |
| CN106097225A (en) | Weather information timely dissemination method and system based on mobile terminal | |
| CN106911909A (en) | Video call method and system based on intelligent camera | |
| CN106657866A (en) | Method and device for sharing multimedia data and video conference system | |
| CN101365113B (en) | Portable examination room omni-directional monitoring apparatus | |
| CN101425211A (en) | Monitoring method, system and cam for safety guard of residence zone | |
| CN105847709A (en) | Cloud program directing station and multi-channel video stitching method | |
| CN106664432B (en) | Multimedia information playing method and system, acquisition equipment and standardized server | |
| CN104754261A (en) | Projection equipment and projection method | |
| CN208337763U (en) | A kind of people's air defense mobile commanding system | |
| CN211830976U (en) | Video conference platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |