CN109218794A - Remote job guidance method and system - Google Patents
Remote job guidance method and system Download PDFInfo
- Publication number
- CN109218794A CN109218794A CN201710523982.6A CN201710523982A CN109218794A CN 109218794 A CN109218794 A CN 109218794A CN 201710523982 A CN201710523982 A CN 201710523982A CN 109218794 A CN109218794 A CN 109218794A
- Authority
- CN
- China
- Prior art keywords
- video
- frame
- audio
- augmented reality
- markup information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000003190 augmentative effect Effects 0.000 claims abstract description 135
- 230000001360 synchronised effect Effects 0.000 claims abstract description 86
- 238000012545 processing Methods 0.000 claims description 26
- 238000004891 communication Methods 0.000 claims description 12
- 239000000284 extract Substances 0.000 claims description 11
- 238000011946 reduction process Methods 0.000 claims description 7
- 230000002708 enhancing effect Effects 0.000 claims description 5
- 238000005457 optimization Methods 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 description 13
- 238000004590 computer program Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 10
- 238000012423 maintenance Methods 0.000 description 6
- 238000003860 storage Methods 0.000 description 6
- 238000009434 installation Methods 0.000 description 4
- 230000003139 buffering effect Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000011664 signaling Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000009172 bursting Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000012966 insertion method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004080 punching Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/764—Media network packet handling at the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明提供了一种远程作业指导方法及系统，包括：智能终端在采集的音频、视频和增强现实标注信息上添加第一相对时间戳使三者同步，同步后发送给WEB终端；智能终端获取WEB端返回的添加有第二相对时间戳的视频和远程协助信息；智能终端根据第一相对时间戳对音频、视频和增强现实标注信息进行同步回放，同时根据第二相对时间戳对视频和远程协助信息进行同步回放；智能终端以视频为主流，显示同步回放后的视频、音频、增强现实标注信息和远程协助信息。本发明提供的技术方案使用相对时间戳同步法实现了音频、视频和增强现实标注信息三者的同步，采用同步回放实现视频、音频、增强现实标注信息和远程协助信息的同步显示，实现精准化远程指导。
The invention provides a remote operation guidance method and system, comprising: adding a first relative timestamp to the collected audio, video and augmented reality annotation information by an intelligent terminal to synchronize the three, and sending the synchronization to a WEB terminal; The video and remote assistance information returned by the WEB end with the second relative timestamp added; the intelligent terminal synchronously plays back the audio, video and augmented reality annotation information according to the first relative timestamp, Assist information to be played back synchronously; the smart terminal uses video as the mainstream, and displays video, audio, augmented reality annotation information and remote assistance information after synchronous playback. The technical solution provided by the present invention uses the relative timestamp synchronization method to realize the synchronization of audio, video and augmented reality annotation information, and adopts synchronous playback to realize the synchronous display of video, audio, augmented reality annotation information and remote assistance information, and realizes precision Remote instruction.
Description
Technical field
The invention belongs to information technology multimedia application fields, and in particular to remote job guidance method and system.
Background technique
It goes into operation as company's power grid scale is growing with novel device, grid equipment installation, operation, maintenance face data
Many and diverse, the problems such as step is complicated, equipment dismounting precision is high and proficiency is different.Traditional electric network operation mode (capital construction
Maintenance, distribution repairing are maked an inspection tour in installation) using specific plans are formulated before operation, it is executed in implementation procedure in strict accordance with plan, due to
The case where power grid field operation faces is extremely complex, and operating personnel encounters bursting problem processing capacity deficiency, executes the activity duration
It is longer, need on-site personnel level professional technology with higher.
As wearable and augmented reality develops, electric network operation personnel will carry out letter using intelligent terminal mode is worn
Breath acquisition, transmission, processing are subjected to technical specialist's remote assistance encountering knotty problem.And simple pass through video and sound
It can not allow each participant that can clearly realize relevant Job Operations, therefore a kind of grid maintenance working scene remote assistance
Guidance method and system provide intuitive and convenient task instruction and Collaboration support for power grid on-site personnel, improve power grid and set
Standby capital construction installation, tour maintenance, the working efficiency of distribution repairing and safety work are horizontal.
Summary of the invention
In order to meet the needs of grid maintenance field operation, the present invention provides a kind of remote job guidance method and it is
System realizes precision remote guide by way of video, sound, Remote mark.
To achieve the goals above, it adopts the following technical scheme that
The present invention provides a kind of remote job guidance method, comprising:
Intelligent terminal adds the first relative time stamp on the audio of acquisition, video and augmented reality markup information makes three
It is synchronous, and audio, video and the augmented reality markup information after synchronizing are provided to WEB terminal；
Intelligent terminal obtains the video and remote assistance information added with the second relative time stamp that WEB terminal returns；
Intelligent terminal synchronizes playback to audio, video and augmented reality markup information according to the first relative time stamp,
Playback is synchronized to video and remote assistance information according to the second relative time stamp simultaneously；
Intelligent terminal is using video as mainstream, video, audio, augmented reality markup information after showing synchronized playback and long-range
Assistance information.
The intelligent terminal provides audio, video and augmented reality markup information after synchronizing to WEB terminal, comprising:
The intelligent terminal passes through respectively after the audio after synchronizing, video and augmented reality markup information are carried out compressed encoding
Video service is simultaneously or sequentially sent to the sequence of video bag, audio pack, augmented reality markup information packet from independent channel
WEB terminal is sent to by video server again after device.
The remote assistance information includes: remote assistance audio and remote assistance markup information.
It is described that playback is synchronized to audio, video and augmented reality markup information according to the first relative time stamp, comprising:
Extract audio frame, video frame and augmented reality markup information frame simultaneously and be compared, the audio frame, video frame and
Augmented reality markup information frame is equipped with the first relative time stamp, if video frame is normal, and audio frame and augmented reality markup information
Frame lags, then abandons the audio frame and augmented reality markup information frame, if audio/video frames are synchronous, augmented reality markup information frame
Lag, then abandon the augmented reality markup information frame, if video frame lags, just slows down or accelerate video for audio broadcasting speed
Playback rate.
It is described that playback is synchronized to video and remote assistance information according to the second relative time stamp, comprising:
It extracts video frame, remote assistance audio frame and remote assistance markup information frame simultaneously to be compared, if video frame is just
Often, and remote assistance audio frame and remote assistance markup information frame lag, then abandon the remote assistance audio frame and long-range association
Markup information frame is helped, if remote assistance audio frame and video frame synchronization, it is long-range then to abandon this for remote assistance markup information frame lag
Markup information frame is assisted, if video frame lags, just remote assistance audio broadcasting speed is slowed down or accelerated the playback rate of video.
The present invention provides a kind of intelligent terminal, comprising:
First acquisition module, for acquiring video, audio and augmented reality markup information；
First synchronization module is carried out for adding the first relative time stamp to video, audio and augmented reality markup information
It is synchronous；
First communication module, for obtaining the video stabbed added with the second relative time and remote assistance information from WEB terminal；
First synchronized playback module, for being stabbed according to the first relative time to video, audio and augmented reality markup information
Synchronize playback；And playback is synchronized to video, remote assistance information according to the second relative time stamp；
First display module, for the video, audio, augmented reality mark using video as mainstream, after showing synchronized playback
Information and remote assistance information.
The remote assistance information that first communication module is obtained from WEB terminal includes remote assistance audio and remote assistance mark
Infuse information.
The first synchronized playback module includes:
First comparing unit, for being stabbed according to the first relative time while extracting audio frame, video frame and augmented reality mark
Note information frame is compared, and the audio frame, video frame and augmented reality markup information frame are equipped with the first relative time stamp；
First processing units, if normal for video frame, and audio frame and augmented reality markup information frame lag, then lose
The audio frame and augmented reality markup information frame are abandoned, if audio/video frames are synchronous, augmented reality markup information frame lag, then abandoning should
Audio broadcasting speed is just slowed down or is accelerated the playback rate of video if video frame lags by augmented reality markup information frame.
The first synchronized playback module includes:
Second comparing unit, for according to the second relative time stab simultaneously extract video frame, remote assistance audio frame and far
Journey assists markup information frame to be compared；
The second processing unit, if normal for video frame, and remote assistance audio frame and remote assistance markup information frame are equal
Lag, then abandon the remote assistance audio frame and remote assistance markup information frame, if remote assistance audio frame and video frame synchronization,
Remote assistance markup information frame lag, then abandon the remote assistance markup information frame, if video frame lags, just by remote assistance sound
Frequency broadcasting speed slows down or accelerates the playback rate of video.
The present invention provides a kind of remote job guidance method characterized by comprising
WEB terminal obtains audio, video and the augmented reality markup information stabbed added with the first relative time from intelligent terminal,
And playback is synchronized to audio, video and augmented reality markup information according to the first relative time stamp and is shown；
WEB terminal obtains remote assistance information, and the second relative time stamp is added in the remote assistance information and video
It synchronizes；
WEB terminal provides the video stabbed added with the second relative time and remote assistance information after synchronizing to intelligent terminal.
The WEB terminal to after synchronizing remote assistance information and video be sent to intelligent terminal and include:
The WEB terminal to after synchronizing remote assistance information and video carry out compressed encoding after by video server transmission
To intelligent terminal.
It is described that playback is synchronized to audio, video and augmented reality markup information according to the first relative time stamp, comprising:
Extract audio frame, video frame and augmented reality markup information frame simultaneously and be compared, the audio frame, video frame and
Augmented reality markup information frame is equipped with the first relative time stamp, if video frame is normal, and audio frame and augmented reality markup information
Frame lags, then abandons the audio frame and augmented reality markup information frame, if audio/video frames are synchronous, augmented reality markup information frame
Lag, then abandon the augmented reality markup information frame, if video frame lags, just slows down or accelerate video for audio broadcasting speed
Playback rate.
The present invention provides a kind of WEB terminal, comprising:
Second acquisition module, for obtaining remote assistance information；
Second synchronized playback module, for being stabbed according to the first relative time to video, audio and augmented reality markup information
Synchronize playback；
Second display module, for showing video, audio and augmented reality markup information after synchronized playback；
Second synchronization module is synchronized for adding the second relative time stamp to remote assistance information and addition video；
Second communication module, for the video stabbed added with the second relative time after being synchronized to intelligent terminal offer and far
Journey assistance information.
Audio frame, video frame and augmented reality are stabbed according to the first relative time while being extracted to the second synchronized playback module
Markup information frame is compared, and the audio frame, video frame and augmented reality markup information frame are equipped with the first relative time stamp, if
Video frame is normal, and audio frame and augmented reality markup information frame lag, then abandons the audio frame and augmented reality mark letter
Frame is ceased, if audio/video frames are synchronous, augmented reality markup information frame lag then abandons the augmented reality markup information frame, if video
Frame lag, just slows down or accelerates the playback rate of video by audio broadcasting speed.
The present invention provides a kind of remote job and instructs system, including the intelligent terminal, the WEB terminal, Yi Jifen
The video server not communicated with intelligent terminal and WEB terminal, the video server include:
Video quality optimization module, for the decoded data added with stamp and/or the second timestamp at the first time
Information carries out audio-video rate control, mass compensation, echo cancellation, noise reduction process and/or congestion control；
Third communication module, for being communicated with intelligent terminal and/or WEB terminal.
Compared with the latest prior art, technical solution provided by the invention has the advantages that
Technical solution provided by the invention, intelligent terminal stab Synchronos method using relative time, existing in audio, video and enhancing
The first relative time stamp is inserted into real markup information respectively, realizes the same of audio, video and augmented reality markup information three
Step；Intelligent terminal obtains the video and remote assistance information added with the second relative time stamp that WEB terminal returns, and according to first
Timestamp and the second timestamp are using synchronized playback realization video, audio, augmented reality markup information and remote assistance information
Simultaneous display realizes precision remote guide.
Technical solution provided by the invention, WEB terminal by video and acquisition remote guide audio, remote guide mark letter
Breath stabs Synchronos method using relative time, when being inserted into opposite respectively in video, remote guide audio and remote guide markup information
Between stab, it is synchronous with remote guide markup information to realize video, remote guide audio, be sent to video server after synchronizing,
After video server is handled, it is sent to each wearable intelligent terminal again, realizes precision remote guide.
Technical solution provided by the invention, WEB terminal realize video, sound using synchronized playback according to the first relative time stamp
Frequently, the simultaneous display of augmented reality markup information realizes precision remote guide.
Technical solution provided by the invention, intelligent terminal not only acquires video and audio, but also acquires power grid field operation
The mark of personnel's augmented reality, from the multi-faceted complex situations for acquiring electric network operation scene.
Technical solution provided by the invention provides intuitive and convenient task instruction and cooperation branch for power grid on-site personnel
It holds, improves grid equipment capital construction installation, makes an inspection tour maintenance, the working efficiency of distribution repairing and safety work level.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the wearable intelligent terminal of remote job guidance method of the present invention；
Fig. 2 is the flow chart that a kind of remote job of the present invention knows method WEB terminal；
Fig. 3 is audio-video and markup information relative time stamp insertion method schematic diagram；
Fig. 4 is audio-video of the embodiment of the present invention and markup information synchronized playback method schematic diagram；
Fig. 5 is video server architecture diagram of the embodiment of the present invention；
Fig. 6 is that a kind of remote job of the embodiment of the present invention instructs system architecture diagram.
Specific embodiment
The present invention will be further described in detail with reference to the accompanying drawing:
To achieve the goals above, present invention offer adopts the following technical scheme that
As shown in Figure 1, the present invention provides a kind of remote job guidance method, may include steps of:
Intelligent terminal adds the first relative time stamp on the audio of acquisition, video and augmented reality markup information makes three
It is synchronous, and audio, video and the augmented reality markup information after synchronizing are provided to WEB terminal；
Intelligent terminal obtains the video and remote assistance information added with the second relative time stamp that WEB terminal returns；
Intelligent terminal synchronizes playback to audio, video and augmented reality markup information according to the first relative time stamp,
Playback is synchronized to video and remote assistance information according to the second relative time stamp simultaneously；
Intelligent terminal is using video as mainstream, video, audio, augmented reality markup information after showing synchronized playback and long-range
Assistance information.
The intelligent terminal provides audio, video and augmented reality markup information after synchronizing to WEB terminal, comprising:
The intelligent terminal passes through respectively after the audio after synchronizing, video and augmented reality markup information are carried out compressed encoding
Video service is simultaneously or sequentially sent to the sequence of video bag, audio pack, augmented reality markup information packet from independent channel
WEB terminal is sent to by video server again after device.
The remote assistance information includes: remote assistance audio and remote assistance markup information.
It is described that playback is synchronized to audio, video and augmented reality markup information according to the first relative time stamp, comprising:
Extract audio frame, video frame and augmented reality markup information frame simultaneously and be compared, the audio frame, video frame and
Augmented reality markup information frame is equipped with the first relative time stamp, if video frame is normal, and audio frame and augmented reality markup information
Frame lags, then abandons the audio frame and augmented reality markup information frame, if audio/video frames are synchronous, augmented reality markup information frame
Lag, then abandon the augmented reality markup information frame, if video frame lags, just slows down or accelerate video for audio broadcasting speed
Playback rate.
It is described that playback is synchronized to video and remote assistance information according to the second relative time stamp, comprising:
It extracts video frame, remote assistance audio frame and remote assistance markup information frame simultaneously to be compared, if video frame is just
Often, and remote assistance audio frame and remote assistance markup information frame lag, then abandon the remote assistance audio frame and long-range association
Markup information frame is helped, if remote assistance audio frame and video frame synchronization, it is long-range then to abandon this for remote assistance markup information frame lag
Markup information frame is assisted, if video frame lags, just remote assistance audio broadcasting speed is slowed down or accelerated the playback rate of video.
The present invention provides a kind of intelligent terminal, may include:
First acquisition module, for acquiring video, audio and augmented reality markup information；
First synchronization module is carried out for adding the first relative time stamp to video, audio and augmented reality markup information
It is synchronous；
First communication module, for obtaining the video stabbed added with the second relative time and remote assistance information from WEB terminal；
First synchronized playback module, for being stabbed according to the first relative time to video, audio and augmented reality markup information
Synchronize playback；And playback is synchronized to video, remote assistance information according to the second relative time stamp；
First display module, for the video, audio, augmented reality mark using video as mainstream, after showing synchronized playback
Information and remote assistance information.
The remote assistance information that first communication module is obtained from WEB terminal includes remote assistance audio and remote assistance mark
Infuse information.
The first synchronized playback module includes:
First comparing unit, for being stabbed according to the first relative time while extracting audio frame, video frame and augmented reality mark
Note information frame is compared, and the audio frame, video frame and augmented reality markup information frame are equipped with the first relative time stamp；
First processing units, if normal for video frame, and audio frame and augmented reality markup information frame lag, then lose
The audio frame and augmented reality markup information frame are abandoned, if audio/video frames are synchronous, augmented reality markup information frame lag, then abandoning should
Audio broadcasting speed is just slowed down or is accelerated the playback rate of video if video frame lags by augmented reality markup information frame.
The first synchronized playback module includes:
Second comparing unit, for according to the second relative time stab simultaneously extract video frame, remote assistance audio frame and far
Journey assists markup information frame to be compared；
The second processing unit, if normal for video frame, and remote assistance audio frame and remote assistance markup information frame are equal
Lag, then abandon the remote assistance audio frame and remote assistance markup information frame, if remote assistance audio frame and video frame synchronization,
Remote assistance markup information frame lag, then abandon the remote assistance markup information frame, if video frame lags, just by remote assistance sound
Frequency broadcasting speed slows down or accelerates the playback rate of video.
Based on the same inventive concept, it the present invention also provides a kind of intelligent terminal, including processing system, memory and is stored in
On the memory and the computer program that can be run in the processing system, the processing system and the memory coupling
It closes, the processing system realizes above-mentioned remote job guidance method when executing the computer program.
Based on the same inventive concept, described computer-readable to deposit the present invention also provides a kind of computer readable storage medium
Storage media has the computer program that above-mentioned remote job guidance method can be performed.
As shown in Fig. 2, the present invention provides a kind of remote job guidance method, may include steps of:
WEB terminal obtains audio, video and the augmented reality markup information stabbed added with the first relative time from intelligent terminal,
And playback is synchronized to audio, video and augmented reality markup information according to the first relative time stamp and is shown；
WEB terminal obtains remote assistance information, and the second relative time stamp is added in the remote assistance information and video
It synchronizes；
WEB terminal provides the video stabbed added with the second relative time and remote assistance information after synchronizing to intelligent terminal.
The WEB terminal to after synchronizing remote assistance information and video be sent to intelligent terminal and include:
The WEB terminal to after synchronizing remote assistance information and video carry out compressed encoding after by video server transmission
To intelligent terminal.
It is described that playback is synchronized to audio, video and augmented reality markup information according to the first relative time stamp, comprising:
Extract audio frame, video frame and augmented reality markup information frame simultaneously and be compared, the audio frame, video frame and
Augmented reality markup information frame is equipped with the first relative time stamp, if video frame is normal, and audio frame and augmented reality markup information
Frame lags, then abandons the audio frame and augmented reality markup information frame, if audio/video frames are synchronous, augmented reality markup information frame
Lag, then abandon the augmented reality markup information frame, if video frame lags, just slows down or accelerate video for audio broadcasting speed
Playback rate.
The present invention provides a kind of WEB terminal, may include:
Second acquisition module, for obtaining remote assistance information；
Second synchronized playback module, for being stabbed according to the first relative time to video, audio and augmented reality markup information
Synchronize playback；
Second display module, for showing video, audio and augmented reality markup information after synchronized playback；
Second synchronization module is synchronized for adding the second relative time stamp to remote assistance information and addition video；
Second communication module, for the video stabbed added with the second relative time after being synchronized to intelligent terminal offer and far
Journey assistance information.
Audio frame, video frame and augmented reality are stabbed according to the first relative time while being extracted to the second synchronized playback module
Markup information frame is compared, and the audio frame, video frame and augmented reality markup information frame are equipped with the first relative time stamp, if
Video frame is normal, and audio frame and augmented reality markup information frame lag, then abandons the audio frame and augmented reality mark letter
Frame is ceased, if audio/video frames are synchronous, augmented reality markup information frame lag then abandons the augmented reality markup information frame, if video
Frame lag, just slows down or accelerates the playback rate of video by audio broadcasting speed.
Based on the same inventive concept, the present invention also provides a kind of WEB terminal, including processing system, memory and it is stored in institute
The computer program that can be run on memory and in the processing system is stated, the processing system is coupled with the memory,
The processing system realizes above-mentioned remote job guidance method when executing the computer program.
Based on the same inventive concept, described computer-readable to deposit the present invention also provides a kind of computer readable storage medium
Storage media has the computer program that above-mentioned remote job guidance method can be performed.
The present invention provides a kind of remote job and instructs system, may include: the intelligent terminal, the WEB terminal, with
And the video server communicated respectively with intelligent terminal and WEB terminal, the video server include:
Video quality optimization module, for the decoded data added with stamp and/or the second timestamp at the first time
Information carries out audio-video rate control, mass compensation, echo cancellation, noise reduction process and/or congestion control；
Third communication module, for being communicated with intelligent terminal and/or WEB terminal.
The intelligent terminal can be wearable intelligent terminal, such as: intelligent glasses, intelligent helmet etc..
A kind of specific remote job guidance method provided by the invention may include:
A variety of multimedia messages at wearable intelligent terminal Collecting operation scene, after being inserted into the first opposite timestamp respectively
Video server is transmitted to after carrying out compressed encoding together with control signaling；
Video server is to sending WEB terminal to after received data packet encoding and decoding, buffering, processing；
WEB terminal obtains the sound and mark of expert's addition when showing to decoded packet data, buffering, synchronized playback, displaying
Information is inserted into the second relative time stamp and compressed encoding in the expert's sound and markup information for showing video flowing, WEB terminal acquisition
After be transmitted to the video server；
WEB terminal transmission data packet is sent to wearable intelligence eventually by video server after encoding and decoding, buffering and processing
End；
Wearable intelligent terminal receives the data packet that the video server is sent, and after decoding buffer, synchronized playback is simultaneously
It is rendered and is shown, complete precision remote guide.
Specific method includes:
1, data acquire
Wearable intelligent terminal (intelligent glasses, intelligent helmet etc.) acquires video, audio, scape using camera and microphone
Deep camera acquisition electric network operation personnel augmented reality mark and picture information, and by audio, video and markup information, in sound
Frequently, the first relative time of insertion respectively of video and augmented reality markup information stabs, and control signaling carries out compressed encoding together,
Video server is passed in the data packet transmission that formation follows network protocol.
2, data are synchronous
When acquisition video flowing, audio stream, augmented reality markup information are sent respectively to video server, two kinds of Media Streams
With augmented reality markup information by independent transmission, since network can come delay jitter, recipient to transmission belt
It realizes that audio-video is synchronous with markup information, must just synchronize control, to restore the successive time relationship between data.Sound
Frequency stream needs to keep its continuity, and the variation of video flowing should be consistent it is necessary to realize three with audio-frequency information and markup information
It is synchronous.
It is available without the synchronous clock of the whole network in video system, so audio, view can not be realized using absolute timestamp
Frequently, markup information is synchronous, can only be solved using relative time stamp, as shown in figure 3, audio/video flow and markup information have it is respective
Time shaft, when transmission, each frame stamped relative time stamp RTS.Corresponding audio-video and mark, select video flowing for mainstream, mainstream is continuous
It plays, is determined from the broadcasting of stream and markup information by the broadcast state of mainstream, to realize that three is synchronous.
In transmitting terminal, the audio-video and markup information frame of synchronization acquisition stamp identical timestamp, as much as possible together
When send.Transmission process can be put into same thread and be handled, namely successively send video bag, audio pack, mark packet,
Video bag ... can guarantee the synchronization of transmitting terminal in this way.Because being acquired within the sampling time of a video frame multiple
Audio and mark frame, so having multiple audios and mark frame in a video bag.
As shown in figure 4, being subsequently sent to corresponding decoder after RTP frame reaches receiving end and being decoded.Adequately
Playback duration is controlled, data packet Ying Youxian before synchronizing is put into respective buffer area, regards in screen buffer timing extraction
Frequency frame, at the same audio and mark buffer area extract audio frame and mark frame be compared, if video frame is normal, and audio frame and
Mark frame lags, then abandons the audio frame and mark frame, if audio/video frames are synchronous, mark frame lag then abandons the mark frame,
If video frame lags, just audio broadcasting speed is slowed down or is accelerated the playback rate of video.
3, data processing
As shown in figure 5, video server is divided into audio, video, markup information and control end interface etc., audio, video and
Markup information interface is banished to each circuit-switched data into buffer area and decoding, and video processing module carries out rate control to video flowing
System, mass compensation, echo cancellation, noise reduction process, congestion control, wherein rate control controls audio-video rate, quality
Compensation be video quality is compensated, echo cancellation be to sound surround and echo is eliminated, noise reduction process makes an uproar to audio
Sound is handled, congestion control carries out congestion control to data stream, and control information controls media flow transmission.Then it incites somebody to action,
Audio, video, markup information packet are put into buffer area, and WEB terminal is sent to after compressed encoding.
4, expert's remote assistance
Remote is decoded by the data packet that WEB terminal receives video server transmission, buffered, synchronized back
It puts, render and shows, Remote is slided the modes such as mark, paintbrush tool and realized to power grid by voice and touch screen, mouse
On-site personnel video is instructed, after video flowing, expert's mark and sound tutorial message are stamped the second relative time stamp
Compressed encoding is sent to video server, and server will be sent to again wearable intelligent terminal after processing, realizes that precision is remote
Journey guidance.
Based on the same inventive concept, the present invention also provides a kind of remote joies to instruct system, as shown in fig. 6, the system
May include:
Wearable intelligent terminal: the multimedia messages of acquisition are put into slow by a variety of multimedia messages at Collecting operation scene
Punching is inserted into after the first relative time stabs after carrying out compressed encoding together with control signaling respectively and is sent to video server；
Video server: receiving the data packet that wearable intelligent terminal is sent and sends WEB terminal to after being handled；
WEB terminal: video server treated multimedia messages, the sound for obtaining expert's addition and mark letter are received
Breath, after being inserted into the second relative time stamp and compressed encoding in the expert's sound and markup information for showing video flowing, WEB terminal acquisition
It is transmitted to the video server；
The data packet that the video server also receives the transmission of WEB terminal is pushed to wearable intelligent terminal after handling.
Wearable intelligent terminal may include: the camera for acquiring video, the microphone for acquiring audio, acquisition augmented reality
The depth of field camera of markup information is returned for the synchronous synchronization sending module sent of data, the synchronization synchronous for data receiver
Amplification module, the display module for Video Rendering and displaying, the buffer area for buffered data, the coding reconciliation for encoding and decoding
Code device etc..
Video server may include: audio interface, video interface, augmented reality markup information interface, control end interface,
Audio-video Rate control module for audio-video rate control, is used the video quality compensating module for video quality compensation
Echo cancellation module in echo cancellation, the noise reduction process module for noise reduction process carry out congestion control for data flow
Congestion control module, the buffer area for buffered data, coding and decoding device for encoding and decoding etc..
The WEB terminal may include: the buffer area for buffered data, the coding and decoding device for encoding and decoding,
Synchronized playback module for data receiver synchronization, the display for Video Rendering and displaying are believed for obtaining extraneous addition
The acquisition device of breath with for the synchronous sending module of transmission will to be synchronized to addition information.
The WEB terminal may include video display module, acquire the sound and markup information of expert.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Finally it should be noted that: the above examples are only used to illustrate the technical scheme of the present invention rather than to its protection scope
Limitation, although the application is described in detail referring to above-described embodiment, those of ordinary skill in the art should
Understand: those skilled in the art read the specific embodiment of application can still be carried out after the application various changes, modification or
Person's equivalent replacement, but these changes, modification or equivalent replacement, are applying within pending claims.
Claims (15)
1. a kind of remote job guidance method characterized by comprising
Intelligent terminal adds the first relative time stamp on the audio of acquisition, video and augmented reality markup information keeps three same
Step, and audio, video and the augmented reality markup information after synchronizing are provided to WEB terminal；
Intelligent terminal obtains the video and remote assistance information added with the second relative time stamp that WEB terminal returns；
Intelligent terminal synchronizes playback to audio, video and augmented reality markup information according to the first relative time stamp, simultaneously
Playback is synchronized to video and remote assistance information according to the second relative time stamp；
Video, audio, augmented reality markup information and remote assistance of the intelligent terminal using video as mainstream, after showing synchronized playback
Information.
2. remote job guidance method as described in claim 1, which is characterized in that the intelligent terminal is provided to WEB terminal
Audio, video and augmented reality markup information after synchronizing, comprising:
The intelligent terminal passes through respectively solely after the audio after synchronizing, video and augmented reality markup information are carried out compressed encoding
After vertical channel is simultaneously or sequentially sent to video server with the sequence of video bag, audio pack, augmented reality markup information packet
WEB terminal is sent to by video server again.
3. remote job guidance method as described in claim 1, which is characterized in that the remote assistance information includes: long-range
Assist audio and remote assistance markup information.
4. remote job guidance method as described in claim 1, which is characterized in that described to be stabbed according to the first relative time to sound
Frequently, video and augmented reality markup information synchronize playback, comprising:
It extracts audio frame, video frame and augmented reality markup information frame simultaneously to be compared, the audio frame, video frame and enhancing
Real markup information frame is equipped with the first relative time stamp, if video frame is normal, and audio frame and augmented reality markup information frame are equal
Lag, then abandon the audio frame and augmented reality markup information frame, if audio/video frames are synchronous, augmented reality markup information frame is stagnant
Afterwards, then the augmented reality markup information frame is abandoned, if video frame lags, audio broadcasting speed is just slowed down or accelerated broadcasting for video
Put rate.
5. remote job guidance method as claimed in claim 3, which is characterized in that described to be stabbed according to the second relative time to view
Frequency and remote assistance information synchronize playback, comprising:
Video frame, remote assistance audio frame and remote assistance markup information frame is extracted simultaneously to be compared, if video frame is normal, and
Remote assistance audio frame and remote assistance markup information frame lag, then abandon the remote assistance audio frame and remote assistance mark
Information frame, if remote assistance audio frame and video frame synchronization, remote assistance markup information frame lag then abandons the remote assistance mark
Information frame is infused, if video frame lags, just remote assistance audio broadcasting speed is slowed down or accelerated the playback rate of video.
6. a kind of intelligent terminal characterized by comprising
First acquisition module, for acquiring video, audio and augmented reality markup information；
First synchronization module is synchronized for adding the first relative time stamp to video, audio and augmented reality markup information；
First communication module, for obtaining the video stabbed added with the second relative time and remote assistance information from WEB terminal；
First synchronized playback module, for being carried out according to the first relative time stamp to video, audio and augmented reality markup information
Synchronized playback；And playback is synchronized to video, remote assistance information according to the second relative time stamp；
First display module, for the video, audio, augmented reality markup information using video as mainstream, after showing synchronized playback
With remote assistance information.
7. intelligent terminal as claimed in claim 6, which is characterized in that first communication module obtains long-range from WEB terminal
Assistance information includes remote assistance audio and remote assistance markup information.
8. intelligent terminal as claimed in claim 6, which is characterized in that the first synchronized playback module includes:
First comparing unit, for audio frame, video frame and augmented reality mark letter to be stabbed while extracted according to the first relative time
Breath frame is compared, and the audio frame, video frame and augmented reality markup information frame are equipped with the first relative time stamp；
First processing units, if normal for video frame, and audio frame and augmented reality markup information frame lag, then abandoning should
Audio frame and augmented reality markup information frame, if audio/video frames are synchronous, augmented reality markup information frame lag then abandons the enhancing
Audio broadcasting speed is just slowed down or is accelerated the playback rate of video if video frame lags by real markup information frame.
9. intelligent terminal as claimed in claim 7, which is characterized in that the first synchronized playback module includes:
Second comparing unit, for video frame, remote assistance audio frame and long-range association to be stabbed while extracted according to the second relative time
Markup information frame is helped to be compared；
The second processing unit, if normal for video frame, and remote assistance audio frame and remote assistance markup information frame lag,
The remote assistance audio frame and remote assistance markup information frame are then abandoned, if remote assistance audio frame and video frame synchronization, remotely
Markup information frame lag is assisted, then abandons the remote assistance markup information frame, if video frame lags, is just broadcast remote assistance audio
Put the playback rate that speed slows down or accelerate video.
10. a kind of remote job guidance method characterized by comprising
WEB terminal obtains audio, video and the augmented reality markup information stabbed added with the first relative time, and root from intelligent terminal
Playback is synchronized to audio, video and augmented reality markup information according to the first relative time stamp and is shown；
WEB terminal obtains remote assistance information, and adds the second relative time stamp in the remote assistance information and video and carry out
It is synchronous；
WEB terminal provides the video stabbed added with the second relative time and remote assistance information after synchronizing to intelligent terminal.
11. remote job guidance method as claimed in claim 10, which is characterized in that the WEB terminal is to long-range after synchronizing
Assistance information and video are sent to intelligent terminal
The WEB terminal to after synchronizing remote assistance information and video carry out compressed encoding after intelligence is sent to by video server
It can terminal.
12. remote job guidance method as claimed in claim 10, which is characterized in that described according to the first relative time stamp pair
Audio, video and augmented reality markup information synchronize playback, comprising:
It extracts audio frame, video frame and augmented reality markup information frame simultaneously to be compared, the audio frame, video frame and enhancing
Real markup information frame is equipped with the first relative time stamp, if video frame is normal, and audio frame and augmented reality markup information frame are equal
Lag, then abandon the audio frame and augmented reality markup information frame, if audio/video frames are synchronous, augmented reality markup information frame is stagnant
Afterwards, then the augmented reality markup information frame is abandoned, if video frame lags, audio broadcasting speed is just slowed down or accelerated broadcasting for video
Put rate.
13. a kind of WEB terminal characterized by comprising
Second acquisition module, for obtaining remote assistance information；
Second synchronized playback module, for being carried out according to the first relative time stamp to video, audio and augmented reality markup information
Synchronized playback；
Second display module, for showing video, audio and augmented reality markup information after synchronized playback；
Second synchronization module is synchronized for adding the second relative time stamp to remote assistance information and addition video；
Second communication module, for providing the video stabbed added with the second relative time after synchronizing and long-range association to intelligent terminal
Supplementary information.
14. WEB terminal as claimed in claim 13, which is characterized in that the second synchronized playback module according to first it is opposite when
Between stab while extracting audio frame, video frame and augmented reality markup information frame and be compared, the audio frame, video frame and enhancing
Real markup information frame is equipped with the first relative time stamp, if video frame is normal, and audio frame and augmented reality markup information frame are equal
Lag, then abandon the audio frame and augmented reality markup information frame, if audio/video frames are synchronous, augmented reality markup information frame is stagnant
Afterwards, then the augmented reality markup information frame is abandoned, if video frame lags, audio broadcasting speed is just slowed down or accelerated broadcasting for video
Put rate.
15. a kind of remote job instructs system, which is characterized in that including as described in claim 6 to 9 is any intelligent terminal,
WEB terminal according to claim 13 or 14 and the video server communicated respectively with intelligent terminal and WEB terminal, the view
Frequency server includes:
Video quality optimization module, for the decoded data information added with first time stamp and/or the second timestamp
Carry out audio-video rate control, mass compensation, echo cancellation, noise reduction process and/or congestion control；
Third communication module, for being communicated with intelligent terminal and/or WEB terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710523982.6A CN109218794B (en) | 2017-06-30 | 2017-06-30 | Remote work instruction method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710523982.6A CN109218794B (en) | 2017-06-30 | 2017-06-30 | Remote work instruction method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109218794A true CN109218794A (en) | 2019-01-15 |
| CN109218794B CN109218794B (en) | 2022-06-10 |
Family
ID=64961029
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710523982.6A Active CN109218794B (en) | 2017-06-30 | 2017-06-30 | Remote work instruction method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109218794B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110290340A (en) * | 2019-07-02 | 2019-09-27 | 江苏达实久信数字医疗科技有限公司 | A kind of medical operating teaching system and method |
| CN110740285A (en) * | 2019-10-30 | 2020-01-31 | 中车青岛四方机车车辆股份有限公司 | A telematics method and device |
| CN112804559A (en) * | 2020-12-08 | 2021-05-14 | 中国船舶重工集团公司第七0九研究所 | Video picture and keyboard and mouse synchronous transmission method and system |
| CN112887651A (en) * | 2021-01-27 | 2021-06-01 | 昭通亮风台信息科技有限公司 | AR-based remote command method and system |
| CN113766178A (en) * | 2020-06-05 | 2021-12-07 | 北京字节跳动网络技术有限公司 | Video control method, device, terminal and storage medium |
| CN113891132A (en) * | 2021-10-25 | 2022-01-04 | 北京字节跳动网络技术有限公司 | Audio and video synchronization monitoring method and device, electronic equipment and storage medium |
| CN115580697A (en) * | 2022-09-22 | 2023-01-06 | 北京行远博见网络科技有限公司 | A remote control method, system, device and storage medium for equipment |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101127917A (en) * | 2007-09-06 | 2008-02-20 | 中兴通讯股份有限公司 | A method and system for synchronizing Internet stream media format video and audio |
| CN101419827A (en) * | 2007-10-22 | 2009-04-29 | 联发科技股份有限公司 | Method for synchronizing audio and video data in audio-video cross file |
| CN101453655A (en) * | 2007-11-30 | 2009-06-10 | 深圳华为通信技术有限公司 | Method, system and device for customer controllable audio and video synchronization regulation |
| CN101827271A (en) * | 2009-03-04 | 2010-09-08 | 联芯科技有限公司 | Audio and video synchronized method and device as well as data receiving terminal |
| CN101931884A (en) * | 2009-06-23 | 2010-12-29 | 北京三星通信技术研究有限公司 | Method and system for data synchronization |
| CN102957892A (en) * | 2011-08-24 | 2013-03-06 | 三星电子（中国）研发中心 | Method, system and device for realizing audio and video conference |
| CN103414957A (en) * | 2013-07-30 | 2013-11-27 | 广东工业大学 | Method and device for synchronization of audio data and video data |
| CN103634621A (en) * | 2012-08-27 | 2014-03-12 | 中兴通讯股份有限公司 | Method, apparatuses and system for playing synchronization controlling in video recommendation service |
| US20140093085A1 (en) * | 2012-10-01 | 2014-04-03 | Sonos, Inc. | Providing a multi-channel and a multi-zone audio environment |
| US20140139551A1 (en) * | 2012-11-21 | 2014-05-22 | Daniel McCulloch | Augmented reality help |
| CN104506621A (en) * | 2014-12-24 | 2015-04-08 | 北京佳讯飞鸿电气股份有限公司 | Method for performing long-distance guidance by use of video annotation |
| US20150099252A1 (en) * | 2013-10-03 | 2015-04-09 | Autodesk, Inc. | Enhancing movement training with an augmented reality mirror |
| CN104618786A (en) * | 2014-12-22 | 2015-05-13 | 深圳市腾讯计算机系统有限公司 | Audio/video synchronization method and device |
| CN105739704A (en) * | 2016-02-02 | 2016-07-06 | 上海尚镜信息科技有限公司 | Remote guidance method and system based on augmented reality |
| WO2016117480A1 (en) * | 2015-01-19 | 2016-07-28 | シャープ株式会社 | Telecommunication system |
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| CN106780151A (en) * | 2017-01-04 | 2017-05-31 | 国网江苏省电力公司电力科学研究院 | Transformer station's Bidirectional intelligent cruising inspection system and method based on wearable augmented reality |
| US20190187690A1 (en) * | 2016-05-09 | 2019-06-20 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for data communication over a plurality of data paths |
-
2017
- 2017-06-30 CN CN201710523982.6A patent/CN109218794B/en active Active
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101127917A (en) * | 2007-09-06 | 2008-02-20 | 中兴通讯股份有限公司 | A method and system for synchronizing Internet stream media format video and audio |
| CN101419827A (en) * | 2007-10-22 | 2009-04-29 | 联发科技股份有限公司 | Method for synchronizing audio and video data in audio-video cross file |
| CN101453655A (en) * | 2007-11-30 | 2009-06-10 | 深圳华为通信技术有限公司 | Method, system and device for customer controllable audio and video synchronization regulation |
| CN101827271A (en) * | 2009-03-04 | 2010-09-08 | 联芯科技有限公司 | Audio and video synchronized method and device as well as data receiving terminal |
| CN101931884A (en) * | 2009-06-23 | 2010-12-29 | 北京三星通信技术研究有限公司 | Method and system for data synchronization |
| CN102957892A (en) * | 2011-08-24 | 2013-03-06 | 三星电子（中国）研发中心 | Method, system and device for realizing audio and video conference |
| CN103634621A (en) * | 2012-08-27 | 2014-03-12 | 中兴通讯股份有限公司 | Method, apparatuses and system for playing synchronization controlling in video recommendation service |
| US20140093085A1 (en) * | 2012-10-01 | 2014-04-03 | Sonos, Inc. | Providing a multi-channel and a multi-zone audio environment |
| US20140139551A1 (en) * | 2012-11-21 | 2014-05-22 | Daniel McCulloch | Augmented reality help |
| CN103414957A (en) * | 2013-07-30 | 2013-11-27 | 广东工业大学 | Method and device for synchronization of audio data and video data |
| US20150099252A1 (en) * | 2013-10-03 | 2015-04-09 | Autodesk, Inc. | Enhancing movement training with an augmented reality mirror |
| CN104618786A (en) * | 2014-12-22 | 2015-05-13 | 深圳市腾讯计算机系统有限公司 | Audio/video synchronization method and device |
| CN104506621A (en) * | 2014-12-24 | 2015-04-08 | 北京佳讯飞鸿电气股份有限公司 | Method for performing long-distance guidance by use of video annotation |
| WO2016117480A1 (en) * | 2015-01-19 | 2016-07-28 | シャープ株式会社 | Telecommunication system |
| CN105739704A (en) * | 2016-02-02 | 2016-07-06 | 上海尚镜信息科技有限公司 | Remote guidance method and system based on augmented reality |
| US20190187690A1 (en) * | 2016-05-09 | 2019-06-20 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for data communication over a plurality of data paths |
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| CN106780151A (en) * | 2017-01-04 | 2017-05-31 | 国网江苏省电力公司电力科学研究院 | Transformer station's Bidirectional intelligent cruising inspection system and method based on wearable augmented reality |
Non-Patent Citations (2)
| Title |
|---|
| 刘建明等: "增强现实、虚拟现实和混合现实技术在电力系统的应用研究", 《电力信息与通信技术》 * |
| 罗斌等: "增强现实混合跟踪技术综述", 《自动化学报》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110290340A (en) * | 2019-07-02 | 2019-09-27 | 江苏达实久信数字医疗科技有限公司 | A kind of medical operating teaching system and method |
| CN110740285A (en) * | 2019-10-30 | 2020-01-31 | 中车青岛四方机车车辆股份有限公司 | A telematics method and device |
| CN113766178A (en) * | 2020-06-05 | 2021-12-07 | 北京字节跳动网络技术有限公司 | Video control method, device, terminal and storage medium |
| CN112804559A (en) * | 2020-12-08 | 2021-05-14 | 中国船舶重工集团公司第七0九研究所 | Video picture and keyboard and mouse synchronous transmission method and system |
| CN112887651A (en) * | 2021-01-27 | 2021-06-01 | 昭通亮风台信息科技有限公司 | AR-based remote command method and system |
| CN113891132A (en) * | 2021-10-25 | 2022-01-04 | 北京字节跳动网络技术有限公司 | Audio and video synchronization monitoring method and device, electronic equipment and storage medium |
| CN115580697A (en) * | 2022-09-22 | 2023-01-06 | 北京行远博见网络科技有限公司 | A remote control method, system, device and storage medium for equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109218794B (en) | 2022-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109218794A (en) | Remote job guidance method and system | |
| CN105959772B (en) | Streaming Media and the instant simultaneous display of subtitle, matched processing method, apparatus and system | |
| CN103546662A (en) | A method for synchronizing audio and video in a network monitoring system | |
| CN108600815A (en) | A kind of online method and system chorused in real time | |
| CN105306110B (en) | A kind of method and system realized synchronous music and played | |
| CN103208298A (en) | Video shooting method and system | |
| CN106792145A (en) | A kind of method and apparatus of the automatic overlapping text of audio frequency and video | |
| CN104618786A (en) | Audio/video synchronization method and device | |
| RU2013158084A (en) | METHODS AND SYSTEMS OF SYNCHRONIZATION AND SWITCHING FOR THE ADAPTIVE SOUND SYSTEM | |
| US9396762B2 (en) | Systems and methods for networked media synchronization | |
| CN101005574A (en) | Video frequency virtual humance sign language compiling system | |
| CN102982832A (en) | Synchronization method of accompaniment, voice and subtitle for on-line karaoke | |
| CN102957892A (en) | Method, system and device for realizing audio and video conference | |
| CN106060580B (en) | Image synchronous display method and device | |
| CN102655606A (en) | Method and system for adding real-time subtitle and sign language services to live program based on P2P (Peer-to-Peer) network | |
| CN104954727B (en) | Audio-visual synchronization control device and method | |
| CN108965971A (en) | MCVF multichannel voice frequency synchronisation control means, control device and electronic equipment | |
| CN104869341A (en) | Method of realizing trial text and trial video synchronization playback and system thereof | |
| CN103188548A (en) | Digital television sign language dubbing method and digital television sign language dubbing device | |
| CN104247439B (en) | The transmission method of multiple heterochronous digital signals | |
| CN103581730A (en) | Method for achieving synchronization of audio and video on digital set top box | |
| CN112584216B (en) | Lip sound synchronization method and device | |
| CN109040818A (en) | Audio and video synchronization method, storage medium, electronic equipment and system when live streaming | |
| CN104079958A (en) | Video and multichannel audio synchronous broadcasting method | |
| CN101924932A (en) | Rapid making method of CNVS multimedia courseware |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |