[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

Lee et al., 2023 - Google Patents

Farfetchfusion: Towards fully mobile live 3d telepresence platform

Lee et al., 2023

View PDF
Document ID
4179996485958730177
Author
Lee K
Yi J
Lee Y
Publication year
Publication venue
Proceedings of the 29th Annual International Conference on Mobile Computing and Networking

External Links

Snippet

We present FarfetchFusion, a fully mobile live 3D telepresence system. Enabling mobile live telepresence is a challenging problem as it requires i) realistic reconstruction of the user and ii) high responsiveness for immersive experience. We first thoroughly analyze the live 3D …
Continue reading at scholar.archive.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221—Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G06K9/00268—Feature extraction; Face representation
    • G06K9/00281—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0203—Picture signal generators using a stereoscopic image camera
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding, e.g. from bit-mapped to non bit-mapped
    • G06T9/001—Model-based coding, e.g. wire frame
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements

Similar Documents

Publication Publication Date Title
Nagano et al. paGAN: real-time avatars using dynamic textures.
US10839585B2 (en) 4D hologram: real-time remote avatar creation and animation control
Zhang et al. Virtualcube: An immersive 3d video communication system
Lee et al. Farfetchfusion: Towards fully mobile live 3d telepresence platform
EP3980974A1 (en) Single image-based real-time body animation
CN113261013A (en) System and method for realistic head rotation and facial animation synthesis on mobile devices
KR102141319B1 (en) Super-resolution method for multi-view 360-degree image and image processing apparatus
US11961266B2 (en) Multiview neural human prediction using implicit differentiable renderer for facial expression, body pose shape and clothes performance capture
CN112233212A (en) Portrait editing and composition
US12112418B2 (en) Volumetric capture and mesh-tracking based machine learning 4D face/body deformation training
EP4292059A1 (en) Multiview neural human prediction using implicit differentiable renderer for facial expression, body pose shape and clothes performance capture
Jin et al. From capture to display: A survey on volumetric video
Pintore et al. Deep scene synthesis of Atlanta-world interiors from a single omnidirectional image
Xia et al. Modeling and compressing 3-D facial expressions using geometry videos
Eisert et al. Volumetric video–acquisition, interaction, streaming and rendering
Tu et al. Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using Sparse RGB Cameras
Hara et al. Spherical image generation from a few normal-field-of-view images by considering scene symmetry
Tu et al. Tele-Aloha: A telepresence system with low-budget and high-authenticity using sparse rgb cameras
Lee et al. Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpses
Tan et al. FaceCollage: A rapidly deployable system for real-time head reconstruction for on-the-go 3D telepresence
Jiang et al. RT3DHVC: A Real-time Human Holographic Video Conferencing System with a Consumer RGB-D Camera Array
Fedorov et al. Talking head: synthetic video facial animation in MPEG-4
Tran et al. VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresence
Kuriakin et al. MPEG-4 Synthetic Video in real implementation
Dluzniewski et al. 3D reconstruction for tele-immersion in 360° live stream