Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleDecember 2024
RoMo: A Robust Solver for Full-body Unlabeled Optical Motion Capture
SA '24: SIGGRAPH Asia 2024 Conference PapersArticle No.: 76, Pages 1–11https://doi.org/10.1145/3680528.3687615Optical motion capture (MoCap) is the "gold standard" for accurately capturing full-body motions. To make use of raw MoCap point data, the system labels the points with corresponding body part locations and solves the full-body motions. However, MoCap ...
- research-articleDecember 2024
Decoupling Contact for Fine-Grained Motion Style Transfer
- Xiangjun Tang,
- Linjun Wu,
- He Wang,
- Yiqian Wu,
- Bo Hu,
- Songnan Li,
- Xu Gong,
- Yuchen Liao,
- Qilong Kou,
- Xiaogang Jin
SA '24: SIGGRAPH Asia 2024 Conference PapersArticle No.: 54, Pages 1–11https://doi.org/10.1145/3680528.3687609Motion style transfer changes the style of a motion while retaining its content and is useful in computer animations and games. Contact is an essential component of motion style transfer that should be controlled explicitly in order to express the style ...
- research-articleNovember 2024
StyleTex: Style Image-Guided Texture Generation for 3D Models
ACM Transactions on Graphics (TOG), Volume 43, Issue 6Article No.: 212, Pages 1–14https://doi.org/10.1145/3687931Style-guided texture generation aims to generate a texture that is harmonious with both the style of the reference image and the geometry of the input mesh, given a reference style image and a 3D mesh with its text description. Although diffusion-based ...
- research-articleJuly 2024
DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models
- Yuqing Zhang,
- Yuan Liu,
- Zhiyu Xie,
- Lei Yang,
- Zhongyuan Liu,
- Mengzhou Yang,
- Runze Zhang,
- Qilong Kou,
- Cheng Lin,
- Wenping Wang,
- Xiaogang Jin
ACM Transactions on Graphics (TOG), Volume 43, Issue 4Article No.: 39, Pages 1–18https://doi.org/10.1145/3658170Recent advancements in 2D diffusion models allow appearance generation on untextured raw meshes. These methods create RGB textures by distilling a 2D diffusion model, which often contains unwanted baked-in shading effects and results in unrealistic ...
- research-articleJuly 2024
Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Prior
ACM Transactions on Graphics (TOG), Volume 43, Issue 4Article No.: 45, Pages 1–12https://doi.org/10.1145/3658162Existing neural rendering-based text-to-3D-portrait generation methods typically make use of human geometry prior and diffusion models to obtain guidance. However, relying solely on geometry information introduces issues such as the Janus problem, over-...
-
- research-articleJuly 2024
Mob-FGSR: Frame Generation and Super Resolution for Mobile Real-Time Rendering
- Sipeng Yang,
- Qingchuan Zhu,
- Junhao Zhuge,
- Qiang Qiu,
- Chen Li,
- Yuzhong Yan,
- Huihui Xu,
- Ling-Qi Yan,
- Xiaogang Jin
SIGGRAPH '24: ACM SIGGRAPH 2024 Conference PapersArticle No.: 64, Pages 1–11https://doi.org/10.1145/3641519.3657424Recent advances in supersampling for frame generation and super-resolution improve real-time rendering performance significantly. However, because these methods rely heavily on the most recent features of high-end GPUs, they are impractical for mobile ...
- research-articleJuly 2024
Generated realistic noise and rotation-equivariant models for data-driven mesh denoising
- Sipeng Yang,
- Wenhui Ren,
- Xiwen Zeng,
- Qingchuan Zhu,
- Hongbo Fu,
- Kaijun Fan,
- Lei Yang,
- Jingping Yu,
- Qilong Kou,
- Xiaogang Jin
Computer Aided Geometric Design (CAGD), Volume 111, Issue Chttps://doi.org/10.1016/j.cagd.2024.102306Abstract3D mesh denoising is a crucial pre-processing step in many graphics applications. However, existing data-driven mesh denoising models, primarily trained on synthetic white noise, are less effective when applied to real-world meshes with the noise ...
Highlights- Introduced an EMD method using rotation-equivariant features for SOTA mesh denoising.
- Developed an RMNG model to create realistic noisy-clean pairs, enhancing real-world denoising.
- Proposed a method to add smoothing degradation in ...
- research-articleJuly 2024
Real-time collision detection between general SDFs
Computer Aided Geometric Design (CAGD), Volume 111, Issue Chttps://doi.org/10.1016/j.cagd.2024.102305AbstractSigned Distance Fields (SDFs) have found widespread utility in collision detection applications due to their superior query efficiency and ability to represent continuous geometries. However, little attention has been paid to calculating the ...
Highlights- The first real-time and accurate general SDF-SDF collision detection method.
- A novel method for testing the intersection of analytic distance functions.
- An accurate method for estimating contact information for SDF-SDF collision ...
- research-articleMay 2024
FusionDeformer: text-guided mesh deformation using diffusion models
The Visual Computer: International Journal of Computer Graphics (VISC), Volume 40, Issue 7Pages 4701–4712https://doi.org/10.1007/s00371-024-03463-7AbstractMesh deformation has a wide range of applications, including character creation, geometry modelling, deforming animation, and morphing. Recently, mesh deformation methods based on CLIP models demonstrated the ability to perform automatic text-...
- research-articleJune 2024
Octree-based hierarchical sampling optimization for the volumetric super-resolution of scientific data
Journal of Computational Physics (JOCP), Volume 502, Issue Chttps://doi.org/10.1016/j.jcp.2024.112804AbstractWhen introducing physics-constrained deep learning solutions to the volumetric super-resolution of scientific data, the training is challenging to converge and always time-consuming. We propose a new hierarchical sampling method based on octree ...
Highlights- We propose a novel octree-based approach for modeling volumetric scientific data by leveraging its importance distribution.
- We present a hierarchical sampling method to optimize the distribution of sample points in each training data ...
- research-articleDecember 2023
Texture Atlas Compression Based on Repeated Content Removal
SA '23: SIGGRAPH Asia 2023 Conference PapersArticle No.: 52, Pages 1–11https://doi.org/10.1145/3610548.3618150Optimizing the memory footprint of 3D models can have a major impact on the user experiences during real-time rendering and streaming visualization, where the major memory overhead lies in the high-resolution texture data. In this work, we propose a ...
- research-articleDecember 2023
A Locality-based Neural Solver for Optical Motion Capture
- Xiaoyu Pan,
- Bowen Zheng,
- Xinwei Jiang,
- Guanglong Xu,
- Xianli Gu,
- Jingxiang Li,
- Qilong Kou,
- He Wang,
- Tianjia Shao,
- Kun Zhou,
- Xiaogang Jin
SA '23: SIGGRAPH Asia 2023 Conference PapersArticle No.: 117, Pages 1–11https://doi.org/10.1145/3610548.3618148We present a novel locality-based learning method for cleaning and solving optical motion capture data. Given noisy marker data, we propose a new heterogeneous graph neural network which treats markers and joints as different types of nodes, and uses ...
- research-articleJuly 2023
RSMT: Real-time Stylized Motion Transition for Characters
SIGGRAPH '23: ACM SIGGRAPH 2023 Conference ProceedingsArticle No.: 38, Pages 1–10https://doi.org/10.1145/3588432.3591514Styled online in-between motion generation has important application scenarios in computer animation and games. Its core challenge lies in the need to satisfy four critical requirements simultaneously: generation speed, motion quality, style diversity, ...
- research-articleJuly 2023
Deep Real-time Volumetric Rendering Using Multi-feature Fusion
SIGGRAPH '23: ACM SIGGRAPH 2023 Conference ProceedingsArticle No.: 61, Pages 1–10https://doi.org/10.1145/3588432.3591493We present Multi-feature Radiance-Predicting Neural Networks (MRPNN), a practical framework with a lightweight feature fusion neural network for rendering high-order scattered radiance of participating media in real time. By reformulating the Radiative ...
- research-articleMarch 2023
MNSS: Neural Supersampling Framework for Real-Time Rendering on Mobile Devices
IEEE Transactions on Visualization and Computer Graphics (ITVC), Volume 30, Issue 7Pages 4271–4284https://doi.org/10.1109/TVCG.2023.3259141Although neural supersampling has achieved great success in various applications for improving image quality, it is still difficult to apply it to a wide range of real-time rendering applications due to the high computational power demand. Most existing ...
- research-articleMarch 2023
MobileSky: Real-Time Sky Replacement for Mobile AR
- Xinjie Wang,
- Qingxuan Lv,
- Guo Chen,
- Jing Zhang,
- Zhiqiang Wei,
- Junyu Dong,
- Hongbo Fu,
- Zhipeng Zhu,
- Jingxin Liu,
- Xiaogang Jin
IEEE Transactions on Visualization and Computer Graphics (ITVC), Volume 30, Issue 7Pages 4304–4320https://doi.org/10.1109/TVCG.2023.3257840We present <italic>MobileSky</italic>, the first automatic method for real-time high-quality sky replacement for mobile AR applications. The primary challenge of this task is how to extract sky regions in camera feed both quickly and accurately. While the ...
- research-articleJanuary 2023
Multi-Granularity Context Network for Efficient Video Semantic Segmentation
IEEE Transactions on Image Processing (TIP), Volume 32Pages 3163–3175https://doi.org/10.1109/TIP.2023.3269982Current video semantic segmentation tasks involve two main challenges: how to take full advantage of multi-frame context information, and how to improve computational efficiency. To tackle the two challenges simultaneously, we present a novel Multi-...
- ArticleOctober 2022
BRNet: Exploring Comprehensive Features for Monocular Depth Estimation
AbstractSelf-supervised monocular depth estimation has achieved encouraging performance recently. A consensus is that high-resolution inputs often yield better results. However, we find that the performance gap between high and low resolutions in this ...
- ArticleJanuary 2023
Crowd Simulation with Detailed Body Motion and Interaction
AbstractCrowd simulation methods generally focus on high fidelity 2D trajectories but ignore detailed 3D body animation which is normally added in a post-processing step. We argue that this is an intrinsic flaw as detailed body motions affect the 2D ...