HybridMQA: Exploring Geometry-Texture Interactions for Colored Mesh Quality Assessment

University of Waterloo, Canada
CVPR 2025

*Equal Contribution
Abstract Illustration

HybridMQA understands and judges visual quality of 3D meshes
by considering both their geometry and texture.

Abstract

Mesh quality assessment (MQA) models play a critical role in the design, optimization, and evaluation of mesh operation systems in a wide variety of applications. Current MQA models, whether model-based methods using topology-aware features or projection-based approaches working on rendered 2D projections, often fail to capture the intricate interactions between texture and 3D geometry. We introduce HybridMQA, a first-of-its-kind hybrid full-reference colored MQA framework that integrates model-based and projection-based approaches, capturing complex interactions between textural information and 3D structures for enriched quality representations. Our method employs graph learning to extract detailed 3D representations, which are then projected to 2D using a novel feature rendering process that precisely aligns them with colored projections. This enables the exploration of geometry-texture interactions via cross-attention, producing comprehensive mesh quality representations. Extensive experiments demonstrate HybridMQA’s superior performance across diverse datasets, highlighting its ability to effectively leverage geometry-texture interactions for a thorough understanding of mesh quality.

Abstract Illustration

Our main motivation? We observed that geometry and texture interact in complex ways, affecting the visual quality of 3D meshes.

HybridMQA understands 3D geometry and attends to regions with geometric
distortions to judge the perceptual quality of 3D meshes.

HybridMQA identifies and attends to perceptually important regions by exploring
geometry-texture interactions through cross-attention.

Poster

BibTeX

@article{sarvestani2024hybridmqa,
    title={HybridMQA: Exploring Geometry-Texture Interactions for Colored Mesh Quality Assessment},
    author={Sarvestani, Armin Shafiee and Tang, Sheyang and Wang, Zhou},
    journal={arXiv preprint arXiv:2412.01986},
    year={2024}
}