SwiftTailor: Efficient 3D Garment Generation with Geometry Image Representation

Qualcomm AI Research
CVPR 2026 ★ Highlight

*Equal Contribution

Done during AI Resident at Qualcomm AI Research

Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc.
arXiv Code (TBD) Cite
Description of the teaser image
We introduce SwiftTailor, a two-stage framework designed to generate high-quality sewing patterns and reconstruct garments in 3D. The system consists of PatternMaker, which predicts structured sewing patterns from input representations, and GarmentSewer, which assembles these patterns into complete garment geometries. In addition, we propose a novel garment geometry image representation that enables efficient and direct decoding into final 3D garment meshes. This design allows us to directly generate 3D garment meshes without requiring a simulation engine, making the generation process more efficient. The generated meshes are also simulation-ready and can be utilized in downstream tasks.

Abstract

Realistic and efficient 3D garment generation remains a longstanding challenge in computer vision and digital fashion. Existing methods typically rely on large vision- language models to produce serialized representations of 2D sewing patterns, which are then transformed into simulation-ready 3D meshes using garment modeling framework such as GarmentCode. Although these approaches yield high-quality results, they often suffer from slow inference times, ranging from 30 seconds to a minute. In this work, we introduce SwiftTailor, a novel two-stage framework that unifies sewing-pattern reasoning and geometry-based mesh synthesis through a compact geometry image representation. SwiftTailor comprises two lightweight modules: PatternMaker, an efficient vision-language model that predicts sewing patterns from diverse input modalities, and GarmentSewer, an efficient dense prediction transformer that converts these patterns into a novel Garment Geometry Image, encoding the 3D surface of all garment panels in a unified UV space. The final 3D mesh is reconstructed through an efficient inverse mapping process that incorporates remeshing and dynamic stitching algorithms to directly assemble the garment, thereby amortizing the cost of physical simulation. Extensive experiments on the Multimodal GarmentCodeData demonstrate that SwiftTailor achieves state-of-the-art accuracy and visual fidelity while significantly reducing inference time. This work offers a scalable, interpretable, and high-performance solution for next-generation 3D garment generation.

Methodology

Pipeline of the method

Framework Overview: Our PatternMaker is a relatively small vision-language model (InternVL-3-2B) trained to output sewing patterns. The sewing patterns are constructed from discrete tokens and continuous parameters predicted by the VLM. Our GarmentSewer is a dense prediction transformer (DPT) that predicts a garment geometry image from the sewing patterns. In this step, we preprocess the sewing pattern to achieve the semantic and stitching map, which are then passed to the DPT to predict the geometry image, completing our garment geometry image representation (GGI). We then perform a postprocessing step to convert the GGI to a final 3D mesh.

GGI Representation

GGI Representation. (Left) We present how to prepare the three components (geometry, semantic and stiching) of our propose Garment Geometry Image (GGI); (Right) From the estimated geometry and stiching images of GarmentSewer and PatternMaker, two additional remeshing and stiching steps are performed to obtain the final 3D mesh result.

Generated Garments

BibTeX

@article{phuc2026swifttailor,
  title={SwiftTailor: Efficient 3D Garment Generation with Geometry Image Representation},
  author={Pham, Phuc and Tran, Uy Dieu and Hua, Binh-Son and Nguyen, Phong},
  journal={arXiv preprint arXiv:2603.19053},
  year={2026},
  url={https://arxiv.org/abs/2603.19053}
}