Inspired by Geoffrey Hinton emphasis on generative modeling, To recognize shapes, first learn to generate them, we explore the use of 3D diffusion models for object classification. Leveraging the density estimates from these models, our approach, the Diffusion Classifier for 3D Objects (DC3DO), enables zero-shot classification of 3D shapes without additional training. On average, our method achieves a 12.5 percent improvement compared to its multiview counterparts, demonstrating superior multimodal reasoning over discriminative approaches. DC3DO employs a class-conditional diffusion model trained on ShapeNet, and we run inferences on point clouds of chairs and cars. This work highlights the potential of generative models in 3D object classification.
DC3DO: Diffusion Classifier for 3D Objects
Diffusion Classifier for 3D Objects (DC3DO) uses class-conditional diffusion models to achieve zero-shot classification of 3D shapes with superior multimodal reasoning.
- Year
- 2024
- Venue
- arXiv 2024
- Authors
- 9
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/2408.06693ARXIV-DEFAULT
- TL;DR
- Semantic Scholar