Best 3D Object Detection for AR?

I’m currently using Unity with RealSense/HoloLens and other cameras to track 3D-shaped objects and augment buttons. One big hurdle for my project is finding a good 3D model tracking solution. I tried Vuforia a few years ago, but it wasn’t great, so I decided to wait for better tools or improvements.

I’ve looked at several options like Vuforia, EasyAR, and VisionLib. However, I’d love to know if anyone has found a current tool that works well for 3D object tracking. It would be awesome if it integrates with Unity so I can hardcode buttons directly on the mesh without worrying about the math.

The 3D object can be anything—a box, flower pot, bottle, etc. I need the object detection and augmented buttons to move flawlessly and accurately, even when the object is rotated or moved.

Have you tried Google Objectron? It’s good, but you can’t train your own model. They haven’t updated it for that :sob:.

I’m really interested in this topic too! I tried something similar a while back. You should look for 6DoF 3D object tracking. Let me know if you find something, maybe we could collaborate!

I found a thread from the past that might help, but all the replies are from 2 years ago. Here it is: 3D Object Recognition for AR in Unity.

You might want to check out ARCore for Android or ARKit for iOS. They have decent object tracking capabilities.

Have you considered using OpenCV with Unity? It can be a bit complex, but it allows for some powerful tracking options.