Hey everyone, I’m currently working on a concept for an AR mirror, kind of like what you can see in this video:
I’m curious if it’s possible to integrate a live webcam feed into Blender to track the body and augment clothing in real-time. Have any of you come across similar projects done with Blender, or do you have any resources that could help? If not, what software, tools, or AR Kits do you think would be best for this kind of project?
That sounds like a really cool project. I haven’t seen anything specific using Blender for real-time body tracking, but I’ve heard people use Unity with ARKit for similar things.
For body tracking, you might want to check out OpenPose or similar libraries. They can be integrated with Blender for tracking. Not sure about live feed though.
You could also consider using AR.js with a web-based approach if you’re open to that. It’s more straightforward for real-time applications.
I’ve seen some projects where people use TensorFlow for body tracking. It can be a bit complex, but it’s powerful.
I think tools like Vuforia might also help you with AR projects. They have a lot of resources and community support.