I’m interested in creating a smartboard and maybe even something similar to an AR climbing wall setup like this:
I know there probably aren’t any fully completed open-source projects for this, but I’d love any advice on where to start! Also, if anyone has book recommendations to learn more about these types of projects, that would be awesome.
It’s more about the display and sensor side of things, but with the right setup, you might be able to integrate gesture tracking. It’ll require a bit of coding, though!
Jumping in here—I’ve used OpenHMD before. It’s definitely versatile, but yeah, you’ll need to get creative with the tracking. Have you tried using a Kinect for gesture tracking? You could pair it with OpenHMD.
For something like a climbing wall, you might want to look into Project IRIS—it’s designed for tracking movements. Not fully open-source but still has some FOSS components. I’ve used it for VR projects.
It’s fairly user-friendly but has a bit of a learning curve. It should be doable if you’ve got some programming knowledge. Plus, the community around it is super helpful!
I second this! IRIS is great, but you’ll probably also want to pair it with Unity or Unreal Engine for flexibility. Makes it a bit easier to customize the experience, especially for something like an AR wall.
Have you thought about looking into open-source projection mapping software? It might not be AR-specific, but for a climbing wall, it could be a fun alternative. Check out MapMap or Lightform for inspiration.
MapMap is actually pretty straightforward and has a decent community around it. The only challenge is aligning everything perfectly on a 3D surface, but once it’s calibrated, you’re good to go!
For books, maybe check out ‘Practical Augmented Reality’ by Steve Aukstakalnis. It covers AR basics and some project ideas—might be helpful for your smartboard idea!
Jumping in to say that’s a great book! It breaks down things pretty well if you’re starting out, plus some cool use cases for AR. Good luck with the project!