AR face filters with dynamic projection mapping... thoughts?

I just came across this concept of perceptually-aligned dynamic facial projection mapping using high-speed face-tracking and lens-shift coaxial setup. It looks really interesting, especially how it can enhance AR face filters. You can check out the project page here: vision.ict.e.titech.ac.jp. Anyone have thoughts on this technology?

That looked scary at first with the first guy. :laughing:

The lens shift coaxial projection setup is interesting. Nice to see some work into finessing the mapping part of this concept. It’s also good to see more real-world augmentation that’s not dependent on a headset and can be a shared experience.

Thanks! I did some work for Panasonic a few years ago with the PT-RQ35KU 4K projectors they used at the Olympics to do real-time IR-based projection mapping. This stuff is impressive, but the image in my head remains seeing Yugo Nakamura demo some of his R&D work with Sony Japan around 2001. He had ceiling-mounted room projectors that extended into the real world, allowing him to drag files across from his laptop to his computer. That’s kind of like the conceptual shift I had in mind.