“Blended Reality was an applied research grant sponsored by Hewlett-Packard and other industry leaders, such as Intel. Originally intended as a three-year grant that was to culminate in a report on immersive media in higher education, I renewed it for an additional four years based on the merit of the work produced and the meaningful relationships established. I began as one of many team members in 2016 and eventually became the Principal Investigator in 2018.”
Lemmings is an API that uses simple spatial relationships to create remappable gestures for immersive experiences. Most gestures in immersive experiences are created using machine learning, which is very effective, but very difficult to adjust manually. Some gesture systems allow for gestures that can be adjusted but they rely on very complex libraries that might break with unexpected updates, making them difficult to update or transition to new projects.
The Verb Collective is a toolkit designed to aid artists in exploring interactive media and to help non-specialized instructors teach interactive media as well as virtual and augmented reality.
Industry developed interfaces for immersive media are designed to emulate pistols, with the core interaction based on aiming at something and pulling the trigger. Beyond the cultural concerns of such interfaces there is an even more fundamental problem: pointing and clicking makes sense in an abstract interface like a 2D screen, but does it work well in an embodied medium such as virtual reality? The two main outcomes from this investigation were studies regarding the effectiveness of a wheelchair powered interface and a modular, remappable controller that led to the formation of the company Indistinguishable from Magic.
This was an international collective of over twenty creative producers that collaborated on a manifesto for the nascent practice as part of Ars Electronica.