Prototyping a wearable AR training and assistance tool that uses voice commands, gesture controls, and a dynamic HUD to guide surgeons in real surgical procedures.
Google Glass might have been shelved as an awkward gizmo of the late 2010s, and while its uses in the streets would inspire ill-conceived comments or privacy concerns, there were far more legitimate applications in professional environments. One of those is an Operating Room (from now on, OR).
Photo: Cardiac surgeon wearing loupes, Wikimedia commons.
In the vast majority of cases, expert surgeons do not need to be told what is the next step in a procedure. Yet in extreme cases (e.g. emergency or combat situations), critical, live-altering procedures could fall without the particular expertise of a combat surgeon or healthcare practitioner.
Photo: AI-generated, only illustrative.
Touch Surgery tasked my team to evaluate the feasibility of the above scenarios. Short of travelling to an active war zone, the next best thing was to witness a few surgeries. Spoilers: Google Glass's battery was of a too short autonomy, its NLP wasn't nowhere near as reliable as it would be necessary.