Kinect + Brain Scan = Augmented Reality for Neurosurgeons

Microsoft researchers demo a system that creates 3D models of brain scans using the new Kinect Fusion API

Advertisement

With a little duct tape, a touch screen tablet, and their new Kinect API, the Microsoft Research Cambridge team built an augmented reality system to help brain surgeons visualize 3D brain scans. Kinect Fusion supplies 3D modeling of anything, which could fuel some seriously neat medical innovations. (The Cambridge team also built KinEtre, which lets you posses anything.) At the 13th annual Microsoft TechFest, Ben Glocker demoed a prototype system that would allow neurosurgeons to prepare for surgery by looking inside a patient's brain before they cut it open. Doctors could see the skeleton, brain, blood vessels, and the targeted tumor on a tablet—which they can move around the patient's head—helping them to plot the best brain surgery path.

The Fusion API will be released in the next Kinect for Windows SDK, which researchers say will be out very soon.

Robotics News

Biweekly newsletter on advances and news in robotics, automation, control systems, interviews with leading roboticists, and more.

About the Automaton blog

IEEE Spectrum’s award-winning robotics blog, featuring news, articles, and videos on robots, humanoids, automation, artificial intelligence, and more.