Mixed Reality for CSI

Class Project January – March 2017

My Contributions UX  Research, Storyboarding,  3D Animation

An exploration of the HoloLens’ potential to create an efficient method for documenting crime scenes while improving accessibility of information across police, legal, and public parties. This project is currently in the running for the July 2017 Microsoft Design Expo, and will be undergoing lots of revision. Please consider this a work in progress.

HOLOLENS AS A TOOL

Typical methods for crime scene investigations have remained the same for decades, relying on hand measurement, sketches and photographs to recreate the entire environment. The HoloLens’ three dimensional mapping capability not only automates these tasks with increased accuracy, but replicates the entire crime scene as a virtual space beyond the initial investigator’s point of view

The system provides feedback for progress in the initial documentation of the crime scene by overlaying the virtual with the real.

 

Non physical evidence such as testimonials and forensic analysis are represented as virtual objects that relate to their context in the environment.

 

The virtual model allows for prosecuting and defense attorneys to draw conclusions from the same information and present it in an intuitive and accessible format.

 

RESEARCH

In addition to contextual inquiries with the campus police department, we interviewed two law professors with experience in criminal justice to gain a better understanding of evidence's role from investigation to verdict.

 

“If police were required to use HoloLens to document the collection of evidence, it would create more transparency for search and seizure operations.”

“I think a defense attorney would cry tears of joy if this technology were introduced into criminal investigations.”

 

 

Here we learned that the potential of this technology for increasing defense attorney's access to the case files in a way that is intuitively organized. In addition to the immediate spatial understanding gained by standing in a holographic representation, access to non physical evidence such as testimonials and forensic analysis is greatly increased when the contents of a  dense case file exist as virtual objects in the immediate environment.

 

 

 

MY CONTRIBUTIONS

During the research phase of the project I created a high level UX story board showing key moments in the HoloLens' use as a tool for crime scene investigation. in the production phase, I was in charge of creating 3D elements of the final video.

 

Above is an example of a scene's transformation from the initial UX story board to a recreation  in Cinema4D. Changes in camera angle were made to better show interface from a user perspective.

 

MOVING FORWARD

While we were lucky to get the interviews we did, it’s crucial that we learn more about how to ensure that this product fosters public understanding and engagement with the justice system, rather than blind acceptance to simulated evidence presented as truth.