THE BERSERKER: An Emotionally Intelligent Driving Simulator

THE BERSERKER

ArtCenter Graduate Interaction Design Master Thesis

"The Berserker" is a transgressive driving simulator built as a Graduate Master Thesis project at ArtCenter College of Design. It challenges conventional machine vision applications by requiring drivers to maintain a smile throughout the drive to retain vehicle control, forcing participants to viscerally confront the implications of AI-monitored emotion in commercial fleets. Developed end-to-end: from Unreal Engine level design to OpenCV facial recognition and physical simulator hardware.

Process

• Developed "The Berserker" as part of the Graduate Master Thesis project, challenging the conventional use of machine vision technology for monitoring human emotions in commercial fleets.
• Initiated the project as a response to exposure to cutting-edge developments in Germany, particularly during tenure at BMW, and identified an opportunity for innovative exploration.
• Engaged in comprehensive research and development, spanning high-level conceptualization to low-level software and hardware development.
• Leveraged expertise in Unreal Engine, Arduino, hardware design, installation design, and OpenCV machine vision development for the custom prototype.
• Named the prototype "The Berserker" to reflect its unique capability of assuming control if the driver does not maintain a satisfactory emotional facial expression during the drive, thus challenging established norms.

Approach

• Approached the project with the aim of questioning the application of machine vision technology in monitoring driver emotions and the role of AI in user experiences.
• Demonstrated a holistic skill set, from Unreal Engine environmental development to AI machine vision implementation and electronic hardware programming.
• Designed the prototype to require drivers to maintain a smile throughout the drive to retain control, forcing participants to confront the impact of machine vision on their driving experience.
• Created a transgressive driving simulator that pushed the boundaries of conventional user flow and AI utilization within vehicles.
• Encouraged participants to critically evaluate the necessity of machine vision technology in their vehicles and consider the role of AI in their driving interactions.

Outcome

• Successfully completed "The Berserker" prototype as part of the Graduate Master Thesis project, offering a fresh perspective on machine vision technology and AI in commercial fleets.
• Challenged traditional applications of machine vision by designing a system where drivers must maintain a smile to retain control of the vehicle.
• Demonstrated a diverse skill set encompassing Unreal Engine, AI machine vision, and hardware programming.
• Developed a transgressive driving simulator that provoked participants to question the integration of machine vision and AI into their driving experiences.
• Encouraged critical thinking about the impact of emerging technologies on user interactions within vehicles, fostering a deeper understanding of AI's role in transportation.

Tools Used

• Unreal Engine: level design via Unreal Procedural Mapping
• Real-time data-reactive Head Up Display
• MQTT IoT Networking
• Webcam + OpenCV Facial Recognition Model
• Procedural driving sound production in Ableton Live + Unreal Sound Rigging

Credits

• Elise Co (Thesis Advisor): Mentorship & Conceptual Advisement