Interactive AI systems are evolving beyond traditional mobile and web interfaces into new form factors such as extended reality glasses and collaborative robots, expanding AI’s potential to assist users in real-life tasks (e.g., sports training, cooking, vehicle repair). These developments also introduce challenges in interface design for safety and correct execution, effective instruction and feedback, preservation of human agency, ethics, and explainability.
This course explores the challenges at the frontier of immersive human-AI interaction. Through critical analysis and replication of state-of-the-art research, students will design, implement, and evaluate novel XR-based AI prototypes, to address key gaps in the current literature. By grounding development in human-centered design principles, students will learn to create intelligent systems that not only enrich human experience but also amplify human skill, understanding, and agency.
NOTE: We expect all students taking this course to have background knowledge in HCI, either through CS185 or research work or other means. Prior experience building systems with LLMs and/or computer vision tools would be helpful, but not required.
Once the quarter starts, instructor approval is required to maintain enrollment in the course, including if students do not have the listed pre-requisite courses completed.