T17: 3DUX: HCI User Experience Design for Immersive Systems and 3D Environments

Tuesday, 17 July 2018, 08:30 – 12:30


Amy Banic, Ph.D. (short bio)

University of Wyoming, Laramie, WY
Idaho National Laboratory, USA



Participants in this half-day tutorial will:

  • Learn about low-cost immersive systems (input and output hardware).
  • Learn how to utilize these hardware solutions.
  • Be provided with hands-on instruction of APIs to serve as a base for 3D UI
  • Learn about 3D UI components and design as they relate to immersive systems
  • Learn how these issues relate to the design of user-interface components(metaphors, mental models, navigation, interaction, and appearance) for 3D environments.
  • Learn about the cognitive and perception issues and challenges for designing interactiontechniques for immersive environments that affect 3D UX
  • Learn the metrics and tools successful for evaluation of 3D UI and 3D UX in ImmersiveVR/AR systems.


Content and benefits:

This half-day tutorial will focus on the following content:

  • Terminology of Immersive systems (hardware and software) and 3D UI design components
  • and issues, including hardware and software lists.
  • Instructions for use of basic input technologies for immersive environments
  • 3D UI/ 3D UX design methodology
  • Discussion of the challenges in designing for good 3D User Experiences.
  • Discussion of cognitive and perception issues and challenges for designing interaction forimmersive environments, stimulated by provided examples.
  • Advanced metrics to evaluate User Experiences with VR/AR/Mixed Reality systems.

With 3D technology and immersive environments becoming more popular, this tutorial will allowtraditional HCI researchers, professionals, developers, UI/UX designers, etc. to initiate work in 3DUI for immersive environments. This tutorial is focused on introductory concepts and basic lowcosttechnology and open-source software, new 3D UI/ 3D UX issues faced when designing for3D environments and immersive technology, and useful metrics/tools for evaluating 3D UI/ 3DUX and user experience in AR/VR/Mixed Reality systems.


Target Audience:

Target audience for this tutorial include traditional HCI/CHI/UI/UX designers, analysts,developers, usability professionals, cognitive scientists, visual and interaction designers,ethnographers, and other professionals in HCI who may know relatively little about 3D UI / 3DUX design for immersive systems and 3D environments who may want to or already would liketo initiate work in this area. Additionally, this tutorial will be of interest to those who may beinterested in User Experience Design for any Immersive Environments in the Mixed Realityspectrum.

Bio Sketches of Presenters:

Amy Banic is an Associate Professor of Computer Science at theUniversity of Wyoming (UWYO) and holds a joint appointmentat the Idaho National Laboratory. Her research focus is 3D UserInterfaces and Interaction Techniques for Virtual Environments,Immersive Visualizations, and Virtual Humans, with a primaryfocus on bimanual, collaborative, and multi-modal interaction.Learn more at www.AmyBanic.com.Dr. Banic is the founder and director of the 3D Interaction andAgents (3DIA) research lab at UWYO [www.3DIA.org]. Shealso mentors the VR InnoVRtors student maker group at UWYO[www.uwyo.edu/InnoVRtors]. Prior to her appointment at UWYO in 2010 held a Post-DoctoralFellowship position in the Virtual Environments Group at Clemson University, School ofComputing. in 2009, she received her Ph.D in 3D User Interfaces and Virtual Environments in2008 as well as her M.S. in 2005 from the University of North Carolina at Charlotte. She receivedher B.S. in CS and B.A. in Studio Arts from Duquesne University in 2003.