TY - GEN
T1 - Demonstrating XDTK
T2 - 37th Annual ACM Symposium on User Interface Software and Technology, UIST Adjunct 2024
AU - Gonzalez, Eric J.
AU - Chatterjee, Ishan
AU - Patel, Khushman
AU - Gonzalez-Franco, Mar
AU - Colaço, Andrea
AU - Ahuja, Karan
N1 - Publisher Copyright:
© 2024 Copyright held by the owner/author(s).
PY - 2024/10/13
Y1 - 2024/10/13
N2 - The interaction space of XR head-mounted devices can be extended by leveraging other digital devices, such as phones, tablets, and smartwatches. We present a demonstration of XDTK (Cross-Device Toolkit), an open-sourced prototyping toolkit for multi-device interactions in XR. The toolkit consists of: (1) an Android app that runs on client devices and surfaces pose, touch, and other sensor data to a (2) Unity server that can be added to any Unity-based XR application. For this demo, we specifically apply XDTK toward a few example applications, including multi-device arbitration. By leveraging relative pose data from each device, we can infer which device the user is gazing at so as to seamlessly hand off control and display between multiple devices. We also show examples leveraging a tablet sketching and a smartwatch for menu navigation.
AB - The interaction space of XR head-mounted devices can be extended by leveraging other digital devices, such as phones, tablets, and smartwatches. We present a demonstration of XDTK (Cross-Device Toolkit), an open-sourced prototyping toolkit for multi-device interactions in XR. The toolkit consists of: (1) an Android app that runs on client devices and surfaces pose, touch, and other sensor data to a (2) Unity server that can be added to any Unity-based XR application. For this demo, we specifically apply XDTK toward a few example applications, including multi-device arbitration. By leveraging relative pose data from each device, we can infer which device the user is gazing at so as to seamlessly hand off control and display between multiple devices. We also show examples leveraging a tablet sketching and a smartwatch for menu navigation.
KW - cross-device
KW - interaction
KW - mixed reality
KW - multi-device
KW - toolkit
UR - http://www.scopus.com/inward/record.url?scp=85211488508&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85211488508&partnerID=8YFLogxK
U2 - 10.1145/3672539.3686784
DO - 10.1145/3672539.3686784
M3 - Conference contribution
AN - SCOPUS:85211488508
T3 - UIST Adjunct 2024 - Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology
BT - UIST Adjunct 2024 - Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology
PB - Association for Computing Machinery, Inc
Y2 - 13 October 2024 through 16 October 2024
ER -