MIXED REALITY ROBOTICFABRICATION
Mixed reality (MR)
sometimes referred to as hybrid-reality, is the merging of real and virtual worlds to produce new environments and visualizations where physical and digital objects co-exist and interact in real time.
2018/07/26
Microsoft - Principal Designer - Sheng Kai Tang
Prof. Shih-Yuan Wang
Prof. Yu-Ting Sheng
MR & UR robotic arm Collaboration Interface
Explore the possible ways of combing digital fabrication and augmented reality interface
Additive robotic system
With the aids of robotic arms, digital speculations and locations could be approached accurately.
UR 10 robotic arms *2
Hololens G1 *4
self-developed air pad tool*4
By using Microsoft Hololens, we placed the digital object in the augmented reality interface. At the same time, the robotic arm recognized the locations where it places the real bricks to match the outcome in the digital environment. This working scenario could only be built up based on the exploration of a mixed reality robotic fabrication interface.
This method aims to explore the possibilities between digital fabrication and user interface. Without using visual programming software(Grasshopper, CAM), users could intuitively pick up building materials and arrange them directly by using specified hand gestures set in Unity. With the accuracy of robotic arms, the structure could be built up even remotely by a user far away from the construction site.
By using Microsoft Hololens, we placed the digital object in the augmented reality interface. At the same time, the robotic arm recognized the locations where it places the real bricks to match the outcome in the digital environment. This working scenario could only be built up based on the exploration of mixed reality robotic fabrication interface.
This method aims to explore the possibilities between digital fabrication and user interface. Without using visual programming software(Grasshopper, CAM), users could intuitively pick up building materials and arrange them directly by using specified hand gestures set in Unity. With the accuracy of robotic arms, the structure could be built up even remotely by a user far away from the construction site.
AR
Robot
Build
