top of page
8b4f70e7-d8eb-4e7e-a69d-f770b54bdcf6_rw_1920.png

Unreal Engine_Robot Controlled Camera

Unreal Engine x KUKA IIWA

Robotic-oriented

Feng Chia University - Summer 2021

Academic Work - Summer Studio
Advisor: Alexey Marfin, Yu-Ting Shen, Shih-Yuan Wang
Team Member: Han Lin, Chung-Chieh Cheng, Eric Chen, Lee-Yo Chen, Xiao-Tian Yu, Hsiang-Ting Chien, Tsung-Han Tsai, Ting-Chia Chen, Kuo-Feng Wei, Kang-Chia Wei, Hung-Wen Lu, Zhao-Wei Liu, Joseph Wu, Shih-Kai Fan, Chun-Yu Lo,Ting-Xuan Jiang, Hung-Cheng Chun, Yung-Chi Liu, Yu-Sheng Liu

​

"Robot-Controlled Camera" utilizes the IIWA Lady, a human-machine collaborative robot, to explore the spatial perception experience extended by the virtual space and create unique animation effects. This design uses Unreal Engine to create virtual scenes. It also utilizes TACO IIWA software to collaborate with robots, exchanges information with Unreal Engine in real-time. Eventually, control the rendering effects of its virtual cameras and animations.

​

In detail, this study developed a custom interface between the ROSOCoop robots and Unreal Engine. Utilize the robot as an intuitive input device for real-time control of virtual cameras within the Unreal Engine scene. It controlled not only camera position/rotation but also focal length, speed, etc. 

 

Prototype: Communitcation

messageImage_1641194512459.jpg

Prototype: Collaborate with Robotic Engineers

messageImage_1641194595437.jpeg
ezgif.com-gif-maker (1).gif
8fbacad6-8eb2-4d2c-93c1-e87354aede9d.png

Develop an Unreal-Engine blueprint for receiving UDP camera data, from IIWA robot to Rhino Grasshopper and eventually, to Unreal-Engine scene. Utilize the robot as an intuitive input device for real-time control of virtual cameras within the Unreal Engine scene.

bottom of page