National University of Singapore, Singapore
08/2022 - 12/2022
NUS SoC NGNE Research-based Exchange Program
Major: Computer Science, School of Computing
With two CS modules and a research project:
-
CS3243 Interaction Design
-
CS4347 Sound and Music Computing
-
CP3106 Independent Research Project (Topic: Heads-up Computing)
Yixiao Kang
Always look for the intersection of
computing and design
About
I am Yixiao Kang, a senior undergraduate majoring in software engineering from Shanghai Jiao Tong University, China.
I work closely with Professor Stefanie Mueller at the MIT HCI Engineering Group on programmable material and new interactive interfaces. I also did research in the NUS-HCI group, advised by Professor Shengdong Zhao at the National University of Singapore. We developed a system to record people’s ubiquitous ideas with smart glasses. In 2021 summer, I participated in an internship supported by the University of Nottingham and Shanghai Jiao Tong University. Advised by professor Xubo Yang, I developed and deployed an application to create tangible AR souvenirs for interactive learning in the Shanghai Science and Technology Museum. I also worked with Professor Chaoping Chen at the Smart Display Lab at Shanghai Jiao Tong University on computer vision, SLAM, and mapping in augmented reality.
Email: kyx999@sjtu.edu.cn
GitHub: echo-xiao9
Shanghai Jiao Tong University, Shanghai, China
09/2018 - 06/2023 (Expected)
Bachelor of Engineering in Software Engineering
-
Major GPA: 4.00/4.00 (Top 1)
-
Introduction to Human Computer Interaction 100 (Top 1)
-
Game Designing and Programming 99 (Top 1)
-
Computer Graphics 98 (Top 1)
-
Architecture of Applications 94 (Top 3)
-
Data Structure 94 (Top 3)
Research
Massachusetts Institute of Technology, HCI Engineering group, CSAIL Lab
Advisor: Prof. Stefanie Mueller 04/2022 - present
-
Designed and implemented a system(developed in Python, Processing) that allows the user to reprogram the texture of textiles made of the proposed ChromoFiber, which is a reprogrammable multi-color fiber based on photochromic dyes.
-
Processed the video with OpenCV and extract the positions of LEDs in the fiber with the watershed algorithm.
-
Designed user interface and implemented linear programming to get constraint conditions for the specified color pattern.
Artist & Designer
I work as a designer and artist. I enjoy observing and creating.
CHAOS|2019
Digital ART Laboratory of Shanghai Jiao Tong University Shanghai, China
Advisor: Prof. Xubo Yang 02/2021 - 06/2021
-
Proposed a novel retargeting solution for tasks of grabbing and placing objects in virtual reality, called redirected placement (RP), which is applied when placing virtual objects.
-
Created an augmented reality virtual experiment application with unity. It can simulate convex lens imaging and perform real-time calculations of results based on user parameters.
National University of Singapore, NUS-HCI Lab
Advisor: Prof. Shengdong Zhao 07/2022 - 12/2022
-
Developed an NLP framework that converts audio recordings into various levels of structured information in real-time.
-
Data Visualization: extract keywords from the audio transcription, build a mindmap by clustering keywords according to their semantic associations, and render the mindmap on smart glasses.
Joint internship by the University of Nottingham and Shanghai Jiao Tong University, UK
Advisor: Prof. Steve Benford and Prof. Xubo Yang 06/2021 - 12/2021
-
Developed and deployed an augmented reality application to create tangible personalized souvenirs for interactive learning at the Shanghai Science and Technology Museum.
-
Adopted and evaluated multiple interaction methods, including mobile interface, hand gestures and voices.
-
Conducted user research on increasing personalization of the exhibition experience through augmented reality.
Shanghai Jiao Tong University, Smart Display Lab, China
Advisor: Prof. Chao Ping Chen 11/2019 - 01/2021
-
Developed a framework for 3D augmented reality navigation, mapping, and target detection.
-
Processed time-series data from LiDAR Scanner with an unsupervised deep neural network.
-
Built an indoor 3D map by applying Delaunay triangulation to the point cloud.
Smart Display Lab
Tie memories to e-souvenirs: personalized hybrid tangible AR souvenirs in the museum
Yixiao Kang, Zhenglin Zhang, Meiqi Zhao, Xuanhui Yang, Xubo Yang* (Accepted)
in Proceedings of The ACM Symposium on User Interface Software and Technology (UIST), 2022
Retargeting Destinations of Passive Props for Enhancing Haptic Feedback in Virtual Reality
Xuanhui Yang, Yixiao Kang, Xubo Yang*
in Proceedings of IEEE Conference on Virtual Reality and 3D User Interfaces, 2022
-
DOI - Open Access - Video - Slides
Simultaneous Tracking, Tagging and Mapping for Augmented Reality
Yixiao Kang, Yiyang Xu, Chaoping Chen*
in Proceedings of International Conference on Display Technology, 2019
DOI - Open Access - Project Page - Video
Projects
Experimental Platform Based on Augmented Reality Technology, group leader, developer
-
We developed an experimental platform in Unity for middle school students using AR technology.
-
Skill: Unity, Andriod development, AR Foundation
Tencent Unreal Engine ecosystem simulating tool
-
Developed an ecosystem simulation tool in Unreal Engine for data-driven authoring of large-scale ecosystems, which increases the efficiency of large-area foliage arrangement in the game by 20X.
-
Developed a recommendation algorithm for symbiotic plant clusters by leveraging real-world data.
-
Skill: Game Development, Unreal Engine
The Way of Water - Game developed with Unity focusing on fluid simulation
It is a Sewage Purification Game. We use the PBF method to implement fluid simulation.
Tencent, China
-
Developed an ecosystem simulation tool in Unreal Engine for data-driven authoring of large-scale ecosystems, which increases the efficiency of large-area foliage arrangement in the game by 20X.
-
Developed a recommendation algorithm for symbiotic plant clusters by leveraging real-world data.
Internship
Honors and Awards
-
Presentation at International Conference on Display Technology (ICDT 2021) 06/2021
-
Lightning talk at The ACM Symposium on User Interface Software and Technology 11/2022
-
2021 Huawei Scholarship (Top 5%) 12/2021
-
2020 Interdisciplinary Contest in Modeling - Meritorious Winner 04/2020
-
Gold Prize of China Collegiate Algorithm Design & Programming Challenge Contest 06/2021
Activities
Head of the Chinese Volunteer Group at EXIT, the largest music festival in Europe,
Novi Sad, Serbia 07/2019
-
Tuned the sound system and multiple instruments for the performance as a stage assistant
-
Informed artists of performance time and maintained backstage order
Chair of Master Distinguished Lecture Host Group,
Shanghai, China 11/2020 – 10/2022
-
Host Nobel Laureate Adam Riess's seminar, the 125th-anniversary celebration
of the founding of Shanghai Jiao Tong University, and TED talks.
-
Recruited and trained members of the host group.
Official Designer of China International Import Expo,
Shanghai, China 12/2020
-
China International Import Expo volunteer certificate designer
Official Designer of The IEEE Conference on Virtual Reality and 3D User Interfaces,
Shanghai, China 03/2022
-
Designed IEEE VR 2023 logos, website, and other materials. Link: ieeevr.org/2023/
Publication
-
Y. Kang, Y. Xu, C. P. Chen, G. Li, and Z. Cheng, “6: Simultaneous tracking, tagging and mapping for augmented reality,” SID Symposium Digest of Technical Papers, vol. 52, no. S2, pp. 31–33, 2021.
-
X. Yang, Y. Kang, and X. Yang, “Redirected Placement: Retargeting Destinations of Passive Props for Enhancing Bimanual Haptic Feedback in Virtual Reality,” 2022 IEEE Conference on Virtual Reality and 3D User Interfaces, 2022.
-
Y. Kang, et al., “ Tie memories to e-souvenirs: personalized souvenirs with augmented reality for interactive learning in the museum.” The ACM Symposium on User Interface Software and Technology, 2022
