本文へジャンプ

Augmenting Human Capabilities with User Interfaces

MIYATA Laboratory
Senior Lecturer:XIE Haoran

E-mail:
[Research areas]
Computer Graphics (CG), Human Computer Interaction (HCI), Human Augmentation
[Keywords]
Deep Learning, Design Interface, XR(AR,VR,MR), Creativity Support, Physical Augmentation, Wearable Device

Skills and background we are looking for in prospective students

Strong desire to be "wizard", "psychic", or "superman" with their own strengths and development skills and realize their own "dreams". It is desirable but not required, willing to master the CG, HCI and machine learning technologies.

What you can expect to learn in this laboratory

Students can develop future value-creating capabilities with professional expertise and wide knowledge in the coming super-smart society. They can gain the ability to think cross-disciplinarily, utilize feasible approaches, and create innovations. We encourage students to accumulate knowledge from different fields of study and foster interdisciplinary thinking. The development of augmented interfaces acquires practical skills for actual social issues.

【Job category of graduates】
ICT, R&D, Manufacturing, Creative Industry, etc.

Research outline


Fig.1 Research topics in augmented interfaces

We aim to conduct the advanced topics in Augmented(X) Interfaces for realizing Society 5.0※ (Fig. 1). Our research vision is to create a future society in which everyone can pursue their dreams by augmenting their own creativity, cognitive abilities, and physical capabilities through the advanced technologies that highly integrate cyber and physical spaces.
※ i.e., super-smart society, the concept of the future society proposed in Japan 5th Science and Technology Basic Plan.

(1) Creativity Augmentation: xDesign

The rapid development of deep learning related technologies has led to social reforms nowadays. However, creative artificial intelligence (AI) technology is still a challenging and important research topic attracting worldwide attention. This research topic aims to support the media content production by using data-driven methods such as GAN and VAE in CG related research fields. Specific examples include design interface that supports the interactive design of 3D airplane geometry and generative interface that enables to edit the flow motion from user sketches.

(2) Spatial Augmentation: xSpace


Fig.2 Technology map for augmented interfaces

This research topic aims to conduct the user interfaces to support creative activities by seamlessly connecting real and virtual spaces with spatial computing technologies. Specific examples include 3D interface that enables common users to easily construct large-scale fabrication, and sketch system that supports the placement of dominoes in real time from freehand sketches.

(3) Human Augmentation: xHuman

Recent developments of AI, XR and 5G technologies are augmenting every aspect of our lives. We are in the "Augmented Age" which offers us the greatest advantages and possibilities in human history. This research topic aims to develop technologies to recover or augment human's capabilities using information technology and robotics. Specific examples include wearable device that mimics the animal tails to augment human body functions and emotional expressiveness, and the shape-changing clothes with retractable mechanism to adjust body temperature according to the estimated wearer's situation.
Figure 2 shows the possible technologies related to these research topics for augmented interfaces.

Key publications

  1. H.Xie, H. Matsuzaki and T. Torii. xClothes: Augmenting Human Thermoregulation Using Shape Changing Clothes. Augmented Human 2020,1-8,2020. (2nd Best Paper Award)
  2. Z. Hu, H. Xie, T. Fukusato, T. Sato and T. Igarashi. Sketch2VF: Sketch-Based Flow Design with Conditional Generative Adversarial Network. Computer Animation and Virtual Worlds, 30(3-4),1-11, 2019. (Best Paper Nominee Award)(Journal Cover)(Top Downloaded Paper)
  3. H. Xie, T. Igarashi and K. Miyata. Precomputed Panel Solver for Aerodynamics Simulation. ACM Transactions on Graphics. 37(2), 1-12, 2018. (ACM SIGGRAPH 2018)

Equipment

Deep Learning Server, 3D Printer and Scanner, Sensors, Projectors, Depth Cameras, JAIST FabLab

Teaching policy

Our goal is to help students to be ready to work immediately in research and development through collaborative and individual projects, emphasizing own initiative in our research vision of the augmented interface. To achieve these goals, students are encouraged to develop own research styles and communication skills through research projects. They are required to participate in a variety of research projects to clarify their own potential and research vision, and to explore novel solutions in collaboration with faculty member. In addition, we will support students to achieve top-level research outcomes by providing opportunities for joint research and industry-academic collaboration with domestic and international research institutions.

[Website] URL:http://x-interface.com/

PageTop