Haoran Xie, Ph.D.
Associate Professor
Human-Centered AI Laboratory (XIE LAB)
Japan Advanced Institute of Science and Technology (JAIST)
Waseda University (Cross-appointment)
Japan Advanced Institute of Science and Technology (JAIST)
Waseda University (Cross-appointment)
xie at jaist.ac.jp
Latest News
- 2025.10 Research funded by JST BOOST, Kakenhi B and Exploratory, Live2D, NEDO(co-PI) and JST-CREST(co-PI).
- 2025.07 Joined Waseda University as Researcher(Associate Professor) by cross-appointment with JAIST.
- 2025.04 featured in JAIST Faculty Interview [LINK].
Short Bio
Haoran Xie is an Associate Professor at Japan Advanced Institute of Science and Technology (JAIST) and Waseda University. He previously served as Assistant Professor (2018) and Senior Lecturer (2020) at JAIST, and as Project Assistant Professor (2017) and Postdoctoral Researcher (2015) in User Interface Research Group with Takeo Igarashi at University of Tokyo. He received Ph.D. and M.S. in Computer Graphics from JAIST (2015) under the supervision of Kazunori Miyata, and B.S. in Applied Mathematics from Anhui University (2006). He was a visiting scholar at Kent State University (2013–2014) working with Ye Zhao, University of Sydney (2011), and University of California, Davis (2012). He is a member of ACM, IEEE, IPSJ, and the Society for Art and Science. His research has been featured in numerous media outlets, including Nikkan Kogyo Shimbun, ITmedia NEWS, TechXplore, and China Science Daily.
[NSF IRES: Summer Research Intern Opportunity]: From 2022 Fall, we started to direct a three-year research project on Physical AI Design sponsored by NSF with Prof.Bo Zhu (PI) and Prof. Takeo Igarashi. We are actively looking for summer research interns in the areas of physics simulation, machine learning, and user interface in Dartmouth College, University of Tokyo and JAIST. More information about the internship can be found on the project webpage. (The applicant must be a U.S. citizen or permanent resident)
Research Vision
I believe emerging technologies (Information Science) are designed and created to enhance human capabilities and involve human in the loop for better performance and knowledge discovery (Knowledge Science). My main research interests are at Human-Centered Generative AI techniques and its applications as the boundaries (User Interfaces) for Augmenting Human Intelligence with Machine Intelligence, especially generative AI for professional designs (anime, architecture, fashion, robots, etc.), and computer graphics technologies.
Our group conducts the education of both Information Science and Knowledge Science degrees for self-motivated PhD/Master students. We explore innovative research projects in Interactive Computer Graphics, Image and Video Generation, Physical AI, Human-Computer Interaction, Human Augmentation and Robotics with the following current main research topics: (For research introduction, please refer [JAIST][Interview][Sketch].)
- Human-Centered Generative AI:
- Creative Image Generation: anime, architecture, fashion design, etc.
- Physical Video Generation: control, fluid simulation, video generation, etc.
- Physical AI: VLA foundation model, robotic learning, teleoperation, etc.
- Human-AI Interaction: sketch interface, augmented human, creativity support, etc.
- Interactive Computer Graphics:
- Simulation and modeling, physical animation, generative models, virtual & augmented reality, etc.
Selected Projects
Sketch-Guided Content Generation
DiffOBI: Diffusion-based Image Generation of Oracle Bone Inscription Style Characters
X. Xie, X. Du, M. Li, X. Yang, H. Xie
ACM SIGGRAPH Asia 2024, Technical Communications, 2024
[Paper]
X. Xie, X. Du, M. Li, X. Yang, H. Xie
ACM SIGGRAPH Asia 2024, Technical Communications, 2024
[Paper]
AniFaceDrawing: Anime Portrait Exploration during Your Sketching
Z. Huang, H. Xie, T. Fukusato, K. Miyata
ACM SIGGRAPH 2023, Full, 2023
[Project] [PDF] [Video]
[TechXplore] [EurekAlert!] [alphagalileo] [JAIST] [Waseda] [ScienceDaily]
[News8Plus] [日本の研究] [SINA] [QQ] [北陸放送] [北國新聞] [PC Watch] [CGWORLD]
Z. Huang, H. Xie, T. Fukusato, K. Miyata
ACM SIGGRAPH 2023, Full, 2023
[Project] [PDF] [Video]
[TechXplore] [EurekAlert!] [alphagalileo] [JAIST] [Waseda] [ScienceDaily]
[News8Plus] [日本の研究] [SINA] [QQ] [北陸放送] [北國新聞] [PC Watch] [CGWORLD]
Creative AI for Architectural Design
AI-Driven Urban Evolution Forecasting: A Unified Memory-Aware Multi-Conditional Generation Framework for Sustainable Development Planning
X. Du, C. Li, Q. Li, Y. Lu, Y. Xu, Y. Zhang, Z. Xu, H. Xie
Sustainable Cities and Society, 2026(JCR Q1, IF 12.0)
[Paper]
X. Du, C. Li, Q. Li, Y. Lu, Y. Xu, Y. Zhang, Z. Xu, H. Xie
Sustainable Cities and Society, 2026(JCR Q1, IF 12.0)
[Paper]
Controllable Generation of Building Representations: Aligning Campus Building Design Intent with Multi-Stage Retrieval-Augmented Diffusion Models
Z. Wang, Y. Ren, H. Jin, J. Feng, X. Du, Y. Zhang, H. Xie
Frontiers of Architectural Research, 2026(JCR Q1, IF 3.6)
[Paper]
Z. Wang, Y. Ren, H. Jin, J. Feng, X. Du, Y. Zhang, H. Xie
Frontiers of Architectural Research, 2026(JCR Q1, IF 3.6)
[Paper]
Retrieval-Augmented Sketch-Guided 3D Building Generation: Generative Architectural Design for Japanese Detached Houses
Z. Wang, N. Rochanavibhata, Y. Ren, X. Du, Y. Zhang, H. Xie
CAADRIA 2026, 2026
[LINK]
Z. Wang, N. Rochanavibhata, Y. Ren, X. Du, Y. Zhang, H. Xie
CAADRIA 2026, 2026
[LINK]
Creative AI for Physical Intelligence
Human-AI Interaction
Creative Robotics: Learning, Intelligence and Interfaces
Scalable and Foldable Origami-Inspired Supernumerary Robotic Limbs for Daily Tasks
M. Kusunoki, L. Nguyen, H. Tsai, V. Ho, H. Xie
IEEE Access, 2024(JCR Q1, IF 3.6)
[IEEE] [Video] [Video(short)]
M. Kusunoki, L. Nguyen, H. Tsai, V. Ho, H. Xie
IEEE Access, 2024(JCR Q1, IF 3.6)
[IEEE] [Video] [Video(short)]
For more details, please refer to page Publications and Videos.
Profile
- Researcher(Associate Professor)@Waseda University, 2025.07 - current
- Associate Professor@JAIST, 2023.04 - current
- Senior Lecturer@JAIST, 2020.10 - 2023.03
- Assistant Professor@JAIST, 2018.04 - 2020.09
- Project Assistant Professor@University of Tokyo, 2017.04 - 2018.03
- Postdoc Researcher@University of Tokyo, 2016.04 - 2017.03
- JSPS Research Fellow (PD)@University of Tokyo, 2015.04 - 2016.03
- Ph.D. (Computer Graphics)@JAIST, 2012.04 - 2015.03
- JSPS Research Fellow (DC2)@JAIST, 2014.04 - 2015.03
- Visiting Scholar@Kent State University, (2013)
- M.S. (Computer Graphics)@JAIST, 2010.04 - 2012.03
- Visiting Scholar@The University of Sydney, Australia, (2011)
- Research Student(Computer Graphics)@JAIST, 2009.10 - 2010.03
- System Engineer, Project Leader@USTC EBT, 2006.07 - 2009.09
- B.S. (Applied Mathematics)@Anhui University, 2002.09 - 2006.06
Grants
- (Co-PI) JST CREST, Cross-X: Realizing Body Intelligence for Diverse Forms through AI-Driven Tactile/Proximity Sensing and Adaptive Components (PI: Ho Anhvan), Co-Investigator, 2025-2031 LINK
- (PI) KAKENHI Challenging Research (Exploratory), Challenge to Decipher Oracle Bone Script Using Evolutionary Image Generation Models, 2025-2028 LINK
- (PI) JST BOOST Next-Generation AI Talent Development Program (Young Researcher Support), Pioneering Co-evolutionary Interaction between Human Creation and Image Generation, 2025-2030 LINK
- (PI) KAKENHI Grant-in-Aid for Scientific Research (B), Research on Physics-Based Controllable Fluid Video Generation, 2025-2029 LINK
- (PI) Joint Research (Live2D Inc.), Research on Structural Element Separation of Illustration Original Art, 2025.7-2026.6 LINK
- (PI) JAIST Research Center Formation Support - Emerging Research Support, Pioneering Creative Physical Intelligence Research, 2025
- (Co-PI) NEDO, Post-5G Information and Communication System Infrastructure Enhancement R&D Project, Survey on Utilization of Anime x Generative AI for Anime Creator Development and Production Support (PI: Tatsuo Yotsukura), Survey on Physical Expression Production Methods in Anime Production, 2024-2026 LINK
- (PI) JAIST Research Center Formation Support - Advanced Research Center Support, Physical AI Design International Research Center, 2024
- (PI) Kayamori Foundation for Informational Science Advancement Research Grant, New Developments in Creative Support through Controllable Image Generation AI Technology, 2023-2025 LINK
- (Co-PI) KAKENHI Challenging Research (Exploratory), Research on Sketch-Driven Fluid Simulation in Computer Graphics (PI: Shuhei Sato), Co-Investigator, 2023-2026 LINK
- (PI) JAIST Research Center Formation Support - Advanced Research Center Support, Physical AI Design International Research Center, 2023
- (PI) Nakayama Foundation for Human Science 30th Anniversary Memorial Research Grant, Research on Remote Game Support Technology Using Projection Mapping, 2022-2023 LINK
- (PI) JAIST Research Center Formation Support - Emerging Research Support, Creative Activity Support in the Metaverse, 2022
- (PI) JAIST Research Center Formation Support - Advanced Research Center Support, Creative AI Research Center, 2021
- (PI) JAIST Research Center Formation Support - Advanced Research Center Support, Creative AI Research Center, 2020 LINK
- (PI) KAKENHI Grant-in-Aid for Early-Career Scientists, Interactive Functional Design through Precomputation of Complex Fluids, 2020-2023 LINK
- (Co-PI) Tateishi Science and Technology Foundation Research Grant A, Deep Learning Framework for Creating High-Quality 3D Characters from Rough Sketches (PI: Tsukasa Fukusato), Joint Research, 2020 - LINK
- (PI) Nakayama Foundation for Human Science Research Grant A, Research on Game Support Technology Using Projection Mapping, 2020 - LINK
- (PI) JAIST Research Center Formation Support - Emerging Research Support, Creative Activity Support through Projection Mapping Technology, 2019
- Nakayama Foundation for Human Science International Exchange Grant, Computer Animation and Social Agents (CASA 2019), 2019 LINK
- (PI) Funai Foundation for Information Technology Research Encouragement Award, Research on Dynamics Expression of Objects under Complex Fluid Influence, 2019 LINK
- (PI) JAIST Research Center Formation Support - Emerging Research Support, Creative Activity Support through Human-Machine Collaboration, 2018
- Ogasawara Foundation for the Promotion of Science and Engineering International Conference Travel Grant, Precomputed Panel Method for Aerodynamic Models, 2018 LINK
- (PI) KAKENHI Grant-in-Aid for Research Activity Start-up, Design Support for Complex Fluids through Sketching, 2017-2019 LINK
- (PI) Leading Graduate School Faculty Budget (University of Tokyo), GCL Student Development, 2017 LINK
- (PI) Shenzhen Innovation Competition International Competition Research Grant, Human Augmentation Technology through Human-Machine Interaction, 2017- LINK
- (PI) Epson International Scholarship Foundation Research Grant, Support for Functional and Creative Design Considering Turbulence Effects, 2017 LINK
- (PI) KAKENHI Grant-in-Aid for JSPS Fellows, Dynamics Expression of Various Objects Considering Turbulence Effects, 2014-2016 LINK
- JAIST Support Foundation Student Research Encouragement Award (UK), Computer Graphics International 2012, JAIST, 2012
- Institutional Program for Young Researcher Overseas Visits, Research Visit to University of Sydney, JSPS, 2011
Media Coverage
- [JAIST] Student CHEN received Best Paper Award at NICOGRAPH International 2025, JAIST, 2025.08. [LINK]
- [JAIST] Student Miyauchi received Honorable Mention Award at NICOGRAPH International 2025, JAIST, 2025.08. [LINK]
- The World of Creation in the AI Era: Digital Technology Supporting Human Sensibility, JST Science Portal, 2024.10. [LINK]
- High-precision anime images from beginners' rough lines: Generative AI supporting drawing, Asahi Shimbun Digital, 2024.04. [LINK]
- [JAIST] Student ZHANG received Best Presentation Award at CGIP2024, JAIST, 2024.02. [LINK]
- Waseda University research team develops anime generation AI technology: Even beginners can achieve professional level, Nikkan Cyzo, 2023.09. [LINK]
- Various AI models generating 3D face models, textures, and animations from text emerge, CGWORLD.jp, 2023.08. [LINK]
- Beginners' anime illustrations become professional-level: New generative AI "AniFaceDrawing", MRO Hokuriku Broadcasting, 2023.08. [LINK]
- Generative AI framework helps you "one-click generate" anime-style avatars from hand-drawn sketches, Guokr Hard Technology, 2023.08. [LINK]
- Scientists Develop AI-Powered High-Quality Anime Portraits for Beginners, Brighter Side News, 2023.08. [LINK]
- New AI Program Purports to Let Even Beginners Make High-Quality Anime Character Portraits, Anime News Network, 2023.08. [LINK]
- AniFaceDrawing: AI-powered Project Aims to Help Anyone Create Anime Character Portraits, Fagen Wasanni Technologies, 2023.08. [LINK]
- AniFaceDrawing: Delivering Generative AI-Powered High-Quality Anime Portraits for Beginners, ACM technews, 2023.08. [LINK]
- This new AI generates anime portraits from hand sketches and it's pretty awesome, ZME Science, 2023.08. [LINK]
- Generative AI technology developed that enables beginners to create high-quality anime images, University Journal Online, 2023.08. [LINK]
- AI that generates beautiful anime-style characters from rough doodles!, Nazology, 2023.08. [LINK]
- JAIST et al. develop generative AI technology enabling anyone to create professional-level anime images, TECH+, 2023.08. [LINK]
- High-quality portraits created with generative AI: Technology devised by advanced institute, Hokkoku Shimbun, 2023.08. [LINK]
- Generative AI enabling beginners to draw high-quality anime images developed by Waseda and JAIST, PC Watch, 2023.08. [LINK]
- [Press Release] AniFaceDrawing: Delivering generative AI-powered high-quality anime portraits for beginners, 2023.08. [TechXplore] [EurekAlert!] [JAIST] [Waseda]
- [Press Release] Generative AI technology developed enabling beginners to create high-quality anime images, 2023.08. [JAIST] [Waseda]
- [JAIST] Student Kusunoki et al.'s paper received Excellent Oral Presentation Award at ICVR2023, JAIST, 2023.06. [LINK]
- Japanese research team launches AniFaceDrawing to generate high-quality anime images, Sina, 2023.06. [LINK]
- New System Helps Remove Biases Found in AI Training Datasets, AZoRobotics, 2023.04. [LINK]
- JAIST et al. develop system to remove co-occurrence bias in deep learning for images, Niconico News, 2023.04. [LINK]
- Improving DNN reliability for AI social implementation and applications, Business & Public Affairs, 2023.04. [LINK]
- JAIST, UTokyo, and JST develop new interface making deep learning easier and more accurate, Nikkei, 2023.04. [LINK]
- [Press Release] Click away the bias: New system to make AI training easier and more accurate, 2023.03. [EurekAlert!] [techxplore]
- [Press Release] New interface developed to make deep learning easier and more accurate - Reducing AI bias impact with one click, 2023.03. [JAIST] [UTokyo] [JST]
- [JAIST] Research assistant HE received Outstanding Research Presentation Award and Student Presentation Award at IPSJ CG and Visual Informatics Workshop, 2022.11. [LINK]
- [Press Release] Launching "University/Researcher Feature" interviewing researchers involved in human augmentation technology, Aurora Alliance, 2022.10. [LINK]
- Student Interview vol. 1: Haptic Glove R&D, Human Augmentation Lab, 2022.09. [LINK]
- [JAIST] Received Interactive Presentation Award (PC Recommendation) at Interaction 2022, 2022.03. [LINK]
- Lighter and more compact "third hand"! 2.5 times the length of a human arm, helps complete various daily tasks, Robot Lecture Hall, 2021.10. [LINK]
- Japanese researchers invent lighter and longer new robotic arm, China Science Daily, 2021.09. [LINK]
- Developing a third arm to assist daily life: Aiming to become as commonplace as smartwatches, Yahoo News Japan, 2021.09. [LINK]
- A compact robotic limb to support humans during everyday activities, Tech Xplore, 2021.09. [LINK]
- AugLimb is the extra arm you didn't know you needed, Arduino.cc, 2021.09. [LINK]
- Video Friday: Your weekly selection of awesome robot videos, IEEE Spectrum, 2021.09. [LINK]
- Best of Last Week - an augmented limb, Science X, 2021.09. [LINK]
- "Extra" robotic arm promises to help with everyday tasks, The Clare People, 2021.09. [LINK]
- AugLimb's Creator Thinks It Will Become as Popular as Smartwatches, Hackster.io, 2021.09. [LINK]
- Domino toppling: How should they be arranged? Real-time "placement map" generation projected via projection mapping, ITmedia NEWS, 2021.08. [LINK]
- [JAIST] Student WANG received Best Poster Presentation Award at NICOGRAPH International 2021, 2021.07. [LINK]
- [JAIST] Student HUANG received Best Short Paper Award at NICOGRAPH International 2021, 2021.07. [LINK]
- [JAIST] Alumni LUO received Best Full Paper Nominee Award at NICOGRAPH International 2021, 2021.07. [LINK]
- XLIMB@James Dyson Award, jamesdysonaward.org, 2021.07. [LINK]
- AI can now teach you to draw, zhihu.com, 2021.05. [LINK]
- [JAIST] Student DING's group received Best Short Paper Award at Augmented Human 2021, 2021.05. [LINK]
- Simple actuator that bends with plastic and balloons developed by JAIST, Nikkan Kogyo Shimbun, 2021.05. [LINK]
- [JAIST] Students HUANG and Miyauchi received Best Poster Award at Intelligence Design International Symposium, 2021.03. [LINK]
- Compact wearable robotic arm "xLimb" that can be stored and used casually developed by JAIST, ITmedia NEWS, 2021.03. [LINK]
- Programming can be used in such interesting ways!, KoKaNet, 2021.02. [LINK]
- [JAIST] "Total Concentration! JAIST Making Workshop" hosted by Symbiotic AI x Design Research Core, 2021.01. [LINK]
- Dr. Haoran Xie gives online academic lecture to faculty and students, Northwest A&F University, 2020.10. [LINK]
- [JAIST] Assistant Professor Xie's group received 2nd Best Paper Award at Augmented Human, 2020.06. [LINK]
- [JAIST] Student group received Best Paper Award and Best Online Presentation Award (Paper) at NICOGRAPH Intl 2020, 2020.06. [LINK]
- [JAIST] Student received Best Online Presentation Award (Paper) at NICOGRAPH Intl 2020, 2020.06. [LINK]
- [JAIST] Student received Best Online Presentation Award (Poster) at NICOGRAPH Intl 2020, 2020.06. [LINK]
- [JAIST] Assistant Professor Xie's paper selected as one of TOP DOWNLOADED PAPERS in Wiley's CAVW journal, 2020.05. [LINK]
- [JAIST] Received Student Excellent Interactive Presentation Award at IEICE HCG Symposium 2019, 2019.12. [LINK]
- [JAIST] Assistant Professor Xie selected as Best Paper Nominee at CASA 2019, 2019.07. [LINK]
- [JAIST] Assistant Professor Xie received Funai Foundation Research Encouragement Award, 2019.04. [LINK]
- [Tre-Tama] Sittable Tail, TV Tokyo World Business Satellite, 2019.03. [LINK]
- Introduction of the sittable tail RESTAIL, Trend Mix Juice, 2019.03. [LINK]
- Can humans become cats too? Tail-type device that can express emotions born, Niconico News, 2019.03. [LINK]
- A "tail" you can sit on: Eventually capable of emotional expression, NewsSwitch (livedoor), 2019.03. [LINK]
- JAIST develops "sittable tail": Also researching functions that respond to emotions, Nikkan Kogyo Shimbun, 2019.03. [LINK]
- Coffee Time, MRO Hokuriku Broadcasting, 2018.09.
- Such amazing technology existed in ancient times? These four things puzzle scientists, Zhihu, 2018.06. [LINK]
Contact
| Tel: | +81-761-51-1721 |
|---|---|
| Address: | 1-1 Asahidai, Nomi, Ishikawa, 923-1211, Japan |
| Mail: | xie at jaist.ac.jp |