Tianjiao (Joey) Yu
University of Illinois Urbana-Champaign

Tianjiao (Joey) Yu

Ph.D. Candidate, Computer Science

Advised by Ismini Lourentzou, PLAN Lab

3D Intelligence · Generative AI · Multimodal Reasoning

loading · 0 points · pose 1/1 · 0 merged
SCROLL

About

I am a Ph.D. candidate in Computer Science at UIUC, advised by Ismini Lourentzou. I began my doctoral studies at Virginia Tech, where I also worked under Kurt Luther.

My research focuses on 3D intelligence, generative modeling, and multimodal reasoning. I study how models connect language, geometry, and structured representations to understand, create, and reason about 3D worlds.

My work spans generating detailed and controllable 3D objects, connecting semantic reasoning with geometric representations, and building generative environments that support learning through interaction. My background in Theoretical Linguistics informs how I approach compositional structure, grounding, and reasoning across modalities.

Structured 3D GenerationGenerating detailed, controllable objects with explicit geometry, parts, and articulation.
Multimodal Reasoning & UnderstandingConnecting language and geometric representations for grounded reasoning and unified understanding and generation.
World Modeling & Generative EnvironmentsModeling dynamic worlds and generating environments that support interaction and learning.

Beyond academia I co-founded Eternl.AI, where I architect AI infrastructure for embodied intelligence in interactive gaming — spanning agentic AI, long-horizon personalization, and 3D-world generation. We raised $400K at a $40M valuation.

I am currently at Amazon Robotics, where I work on world and action models for long-horizon manipulation tasks.

Ph.D. Computer Science · UIUC M.S. Computer Science · Georgetown B.A. Computer Science, Linguistics · UMN Twin Cities

Selected Publications

⭐🔥CoDA: Co-Evolution of Data Engines and Action Policies Arxiv 2026
Tianjiao Yu, Zhilin Ou, Yifan Shen, Xinzhuo Li, Yuanzhe Liu, Onkar Kishor Susladkar, Fan Wang, Ismini Lourentzou.
⭐🔥SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation NeurIPS 2026
Tianjiao Yu, Xinzhuo Li, Yifan Shen, Ying Shen, Kiet A. Nguyen, Adheesh Sunil Juvekar, Ismini Lourentzou.
⭐🔥ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generation NeurIPS 2026
Tianjiao Yu, Xinzhuo Li, Yifan Shen, Onkar Kishor Susladkar, Yuanzhe Liu, Xiaona Zhou, Ismini Lourentzou .
⭐🔥DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising ECCV 2026
Tianjiao Yu, Muntasir Wahed, Jerry Yuyang Xiong, Xinzhuo Li, Yifan Shen, Ying Shen, Ismini Lourentzou.
⭐🔥Part²GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splatting CVPR 2026
Tianjiao Yu, Vedant Shah, Muntasir Wahed, Ying Shen, Kiet A. Nguyen, Ismini Lourentzou.
⭐CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligence arXiv 2025
Tianjiao Yu, Xinzhuo Li, Yifan Shen, Yuanzhe Liu, Ismini Lourentzou.
⭐Uncertainty in Action: Confidence Elicitation in Embodied Agents arXiv 2024
Tianjiao Yu, Vedant Shah, Muntasir Wahed, Kiet A. Nguyen, Adheesh Sunil Juvekar, Tal August, Ismini Lourentzou.
🔥Tiny but Trusted: Efficient Vision-Language Reasoning for Time-Series Anomaly Detection NeurIPS 2026
Xiaona Zhou, Tianjiao Yu, Muntasir Wahed, Constantin Brif, Ismini Lourentzou.
🔥ChronoVision: Temporal Reasoning via Latent State Reconstruction EMNLP 2026
Yifan Shen, Jian Xu, Boyi Li, Yuner Zhang, Tianjiao Yu, Bingxuan Li, Houze Yang, Rushi Wang, Xu Cao
🔥GraphVid: Interactive Graph-Controllable Video Generation ECCV 2026
Vedant Shah, Onkar Kishor Susladkar, Tushar Prakash, Kiet A. Nguyen, Tianjiao Yu, Adheesh Sunil Juvekar, Muntasir Wahed, Ismini Lourentzou.
🔥PHANTOM: Physics-Infused Video Generation via Joint Modeling of Visual and Latent Physical Dynamics CVPR 2026
Ying Shen, Jerry Xiong, Tianjiao Yu, Ismini Lourentzou.
🔥PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulation CVPR 2026
Yuanzhe Liu, Jingyuan Zhu, Yuchen Mo, Gen Li, Xu Cao, Jin Jin, Yifan Shen, Zhengyuan Li, Tianjiao Yu, Wenzhen Yuan, Fangqiang Ding, Ismini Lourentzou.
📄Counterfactual Segmentation Reasoning: Diagnosing and Mitigating Pixel-Grounding Hallucination CVPR Findings 2026
Xinzhuo Li, Adheesh Sunil Juvekar, Jiaxun Zhang, Xingyou Liu, Muntasir Wahed, Kiet A. Nguyen, Yifan Shen, Tianjiao Yu, Ismini Lourentzou.
📄MOCHA: Are Code Language Models Robust Against Multi-Turn Malicious Coding Prompts? EMNLP Findings 2025
Muntasir Wahed, Xiaona Zhou, Kiet A. Nguyen, Tianjiao Yu, Nirav Diwan, Gang Wang, Dilek Hakkani-Tür, Ismini Lourentzou.
🔥PurpCode: Reasoning for Safer Code Generation NeurIPS 2025
Jiawei Liu, Nirav Diwan, Zhe Wang, Haoyu Zhai, Xiaona Zhou, Kiet A. Nguyen, Tianjiao Yu, Muntasir Wahed, Yinlin Deng, Hadjer Benkraouda, Yuxiang Wei, Lingming Zhang, Ismini Lourentzou, Gang Wang.
🔥CALICO: Part-Focused Semantic Co-Segmentation with Large Vision-Language Models CVPR 2025
Kiet A. Nguyen, Adheesh Sunil Juvekar, Tianjiao Yu, Muntasir Wahed, Ismini Lourentzou.
📄PRIMA: Multi-Image Vision-Language Models for Reasoning Segmentation arXiv 2024
Muntasir Wahed, Kiet A. Nguyen, Adheesh Sunil Juvekar, Xinzhuo Li, Xiaona Zhou, Vedant Shah, Tianjiao Yu, Pinar Yanardag, Ismini Lourentzou.
⭐🔥Sedition Hunters: A Quantitative Study of the Crowdsourced Investigation into the 2021 US Capitol Attack WWW 2023
Tianjiao Yu, Sukrit Venkatagiri, Ismini Lourentzou, Kurt Luther.
📄Sedition Hunters: Countering Extremism through Collective Action CSCW Workshop 2021
Sukrit Venkatagiri, Tianjiao Yu, Vikram Mohanty, Kurt Luther.
📄FARM: Fine-Grained Alignment for Cross-Modal Recipe Retrieval WACV 2024
Muntasir Wahed, Xiaona Zhou, Tianjiao Yu, Ismini Lourentzou.
📄PLAB-Bot: Contextualized & Knowledge-grounded Multimodal Taskbot Alexa Prize 2023
Afrina Tabassum, Muntasir Wahed, Tianjiao Yu, Amarachi B. Mbakwe, Makanjuola Ogunleye, Ismini Lourentzou.