Tianjiao (Joey) Yu
University of Illinois Urbana-Champaign

Tianjiao (Joey) Yu

Ph.D. Candidate, Computer Science

Advised by Ismini Lourentzou, PLAN Lab

Reasoning in 3D & embodied settings · NLP · multimodal learning

loading · 0 points · pose 1/1 · 0 merged
SCROLL

About

I am a Ph.D. candidate in Computer Science at UIUC, advised by Ismini Lourentzou. I began my doctoral studies at Virginia Tech, where I also worked under Kurt Luther.

My research centers on reasoning in 3D and embodied settings, grounded in a broader foundation of natural language processing and multimodal learning. I study how structured representations — linguistic, spatial, and geometric — can be integrated to let machines reason about the world in a grounded, interpretable, and generative way.

Collaborative Reasoning Frameworks that unify language and 3D generation
Part-Level 3D Generation and articulation for structured objects
Embodied Uncertainty Embodied Agents that adapt reasoning and planning in dynamic environments

Across these directions I aim to build language-enabled systems that do not merely predict tokens or pixels, but reason over structure, parts, space, and action — drawing on theoretical linguistics, 3D representation learning, and multimodal world modeling.

Beyond academia I co-founded Eternl.AI, where I architect AI infrastructure for embodied intelligence in interactive gaming — spanning agentic AI, long-horizon personalization, and 3D-world generation. We raised $400K at a $40M valuation.

Ph.D. Computer Science · UIUC M.S. Computer Science · Georgetown B.A. Computer Science, Linguistics · UMN Twin Cities

Publications

⭐🔥DreamPartGen: 3D Generation with Part-Level Text Guidance through Collaborative Part-Latent Denoising ECCV 2026
Tianjiao Yu, Muntasir Wahed, Jerry Yuyang Xiong, Xinzhuo Li, Yifan Shen, Ying Shen, Ismini Lourentzou.
⭐🔥Part²GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splatting CVPR 2026
Tianjiao Yu, Vedant Shah, Muntasir Wahed, Ying Shen, Kiet A. Nguyen, Ismini Lourentzou.
ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generation arXiv 2026
Tianjiao Yu, Xinzhuo Li, Yifan Shen, Onkar Susladkar, Yuanzhe Liu, Xiaona Zhou, Ismini Lourentzou.
CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligence arXiv 2025
Tianjiao Yu, Xinzhuo Li, Yifan Shen, Yuanzhe Liu, Ismini Lourentzou.
Uncertainty in Action: Confidence Elicitation in Embodied Agents arXiv 2024
Tianjiao Yu, Vedant Shah, Muntasir Wahed, Kiet A. Nguyen, Adheesh Sunil Juvekar, Tal August, Ismini Lourentzou.
🔥GraphVid: Interactive Graph-Controllable Video Generation ECCV 2026
Vedant Shah, Onkar Kishor Susladkar, Tushar Prakash, Kiet A. Nguyen, Tianjiao Yu, Adheesh Sunil Juvekar, Muntasir Wahed, Ismini Lourentzou.
🔥PHANTOM: Physics-Infused Video Generation via Joint Modeling of Visual and Latent Physical Dynamics CVPR 2026
Ying Shen, Jerry Xiong, Tianjiao Yu, Ismini Lourentzou.
🔥PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulation CVPR 2026
Yuanzhe Liu, Jingyuan Zhu, Yuchen Mo, Gen Li, Xu Cao, Jin Jin, Yifan Shen, Zhengyuan Li, Tianjiao Yu, Wenzhen Yuan, Fangqiang Ding, Ismini Lourentzou.
📄Counterfactual Segmentation Reasoning: Diagnosing and Mitigating Pixel-Grounding Hallucination CVPR Findings 2026
Xinzhuo Li, Adheesh Sunil Juvekar, Jiaxun Zhang, Xingyou Liu, Muntasir Wahed, Kiet A. Nguyen, Yifan Shen, Tianjiao Yu, Ismini Lourentzou.
📄MOCHA: Are Code Language Models Robust Against Multi-Turn Malicious Coding Prompts? EMNLP Findings 2025
Muntasir Wahed, Xiaona Zhou, Kiet A. Nguyen, Tianjiao Yu, Nirav Diwan, Gang Wang, Dilek Hakkani-Tür, Ismini Lourentzou.
🔥PurpCode: Reasoning for Safer Code Generation NeurIPS 2025
Jiawei Liu, Nirav Diwan, Zhe Wang, Haoyu Zhai, Xiaona Zhou, Kiet A. Nguyen, Tianjiao Yu, Muntasir Wahed, Yinlin Deng, Hadjer Benkraouda, Yuxiang Wei, Lingming Zhang, Ismini Lourentzou, Gang Wang.
🔥CALICO: Part-Focused Semantic Co-Segmentation with Large Vision-Language Models CVPR 2025
Kiet A. Nguyen, Adheesh Juvekar, Tianjiao Yu, Muntasir Wahed, Ismini Lourentzou.
📄PRIMA: Multi-Image Vision-Language Models for Reasoning Segmentation arXiv 2024
Muntasir Wahed, Kiet A. Nguyen, Adheesh Sunil Juvekar, Xinzhuo Li, Xiaona Zhou, Vedant Shah, Tianjiao Yu, Pinar Yanardag, Ismini Lourentzou.
⭐🔥Sedition Hunters: A Quantitative Study of the Crowdsourced Investigation into the 2021 US Capitol Attack WWW 2023
Tianjiao Yu, Sukrit Venkatagiri, Ismini Lourentzou, Kurt Luther.
📄Sedition Hunters: Countering Extremism through Collective Action CSCW Workshop 2021
Sukrit Venkatagiri, Tianjiao Yu, Vikram Mohanty, Kurt Luther.
📄FARM: Fine-Grained Alignment for Cross-Modal Recipe Retrieval WACV 2024
Muntasir Wahed, Xiaona Zhou, Tianjiao Yu, Ismini Lourentzou.
📄PLAB-Bot: Contextualized & Knowledge-grounded Multimodal Taskbot Alexa Prize 2023
Afrina Tabassum, Muntasir Wahed, Tianjiao Yu, Amarachi B. Mbakwe, Makanjuola Ogunleye, Ismini Lourentzou.