Jieneng Chen

Jieneng is a fifth-year Ph.D. candidate in Computer Science at Johns Hopkins University, advised by Distinguished Professor Alan Yuille.

His research focuses on artificial intelligence, computer vision, multimodality, medical AI and embodied AI.

I am on the job market for 2025! Would love to chat more if you are interested. I am also happy to give talks on my research in related seminars.

News

[Sep 2024] I'm honored to be selected as a Siebel Scholar!

[Sep 2024] Two papers accepted to NeurIPS 2024!

[Jul 2024] Check out LLaVolta, an efficient large multi-modal model.

[Jun 2024] Check out ViTamin, a SoTA multimodal foundation model, hosted in timm and open_clip .

During his PhD journey, he co-develops a few highly-cited algorithms in computer vision and medical applications, which are among the top 15 cited 2021 paper in all AI fields (TransUNet), top 3 most influential AAAI 2023 papers (TransFG), and top 3 most cited ECCV papers in five years in Google Metrics (SwinUNet).

Recent Publications

Full list on Google Scholar Profile. His publications have over 10,500 citations with an increase of over 5,000 per year.

Generative World Explorer
Taiming Lu, Tianmin Shu, Alan Yuille, Daniel Khashabi, Jieneng Chen

arxiv preprint, 2024
Paper | Code | Project | Video

Efficient Large Multi-modal Models via Visual Context Compression
Jieneng Chen, Luoxin Ye, Ju He, Zhao-Yang Wang, Daniel Khashabi, Alan Yuille

In Neural Information Processing Systems (NeurIPS), 2024
Paper | Code | Project

Designing Scalable Vision Models in the Vision-Language Era
Jieneng Chen, Qihang Yu, Xiaohui Shen, Alan Yuille, Liang-Chieh Chen

In Conference on Computer Vision and Pattern Recognition (CVPR), 2024
Paper | Code | 🤗 HuggingFace | timm

| open_clip

3D-Gait: Virtual Marker-Driven 3D Representation for Multi-Modal Gait Recognition
Zhaoyang Wang, Jiang Liu, Jieneng Chen, Rama Chellappa

to be appeared in Winter Conference on Applications of Computer Vision (WACV), 2025

Towards a Single Unified Model for Effective Detection, Segmentation, and Diagnosis of Eight Major Cancers
Jieneng Chen, Yingda Xia, Jiawen Yao, Ke Yan, Jianpeng Zhang, Le Lu, .., Jingren Zhou, Alan Yuille, Zaiyi Liu, Ling Zhang

In International Conference on Computer Vision (ICCV), 2023
Paper

Compositor: Bottom-up Clustering and Compositing for Robust Part and Object Segmentation
Ju He *, Jieneng Chen *, Mingxian Lin, Qihang Yu, Alan Yuille

In Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Paper | * Equal contributed

TransMix: Attend to Mix for Vision Transformers
Jieneng Chen, Shuyang Sun, Ju He, Philip Torr, Alan Yuille, Song Bai

In Conference on Computer Vision and Pattern Recognition (CVPR), 2022
Paper | Code

TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Jieneng Chen, Yongyi Lu, Qihang Yu, Xiangde Luo, Ehsan Adeli, Yan Wang, Le Lu, Alan Yuille, Yuyin Zhou

International Conference on Marchine Learning (ICML) workshop, arXiv 2021

3D-TransUNet is published in Medical Image Analysis, 2024 (IF>10)
Paper | Code |

Top 15 Cited 2021 Paper in All AI Fields (Cited 4K times as of 2024) [Source]

TransFG: A Transformer Architecture for Fine-grained Recognition
Ju He, Jieneng Chen, Shuai Liu, Adam Kortylewski, Cheng Yang, Yutong Bai, Changhu Wang, Alan Yuille

In AAAI Conference on Artificial Intelligence (AAAI), 2022
Paper | Code

Top 3 Most Influential AAAI 2023 Papers [Source]

Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation
Hu Cao, Yueyue Wang, Jieneng Chen, Dongsheng Jiang, Xiaopeng Zhang, Qi Tian, Manning Wang

In European Conference on Computer Vision (ECCV), 2022
Paper | Code |

Top 3 Most Cited ECCV Papers in Five Years According to Google Metrics [Source]

Semi-supervised Medical Image Segmentation Through Dual-task Consistency
Xiangde Luo, Jieneng Chen, Tao Song, Guotai Wang

In AAAI Conference on Artificial Intelligence (AAAI), 2021
Paper | Code

Top 15 Most Influential AAAI 2021 Papers [Source]

Sequential Learning on Liver Tumor Boundary Semantics and Prognostic Biomarker Mining
Jieneng Chen, Ke Yan, Yu-Dong Zhang, Youbao Tang, Xun Xu, Shuwen Sun, Qiuping Liu, Lingyun Huang, Jing Xiao, Alan L Yuille, Ya Zhang, Le Lu

In International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2021
Paper | Early Accept | Travel Award (top 10%)

Teaching & Service

Instructor: He is the instructor for a course in Winter 2025 at JHU.
Teaching assistant: He is the head teaching assistant of Vision as Bayesian Inference at JHU in Spring 2024. He is the course assistant of Machine Learning: Deep Learning at JHU in Spring 2022.
Lecturer: He is the guest lecturer for Johns Hopkins Engineering Innovation Pre-College Programs.

Serving: He is on the invited reviewers and program committees for major conference and journals, such as CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, AAAI, TPAMI, TMI and MICCAI.
He provided mentor hours for PhD students and underrepresented students at JHU.