I am a senior research fellow in the School of Computing, National University of Singapore, working with Prof. Tat-seng Chua and Prof. Roger Zimmermann. I have published several papers in top conferences such as SIGIR, CVPR, ECCV, ACM MM, EMNLP and journals including TPAMI, TIP and TCYB. My research interests include but are not limited to: Cross-modal Retrieval, Multi-modal Learning, Multi-modal Generation, and Multi-modal Pretrained Models. Moreover, I have served as the PC member for top-tier conferences/journals, including NeurIPS, SIGIR, CVPR, ICCV, ECCV, AAAI, ACM MM, EMNLP, TPAMI, IJCV, TIP, TMM, etc.

I am actively seeking highly motivated interns who share my research interests. Kindly reach out to me at weiji0523@gmail.com with your resume!

Publications

pdf	Transformer-empowered invariant grounding for video question answering Yicong Li, Xiang Wang, Junbin Xiao, Wei Ji , Tat-Seng Chua TPAMI 2023

pdf	ART: rule bAsed futuRe-inference deducTion Mengze Li, Tianqi Zhao, Bai Jionghao, Baoyi He, Jiaxu Miao, Wenqiao Zhang, Zheqi Lv, Zhou Zhao, Shengyu Zhang, Wei Ji , Fei Wu EMNLP 2023 (Main)

pdf	Transfer visual prompt generator across llms Ao Zhang, Hao Fei, Yuan Yao, Wei Ji , Li Li, Zhiyuan Liu, Tat-Seng Chua NeurIPS 2023

pdf	Learning Style-Invariant Robust Representation for Generalizable Visual Instance Retrieval Tianyu Chang, Xun Yang, Xin Luo, Wei Ji , Meng Wang ACM MM 2023

pdf	Biased-Predicate Annotation Identification via Unbiased Visual Predicate Representation Li Li, Chenwei Wang, You Qin, Wei Ji , Renjie Liang ACM MM 2023

pdf	Partial Annotation-based Video Moment Retrieval via Iterative Learning Wei Ji , Renjie Liang, Lizi Liao, Hao Fei, Fuli Feng ACM MM 2023

pdf	Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendation Wei Ji , Xiangyan Liu, An Zhang, Yinwei Wei, Yongxin Ni, Xiang Wang ACM MM 2023

pdf	Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World. Qifan Yu, Juncheng Li, Yu Wu, Siliang Tang, Wei Ji , Yueting Zhuang ICCV 2023

pdf	Gradient-Regulated Meta-Prompt Learning for Generalizable Vision-Language Models. Juncheng Li, Minghe Gao, Longhui Wei, Siliang Tang, Wenqiao Zhang, Mengze Li, Wei Ji , Qi Tian, Tat-Seng Chua, Yueting Zhuang ICCV 2023

pdf	Two Heads Are Better Than One: Improving Fake News Video Detection by Correlating. Peng Qi, Yuyang Zhao, Yufeng Shen, Wei Ji , Juan Cao, Tat-Seng Chua. ACL 2023 Findings

pdf	Generating Visual Spatial Description via Holistic 3D Scene Understanding. Yu Zhao, Hao Fei,Wei Ji , Jianguo Wei, Meishan Zhang, Min Zhang, Tat-Seng Chua. ACL 2023

pdf	Cross2StrA: Unpaired Cross-lingual Image Captioning with Cross-lingual Cross-modal Structure-pivoted Alignment. Shengqiong Wu, Hao Fei, Wei Ji, Tat-Seng Chua. ACL 2023

pdf	WINNER: Weakly-supervised hIerarchical decompositioN and aligNment for spatio-tEmporal video gRounding. Mengze Li, Han Wang, Wenqiao Zhang, Jiaxu Miao,Wei Ji, Zhou Zhao, Shengyu Zhang, Fei Wu. CVPR 2023

pdf	Are Binary Annotations Sufficient? Video Moment Retrieval via Hierarchical Uncertainty-based Active Learning. Wei Ji, Renjie Liang, Zhedong Zheng, Wenqiao Zhang, Shengyu Zhang, Juncheng, Li and Mengze Li, Tat-Seng Chua. CVPR 2023

pdf	Video-Audio Domain Generalization via Confounder Disentanglement. Shengyu Zhang, Xusheng Feng, Wenyan Fan, Wenjing Fang, Fuli Feng, Wei Ji, Li Shuo, Li Wang, Shanshan Zhao, Zhou Zhao, Tat-Seng Chua, Fei Wu. AAAI 2023

pdf	FakeSV: A Multimodal Benchmark with Rich Social Context for Fake News Detection on Short Video Platforms Peng Qi, Yuyan Bu, Juan Cao, Wei Ji, Ruihao Shui, Junbin Xiao, Danding Wang, Tat-Seng Chua AAAI 2023

pdf	PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models Yuan Yao, Qianyu Chen, Ao Zhang, Wei Ji, Zhiyuan Liu, Tat-Seng Chua, Maosong Sun EMNLP 2022

pdf	Video Question Answering: Datasets, Algorithms and Challenges Yaoyao Zhong, Junbin Xiao, Wei Ji, Yicong Li, Weihong Deng, Tat-Seng Chua EMNLP 2022

pdf	Structured and Natural Responses Co-generation for Conversational Search Chenchen Ye, Lizi Liao, Fuli Feng, Wei Ji, Tat-Seng Chua SIGIR 2022

pdf	Fine-Grained Scene Graph Generation with Data Transfer Ao Zhang, Yuan Yao, Qianyu Chen, Wei Ji, Zhiyuan Liu, Maosong Sun, Tat-Seng Chua ECCV 2022 (oral)

pdf	Conditional Meta-Network for Blind Super-Resolution with Multiple Degradations Guanghao Yin, Wei Wang, Zehuan Yuan, Wei Ji, Dongdong Yu, Shouqian Sun, Tat-Seng Chua, Changhu Wang TIP 2022

pdf	Invariant grounding for video question answering Yicong Li, Xiang Wang, Junbin Xiao, Wei Ji, Tat-Seng Chua CVPR 2022 (oral, Best Paper Finalist)

pdf	Content-Variant Reference Image Quality Assessment via Knowledge Distillation Guanghao Yin, Wei Wang, Zehuan Yuan, Chuchu Han, Wei Ji, Shouqian Sun, Changhu Wang AAAI 2022

pdf	Rethinking the Two-Stage Framework for Grounded Situation Recognition Meng Wei, Long Chen, Wei Ji, Xiaoyu Yue, Tat-Seng Chua AAAI 2022

pdf	Video as Conditional Graph Hierarchy for Multi-Granular Question Answering Junbin Xiao, Angela Yao, Zhiyuan Liu, Yicong Li, Wei Ji, Tat-Seng Chua AAAI 2022

pdf	Deep Learning for Weakly-Supervised Object Detection and Localization: A Survey Feifei Shao, Long Chen, Jian Shao, Wei Ji, Shaoning Xiao, Lu Ye, Yueting Zhuang, Jun Xiao Neurocomputing

pdf	VidVRD 2021: The Third Grand Challenge on Video Relation Detection Wei Ji, Yicong Li, Meng Wei, Xindi Shang, Junbin Xiao, Tongwei Ren, Tat-Seng Chua ACM MM 2021

pdf	Deconfounded Video Moment Retrieval with Causal Intervention Xun Yang, Fuli Feng, Wei Ji, Meng Wang, Tat-Seng Chua SIGIR 2021

pdf	Video Visual Relation Detection via Iterative Inference Xindi Shang, Yicong Li, Junbin Xiao, Wei Ji, Tat-Seng Chua ACM MM 2021

pdf	Boundary Proposal Network for Two-Stage Natural Language Video Localization Shaoning Xiao, Long Chen, Songyang Zhang, Wei Ji, Jian Shao, Lu Ye, Jun Xiao AAAI 2021

pdf	Context-Aware Graph Label Propagation Network for Saliency Detection Wei Ji, Xi Li, Lina Wei, Fei Wu, Yueting Zhuang IEEE Transactions on Image Processing (TIP 2020)

pdf	Human-centric clothing segmentation via deformable semantic locality-preserving network Wei Ji, Xi Li, Fei Wu, Zhijie Pan, Yueting Zhuang IEEE Transactions on Circuits and Systems for Video Technology (TCSVT 2019)

pdf	Context-aware deep spatiotemporal network for hand pose estimation from depth images Yiming Wu, Wei Ji, Xi Li, Gang Wang, Jianwei Yin, Fei Wu IEEE Transactions on Cybernetics (TCYB 2018)

pdf	Multi-task structure-aware context modeling for robust keypoint-based object tracking Xi Li, Liming Zhao, Wei Ji, Yiming Wu, Fei Wu, Ming-Hsuan Yang, Dacheng Tao, Ian Reid IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2018)

pdf	Semantic Locality-Aware Deformable Network for Clothing Segmentation Wei Ji, Xi Li, Yueting Zhuang, Omar El Farouk Bourahla, Yixin Ji, Shihao Li, Jiabao Cui International Joint Conference on Artificial Intelligence (IJCAI 2018)

Professional Services

Program Committee Member of ACL (2023) Program Committee Member of NeurIPS (2023) Program Committee Member of WWW (2023) Program Committee Member of SIGIR (2023) Program Committee Member of CVPR (2022,2023,2024) Program Committee Member of ICCV (2023) Program Committee Member of ECCV (2022) Program Committee Member of AAAI (2021,2022,2023,2024) Program Committee Member of ACM MM (2021,2022,2023) Program Committee Member of EMNLP (2022) Program Committee Member of ACM Multimedia Asia (2021) Invited Reviewer for International Journal of Computer Vision (IJCV) Invited Reviewer for IEEE Transactions on Image Processing (TIP) Invited Reviewer for IEEE Transactions on Multimedia (TMM) Invited Reviewer for IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)

Honors

Outstanding Graduate, Zhejiang University   2020

Distinguished Doctoral Scholarship, Zhejiang University   2018-2019