I am a year-5 PhD student from the Department of Computer Science and Technology, Beijing Institute of Technology (BIT, 北京理工大学计算机学院), under the supervision of Prof. Chi Harold Liu. I received my Bachelor’s degree in Software Engineering from BIT (2015-2019)

My research interest includes mobile crowdsensing and unmanned vehicles, with the consideration of 5G communication modeling and reinforcement learning techniques. I have published more than 10 papers at the top international conferences (e.g., KDD, ICDE, CoRL, INFOCOM) and journals (e.g., TKDE, TMC). I am also one of the Student Liaison of RLChina committee.

Contact: I’m always glad to discuss or collaborate! If interested, feel free to email me at daizipeng@bit.edu.cn.

🔥 News

• 2024.05: 🤠🤠 In my industry experience, I did not focus on developing my research skills. Currently, I am working hard to complete some papers to meet the requirements for the Outstanding Doctoral Dissertation of the Electronics Society.
• 2024.05: 🎉🎉 My google scholar citations have exceeded 300!

📝 Publications

🙋‍♂️ Mobile Crowdsensing

INFOCOM 2022

AoI-minimal UAV Crowdsensing by Model-based Graph Convolutional Reinforcement Learning
Zipeng Dai, Chi Harold Liu, Yuxiao Ye, Rui Han, Ye Yuan, Guoren Wang, Jian Tang INFOCOM 2022 (Oral)

Project |

• IEEE JSAC QoI-Aware Mobile Crowdsensing for Metaverse by Multi-Agent Deep Reinforcement Learning, Yuxiao Ye, Hao Wang, Chi Harold Liu, Zipeng Dai, Guozheng Li, Guoren Wang, Jian Tang
• ICDE 2023 (Oral) Exploring both Individuality and Cooperation for Air-Ground Spatial Crowdsourcing by Multi-Agent Deep Reinforcement Learning, Yuxiao Ye, Chi Harold Liu, Zipeng Dai, Jianxin Zhao, Ye Yuan, Guoren Wang, Jian Tang
• IEEE TMC Delay-Sensitive Energy-Efficient UAV Crowdsensing by Deep Reinforcement Learning, Zipeng Dai, Chi Harold Liu, Rui Han, Guoren Wang, Kin K. Leung, Jian Tang
• KDD 2021 (best paper award runner up) Energy-Efficient 3D Vehicular Crowdsourcing for Disaster Response by Distributed Deep Reinforcement Learning, Hao Wang, Chi Harold Liu, Zipeng Dai, Jian Tang, Guoren Wang (Applied Data Science Track)
• INFOCOM 2021 (Oral) Mobile Crowdsensing for Data Freshness: A Deep Reinforcement Learning Approach, Zipeng Dai, Hao Wang, Chi Harold Liu, Rui Han, Jian Tang, Guoren Wang
• ICDE 2020 (Oral) Curiosity-Driven Energy-Efficient Worker Scheduling in Vehicular Crowdsourcing: A Deep Reinforcement Learning Approach, Chi Harold Liu, Yinuo Zhao, Zipeng Dai, Ye Yuan, Guoren Wang, Dapeng Wu, Kin K. Leung
• INFOCOM 2020 (Oral) Multi-Task-Oriented Vehicular Crowdsensing: A Deep Learning Approach, Chi Harold Liu, Zipeng Dai, Haoming Yang, Jian Tang
• IEEE TMC Distributed and Energy-Efficient Mobile Crowdsensing with Charging Stations by Deep Reinforcement Learning, Chi Harold Liu, Zipeng Dai, Yinuo Zhao, Jon Crowcroft, Dapeng Wu, Kin K. Leung

🚖 Unmanned Vehicles

• CoRL 2022 Socially-Attentive Policy Optimization in Multi-Agent Self-Driving System, Zipeng Dai, Tianze Zhou, Kun Shao, David Henry Mguni, Bin Wang, Jianye Hao

🎟 Others

• IEEE Transactions on Computers HiBid: A Cross-Channel Constrained Bidding System with Budget Allocation by Hierarchical Offline Deep Reinforcement Learning, Hao Wang, Bo Tang, Chi Harold Liu, Shangqin Mao, Jiahong Zhou, Zipeng Dai, Yaqi Sun, Qianlong Xie, Xingxing Wang, Dong Wang
• IEEE Transactions on Games Cooperative Multi-Agent Transfer Learning with Coalition Pattern Decomposition, Tianze Zhou, Fubiao Zhang, Kun Shao, Zipeng Dai, Kai Li, Wenhan Huang, Weixun Wang, Bin Wang, Dong Li, Wulong Liu, Jianye Hao
• ICLR 2023 Timing is Everything: Learning to Act Selectively with Costly Actions and Budgetary Constraints, David Mguni, Aivar Sootla, Juliusz Krzysztof Ziomek, Oliver Slumbers, Zipeng Dai, Kun Shao, Jun Wang
• AAAI 2023 Learning to Shape Rewards using a Game of Two Partners, David Mguni, Taher Jafferjee, Jianhong Wang, Nicolas Perez-Nieves, Wenbin Song, Feifei Tong, Matthew Taylor, Tianpei Yang, Zipeng Dai, Hui Chen, Jiangcheng Zhu, Kun Shao, Jun Wang, Yaodong Yang
• IEEE TKDE Time-Aware Location Prediction by Convolutional Area-of-Interest Modeling and Memory-Augmented Attentive LSTM, Chi Harold Liu, Yu Wang, Chengzhe Piao, Zipeng Dai, Ye Yuan, Guoren Wang, Dapeng Oliver Wu

🎖 Honors and Awards

• 2024.05 The 2nd Prize of the AgileX Sim2Real Challenge in ICRA 2024
• 2023.12 The 7th Rank of the First Low-Altitude Economy Intelligent Flight Management Challenge in Meituan, ShenZhen
• 2022.10 National Scholarship (Top 1%)
• 2022.05 Student Conference Grant of INFOCOM 2022 (50 worldwide each year)
• 2021.08 Best Paper Award, Applied Data Science Runner Up of KDD 2021 (1/238)
• 2020.10 National Scholarship (Top 1%)
• 2019.09 Outstanding Thesis Award (Undergraduate) in Beijing (only 3 person/college)
• 2017.08 The 3rd Place of the Supermarket Robot track (@Home) in RoboCup China 2017
• 2016.12 Future Star of Software Engineering, Beijing Institute of Technology (10/176)

📖 Educations

• 2019.06 - Now, PhD, Beijing Institute of Techonolgy, Beijing.

• 2015.09 - 2019.06, Undergraduate, Beijing Institute of Techonolgy, Beijing.

• 2012.09 - 2015.06, Yaohua High School, Tianjin.

💬 Invited Talks

• 2023.01.17, 基于社会价值取向的无人车交互决策方法, RLChina论文研讨会（第37期）, Online.
• 2022.12.17, Socially-Attentive Policy Optimization in Multi-Agent Self-Driving System, DAI 2022, Tianjin.
• 2022.07.26, Zero-Shot Coordination: A Survey about Human-AI Collaboration, Huawei Noah’s Ark Lab internal discussion, Beijing.

💻 Internships

• 2023.04 - 2024.04, Qiyuan Lab, Beijing. (Mentor: Chao Wang)
• 2021.10 - 2023.03, Huawei Noah’s Ark Lab, Beijing. (Mentor: Kun Shao)

🤝 Partner Links

• Chengzhe Piao (He was the most impressive senior colleague I met during my graduate studies. Before he went to UCL for a PhD in interdisciplinary medical studies, he had already demonstrated exceptional research intuition in AI for science and generative models.)
• Hao Wang (He is the only genius in the history of the school to have received the highest honor scholarship during both his undergraduate and graduate studies.)
• Yuxiao Ye (He was interviewed by a well-known blogger for a project that won a grand prize.)

Design and source code inspired from Yi Ren’s awesome template.