Yan Zheng's Homepage

ZHENG YAN (郑岩)

Co-Leader of Reinforcement Learning Research Team
Deep Reinforcement Learning Lab (天津大学-深度强化学习实验室）

Associate Professor in Tianjin University
Location: Tianjin University, Weijin Road 92, Nankai Distirct, Tianjin, China
News | Research Interest | Education | Publications | Services | Awards

Email: yanzheng@tju.edu.cn
[Google Scholar]

Hiring

Our lab has several Ph.D. and Master positions. If you are interested in the research directions (see here), please send me your CV (yanzheng@tju.edu.cn).

News

[Mar, 2021] One paper was accepted by IEEE TSG 2021.
[Dec, 2020] One paper was accepted by ICSE 2021.
[Dec, 2020] One journal paper was accepted by JAAMAS 2020.
[Nov, 2020] Two paper was accepted by AAAI 2020.
[Sep, 2019] One paper was accepted by ASE 2019 (Distinguished Paper Award).
[Apr, 2019] Two paper was accepted by IJCAI 2020.
[Jun, 2019] Two paper was accepted by AAMAS 2019.
[May, 2018] One paper was accepted by NeurIPS 2018.

Bio & Research Interest

I'm now a Research Fellow@NANYANG TECHNOLOGICAL UNIVERSITY and working in the research group of Prof. Liu Yang (刘杨). I'm also the co-learder of the Deep Reinforcement Learning Lab , founded by Prof. Jianye Hao (郝建业) in Tianjin University. My research concerns many different aspects of Artificial Intelligence, Deep Reinforcement Learning, and Multiagent System, especially the opponent modeling topic, including behavior analytics, prolicy representation and interpretation in multiagent problems.

Education

2019.08-present

Nanyang Technology University, CSL, Postdoc Research Fellow.

2015.9-2019.07

Tianjin University, College of Intelligence and Computing, Ph.D

2008.07-2015.7

Tianjin University, Colleage of Software Engineering, Bachelor and Master of Engineering.

Publications

Some selected papers are listed, visit Google Scholar for more publications.

(TSG 2021, SCI-1) Yan Zheng, Ziming Yan, Kangjie Chen, Jianwen Sun, Yan Xu, Yang Liu, "Vulnerability Assessment of Deep Reinforcement Learning Models for Power System Topology Optimization" in IEEE Transactions on Smart Grid, doi: 10.1109/TSG.2021.3062700.
(ICSE 2021, CCF-A) Yan Zheng, Yi Liu, Xiaofei Xie, Yepang Liu, Lei Ma, Jianye Hao, and Yang Liu, “Automatic Web Testing using Curiosity-Driven Reinforcement Learning” In Proceedings of the 43rd International Conference on Software Engineering.
(IJCAI 2021, CCF-A) Ruimin Shen*, Yan Zheng* (co-first), Jianye Hao, Zhaopeng Meng, Yingfeng Chen, Chanjgie Fan and Yang Liu. Generating BehaviorDiverse Game AIs with Evolutionary Multi-Objectives Deep Reinforcement Learning, Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence (IJCAI 2020), pp.3371--3377, Yokohama, Japan, July 2020 (Acceptance rate: 592/4717=12.6%)
(IJCAI 2021, CCF-A) Peng Zhang, Jianye Hao, Weixun Wang, Hongyan Tang, Yi Ma, Yihai Duan and Yan Zheng. KoGuN: Accelerating Deep Reinforcement Learning via Integrating Human Suboptimal Knowledge, Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence (IJCAI 2020), pp.2291--2297, Yokohama, Japan, July 2020 (Acceptance rate: 592/4717=12.6%)
(JAAMAS 2020, CCF-B) Yan Zheng, Jianye Hao, Zongzhang Zhang, Zhaopeng Meng, Tianpei Yang, Yanran Li, Changjie Fan. Efficient policy detecting and reusing for non-stationarity in Markov games[J]. Journal of Systems and Software, 2020, 35(1): 1-29.
(AAAI 2020, CCF-A) Jianwen Sun*, Yan Zheng* (co-first), Jianye Hao, Zhaopeng Meng and Yang Liu. Continuous Multiagent Control using Collective Behavior Entropy for Large-Scale Home Energy Management, Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI 2020), New York, USA February 7-12, 2020. (Acceptance rate: 1591/7737=20.6%)
(AAAI 2020, CCF-A) Jianwen Sun, Tianwei Zhang, Xiaofei Xie, Lei Ma, Yan Zheng* (corresponding), Kangjie Chen and Yang Liu. Stealthy and Efficient Adversarial Attacks against Deep Reinforcement Learning, Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI 2020), New York, USA February 7-12, 2020. (Acceptance rate: 1591/7737=20.6%)
(JSCT 2020, CCF-B) Yan Zheng, Jianye Hao, Zongzhang Zhang, Zhaopeng Meng, Xiaotian Hao, Efficient Multiagent Policy Optimization Based on Weighted Estimators in Stochastic Cooperative Environments[J], Computer Science & Technology, 2020, 35(2):268-280
(ASE 2019, CCF-A) Yan Zheng, Xiaofei Xie, Ting Su, Lei Ma, Jianye Hao, Zhaopeng Meng, Yang Liu, Ruimin Shen, Yinfeng Chen and Changjie Fan. Wuji: Automatic Online Combat Game Testing Using Evolutionary Deep Reinforcement Learning, The 34th IEEE/ACM International Conference on Automated Software Engineering (ASE 2019), pp. 772–784, San Diego, CA, USA, Nov.11-15, 2019. (Acceptance rate: 20%). (ACM Distinguished Paper Award)
(IJCAI 2019, CCF-A) Yaodong Yang, Jianye Hao, Yan Zheng, Chao Yu, Large-scale home energy management using entropy-based collective multiagent deep reinforcement learning framework, Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI 2019), pp.630-636, Macao, China, August 10-16, 2019 (Acceptance rate: 850/4752=17.9%)
(IJCAI 2019, CCF-A) Tianpei Yang, Jianye Hao, Zhaopeng Meng, Zongzhang Zhang, Yan Zheng and Ze Zheng, Towards Efficient Detection and Optimal Response against Sophisticated Opponents, Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI 2019) pp.630636, Macao, China, August 10-16, 2019 (Acceptance rate: 850/4752=17.9%)
(AAMAS 2019, CCF-B) Yaodong Yang, Jianye Hao, Yan Zheng, Xiaotian Hao and Bofeng Fu. Large-Scale Home Energy Management Using Entropy-Based Collective Multiagent Reinforcement Learning Framework. Proceedings of the 18th International Conference on Autonomous Agents and Multiagent Systems, pp.2285-2287, Montreal, Canada, May 13-17. (Acceptance rate: 189/781 = 24%)
(AAMAS 2019, CCF-B) Tianpei Yang, Jianye Hao, Zhaopeng Meng, Yan Zheng, Chongjie Zhang and Ze Zheng. Bayes-ToMoP: A Fast Detection and Best Response Algorithm Towards Sophisticated Opponents. Proceedings of the 18th International Conference on Autonomous Agents and Multiagent Systems, (AAMAS 2019) pp. 2282--2284, Montreal, Canada, May 13-17. (Acceptance rate: 189/781 = 24%)
(NeruIPS 2018, CCF-A) Yan Zheng, Zhaopeng Meng, Jianye Hao, Zongzhang Zhang, Tianpei Yang, Changjie Fan, A Deep Bayesian Policy Reuse Approach Against Non-Stationary Agents, Processing of the 31st Annual Conference on Neural Information Processing Systems, (NeurIPS 2018) pp.962-972, Montreal, Canada, December 3-8, 2018 (Acceptance rate: 1011/4856=20.8%)
(JSS 2018, CCF-B) Yan Zheng, Zan Wang, Xiangyu Fan, Xiang Chen and Zijiang Yang. Localizing multiple software faults based on evolution algorithm[J]. Journal of Systems and Software, 2018, 139: 107-123.
(PRICAI 2018, CCF-C) Yan Zheng, Zhaopeng Meng, Jianye Hao and Zongzhang Zhang. Weighted Double Deep Multiagent Reinforcement Learning in Stochastic Cooperative Environments. Proceedings of the 15th Pacific Rim International Conference on Artificial Intelligence, pp.421-429, Nanjing, China, August 28-31.

Services

(Senior) Program Committee Member of AAAI、IJCAI、NeurIPS、ECAI、AAMAS、DAI
Proceedings Chair of the 26th Asia-Pacific Software Engineering Conference (APSEC 2020)
Reviewer of Journal of Computer Science and Technology

Awards

CCF (AAMAS) Outstanding Doctoral Dissertation Award, 2020
ACM SIGSOFT Distinguished Paper Award in ASE 2019:" Wuji: Automatic Online Combat Game Testing Using Evolutionary Deep Reinforcement Learning", 2019
(Four times) National Scholarship, China, 2013, 2014, 2015, 2016