Multi-Agent Reinforcement Learning Surveys

This blog post contains surveys on multi-agent reinforcement learning listed in reverse chronological order. The focus here is on general reinforcement learning techniques, so surveys on specific applications are not included.


  1. C. Moulin-Frier, P. Oudeyer. Multi-Agent Reinforcement Learning as a Computational Tool for Language Evolution Research: Historical Context and Future Challenges. arXiv:2002.08878 [cs.MA], 2020.
  2. M. Zaïem, E. Bennequin. Learning to Communicate in Multi-Agent Reinforcement Learning: A Review. arXiv:1911.05438 [cs.LG], 2019.
  3. P. Hernandez-Leal, B. Kartal, M. E. Taylor. A Survey and Critique of Multiagent Deep Reinforcement Learning. Autonomous Agents and Multi-Agent Systems, vol. 33, no. 6, pp. 1-48, 2019.
  4. R. Rădulescu, P. K. Mannion, D. M. Roijers, A. Nowé. Multi-Objective Multi-Agent Decision Making: A Utility-based Analysis and Survey. arXiv:1909.02964 [cs.MA], 2019.
  5. G. Papoudakis, F. Christianos, A. Rahman, S.V. Albrecht. Dealing with Non-Stationarity in Multi-Agent Deep Reinforcement Learning. arXiv:1906.04737 [cs.LG], 2019.
  6. F. Silva, A. Costa. A Survey on Transfer Learning for Multiagent Reinforcement Learning Systems. Journal of Artificial Intelligence Research, vol. 64, pp. 645-703, 2019.
  7. T. T. Nguyen, N. D. Nguyen, S. Nahavandi. Deep Reinforcement Learning for Multi-Agent Systems: A Review of Challenges, Solutions and Applications. arXiv:1812.11794 [cs.LG], 2019.
  8. S.V. Albrecht, P. Stone. Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problems. arXiv:1709.08071 [cs.AI], 2018.
  9. K. Tuyls, P. Stone. Multiagent Learning Paradigms. Lecture Notes in Artificial Intelligence, vol. 10767, pp. 3-21, 2018.
  10. P. Hernandez-Leal, M. Kaisers, T. Baarslag, E. M. De Cote. A Survey of Learning in Multiagent Environments: Dealing with Non-Stationarity. arXiv:1707.09183 [cs.MA], 2017.
  11. D. Bloembergen, K. Tuyls, D. Hennes, M. Kaisers. Evolutionary Dynamics of Multi-agent Learning: A Survey. Journal Of Artificial Intelligence Research, vol. 53, no. 1, pp. 659-97, 2015.
  12. K. Tuyls, G. Weiss. Multiagent Learning: Basics, Challenges, and Prospects. AI Magazine, vol. 33, no. 3, pp. 41-52, 2012.
  13. L. Matignon, G. J. Laurent, N. Le Fort-piat. Independent Reinforcement Learners in Cooperative Markov Games: A Survey Regarding Coordination Problems. The Knowledge Engineering Review, vol. 27, no. 1, pp. 1-31, 2012.
  14. A. Nowé, P. Vrancx, Y. De Hauwere. Game Theory and Multi-agent Reinforcement Learning. Reinforcement Learning State-of-the-Art, pp. 441-470, 2012.
  15. L. Buşoniu, R. Babuška, B. De Schutter. Multi-agent Reinforcement Learning: An Overview. Studies in Computational Intelligence, vol. 310, pp. 183-221, 2010.
  16. A. V. Bab, R. I. Brafman. Multi-Agent Reinforcement Learning in Common Interest and Fixed Sum Stochastic Games: An Experimental Study. Journal of Machine Learning Research, vol. 9, pp. 2635-2675, 2008.
  17. L. Busoniu, R. Babuska, B. De Schutte. A Comprehensive Survey of Multiagent Reinforcement Learning. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 38, pp. 156-172, 2008.
  18. Y. Shoham, R. Powers, T. Grenager. If Multi-Agent Learning is the Answer, What is the Question?. Artificial Intelligence, vol. 171, no. 7, pp. 365-377, 2007.
  19. L. Panait, S. Luke. Cooperative Multi-Agent Learning: The State of the Art. Autonomous Agents and Multi-Agent Systems, vol. 11, no. 3, pp. 387-434, 2005.
  20. P. J. Hoen, K. Tuyls, L. Panait, S. Luke. An Overview of Cooperative and Competitive Multiagent Learning. Proceedings of the First International Conference on Learning and Adaption in Multi-Agent Systems, 2005.
  21. L. A. Panait, S. Luke. Collaborative Multiagent Learning: A Survey. Autonomous Agents and Multi-Agent Systems, vol. 11, no. 3, pp. 387-434, 2005.
  22. E. Yang, D. Gu. Multiagent Reinforcement Learning for Multi-Robot Systems: A Survey. 2004.
  23. Y. Shoham, R. Powers, T. Grenager. Multi-Agent Reinforcement Learning: A Critical Survey. 2003.
  24. E. Alonso, M. D'inverno, D. Kudenko, M. Luck, J. Noble. Learning in Multi-agent Systems. The Knowledge Engineering Review, vol. 16, no. 3, 2001.
  25. P. Stone, M. Veloso. Multiagent Systems: A Survey from a Machine Learning Perspective. Autonomous Robots, vol. 8, no. 3, 2000.
  26. S. Sen, G. Weiss. Learning in Multiagent Systems. Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence, pp. 259-298, 1999.