• The workshop is over, and was a great success.
    Thank you to all authors, both our invited speakers and our panelists.
    All authors will be contacted soon regarding submission
    for the special issue journal.

  • Program online, see: ALA 2013 Program
  • Registration open, see: AAMAS Registration
  • Deadline for Discounted Early Registration: March 27, 2013
  • Deadline extension: February 9, 2013
  • December 12: ALA CFPs
  • December 5: ALA-13 site launched

ALA 2013 - Workshop at AAMAS 2013

Adaptive Learning Agents encompasses diverse fields such as Computer Science, Software Engineering, Biology, as well as Cognitive and Social Sciences. The ALA workshop will focus on agents and multiagent systems which employ learning or adaptation.

Our technical program included 19 oral presentations, 2 invited speakers and a joint panel held in collaboration with the MSDM workshop. For which, the panelists were Prof. Peter Stone, Prof. Sandip Sen, Prof. Milind Tambe and Prof. Shlomo Zilberstein.

This workshop is a continuation of the long running AAMAS series of workshops on adaptive agents, now in its thirteenth year. Previous editions of this workshop may be found at the following urls:

The goal of this workshop is to increase awareness and interest in adaptive agent research, encourage collaboration and give a representative overview of current research in the area of adaptive and learning agents and multiagent systems. It aims at bringing together not only scientists from different areas of computer science (e.g., agent architectures, reinforcement learning, and evolutionary algorithms) but also from different fields studying similar concepts (e.g., game theory, bio-inspired control, mechanism design).

The workshop will serve as an inclusive forum for the discussion on ongoing or completed work in both theoretical and practical issues of adaptive and learning agents and multiagent systems.

This workshop will focus on all aspects of adaptive and learning agents and multiagent systems with a particular emphasis on how to modify established learning techniques and/or create new learning paradigms to address the many challenges presented by complex real-world problems. The topics of interest include but are not limited to:

  • Novel combinations of reinforcement and supervised learning approaches
  • Integrated learning approaches that work with other agent reasoning modules like negotiation, trust models, coordination, etc.
  • Supervised multiagent learning
  • Reinforcement learning (single and multiagent)
  • Planning (single and multiagent)
  • Reasoning (single and multiagent)
  • Distributed learning
  • Adaptation and learning in dynamic environments
  • Evolution of agents in complex environments
  • Co-evolution of agents in a multiagent setting
  • Cooperative exploration and learning to cooperate and collaborate
  • Learning trust and reputation
  • Communication restrictions and their impact on multiagent coordination
  • Design of reward structure and fitness measures for coordination
  • Scaling learning techniques to large systems of learning and adaptive agents
  • Emergent behaviour in adaptive multiagent systems
  • Game theoretical analysis of adaptive multiagent systems
  • Neuro-control in multiagent systems
  • Bio-inspired multiagent systems
  • Applications of adaptive and learning agents and multiagents systems to real world complex systems
  • Learning of Co-ordination

Accepted papers from the workshop will be eligible to be extended for inclusion in a special issue journal

Important Dates

  • Deadline for Discounted Early Registration: March 27, 2013
  • Submission Deadline: February 9, 2013 (extended) January 30, 2013
  • Notification of acceptance: February 27, 2013
  • Camera-ready copies: March 10, 2013
  • Workshop: May 6-7, 2013



9:00 - 10:30Session 1
9:00 - 9:30Logan Brooks and Sandip Sen:
Performance Metrics and System Behavior: Some Anomalies
9:30 - 10:00Siqi Chen, Haitham Bou Ammar, Kurt Driessens, Karl Tuyls and Gerhard Weiss:
Automatic Transfer Between Negotiation Tasks
10:00 - 10:30David Catteeuw and Bernard Manderick:
The Limits of Reinforcement Learning in Lewis Signaling Games
10:30 - 11:00Coffee Break
11:00 - 11:45Invited Talk: Milind Tambe
11:45 - 12:30Session 2
11:45 - 12:00Maxim Claeys et al.:
Design of a Q-Learning based client quality selection algorithm for HTTP Adaptive Video Streaming
12:00 - 12:15Simon Gay and Olivier Georgeon:
Interaction-Based Space Representation for Environment Agnostic Agents
12:15 - 12:30Samuel Barrett, Noa Agmon, Noam Hazon, Sarit Kraus and Peter Stone:
Communicating with Unknown Teammates
12:30 - 13:30Lunch
13:30 - 15:30Session 3
13:30 - 14:00Kenji Kawaguchi and Mauricio Araya-López:
A Greedy Approximation of Bayesian Reinforcement Learning with Probably Optimistic Transition Model
14:00 - 14:30Enda Barrett, Enda Howley and Jim Duggan:
Parallel Bayesian Model Learning
IntervalMid Session Interval
14:30 - 14:45Kyriakos Efthymiadis and Daniel Kudenko:
A Comparison of Plan-Based and Abstract MDP Reward Shaping
14:45 - 15:00Patrick Macalpine, Elad Liebman and Peter Stone:
Simultaneous Learning and Reshaping of an Approximated Optimization Task
15:00 - 15:30Pablo Hernandez-Leal, Enrique Munoz De Cote and L. Enrique Sucar:
Learning against non-stationary opponents
15:30 - 16:00Coffee Break
16:00 - 17:30Session 4
16:00 - 16:30Bikramjit Banerjee and Landon Kraemer:
Counterfactual Regret Minimization for Decentralized Planning
16:30 - 17:00Saminda Abeyruwan, Andreas Seekircher and Ubbo Visser:
Dynamic Role Assignment using General Value Functions
17:00 - 17:30Sara Mc Carthy and Doina Precup:
Theoretical Results on Variable-Length Actions in MDPs
Monday Night at 8PMJoint ALA & MSDM Social Outing


9:00 - 10:30Session 1
9:00 - 9:30Jolie Olsen and Sandip Sen:
On the Rationality of Cycling in the Theory of Moves Framework
9:30 - 10:00Tong Pham, Tim Brys and Matthew Taylor:
Learning Coordinated Traffic Light Control
10:00 - 10:30Jolie Olsen and Sandip Sen:
Discovery, Utilization, and Analysis of Credible Threats for 2 X 2 Incomplete Information Games in TOM
10:30 - 11:00Coffee Break
11:00 - 11:45Invited Talk: Matthew E. Taylor
11:45 - 12:30Session 2
11:45 - 12:15Doran Chakraborty, Peter Stone and Noa Agmon:
Targeted Opponent Modeling of Memory-Bounded Agents
12:15 - 12:30Nicholas Carboni and Matthew Taylor:
Agents Teaching Agents: Preliminary Results for 1 vs. 1 Tactics in Starcraft
Community Meeting
12:30 - 13:30Lunch
17:00 - 18:00Joint ALA & MSDM Panel

Invited Talks

Professor Milind Tambe

Computer Science & Industrial
and Systems Engineering Departments

University of Southern California


Matthew E. Taylor

School of Electrical Engineering
and Computer Science

Washington State University


Program Committee

  • Adrian Agogino, UCSC, NASA Ames Research Center, USA
  • Samuel Barrett,University of Texas at Austin, USA
  • Ana L.C. Bazzan, Universidade Federal do Rio Grande do Sul, Brazil
  • Daan Bloembergen, Maastricht University, The Netherlands
  • Haitham Bou-Ammar, Maastricht University, The Netherlands
  • Doran Chakraborty, University of Texas at Austin, USA
  • Daniel Claes, Maastricht University, The Netherlands
  • William Curran, Oregon State University, USA
  • Yann-Michaël De Hauwere, Vrije Universiteit Brussels, Belgium
  • Sam Devlin, University of York, UK
  • Marek Grzes, University of Waterloo, Canada
  • Daniel Hennes, Maastricht University, The Netherlands
  • Todd Hester, University of Texas at Austin, USA
  • Chris Holmes Parker, Oregon State University, USA
  • Enda Howley, National University of Ireland, Ireland
  • Atil Iscen, Oregon State University, USA
  • Matt Knudson, Carnegie Mellon University, USA
  • Mihail Mihaylov, KAHO Sint-Lieven Gent, Belgium
  • Carrie Rebhuhn, Oregon State University, USA
  • Peter Vrancx, Vrije Universiteit Brussel, Belgium
  • Logan Yliniemi, Oregon State University, USA


This year's workshop is organized by:

If you have any questions about the ALA workshop, please contact Enda Howley at: enda.howley AT

Senior Steering Committee Members:
  • Daniel Kudenko (University of York, UK)
  • Ann Nowé (Vrije Universiteit Brussels, Belgium)
  • Sandip Sen (University of Tulsa, USA)
  • Peter Stone (University of Texas at Austin, USA)
  • Matthew Taylor (Washington State University, USA)
  • Kagan Tumer (Oregon State University, USA)
  • Karl Tuyls (Maastricht University, The Netherlands)


If you have any questions about the ALA workshop, please contact Enda Howley at:
enda.howley AT

For more general news, discussion, collaboration and networking opportunities with others interested in Adaptive Learning Agents then please join our Linkedin Group