ALA 2014 - Workshop at AAMAS 2014

Adaptive Learning Agents (ALA) encompasses diverse fields such as Computer Science, Software Engineering, Biology, as well as Cognitive and Social Sciences. The ALA workshop will focus on agents and multiagent systems which employ learning or adaptation.

This workshop is a continuation of the long running AAMAS series of workshops on adaptive agents, now in its fourteenth year. Previous editions of this workshop may be found at the following urls:

The goal of this workshop is to increase awareness and interest in adaptive agent research, encourage collaboration and give a representative overview of current research in the area of adaptive and learning agents and multiagent systems. It aims at bringing together not only scientists from different areas of computer science (e.g., agent architectures, reinforcement learning, and evolutionary algorithms) but also from different fields studying similar concepts (e.g., game theory, bio-inspired control, mechanism design).

The workshop will serve as an inclusive forum for the discussion on ongoing or completed work in both theoretical and practical issues of adaptive and learning agents and multiagent systems.

This workshop will focus on all aspects of adaptive and learning agents and multiagent systems with a particular emphasis on how to modify established learning techniques and/or create new learning paradigms to address the many challenges presented by complex real-world problems. The topics of interest include but are not limited to:

  • Novel combinations of reinforcement and supervised learning approaches
  • Integrated learning approaches that work with other agent reasoning modules like negotiation, trust models, coordination, etc.
  • Supervised multiagent learning
  • Reinforcement learning (single and multiagent)
  • Planning (single and multiagent)
  • Reasoning (single and multiagent)
  • Distributed learning
  • Adaptation and learning in dynamic environments
  • Evolution of agents in complex environments
  • Co-evolution of agents in a multiagent setting
  • Cooperative exploration and learning to cooperate and collaborate
  • Learning trust and reputation
  • Communication restrictions and their impact on multiagent coordination
  • Design of reward structure and fitness measures for coordination
  • Scaling learning techniques to large systems of learning and adaptive agents
  • Emergent behaviour in adaptive multiagent systems
  • Game theoretical analysis of adaptive multiagent systems
  • Neuro-control in multiagent systems
  • Bio-inspired multiagent systems
  • Applications of adaptive and learning agents and multiagents systems to real world complex systems
  • Learning of Co-ordination

Accepted papers from the workshop will be eligible to be extended for inclusion in a special issue journal.

Important Dates

  • Submission Deadline: January 31, 2014 (extended)
  • Notification of acceptance: February 19, 2014
  • Camera-ready copies: March 1, 2014
  • Early registration: March 25, 2014
  • Workshop: May 5-6, 2014


Monday - May 5, 2014

9:00 - 10:30 Session 1
Daan Bloembergen and Peter Vrancx:
Multiagent Reinforcement Learning (Tutorial Part I)
10:30 - 11:00 Coffee Break
11:00 - 12:30 Session 2 - Chair: Daniel Hennes
11:00 - 11:30 Pablo Hernandez-Leal, Enrique Munoz De Cote, and L. Enrique Sucar:
Exploration strategies to detect strategy switches
11:30 - 12:00 Peter Scopes, and Daniel Kudenko:
Theoretical Properties and Heuristics for Tile Coding
12:00 - 12:30 Sandip Sen, and Anton Ridgway:
Adaptive Algorithms for Fixed-Cost Multi-Armed Bandit Problems with Budget Constraints
12:30 - 14:00 Lunch
14:00 - 15:30 Session 3 (Best Paper Session) - Chair: Daniel Kudenko
14:00 - 14:30 Igor Kiselev, and Pascal Poupart:
POMDP Planning by Marginal-MAP Probabilistic Inference in Generative Models
14:30 - 15:00 Daan Bloembergen, Daniel Hennes, Peter McBurney, and Karl Tuyls:
Trading in Markets with Noisy Information: An Evolutionary Analysis
15:30 - 16:00 Coffee Break
16:00 - 18:00 Session 4 - Chair: Samuel Barrett
16:00 - 17:00 Invited Speaker: Professor Manuela M. Veloso, CMU
Learning to Adapt Behavior in the Presence of State and Action Uncertainty
17:00 - 17:15 Daniel Urieli, and Peter Stone:
TacTex'13: A Champion Adaptive Power Trading Agent
17:15 - 17:30 Kristof Van Moffaert, Madalina Drugan, and Ann Nowe:
Learning Sets of Pareto Optimal Policies
17:30 - 17:45 Carrie Rebhuhn, Matt Knudson, and Kagan Tumer:
Announced strategy types in multiagent RL for conflict-avoidance in the national airspace
17:45 - 18:15 Emmanuel Hadoux, Aurélie Beynier, and Paul Weng:
Solving Hidden-Semi-Markov-Mode Markov Decision Problems
19:30 ALA Community Drinks

Tuesday - May 6, 2014

9:00 - 10:30 Session 1
Logan Yliniemi and Sam Devlin:
Reward Shaping (Tutorial Part II)
Difference Evaluation Functions Slides
Potential-Based Reward Shaping Slides
10:30 - 11:00 Coffee Break
11:00 - 12:30 Session 2 - Chair: Daan Bloembergen
11:00 - 11:30 Chris Holmesparker, Mathew Taylor, Yusen Zhan, and Kagan Tumer:
Exploiting Structure and Agent-Centric Rewards to Promote Coordination in Large Multiagent Systems
11:30 - 12:00 Elmer Jacobs, Joost Broekens, and Catholijn Jonker:
Emergent Dynamics of Joy, Distress, Hope and Fear in Reinforcement Learning Agents
12:00 - 12:15 Osman Yucel, Chad Crawford, and Sandip Sen:
Evolving effective behaviors to interact with tag-based populations
12:15 - 12:30 Saad Ahmad Khan, Saad Arif, and Ladislau Boloni:
Towards learning movement in dense crowds for a socially-aware mobile robot
12:30 - 14:00 Lunch
14:00 - 15:30 Session 3 - Chair: Tim Brys
14:00 - 14:30 Yundi Qian, William Haskell, Albert Xin Jiang, and Milind Tambe:
Online Learning and Planning in Resource Conservation Games
14:30 - 15:00 Stefano Albrecht, and Subramanian Ramamoorthy:
On Convergence and Optimality of Best-Response Learning with Policy Types in Multiagent Systems
15:00 - 15:30 Logan Yliniemi, Adrian Agogino, and Kagan Tumer:
Simulation of the Introduction of New Technologies in Air Traffic Management
15:30 - 16:00 Coffee Break
16:00 - 18:00 Session 4 - Chair: Logan Yliniemi
16:00 -16:30 Kleanthis Malialis, Sam Devlin, and Daniel Kudenko:
Intrusion Response Using Difference Rewards for Scalability and Online Learning
16:30 - 17:00 Yusen Zhan, Anestis Fachantidis, Ioannis Vlahavas, and Matthew Taylor:
Agents Teaching Humans in Reinforcement Learning Tasks
17:00 - 18:00 ALA Community Meeting and FOCAS Best Paper Award Announcement

Invited Talk

Professor Manuela M. Veloso

Computer Science Department

School of Computer Science

Carnegie Mellon University


Program Committee

  • Adrian Agogino, UCSC, NASA Ames Research Center, USA
  • Haitham Bou Ammar, University of Pennsylvania, USA
  • Samuel Barrett, University of Texas at Austin, USA
  • Enda Barrett, NUI Galway, Ireland
  • Daan Bloembergen, Maastricht University, The Netherlands
  • Daniel Claes, University of Liverpool, UK
  • William Curran, Oregon State University, USA
  • Yann-Michaël De Hauwere, Vrije Universiteit Brussels, Belgium
  • Sam Devlin, University of York, UK
  • Kyriakos Efthymiadis, University of York, UK
  • Josha Fossel, University of Liverpool, UK
  • Marek Grzes, University of Waterloo, Canada
  • Daniel Hennes, European Space Agency, The Netherlands
  • Chris Holmes Parker, Oregon State University, USA
  • Enda Howley, National University of Ireland, Ireland
  • Atil Iscen, Oregon State University, USA
  • Michael Kaisers, CWI, The Netherlands
  • Matt Knudson, Carnegie Mellon University, USA
  • Patrick MacAlpine, University of Texas at Austin, USA
  • Kleanthis Malialis, University of York, UK
  • Carrie Rebhuhn, Oregon State University, USA
  • Kaushik Subramanian, Georgia Institute of Technology, USA
  • Logan Yliniemi, Oregon State University, USA


This year's workshop is organized by:
Senior Steering Committee Members:
  • Daniel Kudenko (University of York, UK)
  • Ann Now (Vrije Universiteit Brussels, Belgium)
  • Sandip Sen (University of Tulsa, USA)
  • Peter Stone (University of Texas at Austin, USA)
  • Matthew Taylor (Washington State University, USA)
  • Kagan Tumer (Oregon State University, USA)
  • Karl Tuyls (University of Liverpool, UK)


If you have any questions about the ALA workshop, please contact the organizers at:
ala.workshop.2014 AT

For more general news, discussion, collaboration and networking opportunities with others interested in Adaptive Learning Agents then please join our Linkedin Group