Towards A Common Evolution:
ASADA--Recently we've been studying genetic programming,[*13] particularly to what extent two agents are capable of cooperative behavior. The problem is that they aren't very cooperative with each other. With one driving force of will the concept of efficiency is usable, but with multiple will mechanisms the whole idea of efficient, coordinated action just falls apart. Figuring out how to let them work together to fool an opponent is also extremely difficult to manage. Two robots without a common enemy won't cooperate. There's no apparent necessity for them. Of course, it's more efficient for them to cooperate, but in defining priorities for their tasks, the tasks that they must divide between themselves, there are a lot of managerial adjustments that we must make or collaboration is really difficult to achieve.
ASADA--I mentioned it at some research group recently and someone tried the experiment with their kid's junior league! There was one goalkeeper, and two other children who were supposed to be passing and shooting, but the goalkeeper was just in a far stronger position. It's easy to impede, tough to cooperate. In their game the keeper was always winning, while the attackers were losing spirit, and the kids were losing interest in the game. It was only after they put more restrictions on the goalkeeper's actions that they all started to coevolve.
SAKURA--There is a British psychologist who conducted a classic experiment with a dominant pig and a subordinate pig, where the object was to push a button in one location to make food come out of a dispenser in another.
ASADA--That is precisely the kind of problem that is needed to organize complex relationships and synchronize behavioral patterns for coevolution.
SAKURA--I suppose so. With human beings, societal rules function as such external guiding principles. Of course, humans may be one animal that is inherently good at cooperation, but I suppose that this is the result of a long road of conflict with various external groups. For example, groups that found plentiful water supplies were bound together to protect it. External pressures. The existence of a third party is what forwards the body politic.
ASADA--I think that it's interesting that competition is innate, but collaboration is learned. Games don't often stress such situations. We've finally gotten the lower level behaviors in line, the shooters to learn shooting, but we haven't yet been able to enable the higher levels of cooperation. What we've done is to simulate human society, where in this case you would have a coach working with the team to encourage coevolution,[*14] "bottom-up" methodologies. Even though they may not learn a given skill the first time it is taught to them, after repeating the skill along with the coach several times, they begin to grasp what was being explained to them. Also, the coaches learn how to express themselves better over time. It is an experiment in collaborative development. Rather than all of the robots beginning from the same starting point, some, which are designated as coaches, are able to interact with the player robots and they both learn how to function within their roles together.