Description

Title Increasing Reward in Biased Natural Selection Decreases Task Performance
Abstract My talk will present an investigation into a population of robots that evolves through embodied evolution --- an evolutionary process that is not centrally controlled, but emerges from robot interactions just as natural evolution does. The robots select their partners randomly, without reference to any assessment of task performance, but the environment is biased to promote task behaviour by awarding additional lifetime to robots that pick up pucks. The experiments show that the robots do learn to pick up pucks in such a setting. Contrary to what one might expect, increasing the amount of additional lifetime awarded decreases task performance for all settings considered. Closer analysis shows that this decrease is in part due to the fact that the increased lifespan decreases the number of opportunities to spread a robot's genome, but that increasing the award level also negatively affects selection pressure when there is opportunity for robots to spread their genome. We conclude that higher rewards overly emphasise one aspect of robot behaviour and in doing so prevent evolution from exploring the behaviour space.

Other presentations by Evert Haasdijk

DateTitle
10 March 2008
19 January 2009 Symbrion
22 March 2010
04 April 2011 Using HyperNEAT for modular robot locomotion
27 February 2012
17 December 2012 MONEE Talks
11 November 2013 FOCAS Living Textbook
07 September 2015 Combining Conflicting Environmental and Task Requirements in Evolutionary Robotics
11 April 2016 Increasing Reward in Biased Natural Selection Decreases Task Performance
23 January 2017