— Marcus Tullius Cicero (106-43 BC)If a countless number of copies of the one-and-twenty letters of the alphabet, made of gold or whatever you will, were thown together into some receptical and then shaken out on to the ground, [would it] be possible that they should produce the Annals of Ennius? ... I doubt whether chance could possibly succeed in the producing even a single verse!
Nature of the Gods, Book II, Section XXXVII
According to conservation of information theorems, performance of an arbitrarily chosen search, on average, does no better than blind search. Domain expertise and prior knowledge about search space structure or target location is therefore essential in crafting the search algorithm. The effectiveness of a given algorithm can be measured by the active information introduced to the search. We illustrate this by identifying sources of active information in Avida, a software program designed to search for logic functions using nand gates. Avida uses stair step active information by rewarding logic functions using a smaller number of nands to construct functions requiring more. Removing stair steps deteriorates Avida's performance while removing deleterious instructions improves it. Some search algorithms use prior knowledge better than others. For the Avida digital organism, a simple evolutionary strategy generates the Avida target in far fewer instructions using only the prior knowledge available to Avida.
[ PDF | IEEE ]