— Pierre GrasséAny living being possesses an enormous amount of 'intelligence,' very much more than is necessary to build the most magnificent of cathedrals. Today, this 'intelligence' is called 'information,' but it is still the same thing. It is not programmed as in a computer, but rather it is condensed on a molecular scale in the chromosomal DNA or in that of any other organelle in each cell. This 'intelligence' is the sine qua non of life. If absent, no living being is imaginable. Where does it come from?
Evolution of Living Organisms: Evidence for a New Theory of Transformation, (New York: Academic Press, 1977), 2
Conservation of information theorems indicate that any search algorithm performs on average as well as random search without replacement unless it takes advantage of problem-specific information about the search target or the search-space structure. Combinatorics shows that even a moderately sized search requires problem-specific information to be successful. Three measures to characterize the information required for successful search are (1) endogenous information, which measures the difficulty of finding a target using random search; (2) exogenous information, which measures the difficulty that remains in finding a target once a search takes advantage of problem-specific information; and (3) active information, which, as the difference between endogenous and exogenous information, measures the contribution of problem-specific information for successfully finding a target. This paper develops a methodology based on these information measures to gauge the effectiveness with which problem-specific information facilitates successful search. It then applies this methodology to various search tools widely used in evolutionary search.
[ PDF | IEEE ]