— Michael PolanyiA shaping of boundaries may be said to go beyond a mere fixing of boundaries and establishes a 'controlling principle.' It achieves control of the boundaries by imprinting a significant pattern on the boundaries of the system. Or, to use information language, we may say that it puts the system under the control of a non-physical-chemical principle by a profoundly informative intervention.
"Life Transcending Physics and Chemistry," Chemical & Engineering News (21 August 1967): 64.
Needle-in-the-haystack problems look for small targets in large spaces. In such cases, blind search stands no hope of success. Conservation of information dictates any search technique will work, on average, as well as blind search. Success requires an assisted search. But whence the assistance required for a search to be successful? To pose the question this way suggests that successful searches do not emerge spontaneously but need themselves to be discovered via a search. The question then naturally arises whether such a higher-level “search for a search” is any easier than the original search. We prove two results: (1) The Horizontal No Free Lunch Theorem, which shows that average relative performance of searches never exceeds unassisted or blind searches, and (2) The Vertical No Free Lunch Theorem, which shows that the difficulty of searching for a successful search increases exponentially with respect to the minimum allowable active information being sought.
[ PDF ]