Dr. Mark Humphrys

School of Computing. Dublin City University.

Home      Blog      Teaching      Research      Contact

My big idea: Ancient Brain


CA114      CA170

CA668      CA669      Projects

Comparison of Neural Net and GA

For Both:

  1. Climbing/Descending an unknown multi-dimensional landscape.
  2. Never being shown the actual shape of the landscape, only deducing its shape from a finite number of sample points on its surface.
  3. No method that works like that can ever guarantee to find the global maximum/minimum. It may require an infinite amount of exploration to hit (by luck) the global optimum, if there is no landscape leading up/down towards it.
  4. To avoid local optima, we do not do strict descent/ascent. We can make moves in the opposite direction. This probability of this "noise" is high at the start and declines as we go on.

For Neural Nets only:

  1. It is given well-chosen, representative exemplars.
  2. E is known (distance from correct answer).

  3. is known (how error changes as we change the parameters).

  4. We can make a directed move.
  5. We start off by climbing/descending multiple landscapes at once. Eventually, the weight specialises on climbing/descending a particular family of similar landscapes.

For GAs only:

  1. It has to make up its own exemplars.
  2. E is not known. We do not know how good the "correct" answer might be. We get a fitness score for our attempt, certainly, but we do not know how good an attempt could possibly be.

  3. is not known.

  4. We can only make a random move.
  5. We use a population of multiple climbers/descenders on the same landscape. We follow the best performers. So this may mean we are following a number of trails at once.

ancientbrain.com      w2mind.org      humphrysfamilytree.com

On the Internet since 1987.

Wikipedia: Sometimes I link to Wikipedia. I have written something In defence of Wikipedia. It is often a useful starting point but you cannot trust it. Linking to it is like linking to a Google search. A starting point, not a destination. I automatically highlight in red all links to Wikipedia and Google search and other possibly-unreliable user-generated content.