Mark Humphrys
-
Teaching
- CA300
Search:
Help
on Search
Introduction to Artificial Intelligence
Email
With several hundred students, I WOULD PREFER NOT TO RECEIVE COMMUNICATION BY EMAIL. See
How to contact me
. See
What I think about email
.
Course Descriptor
CA300 - Introduction to Artificial Intelligence
(and
here
)
This module is 70 exam, 30 project.
Past exam papers
Exam is multiple choice.
2007 exam:
Also relevant was
CA477
.
email lists
CA300 email list
Charlie Daly
discussion boards
(or via
here
)
CA300 discussion board
Notes
Introduction to AI
Introduction to AI
Survey of AI
AI Links
Robotics Links
Evolution Links
Philosophy of AI
Reading
Philosophy and Future of AI
What is Intelligence?
What is Consciousness?
What is Life?
Continuum of Autonomy
History of AI
Reading
Machine Learning (mainly focusing here on Neural Networks)
Search
Local and Global Optima
Maximising a function
Machine Learning
Representing a function
Distance in n-dimensions
Sample applications of Neural Networks
The Neural Network data structure
Chaotic functions
Chaos Theory demo
Single-layer Neural Networks
Perceptron Learning Rule
[SINGLE-LAYER LEARNING RULE]
Convergence Proof
[EXISTS]
Multi-layer Neural Networks
Timeline
Continuous Output - The sigmoid function
Notation
[REFERENCE]
Back-propagation
[MULTI-LAYER LEARNING RULE]
No method of finite sampling can
guarantee
to find the global minimum
Convergence Proof
[DOES NOT EXIST, HEURISTIC]
Designing the Network
The Back-propagation algorithm
[REFERENCE]
Designing the Inputs
Infinite weights/thresholds are bad
Specialisation
Need random,
diverse
initial w's
How does specialisation happen?
Alternatives to Supervised Learning
Sample code for Neural Networks
Neural Net Exercise - Binary Encoder Network
Neural Net Exercise - X and O recogniser
Machine Learning - Reference
Machine Evolution (mainly focusing here on Genetic Algorithms)
Computational Evolution
Introduction to Evolution
Definitions
The Genetic Algorithm
[HEURISTIC]
Encoding the Genotype
Fitness - Who reproduces?
Reproduction
2 copies of instructions - Nature's elegant algorithm
50-50 ratio - Further elegance in nature
Boltzmann "soft max" distribution
GAs - Discussion
Sample applications of Genetic Algorithms
What is Life?
Sample code for Genetic Algorithms
How to make a decision probabilistically
GA Exercise - Adaptive Landscape
Computational Evolution - Reference
General
Comparison of Neural Net and GA
Continuum of Autonomy
Open Issues in AI
NOT ON COURSE THIS YEAR
Advanced Topics in Machine Evolution
Speciation
(Local mating)
Architectures of Autonomous Agents
Reading
Concepts
Search and Learning - state spaces, generalisation, nearest-neighbours.
Learning from examples - Single-layer Neural Networks, Multi-layer Neural Networks, supervised learning, back-propagation, Neural Networks as generalisations (of state-spaces or non-linear functions).
Learning from rewards - Reinforcement Learning, Delayed reinforcement, Markov worlds, exploration v. exploitation, world models.
Artificial evolution - fitness landscapes, hill-climbing, the Genetic Algorithm, classifier systems, Genetic Programming.
Collective behavior - Cellular Automata, Chaos and Complexity, basins and attractors, prediction, the Game of Life, Artificial Life.
Practical
Practical
- Not yet ready to launch.
Recommended Reading
Coverage of both the symbolic and the biological approaches to AI in one book:
Artificial Intelligence
, George F. Luger - Library 006.3.LUG, and Bookshop.
6th edn is good, but my refs are to 5th edn, 2005.
Student resources
Lecturer resources
Images can be used for class access but not public access on the Web.
Neural Networks:
Neural Computing
, Philip D. Wasserman, 1989. - Library 006.3.WAS.
Neural Network Architectures: An Introduction
, Judith Dayhoff, 1990. - Library 006.3.DAY.
An Introduction to Neural Computing
, Igor Aleksander and Helen Morton, 2nd edn, 1995. - Library 006.3.ALE.
"Learning Internal Representations by Error Propagation"
, Rumelhart et al, Chapter 8 in
Parallel Distributed Processing
, Rumelhart and McClelland, 1986. - Library 153.RUM.
Genetic Algorithms:
Genetic Algorithms in Search, Optimization and Machine Learning
,
David Goldberg
, 1989. - Library 006.31.GOL.
Library categories
006 - Special computer methods
006.3 - Artificial Intelligence
629 - Other branches of engineering
629.8 - Automatic control engineering (robotics)
100 - Philosophy and psychology
120 - Epistemology, causation, humankind
128 - Humankind
150 - Psychology
153 - Mental processes and intelligence