Decision boundaries Separating positive and negative example with a straight line that is as far as possible from both positive and negative examples, a median that maximizes the space between positive and negative examples. Constraints are applied to build a…
15. Learning: Near Misses, Felicity Conditions
One-shot learning Learning in human-like way, in one shot: learning something definite from each example. The evolving model Comparing an initial model example, a seed, with a near miss or another example, the evolving model understands an important characteristic for each…
14. Learning: Sparse Spaces, Phonology
Visual recognition to sound production Words can be classified in tables representing the 14 features of each sound, notably if they are “voiced” or not. With such a matrix of sounds, a “speaking machine” can be built to produce words…
13. Learning: Genetic Algorithms
Mimicking chromosomes Reproduction loop Strings of 0 and 1 simulate chromosomes in binary systems. An initial population of chromosomes is allowed to mutate (modification of certain bit in the strings), cross over with other strings during replication, or to remain…
12b: Deep Neural Nets
Image recognition by a deep neural net Convolution: a neuron looks for patterns in a small portion (10×10 px) of an image (256×256 px), the process is repeated by moving this small area little by litte. Pooling: The result of…