AI at a Glance

AI at a Glance

1. Clustering – form of unsupervised learning
   • training data is available but without the classification information or class labels
   • identify and group similar individual data elements based on some measure of similarity
2. “Learning denotes changes in a system that … enables a system to do the same task more efficiently the next time.” (by Herbert Simon)
3. Information Gain
   • Entropy – a measure commonly used in statistics and information theory
   • Entropy characterizes the purity/impurity of an arbitrary collection of examples
   • Information Gain is the expected reduction in entropy caused by partitioning the examples according to
     this attribute
   • measure of the effectiveness of an attribute in classifying the training data
4. ANNs (Artificial Neural Networks)
   • Classification
   • Pattern Recognition
   • Prediction