Classification: When the yi's are from some finite set. yi ? {finite set} Regression: When the yi's are real valued or they are in d dimensional space.