Machine Learning · Splitting Criterion
Entropy & Gain
Impurity peaks at a 50/50 mix — a tree splits on whatever question removes the most of it.
split on
entropy (bits)gini
drag p: both peak at 50/50, both hit 0 when the leaf is pure
Information Gain · Play Tennis (14 days)