Information gain calculates the reduction in entropy or surprise from transforming a dataset in some way. It is commonly used…
Continue Readinggain
Analyzing my weight loss journey with machine learning
After I rescaled my features, these warnings went away and my algorithm was able to converge. By reducing my features…
Continue ReadingEntropy: How Decision Trees Make Decisions
No. It’s just a metric. It’s not important to know how it came to be. It’s important to know how…
Continue ReadingDecision Tree
Attribute selection is used to determine the splitting criterion which tells us which attribute to test at node N by…
Continue Reading