What is the Relationship between Statistics and Machine Learning
Jason Lerner showcases how machine learning has impacted the field of statistics. Many statistical methods, such as regression, leverage machine learning techniques. However, as the field of statistics has continued to develop and advance, machine learning methods have reshaped our approach to statistical results and inference. Using a real world dataset on heart disease, Jason contrasts an application of logistic regression with Random Forest, a complex machine learning technique employed in prediction. The video showcases that while advanced machine learning techniques, like Random Forest, improve prediction accuracy, those complex methods may also limit the opportunity for statistical inference. That is, the opportunity for improved prediction (made possible by complex machine learning algorithms) may come out the cost of our ability to draw inferences and describe the explicit relationship between inputs and outputs.
Project Members: Jason Lerner