Based on decision trees, many fields have arguably made tremendous progress in recent years. In simple words, decision trees use the strategy of "divide-and-conquer" to divide the complex problem on the dependency between input features and labels into smaller ones. While decision trees have a long history, recent advances have greatly improved their performance in computational advertising, recommender system, information retrieval, etc. We introduce common tree-based models (e.g., Bayesian CART, Bayesian regression splines) and training techniques (e.g., mixed integer programming, alternating optimization, gradient descent). Along the way, we highlight probabilistic characteristics of tree-based models and explain their practical and theoretical benefits. Except machine learning and data mining, we try to show theoretical advances on tree-based models from other fields such as statistics and operation research. We list the reproducible resource at the end of each method.
Department of Electronics and Computer Engineering, Institute of Engineering, Thapathali Campus, Tribhuvan University, Kathmandu, Nepal（电子与计算机工程系，工程学院，塔帕塔利校区， Tribhuvan 大学，尼泊尔加德满都）；Department of Computer Science, Swastik College, Tribhuvan University, Bhaktapur, Nepal（计算机科学系，Swastik 学院， Tribhuvan 大学，尼泊尔巴赫塔普尔）；School of Computer Science, Gallogly College of Engineering, University of Oklahoma, Norman, USA（计算机科学学院，Gallogly 工程学院，俄克拉荷马大学，美国诺曼）
Indian Institute of Technology Indore（印度理工学院印多尔分校）；Nanyang Technological University（南洋理工大学）；Qatar University（卡塔尔大学）；VŠB - Technical University of Ostrava（俄斯特拉发技术大学）
Highly Detailed and Generalizable Broadleaf Tree Crown Instance Segmentation from UAV Imagery
DeepForest Technologies Co., Ltd.（深森林技术有限公司）；YM Lab.（YM实验室）；Graduate School of Agriculture, Kyoto University（京都大学农业研究院）；Graduate School of Science, Osaka Metropolitan University（大阪 metropolitan 大学理学研究院）；Faculty of Tropical Forestry, Universiti Malaysia Sabah（马来西亚沙巴大学热带林业学院）；Forest Research Centre, Sabah Forestry Department（沙巴林业部门森林研究中心）
A Kernel Fisher Discriminant Analysis-Based Tree Ensemble Classifier: KFDA Forest
School of Industrial Management Engineering, Korea University（韩国大学工业管理工程学院）；School of Mechanical Engineering, Chungnam National University（Chungnam国立大学机械工程学院）
