Regression has attracted immense interest lately due to its effectiveness in tasks like predicting values. And Regression is of widespread use in multiple fields such as Economics, Finance, Business, Biology and so on. While considerable studies have proposed some impressive models, few of them have provided a whole picture regarding how and to what extent Regression has developed. With the aim of aiding beginners in understanding the relationships among different Regression algorithms, this paper characterizes a broad and thoughtful selection of recent regression algorithms, providing an organized and comprehensive overview of existing work and models utilized frequently. In this paper, the relationship between Regression and Deep Learning is also discussed and a conclusion can be drawn that Deep Learning can be more powerful as an combination with Regression models in the future.
How important are activation functions in regression and classification? A survey, performance comparison, and future directions
Brown University(布朗大学)
Inspired by biological neurons, the activation functions play an essential part in the learning process of any artificial neural network commonly used in many real-world problems. Various activation functions have been proposed in the literature for classification as well as regression tasks. In this work, we survey the activation functions that have been employed in the past as well as the current state-of-the-art. In particular, we present various developments in activation functions over the years and the advantages as well as disadvantages or limitations of these activation functions . We …
Mean estimation and regression under heavy-tailed distributions--a survey
Pompeu Fabra University(庞培法布拉大学);ICREA(加泰罗尼亚研究与高等研究院);Barcelona Graduate School of Economics(巴塞罗那经济研究生院);The Australian National University(澳大利亚国立大学);Sorbonne University(索邦大学)
A Survey of Predictive Maintenance Methods: An Analysis of Prognostics via Classification and Regression
Department of Information Systems University of Maryland Baltimore County(信息系统系大学马里兰大学巴尔的摩县);Department of Information Systems Colorado State University Pueblo(信息系统系科罗拉多州立大学普劳尔)
Hierarchical Mixtures-of-Experts for Exponential Family Regression Models with Generalized Linear Mean Functions: A Survey of Approximation and Consistency Results
Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Survey
School of Computer Science and Engineering, Hubei Key Laboratory of Intelligent Robot, Wuhan Institute of Technology(计算机科学与工程学院、智能机器人湖北省重点实验室、武汉理工大学);School of Computer Science, Wuhan University(计算机科学学院、武汉大学)
Gaussian Processes and Kernel Methods: A Review on Connections and Equivalences
University of Tübingen(图宾根大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Oxford(牛津大学);Pennsylvania State University(宾夕法尼亚州立大学)
Estimation of Fish Catch Using Sentinel-2, 3 and XGBoost-Kernel-Based Kernel Ridge Regression
Optical and SAR Sensing Laboratory, Agricultural and Food Engineering Department, Indian Institute of Technology Kharagpur(光学与SAR传感实验室,农业与食品工程系,印度理工学院Kharagpur);Department of Environmental Biology and Fishery Science, National Taiwan Ocean University(环境生物学与渔业科学系,台湾海洋大学)