We propose a novel high-performance and interpretable canonical deep tabular data learning architecture, TabNet. TabNet uses sequential attention to choose which features to reason from at each decision step, enabling interpretability and more efficient learning as the learning capacity is used for the most salient features. We demonstrate that TabNet outperforms other neural network and decision tree variants on a wide range of non-performance-saturated tabular datasets and yields interpretable feature attributions plus insights into the global model behavior. Finally, for the first time to our knowledge, we demonstrate self-supervised learning for tabular data, significantly improving performance with unsupervised representation learning when unlabeled data is abundant.
Qatar Computing Research Institute（卡塔尔计算研究所）；University of Gabes（加贝斯大学）；Sidra Medicine（西德拉医院）
Patient no-shows is a major burden for health centers leading to loss of revenue, increased waiting time and deteriorated health outcome. Developing machine learning (ML) models for the prediction of no -shows could help addressing this important issue. It is crucial to consider fair ML models for no-show prediction in order to ensure equality of opportunity in accessing healthcare services. In this wo rk, we are interested in developing deep learning models for no-show prediction based on tabular data while ensuring fairness properties. Our baseline model, TabNet, uses on attentive feature tr…
In spite of showing unreasonable effectiveness in modalities like Text and Image, Deep Learning has always lagged Gradient Boosting in tabular data - both in popularity and performance. But recently there have been newer models created specifically for tabular data, which is pushing the performance bar. But popularity is still a challenge because there is no easy, ready-to-use library like Sci-Kit Learn for deep learning. PyTorch Tabular is a new deep learning library which makes working with Deep Learning and tabular data easy and fast. It is a library built on top of PyTorch and PyTorch Ligh…
Attention-Based Deep Learning for Early Parkinson's Disease Detection with Tabular Biomedical Data
African Institute for Mathematical Sciences, Kigali, Rwanda（非洲数学科学研究所，基加利，刚果（金））；Department of Data and Information Science, University of Ibadan, Oyo State, Nigeria（数据与信息科学系，伊巴丹大学，奥约州，尼日利亚）；Department of Computer Science and Information Systems, University of Limerick, Castletroy, V94 T9PX, Limerick, Ireland（计算机科学与信息系统系，利默里克大学，卡斯利特罗伊，爱尔兰）
An Empirical Study of Machine Learning Robustness and Scalability for Imbalanced Tabular Clinical Data in Emergency and Critical Care
Computer Vision Group, Institute of Cognitive Science, Osnabrück University（计算机视觉组，认知科学研究所，奥斯纳布吕克大学）；Department of Mathematics, Rhodes University（数学系，罗德斯大学）；National Institute for Theoretical and Computational Sciences (NITheCS)（国家理论与计算科学研究所（NITheCS））
Gradient Boosting Decision Trees on Medical Diagnosis over Tabular Data
Department of Electrical and Computer Engineering（电气与计算机工程系）；Northeastern University（东北大学）；The Business School（商学院）；Worcester Polytechnic Institute（沃思利理工学院）
Risk-Aware Financial Forecasting Enhanced by Machine Learning and Intuitionistic Fuzzy Multi-Criteria Decision-Making
Sakarya University（萨卡里亚大学）；University of East Sarajevo（东萨拉热窝大学）；Korea University（高丽大学）；Necmettin Erbakan University（内吉梅丁·埃尔巴坎大学）；Singapore University of Social Sciences（新加坡社会科学大学）
DALL-M: Context-Aware Clinical Data Augmentation with LLMs
School of Information Systems, Queensland University of Technology（昆士兰科技大学信息系统学院）；School of Computer Science, Queensland University of Technology（昆士兰科技大学计算机科学学院）；Data Science Institute, University of Technology Sydney（悉尼科技大学数据科学研究所）；Imagiology Department, Grupo Lusiadas（卢西塔达斯集团影像学系）
