The interactive exploration of large and evolving datasets is challenging as relationships between underlying variables may not be fully understood. There may be hidden trends and patterns in the data that are worthy of further exploration and analysis. We present a system that methodically explores multiple combinations of variables using a searchlight technique and identifies outliers. An iterative k-means clustering algorithm is applied to features derived through a split-apply-combine paradigm used in the database literature. Outliers are identified as singleton or small clusters. This algorithm is swept across the dataset in a searchlight manner. The dimensions that contain outliers are combined in pairs with other dimensions using a susbset scan technique to gain further insight into the outliers. We illustrate this system by anaylzing open health care data released by New York State. We apply our iterative k-means searchlight followed by subset scanning. Several anomalous trends in the data are identified, including cost overruns at specific hospitals, and increases in diagnoses such as suicides. These constitute novel findings in the literature, and are of potential use to regulatory agencies, policy makers and concerned citizens.
Incremental Outlier Detection Modelling Using Streaming Analytics in Finance & Health Care
National Institute of Technology Warangal(瓦朗加尔国家理工学院);Jawaharlal Nehru Technological University – Gurajada Vizianagaram (JNTU-GV)(贾瓦哈拉尔·尼赫鲁技术大学古拉贾达维齐亚纳格拉姆分校)
Outlier detection for patient monitoring and alerting
Department of Computer Science, University of Pittsburgh(匹兹堡大学计算机科学系);The Intelligent Systems Program, University of Pittsburgh(匹兹堡大学智能系统计划);Inria Lille-Nord Europe, equipe SequeL(Inria里尔-北欧洲研究中心,SequeL团队);Department of Biomedical Informatics, University of Pittsburgh(匹兹堡大学生物医学信息学系);CRISMA Center, Department of Critical Care Medicine, University of Pittsburgh School of Medicine(匹兹堡大学医学院重症医学科CRISMA中心)
Do Ensembling and Meta-Learning Improve Outlier Detection in Randomized Controlled Trials?
Centre for Data Science and Digital Health, Hamilton Health Sciences(汉密尔顿健康科学中心数据科学与数字健康中心);Department of Statistical Sciences, University of Toronto(多伦多大学统计科学系);Institute for Health Policy, Management and Evaluation, University of Toronto(多伦多大学卫生政策、管理与评估研究所);Department of Medicine, McMaster University(麦克马斯特大学医学系);Population Health Research Institute(人口健康研究所)
Probabilistic data quality assessment for structural monitoring data via outlier-resistant conditional diffusion model
Key Lab of Smart Prevention and Mitigation of Civil Engineering Disasters of the Ministry of Industry and Information Technology(工业和信息化部智能防灾减灾重点实验室);School of Civil Engineering, Harbin Institute of Technology(哈尔滨工业大学土木工程学院);Key Lab of Structures Dynamic Behavior and Control of the Ministry of Education(教育部结构动力行为与控制重点实验室);Harbin Institute of Technology(哈尔滨工业大学)
A Robust AUC Maximization Framework with Simultaneous Outlier Detection and Feature Selection for Positive-Unlabeled Classification
University of Rochester(罗切斯特大学);Baylor College of Medicine(贝勒医学院);University of Texas Health Science Center at Houston(休斯顿德克萨斯大学健康科学中心);University of Washington(华盛顿大学)
Outlier-based Autism Detection using Longitudinal Structural MRI
Amrita School of Engineering(阿姆里塔工程学院);Amrita Vishwa Vidyapeetham(阿姆里塔大学);Inception Institute of Artificial Intelligence(起源人工智能研究院);University of Canberra(堪培拉大学)
An Efficient Outlier Detection Algorithm for Data Streaming
California State University, San Bernardino(加州州立大学圣贝纳迪诺分校);John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院);University of California, Riverside(加州大学河滨分校)
Carnegie Mellon University(卡内基梅隆大学);Peking University(北京大学);Purdue University(普渡大学);Arima Inc.(Arima公司);IQVIA(艾昆纬);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Improving Clinical Decision Support through Interpretable Machine Learning and Error Handling in Electronic Health Records
Department of Electrical and Computer Engineering(电气与计算机工程系);Duke University(杜克大学);Department of Surgery(外科系);Duke University School of Medicine(杜克大学医学院);Department of Industrial and Systems Engineering(工业与系统工程系);Georgia Institute of Technology(佐治亚理工学院);Emory University School of Medicine(埃默里大学医学院);Sloan School of Management(斯隆管理学院);Massachusetts Institute of Technology(麻省理工学院)
DeepFIB: Self-Imputation for Time Series Anomaly Detection
时间序列(TS)异常检测(AD)在各种应用中起着至关重要的作用,例如,金融和医疗监控中的欺诈检测。由于异常的固有不可预测性和高度变化的性质以及历史数据中缺乏异常标签,AD问题通常被公式化为无监督学习问题。现有解决方案的性能往往不令人满意,特别是在数据稀缺的情况下。为了解决这个问题,我们提出了一种新的自监督学习技术AD的时间序列,即\emph{DeepFIB}。我们将问题建模为一个\emph{Fill In the Blank}游戏,通过掩蔽TS中的一些元素并将其与其余元素相关联。考虑到TS数据中两种常见的异常形状(点异常或序列异常),我们使用许多自生成的训练样本实现了两种掩蔽策略。相应的自归算网络可以提取更强大的时间关系比现有的AD解决方案,并有效地促进识别这两种类型的异常。对于连续离群值,我们还提出了一个异常定位算法,大大减少了AD错误。在各种真实TS数据集上的实验表明,DeepFIB的性能大大优于最先进的方法,在F1评分方面实现了高达$65.2\%$的相对改善。
Efficient Data Representation by Selecting Prototypes with Importance Weights
Amazon Development Center(亚马逊开发中心);IBM Research(IBM研究院)
最好地总结和解释代表底层复杂数据分布的原型示例在难以提取简单解释的领域中向人类传达有意义的见解。在本文中,我们提出了强有力的理论保证挖掘这些数据集,并选择原型a.k.a.算法。最好的代表来描述它们。我们的工作特别概括了Kim等人(2016)最近的工作,除了选择原型之外,我们还关联了非负权重,这表明了它们的重要性。这个扩展提供了一个单一的连贯框架,在这个框架下可以找到原型和批评(即离群值)。此外,我们的框架适用于任何对称正定核,从而解决了Kim et al.(2016)中提出的一个关键开放问题。通过建立我们的目标函数享有的弱次模块化的关键属性,我们提出了一个快速的ProtoDash算法,并获得近似保证相同。我们证明了我们的方法在不同领域的有效性,如零售,数字识别(MNIST)和公开的40个健康问卷从美国疾病控制中心(CDC)网站维护的美国部门。of Health.我们根据专家反馈和最近发表的关于公共卫生的科学研究,定量和定性地验证了结果,从而展示了我们的技术在提供可操作性(零售),实用性(MNIST)和洞察力(CDC数据集)方面的力量,这可以说是有效数据挖掘方法的标志。
Heart Disease Detection using Quantum Computing and Partitioned Random Forest Methods
Damghan University(达姆甘大学);Kuwait College of Science and Technology(科威特科学技术学院);Vels Institute of Sciences, Technology, and Advanced Studies(韦尔斯科学、技术与高等研究院);Universiti Malaysia Perlis(马来西亚玻璃市大学)
Detection of Sensor-To-Sensor Variations using Explainable AI
Technical University of Munich(慕尼黑工业大学);Infineon Technologies AG(英飞凌科技股份公司);Johannes Kepler University Linz(林茨约翰内斯·开普勒大学);Software Competence Center Hagenberg GmbH (SCCH)(哈根堡软件能力中心有限公司)