The evaluation of clustering results is difficult, highly dependent on the evaluated data set and the perspective of the beholder. There are many different clustering quality measures, which try to provide a general measure to validate clustering results. A very popular measure is the Silhouette. We discuss the efficient medoid-based variant of the Silhouette, perform a theoretical analysis of its properties, provide two fast versions for the direct optimization, and discuss the use to choose the optimal number of clusters. We combine ideas from the original Silhouette with the well-known PAM algorithm and its latest improvements FasterPAM. One of the versions guarantees equal results to the original variant and provides a run speedup of $O(k^2)$. In experiments on real data with 30000 samples and $k$=100, we observed a 10464$\times$ speedup compared to the original PAMMEDSIL algorithm. Additionally, we provide a variant to choose the optimal number of clusters directly.
Quantitative Evaluation of Performance and Validity Indices for Clustering the Web Navigational Sessions
P.A. College of Engineering(P.A.工程学院);Jawaharlal Nehru Technical University(贾瓦哈拉尔·尼赫鲁技术大学)
聚类技术被广泛用于Web使用挖掘中,以捕获访问Web站点的用户之间的相似兴趣和趋势。为此,在特定网站处生成的web访问日志被预处理以发现用户导航会话。然后应用聚类技术将用户会话数据分组为用户会话簇,其中簇间相似性最小化,而簇内相似性最大化。由于不同聚类算法的应用通常会导致不同的聚类形成集,因此重要的是要评估这些方法在聚类的准确性和有效性方面的性能,以及使用适当的性能度量生成它们所需的时间。本文介绍了各种有效性和准确性的措施,包括邓恩的指数,戴维斯博尔丁指数,C指数,兰德指数,杰卡尔指数,剪影指数,Fowlkes马洛和平方误差之和(SSE)。我们对以下聚类技术进行了性能评估:k-Means,k-Medoids,Leader,Single Link Agglomerative Hierarchical和DBSCAN。这些技术的实现和测试对Web用户的导航数据。最后给出了它们的性能结果并进行了比较。
Comparative analysis of unsupervised clustering techniques using validation metrics: Study on cognitive features from the Canadian Longitudinal Study on Aging (CLSA)
Contextual Phenotyping of Pediatric Sepsis Cohort Using Large Language Models
Department of Surgery, Duke university school of medicine(杜克大学医学学院外科部);Department of Anesthesiology, Duke university school of medicine(杜克大学医学学院麻醉科);Indian Institute of Technology, Goa(印度去邦理工学院);Institute for Global Health, BC Children’s Hospital and BC Women’s Hospital + Health Centre(全球健康研究所,BC儿童医院和BC妇女医院及健康中心);Department of Anesthesia, Pharmacology & Therapeutics, University of British Columbia(不列颠哥伦比亚大学麻醉学、药理学与治疗学系);BC Children’s Hospital Research Institute, BC Children’s Hospital(BC儿童医院研究学院,BC儿童医院);Department of Pediatrics, University of British Columbia(不列颠哥伦比亚大学儿科系);Walimu, Kampala, Uganda(乌干达坎帕拉沃尔imu);Department of Community Health, Mbarara University of Science and Technology(马巴拉拉大学科学与技术学院社区健康系)
Automatic Clustering for Unsupervised Risk Diagnosis of Vehicle Driving for Smart Road
Institute for Infocomm Research, Agency for Science Technology and Research (A*STAR)(新加坡科技研究局信息通信研究院);School of Microelectronics, Shanghai University(上海大学微电子学院);School of Civil and Environmental Engineering, Nanyang Technological University(南洋理工大学土木与环境工程学院);College of Transportation Engineering, Tongji University(同济大学交通运输工程学院);Nanyang Business School, Nanyang Technological University(南洋理工大学南洋商学院)
Building RadiologyNET: Unsupervised annotation of a large-scale multimodal medical database
University of Rijeka – Faculty of Engineering(里耶卡大学工程学院);Center for Artificial Intelligence and Cybersecurity(人工智能与网络安全中心);Medical University of Graz(格拉茨医科大学)