Artificial intelligence is applied in a range of sectors, and is relied upon for decisions requiring a high level of trust. For regression methods, trust is increased if they approximate the true input-output relationships and perform accurately outside the bounds of the training data. But often performance off-test-set is poor, especially when data is sparse. This is because the conditional average, which in many scenarios is a good approximation of the `ground truth', is only modelled with conventional Minkowski-r error measures when the data set adheres to restrictive assumptions, with many real data sets violating these. To combat this there are several methods that use prior knowledge to approximate the `ground truth'. However, prior knowledge is not always available, and this paper investigates how error measures affect the ability for a regression method to model the `ground truth' in these scenarios. Current error measures are shown to create an unhelpful bias and a new error measure is derived which does not exhibit this behaviour. This is tested on 36 representative data sets with different characteristics, showing that it is more consistent in determining the `ground truth' and in giving improved predictions in regions beyond the range of the training data.
Independence Tests Without Ground Truth for Noisy Learners
Data Engines(数据引擎)
精确的真值不变多项式系统可以被写入任意相关的二进制分类器。他们的解决方案给出了样本统计量的估计,需要了解样本中正确标签的真值。在这些多项式系统中,只有少数以封闭形式求解。在这里,我们讨论了独立二进制分类器的精确解决方案-解决了在本次会议和其他会议上提出的一个突出问题。它的实用性受到其唯一剩余假设的阻碍-分类器需要在其样本误差中独立。我们讨论了如何使用封闭形式的解决方案来创建一个自洽的测试,可以验证独立性假设本身没有正确的标签真值。它可以作为一个代数几何猜想的二元分类器,仍然没有解决。一个类似的猜想的真值不变代数系统的标量回归是可解的,我们提出的解决方案在这里。我们还讨论了Penn ML Benchmark分类任务上的实验,这些实验提供了进一步的证据,证明该猜想可能适用于二元分类器的多项式系统。
Lyapunov Stability Learning with Nonlinear Control via Inductive Biases
School of Computing and Data Science, the University of Hong Kong and the Centre for Garment Production Limited (TransGP), Hong Kong SAR(计算与数据科学学院,香港大学及服装生产中心(TransGP),香港特别行政区)
Learning Inductive Biases with Simple Neural Networks
New York University(纽约大学)
人们利用丰富的先验知识来有效地学习新概念。这些先验-也称为“归纳偏差”-属于学习者考虑的内部模型空间,它们帮助学习者做出超越观察数据的推断。最近的一项研究发现,针对对象识别优化的深度神经网络产生了形状偏差(Ritter et al.,2017年),一个归纳偏见所拥有的儿童,在早期的文字学习中发挥着重要作用。然而,这些网络使用不切实际的大量训练数据,并且这些偏差发展所需的条件还没有得到很好的理解。此外,目前还不清楚这些网络的学习动态如何与儿童的发展过程有关。我们调查的发展和影响的形状偏差在神经网络使用控制数据集的抽象模式和合成图像,使我们能够系统地改变数量和形式的经验提供给学习算法。我们发现,简单的神经网络在看到4个对象类别的3个示例后会产生形状偏好。这些偏见的发展预测了我们网络中词汇加速的开始,与儿童的发展过程一致。
Inductive Biases for Object-Centric Representations in the Presence of Complex Textures
University of Amsterdam(阿姆斯特丹大学);The Netherlands Cancer Institute(荷兰癌症研究所);Technical University of Denmark(丹麦技术大学);University of Copenhagen(哥本哈根大学);Copenhagen University Hospital(哥本哈根大学医院);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所)
Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biases
Institute of Artificial Intelligence, School of Computer Science, Wuhan University, China;Hubei Luojia Laboratory, Wuhan, China;The University of Sydney, Australia;JD Explore Academy, Beijing, China;Nanyang Technological University, Singapore
ProCause: Generating Counterfactual Outcomes to Evaluate Prescriptive Process Monitoring Methods
Research Centre for Information Systems Engineering (LIRIS), KU Leuven, Leuven, Belgium(信息系统工程研究中心(LIRIS),根特大学,比利时卢汶);School of Computation, Information and Technology, Technical University of Munich (TUM), Munich, Germany(计算、信息与技术学院,慕尼黑技术大学,德国慕尼黑)
An Adaptor for Triggering Semi-Supervised Learning to Out-of-Box Serve Deep Image Clustering
State Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家重点实验室,南京大学);School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院)
Disentanglement with Factor Quantized Variational Autoencoders
Department of Mathematics and Computer Science, University of Southern Denmark(数学与计算机科学系,丹麦南部大学);Department of Computer Engineering, Istanbul Technical University(计算机工程系,伊斯坦布尔技术大学);Department of AI and Data Engineering, Istanbul Technical University(人工智能与数据工程系,伊斯坦布尔技术大学)
Large Language Models are Efficient Learners of Noise-Robust Speech Recognition
Nanyang Technological University(南洋理工大学);Georgia Institute of Technology(佐治亚理工学院);NVIDIA Research(英伟达研究院);University of Aberdeen(阿伯丁大学);Tsinghua University(清华大学)