In this paper, we address the problem of measuring and analysing sensation, the subjective magnitude of one's experience. We do this in the context of the method of triads: the sensation of the stimulus is evaluated via relative judgments of the form: "Is stimulus S_i more similar to stimulus S_j or to stimulus S_k?". We propose to use ordinal embedding methods from machine learning to estimate the scaling function from the relative judgments. We review two relevant and well-known methods in psychophysics which are partially applicable in our setting: non-metric multi-dimensional scaling (NMDS) and the method of maximum likelihood difference scaling (MLDS). We perform an extensive set of simulations, considering various scaling functions, to demonstrate the performance of the ordinal embedding methods. We show that in contrast to existing approaches our ordinal embedding approach allows, first, to obtain reasonable scaling function from comparatively few relative judgments, second, the estimation of non-monotonous scaling functions, and, third, multi-dimensional perceptual scales. In addition to the simulations, we analyse data from two real psychophysics experiments using ordinal embedding methods. Our results show that in the one-dimensional, monotonically increasing perceptual scale our ordinal embedding approach works as well as MLDS, while in higher dimensions, only our ordinal embedding methods can produce a desirable scaling function. To make our methods widely accessible, we provide an R-implementation and general rules of thumb on how to use ordinal embedding in the context of psychophysics.
Less but Better: Generalization Enhancement of Ordinal Embedding via Distributional Margin
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
Robust Ordinal Embedding from Contaminated Relative Comparisons
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);University of Chinese Academy of Sciences(中国科学院大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
Adaptive Global and Fine-Grained Perceptual Fusion for MLLM Embeddings Compatible with Hard Negative Amplification
State Key Lab of General AI, School of Intelligence Science and Technology, Peking University(人工智能国家重点实验室,智能科学与技术学院,北京大学);Institute for Artificial Intelligence, Peking University(人工智能研究院,北京大学)
Fast Stochastic Ordinal Embedding with Variance Reduction and Adaptive Step Size
University of Chinese Academy of Sciences(中国科学院大学);Peng Cheng Laboratory(鹏城实验室);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Jiangxi Normal University(江西师范大学);Hong Kong University of Science and Technology(香港科技大学);Tencent AI Lab(腾讯人工智能实验室);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
Stochastic Non-convex Ordinal Embedding with Stabilized Barzilai-Borwein Step Size
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);University of Chinese Academy of Sciences(中国科学院大学);Jiangxi Normal University(江西师范大学);Hong Kong University of Science and Technology(香港科技大学);Tencent AI Lab(腾讯人工智能实验室)
Tabular Learning: Encoding for Entity and Context Embeddings
Institute for Data Applications and Security(数据应用与安全研究院);School of Engineering and Computer Science(工程与计算机科学学院);Bern University of Applied Sciences(伯尔尼应用科学大学)
Improving Perceptual Audio Aesthetic Assessment via Triplet Loss and Self-Supervised Embeddings
Research Center for Information Technology Innovation, Academia Sinica(学术院信息科技创新研究中心);College of Informatics, National Chengchi University(国立成功大学资讯学院);Institute of Information Science, Academia Sinica(学术院信息科学研究所);Institute of Communications Engineering, National Yang Ming Chiao Tung University(国立阳明交通大学通讯工程研究所)
Active Learning of Ordinal Embeddings: A User Study on Football Data
Friedrich-Alexander-Universität Erlangen-Nürnberg(弗里德里希-亚历山大-埃尔兰根-纽伦堡大学);Fraunhofer Institute for Integrated Circuits(弗劳恩霍夫集成电路研究所);Georgia Institute of Technology(佐治亚理工学院)