首页/论文/1303.1761

arXiv 1303.17612013-03-07cs.CV

Improving Automatic Emotion Recognition from speech using Rhythm and Temporal feature

Indian Institute of Technology Bhubaneswar（布巴内斯瓦尔印度理工学院）；TU Berlin（柏林工业大学）

Mayank Bhargava, Tim Polzehl

备注：: Appeared in ICECIT-2012, Srinivasa Ramanujan Institute of Technology, Anantapur

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

This paper is devoted to improve automatic emotion recognition from speech by incorporating rhythm and temporal features. Research on automatic emotion recognition so far has mostly been based on applying features like MFCCs, pitch and energy or intensity. The idea focuses on borrowing rhythm features from linguistic and phonetic analysis and applying them to the speech signal on the basis of acoustic knowledge only. In addition to this we exploit a set of temporal and loudness features. A segmentation unit is employed in starting to separate the voiced/unvoiced and silence parts and features are explored on different segments. Thereafter different classifiers are used for classification. After selecting the top features using an IGR filter we are able to achieve a recognition rate of 80.60 % on the Berlin Emotion Database for the speaker dependent framework.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

当语义重要时：共语手势生成的可靠性感知语义节奏控制

When Semantics Matter: Reliability-Aware Semantic-Rhythm Control for Co-Speech Gesture Generation

Hainan International College, Communication University of China（中国传媒大学海南国际学院）；School of Data Science and Intelligent Media, Communication University of China（中国传媒大学数据科学与智能媒体学院）；School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University（中山大学深圳校区网络空间安全学院）

针对共语手势生成中语义利用不足的问题，提出可靠性感知的语义节奏控制框架，通过双分支信息增益估计与噪声条件调制，实现语义表现力与节奏同步的平衡。

2026-09-30cs.CV

SEDTalker: 基于帧级语音情感分离的3D面部动画

SEDTalker: Emotion-Aware 3D Facial Animation Using Frame-Level Speech Emotion Diarization

University of Alberta, Edmonton, AB, Canada（阿尔伯塔大学）；University of Florence, Florence, Italy（佛罗伦萨大学）

SEDTalker通过帧级语音情感分离实现情感感知的3D面部动画，利用混合Transformer-Mamba架构生成连续表情控制。在多语种语音情感分离数据集和EmoVOCA数据集上验证，取得高精度情感识别和低重建误差。

2026-04-14cs.CV

Rhythmic Gesticulator：基于分层神经嵌入的节奏感知协同语音手势合成

Rhythmic Gesticulator: Rhythm-Aware Co-Speech Gesture Synthesis with Hierarchical Neural Embeddings

Peking University（北京大学）；Shandong University（山东大学）

针对现有协同语音手势合成方法难以兼顾节奏与语义的问题，提出基于分层神经嵌入的Rhythmic Gesticulator方法，通过节奏分割流水线与语音-动作分层嵌入解耦匹配实现优质合成，经多维度评估性能显著优于现有最优系统。

2023-05-04cs.AIcs.CVcs.GR

Emotion Recognition in Speech using Cross-Modal Transfer in the Wild

University of Oxford（牛津大学）

Obtaining large, human labelled speech datasets to train models for emotion recognition is a notoriously challenging task, hindered by annotation cost and label ambiguity. In this work, we consider the task of learning embeddings for speech classification without access to any form of labelled audio. We base our approach on a simple hypothesis: that the emotional content of speech correlates with the facial expression of the speaker. By exploiting this relationship, we show that annotations of expression can be transferred from the visual domain (faces) to the speech domain (voices) through cr…

2018-08-16cs.CV

基于解耦潜在扩散的情感语音驱动3D人体动画

Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion

KTH Royal Institute of Technology, Sweden（瑞典皇家理工学院）；Max Planck Institute for Intelligent Systems, Germany（德国马克斯·普朗克智能系统研究所）

本文提出AMUSE模型，通过解耦潜在向量实现情感语音驱动的3D人体动画生成，能控制情绪和风格，生成更符合语音内容且表现更真实的情绪动作序列。

2026-03-30cs.CV

Cross Lingual Speech Emotion Recognition: Urdu vs. Western Languages

Information Technology University (ITU)-Punjab（旁遮普信息技术大学）；COMSATS University Islamabad (CUI)（伊斯兰堡COMSATS大学）

Cross-lingual speech emotion recognition is an important task for practical applications. The performance of automatic speech emotion recognition systems degrades in cross-corpus scenarios, particularly in scenarios involving multiple languages or a previously unseen language such as Urdu for which limited or no data is available. In this study, we investigate the problem of cross-lingual emotion recognition for Urdu language and contribute URDU---the first ever spontaneous Urdu-language speech emotion database. Evaluations are performed using three different Western languages against Urdu and…

2020-07-28cs.CLcs.CV

更多相关论文收起更多论文

Interpretable Multimodal Emotion Recognition using Hybrid Fusion of Speech and Image Data

Indian Institute of Technology Roorkee（印度理工学院鲁尔基分校）

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been developed to identify the important speech & image features leading to the prediction of particular emotion classes. The proposed system's architecture has been determined through intensive ablation studies. It fuses the speech & image features and then combines speech, image, and intermediate fusion outputs. The proposed interpretability technique incorporates the …

2023-01-07cs.CVcs.SDeess.AS

Speech Driven Talking Face Generation from a Single Image and an Emotion Condition

University of Rochester（罗切斯特大学）

Visual emotion expression plays an important role in audiovisual speech communication. In this work, we propose a novel approach to rendering visual emotion expression in speech-driven talking face generation. Specifically, we design an end-to-end talking face generation system that takes a speech utterance, a single face image, and a categorical emotion label as input to render a talking face video synchronized with the speech and expressing the conditioned emotion. Objective evaluation on image quality, audiovisual synchronization, and visual emotion expression shows that the proposed system…

2021-07-21cs.CVcs.LGcs.MM