FineSkiing：滑雪动作质量评估的细粒度基准
FineSkiing: A Fine-grained Benchmark for Skiing Action Quality Assessment
AI总结：
针对现有动作质量评估（AQA）方法可解释性和可靠性有限、数据集缺乏细粒度标注的问题，构建首个空中滑雪细粒度AQA数据集，提出JudgeMind方法，通过阶段分割、特征增强融合及知识解码器提升性能，实现SOTA。
摘要：
动作质量评估（AQA）旨在对体育动作进行评估和打分，近年来引起了广泛关注。现有AQA方法主要基于从整个视频中提取的特征预测分数，导致可解释性和可靠性有限。同时，现有AQA数据集也缺乏对动作分数的细粒度标注，特别是扣分项目和子分数标注。在本文中，我们构建了首个包含空中滑雪细粒度子分数和扣分标注的AQA数据集，该数据集将作为新基准发布。针对技术挑战，我们提出了一种名为JudgeMind的新型AQA方法，通过模拟专业裁判的判断和打分思维，显著提升了性能和可靠性。我们的方法将输入的动作视频分割为不同阶段，并对每个阶段进行打分以提高准确性。然后，我们提出了一个阶段感知特征增强与融合模块，以增强对阶段特定关键区域的感知，并提高对频繁摄像机视角切换引起的视觉变化的鲁棒性。此外，我们提出了一个基于知识的等级感知解码器，将可能的扣分项目作为先验知识纳入，以预测更准确可靠的分数。实验结果表明，我们的方法实现了最先进的性能。
英文摘要：
Action Quality Assessment (AQA) aims to evaluate and score sports actions, which has attracted widespread interest in recent years. Existing AQA methods primarily predict scores based on features extracted from the entire video, resulting in limited interpretability and reliability. Meanwhile, existing AQA datasets also lack fine-grained annotations for action scores, especially for deduction items and sub-score annotations. In this paper, we construct the first AQA dataset containing fine-grained sub-score and deduction annotations for aerial skiing, which will be released as a new benchmark. For the technical challenges, we propose a novel AQA method, named JudgeMind, which significantly enhances performance and reliability by simulating the judgment and scoring mindset of professional referees. Our method segments the input action video into different stages and scores each stage to enhance accuracy. Then, we propose a stage-aware feature enhancement and fusion module to boost the perception of stage-specific key regions and enhance the robustness to visual changes caused by frequent camera viewpoints switching. In addition, we propose a knowledge-based grade-aware decoder to incorporate possible deduction items as prior knowledge to predict more accurate and reliable scores. Experimental results demonstrate that our method achieves state-of-the-art performance.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
