arXiv 2201.069072022-01-18cs.CLcs.AI

Improve Sentence Alignment by Divide-and-conquer

The University of Hong Kong（香港大学）

Wu Zhang

英文摘要：

In this paper, we introduce a divide-and-conquer algorithm to improve sentence alignment speed. We utilize external bilingual sentence embeddings to find accurate hard delimiters for the parallel texts to be aligned. We use Monte Carlo simulation to show experimentally that using this divide-and-conquer algorithm, we can turn any quadratic time complexity sentence alignment algorithm into an algorithm with average time complexity of O(NlogN). On a standard OCR-generated dataset, our method improves the Bleualign baseline by 3 F1 points. Besides, when computational resources are restricted, our algorithm is faster than Vecalign in practice.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

思维递归：一种用于语言模型多上下文推理的分治方法

Recursion of Thought: A Divide-and-Conquer Approach to Multi-Context Reasoning with Language Models

Seoul National University（首尔国立大学）；SNU-LG AI Research Center（首尔国立大学-LG人工智能研究中心）

针对思维链长度易超出语言模型上下文上限的问题，研究提出思维递归（RoT）分治推理框架，通过特殊token触发上下文拆分操作，经多架构实验验证可大幅提升模型求解长推理问题的能力。

2023-06-12cs.AIcs.CL

A Divide-and-Conquer Strategy for Parsing

In this paper, we propose a novel strategy which is designed to enhance the accuracy of the parser by simplifying complex sentences before parsing. This approach involves the separate parsing of the constituent sub-sentences within a complex sentence. To achieve that, the divide-and-conquer strategy first disambiguates the roles of the link words in the sentence and segments the sentence based on these roles. The separate parse trees of the segmented sub-sentences and the noun phrases within them are then synthesized to form the final parse. To evaluate the effects of this strategy on parsing,…

1996-07-16cmp-lgcs.CL

对大语言模型中分而治之提示策略有效性的考察

An Examination on the Effectiveness of Divide-and-Conquer Prompting in Large Language Models

University of Southern California（南加州大学）；Coupang, Inc（Coupang公司）；Microsoft Research, Asia（微软亚洲研究院）

本文通过理论分析考察大语言模型中分而治之提示策略的适用任务类型，并以大整数算术和事实验证两个案例验证了该策略在特定任务上的性能提升。

2024-07-02cs.AIcs.CLcs.LG

分而治之：通过自适应并行解码加速扩散式大语言模型

Divide and Conquer: Accelerating Diffusion-Based Large Language Models via Adaptive Parallel Decoding

Southeast University（东南大学）；Nanyang Technological University（南洋理工大学）

DiCo通过分而治之的自适应并行解码方法，提升扩散式大语言模型的推理速度并保持生成质量。

2026-02-27cs.CL

面向复杂语言文本图像检索的神经分治推理框架

A Neural Divide-and-Conquer Reasoning Framework for Image Retrieval from Linguistically Complex Text

Harbin Institute of Technology（哈尔滨工业大学）；Meituan（美团）

针对预训练VLM在复杂语言文本图像检索任务中性能骤降的问题，受分治算法与双过程理论启发，提出包含拆分、交互、推理三模块的NDCR框架，显著提升复杂图文推理性能。

2023-05-05cs.CL

Divide and Conquer: Text Semantic Matching with Disentangled Keywords and Intents

Fudan University（复旦大学）；Shanghai Collaborative Innovation Center of Intelligent Visual Computing（上海智能视觉计算协同创新中心）；Tencent（腾讯）

Text semantic matching is a fundamental task that has been widely used in various scenarios, such as community question answering, information retrieval, and recommendation. Most state-of-the-art matching models, e.g., BERT, directly perform text comparison by processing each word uniformly. However, a query sentence generally comprises content that calls for different levels of matching granularity. Specifically, keywords represent factual information such as action, entity, and event that should be strictly matched, while intents convey abstract concepts and ideas that can be paraphrased int…

2022-03-06cs.CL

更多相关论文收起更多论文

A Divide-and-Conquer Approach to the Summarization of Long Documents

Aristotle University of Thessaloniki（塞萨洛尼基亚里士多德大学）；Atypon Hellas

We present a novel divide-and-conquer method for the neural summarization of long documents. Our method exploits the discourse structure of the document and uses sentence similarity to split the problem into an ensemble of smaller summarization problems. In particular, we break a long document and its summary into multiple source-target pairs, which are used for training a model that learns to summarize each part of the document separately. These partial summaries are then combined in order to produce a final complete summary. With this approach we can decompose the problem of long document su…

2020-09-23cs.CL

Divide and...conquer? On the limits of algorithmic approaches to syntactic semantic structure

University of Reading（雷丁大学）

In computer science, divide and conquer (D&C) is an algorithm design paradigm based on multi-branched recursion. A D&C algorithm works by recursively and monotonically breaking down a problem into sub problems of the same (or a related) type, until these become simple enough to be solved directly. The solutions to the sub problems are then combined to give a solution to the original problem. The present work identifies D&C algorithms assumed within contemporary syntactic theory, and discusses the limits of their applicability in the realms of the syntax semantics and syntax morphophonology int…

2016-09-11cs.CLcs.FL

Divide-and-Conquer based Ensemble to Spot Emotions in Speech using MFCC and Random Forest

College of Electronics and Information Engineering, Sejong University（世宗大学电子与信息工程学院）

Besides spoken words, speech signals also carry information about speaker gender, age, and emotional state which can be used in a variety of speech analysis applications. In this paper, a divide and conquer strategy for ensemble classification has been proposed to recognize emotions in speech. Intrinsic hierarchy in emotions has been utilized to construct an emotions tree, which assisted in breaking down the emotion recognition task into smaller sub tasks. The proposed framework generates predictions in three phases. Firstly, emotions are detected in the input speech signal by classifying it a…

2016-10-05cs.CLcs.SD

OmAgent：基于任务分治的复杂视频理解多模态智能体框架

OmAgent: A Multi-modal Agent Framework for Complex Video Understanding with Task Divide-and-Conquer

Om AI Research（Om AI研究院）；Binjiang Institute of Zhejiang University（浙江大学滨江研究院）

针对长视频处理信息丢失问题，提出多模态智能体框架OmAgent，通过高效存储检索视频帧与分治循环动态调用工具，显著减少信息丢失并提升复杂视频理解准确性。

2024-11-12cs.CLcs.CV