用KumQuat自动综合并行Unix命令和流水线
Automatic Synthesis of Parallel Unix Commands and Pipelines with KumQuat
摘要：
我们目前KumQuat，一个系统自动生成数据的Unix shell命令和管道并行实现。所生成的并行版本拆分输入流，执行原始流水线命令的多个实例化以并行处理拆分，然后组合所得到的并行输出以产生最终输出流。KumQuat自动合成组合运算符，特定于域的组合器语言作为一个强大的正则化器，促进正确组合器的有效推理。我们在70个基准脚本上评估KumQuat，这些脚本总共有427个阶段。KumQuat为这些基准测试脚本中出现的121个唯一命令中的113个合成了正确的组合器。合成时间在39秒和331秒之间变化，中值为60秒。我们目前的实验结果表明，这些组合器使我们的基准脚本的有效并行化。
英文摘要：
We present KumQuat, a system for automatically generating data parallel implementations of Unix shell commands and pipelines. The generated parallel versions split input streams, execute multiple instantiations of the original pipeline commands to process the splits in parallel, then combine the resulting parallel outputs to produce the final output stream. KumQuat automatically synthesizes the combine operators, with a domain-specific combiner language acting as a strong regularizer that promotes efficient inference of correct combiners. We evaluate KumQuat on 70 benchmark scripts that together have a total of 427 stages. KumQuat synthesizes a correct combiner for 113 of the 121 unique commands that appear in these benchmark scripts. The synthesis times vary between 39 seconds and 331 seconds with a median of 60 seconds. We present experimental results that show that these combiners enable the effective parallelization of our benchmark scripts.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
