CFO: A Framework for Building Production NLP Systems

动态双向模式记忆：临床NLP中推理时门控的生产规模实证特征

Dynamic Bidirectional Pattern Memory: A Production-Scale Empirical Characterisation of Inference-Time Gating in Clinical NLP

本研究在生产规模的临床NLP管道中，通过生成器-验证器架构和轻量级记忆机制，发现直接从验证器拒绝学习过滤规则在大规模下失效，而基于固定临床本体的规则有效，并揭示门控选择性取决于是否测试验证器权衡的证据。

PyText: A Seamless Path from NLP research to production

We introduce PyText - a deep learning based NLP modeling framework built on PyTorch. PyText addresses the often-conflicting requirements of enabling rapid experimentation and of serving models at scale. It achieves this by providing simple and extensible interfaces for model components, and by using PyTorch's capabilities of exporting models for inference via the optimized Caffe2 execution engine. We report our own experience of migrating experimentation and production workflows to PyText, which enabled us to iterate faster on novel modeling ideas and then seamlessly ship them at industrial sc…

Deploying a BERT-based Query-Title Relevance Classifier in a Production System: a View from the Trenches

The Bidirectional Encoder Representations from Transformers (BERT) model has been radically improving the performance of many Natural Language Processing (NLP) tasks such as Text Classification and Named Entity Recognition (NER) applications. However, it is challenging to scale BERT for low-latency and high-throughput industrial use cases due to its enormous size. We successfully optimize a Query-Title Relevance (QTR) classifier for deployment via a compact model, which we name BERT Bidirectional Long Short-Term Memory (BertBiLSTM). The model is capable of inferring an input in at most 0.2ms o…

BERTaú: Itaú BERT for digital customer service

In the last few years, three major topics received increased interest: deep learning, NLP and conversational agents. Bringing these three topics together to create an amazing digital customer experience and indeed deploy in production and solve real-world problems is something innovative and disruptive. We introduce a new Portuguese financial domain language representation model called BERTaú. BERTaú is an uncased BERT-base trained from scratch with data from the Itaú virtual assistant chatbot solution. Our novel contribution is that BERTaú pretrained language model requires less data, reached…

GeoSense-AI：从危机推文快速推断位置

GeoSense-AI: Fast Location Inference from Crisis Microblogs

GeoSense-AI通过领域调优的NLP和知识基础，从危机推文快速推断位置，提升应急响应效率。

电商应用场景下知识图谱检索增强生成中神经检索-排序流水线的比较分析

Comparative Analysis of Neural Retriever-Reranker Pipelines for Retrieval-Augmented Generation over Knowledge Graphs in E-commerce Applications

本文研究电商场景下知识图谱检索增强生成中神经检索-排序流水线的设计与比较，通过实验验证了优化配置在提升检索性能上的有效性。