语言大模型 / LLM - arXivDaily 专题

2312.03936 2023-12-08 cs.CV cs.CY cs.LG cs.SI 74%

The Potential of Vision-Language Models for Content Moderation of Children's Videos

Syed Hammad Ahmed, Shengnan Hu, Gita Sukthankar

专题命中预训练与数据：language model(title)；分类 cs.LG

Comments 5 pages, 1 figure. Accepted at IEEE ICMLA 2023

2311.00729 2023-11-08 cs.CV cs.AI 74%

ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detection

Thinh Phan, Khoa Vo, Duy Le, Gianfranco Doretto, Donald Adjeroh, Ngan Le

专题命中预训练与数据：language model(title)；分类 cs.AI

2311.03243 2023-11-07 cs.CL 74%

Safurai-Csharp: Harnessing Synthetic Data to improve language-specific Code LLM

Davide Cifarelli, Leonardo Boiardi, Alessandro Puppo, Leon Jovanovic

专题命中预训练与数据：LLM(title)；分类 cs.CL

2307.06235 2023-10-10 cs.LG q-bio.BM 74%

Multimodal Molecular Pretraining via Modality Blending

Qiying Yu, Yudi Zhang, Yuyan Ni, Shikun Feng, Yanyan Lan, Hao Zhou, Jingjing Liu

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2208.08236 2023-09-18 physics.chem-ph cs.LG physics.comp-ph 74%

DPA-1: Pretraining of Attention-based Deep Potential Model for Molecular Simulation

Duo Zhang, Hangrui Bi, Fu-Zhi Dai, Wanrun Jiang, Linfeng Zhang, Han Wang

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2309.00878 2023-09-06 cs.SD cs.LG eess.AS 74%

Pretraining Representations for Bioacoustic Few-shot Detection using Supervised Contrastive Learning

Ilyass Moummad, Romain Serizel, Nicolas Farrugia

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2303.17590 2023-08-31 cs.CV cs.CL 74%

Going Beyond Nouns With Vision & Language Models Using Synthetic Data

Paola Cascante-Bonilla, Khaled Shehada, James Seale Smith, Sivan Doveh, Donghyun Kim, Rameswar Panda, Gül Varol, Aude Oliva, Vicente Ordonez, Rogerio Feris, Leonid Karlinsky

专题命中预训练与数据：language model(title)；分类 cs.CL

Comments Accepted to ICCV 2023. Project page: https://synthetic-vic.github.io/

2211.12791 2023-08-17 cs.LG physics.chem-ph 74%

An ensemble of VisNet, Transformer-M, and pretraining models for molecular property prediction in OGB Large-Scale Challenge @ NeurIPS 2022

Yusong Wang, Shaoning Li, Zun Wang, Xinheng He, Bin Shao, Tie-Yan Liu, Tong Wang

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2210.16192 2023-08-14 cs.SD cs.LG eess.AS 74%

Pretraining Respiratory Sound Representations using Metadata and Contrastive Learning

Ilyass Moummad, Nicolas Farrugia

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2307.13004 2023-07-26 q-bio.QM cs.LG 74%

DeepGATGO: A Hierarchical Pretraining-Based Graph-Attention Model for Automatic Protein Function Prediction

Zihao Li, Changkun Jiang, Jianqiang Li

专题命中预训练与数据：pretraining(title)；分类 cs.LG

Comments Accepted in BIOKDD'23

2306.08955 2023-06-16 eess.IV cs.CV cs.LG 74%

A Comparison of Self-Supervised Pretraining Approaches for Predicting Disease Risk from Chest Radiograph Images

Yanru Chen, Michael T Lu, Vineet K Raghu

专题命中预训练与数据：pretraining(title)；分类 cs.LG

Comments 33 pages, 22 figures, Accepted for publication at MIDL 2023

2305.10568 2023-05-26 cs.CL 74%

From chocolate bunny to chocolate crocodile: Do Language Models Understand Noun Compounds?

Jordan Coil, Vered Shwartz

专题命中预训练与数据：language model(title)；分类 cs.CL

Comments Findings of ACL 2023

2202.06574 2023-03-14 cs.CL cs.CV 74%

I-Tuning: Tuning Frozen Language Models with Image for Lightweight Image Captioning

Ziyang Luo, Zhipeng Hu, Yadong Xi, Rongsheng Zhang, Jing Ma

专题命中预训练与数据：language model(title)；分类 cs.CL

Comments ICASSP 2023

2302.13289 2023-02-28 cs.LG 74%

Improving Representational Continuity via Continued Pretraining

Michael Sun, Ananya Kumar, Divyam Madaan, Percy Liang

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2211.05213 2023-02-10 cs.LG stat.ML 74%

Flaky Performances when Pretraining on Relational Databases

Shengchao Liu, David Vazquez, Jian Tang, Pierre-André Noël

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2301.09809 2023-02-01 cs.CL 74%

Low-Resource Compositional Semantic Parsing with Concept Pretraining

Subendhu Rongali, Mukund Sridhar, Haidar Khan, Konstantine Arkoudas, Wael Hamza, Andrew McCallum

专题命中预训练与数据：pretraining(title)；分类 cs.CL

Comments EACL 2023

2209.01604 2023-01-10 cs.CV cs.LG 74%

Representative Image Feature Extraction via Contrastive Learning Pretraining for Chest X-ray Report Generation

Yu-Jen Chen, Wei-Hsiang Shen, Hao-Wei Chung, Ching-Hao Chiu, Da-Cheng Juan, Tsung-Ying Ho, Chi-Tung Cheng, Meng-Lin Li, Tsung-Yi Ho

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2205.14459 2022-10-28 cs.CV cs.LG 74%

CyCLIP: Cyclic Contrastive Language-Image Pretraining

Shashank Goel, Hritik Bansal, Sumit Bhatia, Ryan A. Rossi, Vishwa Vinay, Aditya Grover

专题命中预训练与数据：pretraining(title)；分类 cs.LG

Comments 19 pages, 13 tables, 6 figures, Oral at NeuRIPS 2022

2210.04073 2022-10-11 cs.CL 74%

On Task-Adaptive Pretraining for Dialogue Response Selection

Tzu-Hsiang Lin, Ta-Chung Chi, Anna Rumshisky

专题命中预训练与数据：pretraining(title)；分类 cs.CL

Comments 6 pages, 4 figures

2209.00446 2022-09-02 cs.IR cs.LG 74%

Self-Supervised Pretraining of Graph Neural Network for the Retrieval of Related Mathematical Expressions in Scientific Articles

Lukas Pfahler, Katharina Morik

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2207.13364 2022-07-28 cs.CV cs.LG 74%

Deep Clustering with Features from Self-Supervised Pretraining

Xingzhi Zhou, Nevin L. Zhang

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2204.04950 2022-04-12 cs.CV cs.AI 74%

Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data

Kyungjune Baek, Hyunjung Shim

专题命中预训练与数据：pretraining(title)；分类 cs.AI

Comments CVPR 2022 accepted

2203.04006 2022-03-09 cs.CV cs.CL 74%

Visual-Language Navigation Pretraining via Prompt-based Environmental Self-exploration

Xiwen Liang, Fengda Zhu, Lingling Li, Hang Xu, Xiaodan Liang

专题命中预训练与数据：pretraining(title)；分类 cs.CL

Comments Accepted by ACL 2022

2202.12142 2022-02-25 cs.CL 74%

Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words

Zhangyin Feng, Duyu Tang, Cong Zhou, Junwei Liao, Shuangzhi Wu, Xiaocheng Feng, Bing Qin, Yunbo Cao, Shuming Shi

专题命中预训练与数据：pretraining(title)；分类 cs.CL

2104.01642 2022-02-22 cs.SE cs.CL 74%

Recommending Metamodel Concepts during Modeling Activities with Pre-Trained Language Models

Martin Weyssow, Houari Sahraoui, Eugene Syriani

专题命中预训练与数据：language model(title)；分类 cs.CL

Comments 18+2 pages

Journal ref Software and Systems Modeling, 2022

2112.11929 2021-12-23 cs.CV cs.LG 74%

Meta-Learning and Self-Supervised Pretraining for Real World Image Translation

Ileana Rugina, Rumen Dangovski, Mark Veillette, Pooya Khorrami, Brian Cheung, Olga Simek, Marin Soljačić

专题命中预训练与数据：pretraining(title)；分类 cs.LG

Comments 10 pages, 8 figures, 2 tables

2109.02966 2021-09-16 cs.CL 74%

FH-SWF SG at GermEval 2021: Using Transformer-Based Language Models to Identify Toxic, Engaging, & Fact-Claiming Comments

Christian Gawron, Sebastian Schmidt

专题命中预训练与数据：language model(title)；分类 cs.CL

2106.01797 2021-06-15 cs.CL 74%

TVDIM: Enhancing Image Self-Supervised Pretraining via Noisy Text Data

Pengda Qin, Yuhong Li, Kefeng Deng, Qiang Wu

专题命中预训练与数据：pretraining(title)；分类 cs.CL

2105.10213 2021-05-24 cs.LG 74%

GAN pretraining for deep convolutional autoencoders applied to Software-based Fingerprint Presentation Attack Detection

Tobias Rohrer, Jascha Kolberg

专题命中预训练与数据：pretraining(title)；分类 cs.LG

2006.11098 2021-05-04 cs.CL 74%

Mechanisms for Handling Nested Dependencies in Neural-Network Language Models and Humans

Yair Lakretz, Dieuwke Hupkes, Alessandra Vergallito, Marco Marelli, Marco Baroni, Stanislas Dehaene

专题命中预训练与数据：language model(title)；分类 cs.CL

Journal ref Lakretz et al. (2021), Cognition

1. 预训练与数据 12429 篇

The Potential of Vision-Language Models for Content Moderation of Children's Videos

ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detection

Safurai-Csharp: Harnessing Synthetic Data to improve language-specific Code LLM

Multimodal Molecular Pretraining via Modality Blending

DPA-1: Pretraining of Attention-based Deep Potential Model for Molecular Simulation

Pretraining Representations for Bioacoustic Few-shot Detection using Supervised Contrastive Learning

Going Beyond Nouns With Vision & Language Models Using Synthetic Data

An ensemble of VisNet, Transformer-M, and pretraining models for molecular property prediction in OGB Large-Scale Challenge @ NeurIPS 2022

Pretraining Respiratory Sound Representations using Metadata and Contrastive Learning

DeepGATGO: A Hierarchical Pretraining-Based Graph-Attention Model for Automatic Protein Function Prediction

A Comparison of Self-Supervised Pretraining Approaches for Predicting Disease Risk from Chest Radiograph Images

From chocolate bunny to chocolate crocodile: Do Language Models Understand Noun Compounds?

I-Tuning: Tuning Frozen Language Models with Image for Lightweight Image Captioning

Improving Representational Continuity via Continued Pretraining

Flaky Performances when Pretraining on Relational Databases

Low-Resource Compositional Semantic Parsing with Concept Pretraining

Representative Image Feature Extraction via Contrastive Learning Pretraining for Chest X-ray Report Generation

CyCLIP: Cyclic Contrastive Language-Image Pretraining

On Task-Adaptive Pretraining for Dialogue Response Selection

Self-Supervised Pretraining of Graph Neural Network for the Retrieval of Related Mathematical Expressions in Scientific Articles

Deep Clustering with Features from Self-Supervised Pretraining

Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data

Visual-Language Navigation Pretraining via Prompt-based Environmental Self-exploration

Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words

Recommending Metamodel Concepts during Modeling Activities with Pre-Trained Language Models

Meta-Learning and Self-Supervised Pretraining for Real World Image Translation

FH-SWF SG at GermEval 2021: Using Transformer-Based Language Models to Identify Toxic, Engaging, & Fact-Claiming Comments

TVDIM: Enhancing Image Self-Supervised Pretraining via Noisy Text Data

GAN pretraining for deep convolutional autoencoders applied to Software-based Fingerprint Presentation Attack Detection

Mechanisms for Handling Nested Dependencies in Neural-Network Language Models and Humans