语言大模型 / LLM - arXivDaily 专题

2312.04891 2023-12-11 cs.CV 78%

Cross-BERT for Point Cloud Pretraining

Xin Li, Peng Li, Zeyong Wei, Zhe Zhu, Mingqiang Wei, Junhui Hou, Liangliang Nan, Jing Qin, Haoran Xie, Fu Lee Wang

专题命中预训练与数据：pretraining(title,abstract)

2310.13355 2023-12-08 cs.CV 78%

SILC: Improving Vision Language Pretraining with Self-Distillation

Muhammad Ferjad Naeem, Yongqin Xian, Xiaohua Zhai, Lukas Hoyer, Luc Van Gool, Federico Tombari

专题命中预训练与数据：pretraining(title,abstract)

2312.02910 2023-12-06 astro-ph.GA cs.CV 78%

Rare Galaxy Classes Identified In Foundation Model Representations

Mike Walmsley, Anna M. M. Scaife

专题命中预训练与数据：foundation model(title)；pretraining(abstract)

Comments Accepted at Machine Learning and the Physical Sciences Workshop, NeurIPS 2023

2312.00863 2023-12-05 cs.CV 78%

EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anything

Yunyang Xiong, Bala Varadarajan, Lemeng Wu, Xiaoyu Xiang, Fanyi Xiao, Chenchen Zhu, Xiaoliang Dai, Dilin Wang, Fei Sun, Forrest Iandola, Raghuraman Krishnamoorthi, Vikas Chandra

专题命中预训练与数据：pretraining(title,abstract)

2311.17770 2023-11-30 cs.CV cs.RO 78%

PillarNeSt: Embracing Backbone Scaling and Pretraining for Pillar-based 3D Object Detection

Weixin Mao, Tiancai Wang, Diankun Zhang, Junjie Yan, Osamu Yoshie

专题命中预训练与数据：pretraining(title,abstract)

2206.10996 2023-11-22 cs.CV 78%

ProtoCLIP: Prototypical Contrastive Language Image Pretraining

Delong Chen, Zhao Wu, Fan Liu, Zaiquan Yang, Huaxi Huang, Ying Tan, Erjin Zhou

专题命中预训练与数据：pretraining(title,abstract)

Comments Accepted by IEEE Transactions on Neural Networks and Learning Systems (TNNLS)

2311.07603 2023-11-15 cs.CV 78%

PECoP: Parameter Efficient Continual Pretraining for Action Quality Assessment

Amirhossein Dadashzadeh, Shuchao Duan, Alan Whone, Majid Mirmehdi

专题命中预训练与数据：pretraining(title,abstract)

Comments Accepted to WACV 2024 (preprint)

2311.02536 2023-11-07 cs.CV 78%

Augment the Pairs: Semantics-Preserving Image-Caption Pair Augmentation for Grounding-Based Vision and Language Models

Jingru Yi, Burak Uzkent, Oana Ignat, Zili Li, Amanmeet Garg, Xiang Yu, Linda Liu

专题命中预训练与数据：language model(title,abstract)

Comments Accepted to WACV2024

2310.15019 2023-10-25 cs.LG cs.AI cs.CL 78%

Meta learning with language models: Challenges and opportunities in the classification of imbalanced text

Apostol Vassilev, Honglan Jin, Munawar Hasan

专题命中预训练与数据：language model(title)；分类 cs.CL、cs.AI、cs.LG

Comments 22 pages, including 5 figures, 12 tables, 1 appendix

2206.00311 2023-10-11 cs.CV 78%

MaskOCR: Text Recognition with Masked Encoder-Decoder Pretraining

Pengyuan Lyu, Chengquan Zhang, Shanshan Liu, Meina Qiao, Yangliu Xu, Liang Wu, Kun Yao, Junyu Han, Errui Ding, Jingdong Wang

专题命中预训练与数据：pretraining(title)；language model(abstract)

2309.11730 2023-09-28 eess.AS cs.SD 78%

Leveraging In-the-Wild Data for Effective Self-Supervised Pretraining in Speaker Recognition

Shuai Wang, Qibing Bai, Qi Liu, Jianwei Yu, Zhengyang Chen, Bing Han, Yanmin Qian, Haizhou Li

专题命中预训练与数据：pretraining(title,abstract)

Comments submitted to ICASSP 2024

2309.07394 2023-09-22 cs.CV 78%

Nucleus-aware Self-supervised Pretraining Using Unpaired Image-to-image Translation for Histopathology Images

Zhiyun Song, Penghui Du, Junpeng Yan, Kailu Li, Jianzhong Shou, Maode Lai, Yubo Fan, Yan Xu

专题命中预训练与数据：pretraining(title,abstract)

2309.09421 2023-09-19 cs.MM 78%

Unified Pretraining Target Based Video-music Retrieval With Music Rhythm And Video Optical Flow Information

Tianjun Mao, Shansong Liu, Yunxuan Zhang, Dian Li, Ying Shan

专题命中预训练与数据：pretraining(title,abstract)

2307.03275 2023-08-23 cs.CV 78%

To pretrain or not to pretrain? A case study of domain-specific pretraining for semantic segmentation in histopathology

Tushar Kataria, Beatrice Knudsen, Shireen Elhabian

专题命中预训练与数据：pretraining(title,abstract)

2308.09775 2023-08-22 cs.CV 78%

Long-range Multimodal Pretraining for Movie Understanding

Dawit Mureja Argaw, Joon-Young Lee, Markus Woodson, In So Kweon, Fabian Caba Heilbron

专题命中预训练与数据：pretraining(title,abstract)

Comments Accepted to ICCV 2023

2308.08414 2023-08-17 cs.CV 78%

Tem-adapter: Adapting Image-Text Pretraining for Video Question Answer

Guangyi Chen, Xiao Liu, Guangrun Wang, Kun Zhang, Philip H. S. Torr, Xiao-Ping Zhang, Yansong Tang

专题命中预训练与数据：pretraining(title,abstract)

Comments ICCV 2023

2308.05358 2023-08-11 cs.CV 78%

Fine-grained building roof instance segmentation based on domain adapted pretraining and composite dual-backbone

Guozhang Liu, Baochai Peng, Ting Liu, Pan Zhang, Mengke Yuan, Chaoran Lu, Ningning Cao, Sen Zhang, Simin Huang, Tao Wang

专题命中预训练与数据：pretraining(title,abstract)

2209.13042 2023-08-01 cs.RO 78%

Self-Supervised Visuo-Tactile Pretraining to Locate and Follow Garment Features

Justin Kerr, Huang Huang, Albert Wilcox, Ryan Hoque, Jeffrey Ichnowski, Roberto Calandra, Ken Goldberg

专题命中预训练与数据：pretraining(title,abstract)

Comments RSS 2023, site: https://sites.google.com/berkeley.edu/ssvtp

2307.14768 2023-07-28 cs.CV 78%

Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining

Benjia Zhou, Zhigang Chen, Albert Clapés, Jun Wan, Yanyan Liang, Sergio Escalera, Zhen Lei, Du Zhang

专题命中预训练与数据：pretraining(title,abstract)

Comments Accepted to ICCV'23

2307.12854 2023-07-25 cs.CV 78%

Multiscale Video Pretraining for Long-Term Activity Forecasting

Reuben Tan, Matthias De Lange, Michael Iuzzolino, Bryan A. Plummer, Kate Saenko, Karl Ridgeway, Lorenzo Torresani

专题命中预训练与数据：pretraining(title,abstract)

2106.04550 2023-07-21 cs.CV 78%

DETReg: Unsupervised Pretraining with Region Priors for Object Detection

Amir Bar, Xin Wang, Vadim Kantorov, Colorado J Reed, Roei Herzig, Gal Chechik, Anna Rohrbach, Trevor Darrell, Amir Globerson

专题命中预训练与数据：pretraining(title,abstract)

Comments Project page: https://www.amirbar.net/detreg/

2204.02825 2023-07-19 cs.CV 78%

An Empirical Study of Remote Sensing Pretraining

Di Wang, Jing Zhang, Bo Du, Gui-Song Xia, Dacheng Tao

专题命中预训练与数据：pretraining(title,abstract)

Comments Accepted by IEEE TGRS, codes and pretrained models are moved to https://github.com/ViTAE-Transformer/RSP

2306.10146 2023-06-21 cs.CV eess.IV 78%

Multi-task 3D building understanding with multi-modal pretraining

Shicheng Xu

专题命中预训练与数据：pretraining(title,abstract)

Comments 8 pages, 9 figures, 9 tables

2306.07791 2023-06-14 cs.SD eess.AS 78%

Unlocking Foundation Models for Privacy-Enhancing Speech Understanding: An Early Study on Low Resource Speech Training Leveraging Label-guided Synthetic Speech Content

Tiantian Feng, Digbalay Bose, Xuan Shi, Shrikanth Narayanan

专题命中预训练与数据：foundation model(title,abstract)

2306.02867 2023-06-06 cs.IR 78%

Benchmarking Middle-Trained Language Models for Neural Search

Hervé Déjean, Stéphane Clinchant, Carlos Lassance, Simon Lupart, Thibault Formal

专题命中预训练与数据：language model(title,abstract)

2208.14754 2023-06-06 cs.IR 78%

LexMAE: Lexicon-Bottlenecked Pretraining for Large-Scale Retrieval

Tao Shen, Xiubo Geng, Chongyang Tao, Can Xu, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang

专题命中预训练与数据：pretraining(title)；language model(abstract)

Comments Appeared at ICLR 2023

2302.02318 2023-05-23 cs.CV 78%

Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining

Zekun Qi, Runpei Dong, Guofan Fan, Zheng Ge, Xiangyu Zhang, Kaisheng Ma, Li Yi

专题命中预训练与数据：pretraining(title,abstract)

Comments Accepted at ICML 2023

2305.05598 2023-05-10 cs.CV 78%

Region-based Contrastive Pretraining for Medical Image Retrieval with Anatomic Query

Ho Hin Lee, Alberto Santamaria-Pang, Jameson Merkow, Ozan Oktay, Fernando Pérez-García, Javier Alvarez-Valle, Ivan Tarapov

专题命中预训练与数据：pretraining(title,abstract)

2305.03324 2023-05-08 cs.IR 78%

Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and Prompting

Zhihao Wen, Yuan Fang

专题命中预训练与数据：prompting(title,abstract)

Comments 11 pages, accepted by SIGIR'23

2302.05020 2023-04-18 cs.SE 78%

Impact of Code Language Models on Automated Program Repair

Nan Jiang, Kevin Liu, Thibaud Lutellier, Lin Tan

专题命中预训练与数据：language model(title,abstract)

Comments This paper is accepted by 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE)

1. 预训练与数据 12393 篇

Cross-BERT for Point Cloud Pretraining

SILC: Improving Vision Language Pretraining with Self-Distillation

Rare Galaxy Classes Identified In Foundation Model Representations

EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anything

PillarNeSt: Embracing Backbone Scaling and Pretraining for Pillar-based 3D Object Detection

ProtoCLIP: Prototypical Contrastive Language Image Pretraining

PECoP: Parameter Efficient Continual Pretraining for Action Quality Assessment

Augment the Pairs: Semantics-Preserving Image-Caption Pair Augmentation for Grounding-Based Vision and Language Models

Meta learning with language models: Challenges and opportunities in the classification of imbalanced text

MaskOCR: Text Recognition with Masked Encoder-Decoder Pretraining

Leveraging In-the-Wild Data for Effective Self-Supervised Pretraining in Speaker Recognition

Nucleus-aware Self-supervised Pretraining Using Unpaired Image-to-image Translation for Histopathology Images

Unified Pretraining Target Based Video-music Retrieval With Music Rhythm And Video Optical Flow Information

To pretrain or not to pretrain? A case study of domain-specific pretraining for semantic segmentation in histopathology

Long-range Multimodal Pretraining for Movie Understanding

Tem-adapter: Adapting Image-Text Pretraining for Video Question Answer

Fine-grained building roof instance segmentation based on domain adapted pretraining and composite dual-backbone

Self-Supervised Visuo-Tactile Pretraining to Locate and Follow Garment Features

Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining

Multiscale Video Pretraining for Long-Term Activity Forecasting

DETReg: Unsupervised Pretraining with Region Priors for Object Detection

An Empirical Study of Remote Sensing Pretraining

Multi-task 3D building understanding with multi-modal pretraining

Unlocking Foundation Models for Privacy-Enhancing Speech Understanding: An Early Study on Low Resource Speech Training Leveraging Label-guided Synthetic Speech Content

Benchmarking Middle-Trained Language Models for Neural Search

LexMAE: Lexicon-Bottlenecked Pretraining for Large-Scale Retrieval

Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining

Region-based Contrastive Pretraining for Medical Image Retrieval with Anatomic Query

Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and Prompting

Impact of Code Language Models on Automated Program Repair