AOI-SSL:用于光学检测中高效分割焊接半导体的自监督框架
AOI-SSL: Self-Supervised Framework for Efficient Segmentation of Wire-bonded Semiconductors In Optical Inspection
AI总结:
本文提出AOI-SSL框架,结合小领域自监督预训练与上下文推理,提升焊接半导体分割效率,减少标注数据需求,实验显示自监督预训练显著提升分割质量。
摘要:
在自动化光学检测中,焊接半导体的分割模型通常特定于设备,需重新训练以适应新设备或分布偏移。本文提出AOI-SSL,通过结合小领域自监督预训练视觉变换器与上下文推理,实现高效的语义分割。我们在小工业检测数据集上预训练了最先进的自监督算法,发现Masked Autoencoders在小数据设置中效果最佳,提升了下游分割性能并减少了标注微调工作量。我们进一步引入上下文、基于补丁的检索方法,直接从密集编码器嵌入预测掩码,几乎无需额外训练。实验表明,在此设置中,简单的相似性检索性能与当前文献中更复杂的注意力聚合相当。此外,我们的实验显示,自监督预训练在固定微调计算预算下,比从头训练和ImageNet预训练的backbone表现更优。最后,结果表明,基于检索的分割在针对单个设备图像时优于微调,允许快速适应困难样本。
英文摘要:
Segmentation models in automated optical inspection of wire-bonded semiconductors are typically device-specific and must be re-trained when new devices or distribution shifts appear. We introduce AOI-SSL, a training-efficient framework for semantic segmentation of wire-bonded semiconductors by combining small-domain self-supervised pre-training of vision transformers with in-context inference that minimizes the need of labeled examples. We pre-train SOTA self-supervised algorithms in a small industrial inspection dataset and find that Masked Autoencoders are the most effective in this small-data setting, improving downstream segmentation while reducing the labeled fine-tuning effort. We further introduce in-context, patch-level retrieval methods that predict masks directly from dense encoder embeddings with negligible additional training. We show that, in this setting, simple similarity-based retrieval performs on par with more complex attention-based aggregation used currently in the literature. Furthermore, our experiments demonstrate that self-supervised pre-training significantly improves segmentation quality compared to training from scratch and to ImageNet pre-trained backbones under a fixed fine-tuning computational budget. Finally, the results reveal that retrieval based segmentation outperforms fine-tuning when targeting single device images, allowing for near-instant adaptation to difficult samples.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。