๐Ÿ“‘Paper Review

[paper review] Towards Total Recall in Industrial Anomaly Detection

date
Dec 15, 2023
slug
paper-review-TTRIAD
author
status
Public
tags
DeepLearning
paper
summary
type
Post
thumbnail
Untitled (2).png
category
๐Ÿ“‘Paper Review
updatedAt
Sep 6, 2024 03:49 PM
<PatchCore ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•œ MVTec Benchmark datasets์˜ ๊ฒฐ๊ณผ>
<PatchCore ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•œ MVTec Benchmark datasets์˜ ๊ฒฐ๊ณผ>

Abstract

Being able to spot defective parts is a critical component in large-scale industrial manufacturing. A particular challenge that we address in this work is the cold-start problem: fit a model using nominal (non-defective) example images only. While handcrafted solutions per class are possible, the goal is to build systems that work well simultaneously on many different tasks automatically. The best peforming approaches combine embeddings from ImageNet models with an outlier detection model. In this paper, we extend on this line of work and propose PatchCore, which uses a maximally representative memory bank of nominal patchfeatures. PatchCore offers competitive inference times while achieving state-of-the-art performance for both detection and localization. On the challenging, widely used MVTec AD benchmark PatchCore achieves an image-level anomaly detection AUROC score of up to 99.6%, more than halving the error compared to the next best competitor. We further report competitive results on two additional datasets and also find competitive results in the few samples regime.
ย 
1) ๋Œ€๊ฒŒ Anomaly Detection๋ชจ๋ธ์€ ๋…ธ๋ฉ€ ๋ฐ์ดํ„ฐ๊ฐ€ ๋Œ€๋ถ€๋ถ„์ธ ๋ฐ์ดํ„ฐ์…‹์—์„œ ์–ด๋…ธ๋ง์„ ์ฐพ๋Š” ๋ฌธ์ œ์ž„์œผ๋กœ โ€˜cold-startโ€™๋ฌธ์ œ๊ฐ€ ์žˆ์Œ
2) ๋ณธ ๋…ผ๋ฌธ์€ PatchCore ๋ชจ๋ธ์„ ์ œ์•ˆํ•˜๋ฉฐ ๋ชจ๋ธ์—์„œ ์‚ฌ์šฉํ•˜๋Š” nominal patchfeatures์˜ ์ง‘ํ•ฉ์ธ โ€˜memory bankโ€™๋Š” SOTA์— ๊ฐ€๊นŒ์šด ์–ด๋…ธ๋ง์˜ detection๊ณผ localization ์„ฑ๋Šฅ์„ ๋‚˜ํƒ€๋‚ด์—ˆ์œผ๋ฉฐ ๋น ๋ฅธ ์ถ”๋ก  ์‹œ๊ฐ„์„ ๋ณด์˜€์Œ
3) MVTec AD benchmark ๋ฐ์ดํ„ฐ์…‹์„ ์‚ฌ์šฉํ•˜์—ฌ ์‹คํ—˜ํ•˜์˜€์œผ๋ฉฐ Image-level anomaly detection์—์„œ AUROC 99.6%์˜ ์„ฑ๋Šฅ์„ ๋ณด์˜€๋‹ค.
ย 

Method

notion image
1) Training ๊ณผ์ •์—์„œ ๊ธฐ์กด์— ํ•™์Šต๋œ ImageNet ๊ฐ€์ค‘์น˜๋ฅผ ์‚ฌ์šฉํ•จ. ๋ชจ๋“  ๋ฐ์ดํ„ฐ์…‹์—๋Œ€ํ•˜์—ฌ patch features๋ฅผ ์—ฐ์‚ฐํ•จ N_p๋Š” ํŒจ์น˜ pi๋Š” ํŒจ์น˜์˜ ์ฑ„๋„์„ aggregationํ•œ patch๋ฅผ ์˜๋ฏธํ•จ pi์˜ i,j๋Š” ๊ฐ๊ฐ ์ด๋ฏธ์ง€, resnet์˜ ๋ธ”๋ก์˜ ๋ฒˆํ˜ธ๋ฅผ ์˜๋ฏธํ•จ
notion image
P๋Š” ๊ฐ ํŒจ์น˜์˜ ์ง‘ํ•ฉ
notion image
MemoryBank M์€ P์˜ ๊ฐ ์ด๋ฏธ์ง€์— ๋Œ€ํ•œ ์ง‘ํ•ฉ์ž„
notion image
๊ฒฐ๊ตญ M์€ ํ•™์Šต์ด๋ฏธ์ง€์˜ ๋ชจ๋“  ๋ฐ์ดํ„ฐ์˜ feature ์ง‘ํ•ฉ์ž„
1-1) ์—ฐ์‚ฐ๋Ÿ‰์„ ์ค„์ด๊ธฐ ์œ„ํ•˜์—ฌ ๊ธฐ์กด MemoryBank M์„ ์ตœ๋Œ€ํ•œ ์„ค๋ช…ํ•˜๋Š” M_c๋ฅผ ๊ตฌํ•˜์˜€์Œ. ์ด ๊ณผ์ •์—์„œ L2๋†ˆ์„ ์‚ฌ์šฉํ•˜์˜€๊ณ  min max๋ฌธ์ œ๋ฅผ ํ’€์–ด ์—ฐ์‚ฐํ•จ.
notion image
2) Test๊ณผ์ •์—์„œ๋Š” ์ž…๋ ฅ๋œ ํ…Œ์ŠคํŠธ ๋ฐ์ดํ„ฐ๊ฐ€ M_c์˜ ๋ฐ์ดํ„ฐ์™€์˜ ๊ฑฐ๋ฆฌ๋ฅผ ๊ตฌํ•˜์—ฌ anomalty๋ฅผ ๊ตฌํ•˜์˜€์Œ
notion image

Result

์‹คํ—˜๊ฒฐ๊ณผ ๊ธฐ์กด์˜ ์ œ์•ˆ๋œ ๋ชจ๋ธ๋ณด๋‹ค ๋›ฐ์–ด๋‚œ ์„ฑ๋Šฅ์„ ๋ณด์˜€์Œ
notion image
ย