Fast regularity measures for surface defect detection

 

Student : Ming-Chun Chen                 Advisor : Dr. Du-Ming Tsai

 

Department of Industrial Engineering and Management

YUAN-ZE University

 

ABSTRACT

 

This research proposes machine vision schemes for detecting subtle defects in non-textured and homogeneously textured surfaces. The defects to be inspected are ill-defined and hardly visible in the surfaces, which make the automatic surface inspection task extremely difficult.

 

In this study, regularity features of a small window sliding through the whole image are extracted based on the consistence of spatial distribution of gray levels in each window. Two methods are proposed. The first method is based on principal component analysis (PCA) that calculates the eigenvalues of the covariance matrix formed by the covariance of x- and y-coordinates with the gray level as the weight. The smaller eigenvalue λ2 is used as the regularity feature, where a defective region will generate a feature value smaller than that of a homogeneous defect-free region. The second method divides the sliding window into a set of small non-overlapped blocks. The sum of the gray levels in each block should be similar to each other if the window of the sensed image contains no defects. The Chi-square ( χ2 ) that measures the difference between the gray-level sum of a block and the mean gray-level sum, and the entropy that measures the complexity of the gray-level sums in all the blocks are then used as the regularity measures. By using the integral image technique, the sum operations for all three proposed regularity measures can be efficiently calculated for on-line, real-time implementation.

 

The experiments on a variety of textured and non-textured surfaces including plastic case images of laptop computers, leather, TFT-LCD backlight panels and backsides of solar wafers have shown the effectiveness of the proposed methods. The computation times for an image of size 400×400 are only 0.032 seconds for λ2 and 0.28 seconds for χ2 and the entropy measures on a typical personal computer.

 

Keywords: Machine vision; surface defect detection; texture analysis; regularity

measure; principal component analysis; integral image


Demonstration

 

Plastic case images of laptop computers

(a1)

Defective image I

 

(a2)

Detection result of λ2

(a3)

Detection result of χ2

(a4) Detection result

of Entropy

 

(b1)

Defective image II

 

(b2)

Detection result of λ2

(b3)

Detection result of χ2

(b4) Detection result

of Entropy

 

(c1)

Defect-free image

 

(c2)

Detection result of λ2

(c3)

Detection result of χ2

(c4) Detection result

of Entropy

 

 

 

 

 

Leather A

(a1)

Defective image I

 

(a2)

Detection result of λ2

(a3)

Detection result of χ2

(a4) Detection result

of Entropy

 

(b1)

Defective image II

 

(b2)

Detection result of λ2

(b3)

 Detection result of χ2

(b4) Detection result

of Entropy

 

(c1)

Defect-free image

 

(c2)

Detection result of λ2

(c3)

Detection result of χ2

(c4) Detection result

of Entropy

 

 

 

 

 

Leather B

(a1)

Defective image I

 

(a2)

Detection result of λ2

(a3)

Detection result of χ2

(a4) Detection result

of Entropy

 

(b1)

Defect-free image

 

(b2)

Detection result of λ2

(b3)

Detection result of χ2

(b4) Detection result

of Entropy

 

 

 

 

 

Leather C

(a1)

Defective image I

 

(a2)

Detection result of λ2

(a3)

Detection result of χ2

(a4) Detection result

of Entropy

 

(b1)

Defective image II

 

(b2)

Detection result of λ2

(b3)

Detection result of χ2

(b4) Detection result

of Entropy

 

(c1)

Defect-free image

 

(c2)

Detection result of λ2

(c3)

Detection result of χ2

(c4) Detection result

 of Entropy

 

 

 

 

 

TFT-LCD backlight panels

(a1)

Defective image I

 

(a2)

Detection result of λ2

(a3)

Detection result of χ2

(a4) Detection result

of Entropy

 

(b1)

Defect-free image

 

(b2)

Detection result of λ2

(b3)

Detection result of χ2

(b4) Detection result

of Entropy

 

Backsides of solar wafers

(a1)

Defective image I

 

(a2)

Detection result of λ2

(a3)

Detection result of χ2

(a4) Detection result

of Entropy

 

(b1)

Defective image II

 

(b2)

Detection result of λ2

(b3)

Detection result of χ2

(b4) Detection result

of Entropy

 

(c1)

Defect-free image

 

(c2)

Detection result of λ2

(c3)

Detection result of χ2

(c4) Detection result

of Entropy