Mathematical morphology-based approach to the enhancement of morphological features in medical images
© Kimori; licensee BioMed Central Ltd. 2011
Received: 25 August 2011
Accepted: 16 December 2011
Published: 16 December 2011
Medical image processing is essential in many fields of medical research and clinical practice because it greatly facilitates early and accurate detection and diagnosis of diseases. In particular, contrast enhancement is important for optimal image quality and visibility. This paper proposes a new image processing method for enhancing morphological features of masses and other abnormalities in medical images.
The proposed method involves two steps: (1) selective extraction of target features by mathematical morphology and (2) enhancement of the extracted features by two contrast modification techniques.
The goal of the proposed method is to enable enhancement of fine morphological features of a lesion region with high suppression of surrounding tissues. The effectiveness of the method was evaluated in quantitative terms of the contrast improvement ratio. The results clearly show that the method outperforms five conventional contrast enhancement methods. The effectiveness and usefulness of the proposed method were further demonstrated by application to three types of medical images: a mammographic image, a chest radiographic image, and a retinal image.
The proposed method enables specific extraction and enhancement of mass lesions, which is essential for clinical diagnosis based on medical image analysis. Thus, the method can be expected to achieve automatic recognition of lesion location and quantitative analysis of legion morphology.
KeywordsMathematical morphology Contrast enhancement Mammographic image Chest radiographic image Retinal image
In contemporary medical practices, image-based diagnosis is a crucial component of disease evaluation. Medical images of various modalities such as X-ray, mammography, computed tomography, magnetic resonance imaging, color fundus imaging, and ultrasound contain important information for clinical diagnosis.
Of these, image processing is of particular importance. Its goals are threefold: to improve original image data, extract morphological features of pathological structures, and obtain relevant information essential for clinical diagnosis. Image processing is also indispensable for subsequent preprocesses such as image segmentation and classification in CADe system.
This study focuses on contrast enhancement in image processing. Medical images are often characterized by low grey-level contrast and complicated structured backgrounds. In processing of such images, contrast enhancement involves highlighting small diagnostic features that are superimposed on a complex background. Various contrast enhancement techniques have been proposed [5–7], including histogram modification methods, spatial domain and frequency domain filtering, and mathematical morphology-based methods. Let us consider these in order.
Histogram modification is popular because of its simplicity, speed, and capability to preserve all information from the original image. Typical histogram modification techniques include histogram equalization and its variants [8–10].
Spatial domain filtering involves direct manipulation of pixel values on an original image plane . Spatial domain filtering is often implemented with a convolution mask, which is a small matrix of fixed numbers [12–14].
Frequency domain filtering involves transformation of an original image into the frequency domain by means of discrete Fourier transform, discrete cosine transform, or discrete wavelet transform [15, 16].
A common disadvantage of these methods is that they usually enhance entire structures in a medical image without discrimination, whereas, for effective detection of lesions, it is necessary to enhance only specific target lesions and not the surrounding tissue. For this purpose, the author attempted to devise a new image processing method based on mathematical morphology. This is a nonlinear image analysis method based on the set theory and involves extraction of shape characteristics from an image, typically for shape representation and description . Furthermore, size information in the image can also be obtained by using the granulometry which is an approach to measure a size distribution of objects . Several morphological contrast enhancement methods have been applied to medical images [19–22]. These methods enable detection of lesions of various sizes and shapes, including complex shapes.
This study describes an approach to medical image processing using a type of mathematical morphology called rotational morphological processing (RMP) [23–25] for enhancement of mass lesions in medical images captured by various modalities. The proposed method involves two consecutive steps: (1) selective extraction of target features by mathematical morphology and (2) enhancement of the extracted features by two contrast modification techniques. This method enables specific enhancement of target lesion features with high suppression of complex background tissues.
The method was evaluated subjectively and quantitatively in terms of the measured contrast improvement ratio (CIR) in a simulated mammographic image. It was then applied to three real medical images: a mammographic image, a chest radiographic image, and a retinal image. The results show that the method is highly efficient and reliable.
This paper is organized as follows: the current section presents relevant background information. The methods section describes the sample images and methodology used in the study. The results and discussion section describes the experimental results. The final section presents the study conclusions.
Three types of medical images were used to test the performance of the proposed method: mammographic, chest radiographic, and retinal.
Mammographic images were obtained from the mini mammography database provided by the Mammographic Image Analysis Society (MIAS) . The size of each mammographic image was 1024 × 1024 pixels with a spatial resolution of 200 μm/pixel.
Chest radiographic images were obtained from the standard digital image database for chest lung nodules and non-nodules provided by the Japanese Society of Radiological Technology . Image size was 2048 × 2048 pixels with a spatial resolution of 0.175 mm/pixel.
Retinal images were obtained from the digital retinal images for vessel extraction (DRIVE) database provided by the Image Sciences Institute . Image size was 584 × 565 pixels.
Image processing using mathematical morphology
Types of mathematical morphology
In conventional morphological operations, a single structuring element is used to process an image. An operation involves passing a structuring element over an image and retaining, for further image processing, any features in the image that are fit by the structuring element. However, a structuring element can fit only same-direction features, not different-direction features. Thus, such operations are not suitable for use on randomly oriented features in an image.
To overcome this limitation, a type of extended mathematical morphology called RMP has been proposed [23–25]. RMP rotates the original image with respect to the structuring element that is fixed in one direction.
We assume that full 180° angles are equally divided into N directions; the function f i denotes the rotation of an original image f by the degree of θ i = 180 i/N, where i = 0, 1,..., N-1. The image f i is rotated clockwise on the centre of the image frame. The opening operation of the rotated image f i with B is represented as ϕ B (f i ), and the closing operation of the rotated image f i with B is represented as γ B (f i ). The images operated by the RMP are followed by rotation at θ i degrees in the counter-clockwise direction. The i-th rotated opened image and closed image are denoted by h i Opn and h i Clsn , respectively. The processed images are finally compiled together by combining pixel values as per certain rules. The maximum brightness value of each pixel is selected in opening processing and the minimum brightness of each pixel value is selected in closing processing.
The two filters operate in the following manner: Smoothing filter SM(f ) creates a smoothed image by removing structures in the original image that are represented as bright and dark values. Feature extraction filter δ TH (f ) recreates the original image by recovering these structures.
Structuring element selection
Two parameters of a structuring element, size and shape, determine the effect and performance of the morphological filter.
The size parameter of a structuring element must be set in accordance with the size of the structure to be extracted. The feature extraction filter extracts morphological features whose base sizes are smaller than the size of the structuring element. Hence, the size of the structuring element must be larger than the base size of the target lesion.
The shape parameter of a structuring element must be set in accordance with the shape of the structure to be extracted. For extraction of mass structures, a structuring element in the shape of a line segment (width 1 pixel) was chosen. This element shape was used in RMP for extraction of bright spots in fluorescence microscopy images, in which local spots with base diameters smaller than the length of the structuring element were extracted, confirming the effectiveness of morphological processing . For extraction of fibrous (or elongated) structures, that is, spiculated masses, in mammographic images and for extraction of blood vessels in retinal images, disk-shaped structuring elements were chosen.
Thus, the proposed method should be capable of handling various morphological features by changing the size and shape of the structuring element.
Contrast enhancement method
The proposed method involves two steps: selective extraction of the features to be enhanced by feature extraction filter δ TH (f ), followed by contrast enhancement of the extracted features by two contrast modification techniques.
In the second step, the contrast of the feature image is enhanced by application of the histogram equalization (HE) technique  followed by the linear contrast stretching (LCS) technique . The former technique manipulates the histogram of an image by redistributing the number of pixels between intensity levels to obtain an equal frequency. The latter technique normalizes the intensity levels by determining the minimum and maximum intensity values of an image and then stretching this range linearly so that the full range is available for output intensity values (for example, 0-255 for an 8-bit grey-scale image).
Contrast improvement ratio (CIR)
where p and a are the mean values within the center region (3 × 3) pixels and the neighborhood, or surrounding region, (7 × 7) pixels, respectively.
Results and discussion
Evaluation of contrast enhancement
For evaluation of contrast improvement, the proposed method was compared with five conventional contrast enhancement methods: HE, LCS, unsharp masking (USM) , multiscale retinex (MSR) , and contrast limited adaptive histogram equalization (CLAHE) .
The simulated image was enhanced by the proposed method (Figure 3(D)) and by HE, LCS, USM, MSR, and CLAHE (Figures 3(E)-(I)). Feature extraction filter δ TH (f ) was operated with a line segment structuring element (length 41 pixels or 8.2 mm) whose diameter is larger than the base diameter of each phantom feature. Relevant parameter settings were optimized for fair comparison as follows. USM involves creating a blurred version of the image using a Gaussian blur filter and then subtracting this from the original image using a weighted factor that controls the degree of enhancement. Accordingly, the blur radius of the Gaussian was set to 10 pixels and the mask weight was set to 0.7. MSR involves use of the typical retinex theory for image contrast enhancement and calculation of output image values by taking the difference between the original image and its blurred version in the logarithm domain. Accordingly, three convolution scales were used with standard deviations set to 5, 50, and 150 pixels, respectively, and weighted factors were set to 1/3 for each scale. CLAHE is an adaptive image contrast enhancement technique based on histogram modification, and it operates on small regions (blocks) in an image and improves the local contrast of the image. Accordingly, block size was set to 15 × 15 pixels.
Measured CIR values for ROIs including phantom features
Measured CIR values for various image enhancement methods
The local contrast value (Eqn. (10)) is the difference in average grey-scale values between a target feature and the surrounding tissue. For enhancement by the proposed method (Figure 3(D)), inhomogeneous background is subtracted and each phantom feature is clearly isolated in the ROIs. Thus, the luminance of the phantom features is high and, in contrast, the luminance of the background is low. Increase in local contrast may contribute to the high CIR value.
The most distinctive property of the proposed method is that it enhances only the target features. This property improves the visibility of subtle mass lesions and reduces unwanted background information even in real medical images.
When the original image is noisy, noise reduction is necessary as a preprocessing for contrast enhancement. As a more straightforward approach, a blurring (or smoothing) filter can be used to this purpose. In general, contrast of the original image further decreases with reducing noise by the blurring filter. However, it is considered that the proposed method can be applied to such degraded images. As a future work, it is necessary to develop the method for discriminating between signal and noise in many practical medical images.
Image contrast enhancement is important for medical diagnosis, and early detection of disease is facilitated by specific enhancement of low-contrast lesion features. For contrast enhancement of medical images, this paper presents a new method based on RMP. The method involves two steps: selective extraction of target features followed by enhancement of the extracted features. It offers the following advantages:
It can be applied to various types of medical images without restrictions.
It enables specific enhancement of target lesion features with high suppression of complex background tissues.
It can handle various morphological features by changing the size and shape of the structuring element.
It enables enhancement of both bright and dark morphological features.
The superior performance of the proposed method was demonstrated by comparison of CIR values with various conventional methods, and the effectiveness and usefulness of the method were demonstrated by application to various types of medical images.
Future studies should involve development of an automatic image segmentation method to separate targets of interest from their backgrounds. This method is important for automatic recognition of abnormalities and the quantitative analysis of medical images using CAD. The proposed method, which successfully distinguishes between targets and surrounding tissue, may, in combination with conventional automatic thresholding techniques, enable the development of a new approach for automatic segmentation of medical images.
I sincerely thank Dr. Takao Kodama, Dr. Jun Hatazawa (Osaka University), and Dr. Takashi Murayama (Juntendo University) for advice and critical reading of the manuscript. I am grateful to Dr. Motoya Katsuki (National Institutes of Natural Sciences) for his support and encouragement. I would like to thank the anonymous reviewers for their useful comments. I also acknowledge the use of the mammographic image database (Mammographic Image Analysis Society), the standard digital image database (Japanese Society of Radiological Technology), and the digital retinal images for vessel extraction database (Image Sciences Institute). This work was supported by NINS Program for Cross-Disciplinary Study.
- Fraioli F, Serra G, Passariello R: CAD (computed-aided detection) and CADx (computer aided diagnosis) systems in identifying and characterising lung nodules on chest CT: overview of research, developments and new prospects. Radiol Med. 2010, 115: 385-402. 10.1007/s11547-010-0507-2.View ArticlePubMedGoogle Scholar
- Giger ML, Chan HP, Boone J: Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM. Med Phys. 2008, 35: 5799-5820. 10.1118/1.3013555.PubMed CentralView ArticlePubMedGoogle Scholar
- Doi K: Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph. 2007, 31: 198-211. 10.1016/j.compmedimag.2007.02.002.PubMed CentralView ArticlePubMedGoogle Scholar
- Tang J, Rangayyan RM, Xu J, El Naqa I, Yang Y: Computer-aided detection and diagnosis of breast cancer with mammography: recent advances. IEEE Trans Inf Technol Biomed. 2009, 13: 236-251.View ArticlePubMedGoogle Scholar
- Dhawan AP: A review on biomedical image processing and future trends. Comput Methods Programs Biomed. 1990, 31: 141-183. 10.1016/0169-2607(90)90001-P.View ArticlePubMedGoogle Scholar
- Rangayyan RM, Ayres FJ, Desautels JEL: A review of computer-aided diagnosis of breast cancer: Toward the detection of subtle signs. Journal of the Franklin Institute. 2007, 344: 312-348. 10.1016/j.jfranklin.2006.09.003.View ArticleGoogle Scholar
- Cheng HD, Shan J, Ju W, Guo Y, Zhang L: Automated breast cancer detection and classification using ultrasound images: A survey. Pattern Recognition. 2010, 43: 299-317. 10.1016/j.patcog.2009.05.012.View ArticleGoogle Scholar
- Zhu H, Chan FHY, Lam FK: Image contrast enhancement by constrained local histogram equalization. Comput Vis Image Underst. 1999, 73: 281-290. 10.1006/cviu.1998.0723.View ArticleGoogle Scholar
- Zimmerman JB, Cousins SB, Hartzell KM, Frisse ME, Kahn MG: A psychophysical comparison of two methods for adaptive histogram equalization. J Digit Imaging. 1989, 2: 82-91. 10.1007/BF03168024.View ArticlePubMedGoogle Scholar
- Stoel BC, Vossepoel AM, Ottes FP, Hofland PL, Kroon HM, Kool LJS: Interactive histogram equalization. Pattern Recognition Letters. 1990, 11: 247-254. 10.1016/0167-8655(90)90063-8.View ArticleGoogle Scholar
- Gonzalez RC, Woods RE: Digital Image Processing. 2008, New Jersey: Prentice Hall, 3Google Scholar
- Levi L: Unsharp masking and related image enhancement techniques. Comput Graphics and Image Processing. 1974, 3: 163-177. 10.1016/S0146-664X(74)80005-5.View ArticleGoogle Scholar
- Ji TL, Sundareshan MK, Roehrig H: Adaptive image contrast enhancement based on human visual properties. IEEE Trans Med Imaging. 1994, 13: 573-586. 10.1109/42.363111.View ArticlePubMedGoogle Scholar
- Russo F: An image enhancement technique combining sharpening and noise reduction. IEEE Trans Instrum Meas. 2002, 51: 824-828. 10.1109/TIM.2002.803394.View ArticleGoogle Scholar
- Agaian SS, Panetta K, Grigoryan AM: Transform-based image enhancement algorithms with performance measure. IEEE Trans Image Process. 2001, 10: 367-382. 10.1109/83.908502.View ArticlePubMedGoogle Scholar
- Aghagolzadeh S, Ersoy OK: Transform image enhancement. Opt Eng. 1992, 31: 614-626. 10.1117/12.56095.View ArticleGoogle Scholar
- Serra J: Image analysis and mathematical morphology. 1982, London: Academic PressGoogle Scholar
- Breen EJ, Jones R: Attribute Openings, Thinnings, and Granulometries. Comput Vis Image Underst. 1996, 64: 377-389. 10.1006/cviu.1996.0066.View ArticleGoogle Scholar
- Reljin B, Milosević Z, Stojić T, Reljin I: Computer aided system for segmentation and visualization of microcalcifications in digital mammograms. Folia Histochem Cytobiol. 2009, 47: 525-532. 10.2478/v10042-009-0076-1.PubMedGoogle Scholar
- Oh J, Hwang H: Feature enhancement of medical images using morphology-based homomorphic filter and differential evolution algorithm. International Journal of Control, Automation and Systems. 2010, 8: 857-861. 10.1007/s12555-010-0418-y.View ArticleGoogle Scholar
- Thackray BD, Nelson AC: Semi-automatic segmentation of vascular network images using a rotating structuring element (ROSE) with mathematical morphology and dual feature thresholding. IEEE Trans Med Imaging. 1993, 12: 385-392. 10.1109/42.241865.View ArticlePubMedGoogle Scholar
- Kobatake H, Yoshinaga Y: Detection of spicules on mammogram based on skeleton analysis. IEEE Trans Med Imaging. 1996, 15: 235-245. 10.1109/42.500062.View ArticlePubMedGoogle Scholar
- Kimori Y, Oguchi Y, Ichise N, Baba N, Katayama E: A procedure to analyze surface profiles of the protein molecules visualized by quick freeze deep-etch replica electron microscopy. Ultramicroscopy. 2007, 107: 25-39. 10.1016/j.ultramic.2006.04.012.View ArticlePubMedGoogle Scholar
- Kimori Y, Baba N, Morone N: Extended morphological processing: a practical method for automatic spot detection of biological markers from microscopic images. BMC Bioinformatics. 2010, 11: 373-10.1186/1471-2105-11-373.PubMed CentralView ArticlePubMedGoogle Scholar
- Kimori Y, Katayama E, Morone N, Kodama T: Fractal dimension analysis and mathematical morphology of structural changes in actin filaments imaged by electron microscopy. J Struct Biol. 2011, 176: 1-8. 10.1016/j.jsb.2011.07.007.View ArticlePubMedGoogle Scholar
- Suckling J, Parker J, Dance D, et al: The mammographic image analysis society digital mammogram database. Exerpta Medica. International Congress Series. 1994, 1069: 375-378.Google Scholar
- Shiraishi J, Katsuragawa S, Ikezoe J, et al: Development of a digital image database for chest radiographs with and without a lung nodule: Receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. Am J Roentgenol. 2000, 174: 71-74.View ArticleGoogle Scholar
- Staal J, Abràmoff MD, Niemeijer M, Viergever MA, van Ginneken B: Ridge-based vessel segmentation in color images of the retina. IEEE Trans Med Imaging. 2004, 23: 501-509. 10.1109/TMI.2004.825627.View ArticlePubMedGoogle Scholar
- Schulze MA, Pearce JA: Linear combinations of morphological operators: The midrange, pseudomedian and LOCO filters. Proceedings of the 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing: 27-30 April 1993; Minneapolis. 1993, V.57-60.Google Scholar
- Wang YP, Wu Q, Castleman KR, Xiong Z: Chromosome image enhancement using multiscale differential operators. IEEE Trans Med Imaging. 2003, 22: 685-693. 10.1109/TMI.2003.812255.View ArticlePubMedGoogle Scholar
- Jobson DJ, Rahman Z, Woodell GA: A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process. 1997, 6: 965-976. 10.1109/83.597272.View ArticlePubMedGoogle Scholar
- Pizer SM, Amburn EP, Austin JD, Cromartie R, Geselowitz A, Greer T, Romeny BTH, Zimmerman JB, Zuiderveld K: Adaptive histogram equalization and its variations. Computer Vision, Graphics, and Image Processing. 1987, 39: 355-368. 10.1016/S0734-189X(87)80186-X.View ArticleGoogle Scholar
- Guo Y, Sivaramakrishna R, Lu CC, Suri JS, Laxminarayan S: Breast image registration techniques: a survey. Med Biol Eng Comput. 2006, 44: 15-26. 10.1007/s11517-005-0016-y.View ArticlePubMedGoogle Scholar
- Wirth M, Stapinski A: Segmentation of the breast region in mammograms using active contours. Proceedings of SPIE: Visual Communications and Image Processing. 2003, 5150: 1995-2006.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.