Ayush Dogra , Sunil Agrawal, Bhawna Goyal
Department of Electronics and Communications, Panjab University, Chandigarh, India;For correspondence:- Ayush Dogra Email: ayush123456789@gmail.com
Received: 20 March 2016 Accepted: 1 June 2016 Published: 30 September 2016
Citation: Dogra A, Agrawal S, Goyal B. Efficient representation of texture details in medical images by fusion of Ripplet and DDCT transformed images. Trop J Pharm Res 2016; 15(9):1983-1993 doi: 10.4314/tjpr.v15i9.24
© 2016 The authors.
This is an Open Access article that uses a funding model which does not charge readers or their institutions for access and distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0) and the Budapest Open Access Initiative (http://www.budapestopenaccessinitiative.org/read), which permit unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited..
Introduction
Better representation of image details is most important step for executing different image processing tasks like image fusion, image registration [1,2] and image enhancement [3-6]. These image processing tasks serve various fields like medical imaging and pharmaceutical sciences. Medical imaging has emerged as a prominent tool in clinical trials as it enables rapid diagnosis along with visualization and quantitative assessment. The enhancement in the visual quality of medical images like MRI, CT, SPECT, X-Ray image quality lessens the probability of false diagnosis. In medical imaging, image enhancement software is now in great demand. Imaging is a key in medical diagnosis of many diseases and particle size analysis in tableting and encapsulation of medicines. The enhancements of images of letters inscribed on medicinal tablets can play a key role in the identification of medicines. In particle size analysis image enhancement technique is used for making particle measurements like particle size, morphology, shape analysis and grayscale or color.
The mapping of source image to coefficients is called a transform. In many image processing tasks, Fourier transform is used to provide an efficient representation of smooth images but not good on images that are dominant with edges. Usually some image features, like edges, cause singularities in the quality of images. Wavelet transform is not capable of resolving discontinuities in two dimensional signals though it is able to resolve the issues regarding one dimensional signal. To overcome the discontinuities, like edges and contours, many transforms such as Ridgelet, Curvelet, Contour let and Ripplet have been devised as wavelet and Fourier transform are unable to resolve edge and contour discontinuities in 2D signal. Ridgelet can resolve 1D discontinuity along vertical and horizontal directions [7]. Ridgelet is based on Radon transform and can provide information of linear edges in image. Although Radon transform is able to extract lines along arbitrary directions, Ridgelet is not capable of resolving singularities in 2D signals. First generation Curvelet transform was devised by Donoho and it is based on multiscale Ridgelet [7]. Later Donoho proposed second generation Curvelet transform which was able to resolve 2D discontinuities along curves [7]. It uses parabolic scaling law to achieve directionality. Similar approaches like Contourlet and Bandlet were devised to resolve 2D discontinuities. These new devised image transforms have limitations [7]. While Ridgelet resolves discontinuities only along lines, Curvelet, Contourlet and Ripplet addresses discontinuities along curves. Ridgelet, Curvelet, Bandlet, Brushlet, Contourlet and Ripplet are considered as multiscale geometric analysis (MGA) tools to determine high dimensional signals. These MGA tools have capability to overcome the problems imposed by WT (Wavelet transform). Ripplet is devised using generalization of parabolic scaling law in Curvelet transform. It has six main properties that make it more suitable than Wavelet and its variants in image transformation. These properties are multiresolution, good-localization, high directionality, scaling and support in arbitrary degrees, anisotropy and fast decay of coefficients [5]. Ripplet is capable of providing an efficient representation of image along smooth curves and provides better representation of edges in images. To overcome the limitation of conventional discrete cosine transform, directional discrete cosine transform has been proposed. Conventional discrete cosine transform performs well on horizontal and vertical edges which causes some defects in other directions like diagonal directions whereas Directional Discrete Cosine transform operates on edges in different directions within a specified block size [13]. To evaluate the efficiency of Ripplet and Discrete Cosine transform, experiments on magnetic resonance imaging (MRI) image were conducted. It is quite evident from the literature that Ripplet can represent images more efficiently than Discrete Wavelet transform and Discrete Cosine transform [7]. In this paper we proposed a novel technique of combining RT and DDCT by direct combination and using multiplication and addition operator for better representation of MRI images.
The objective of this study has been is to explore, implement and compare the performance of Ripplet and conventional/directional discrete cosine transform and their combinational approaches for effectual representation of MRI image. It has been assumed that this novel combination is able to improvise the visual diagnostic quality of MRI images.
Methods
Experiment 1
An MRI image used in medical diagnosis was taken as the input source image. This image was reconstructed using Ripplet type-1 transform so as to enhance as well as preserve the edge information along smooth curves. The source image obtained in spatial domain is first transformed in frequency domain. Then the image function was convolved with Ripplet functions. And finally the resultant image was obtained by inverse transforming the frequency domain function back to spatial domain. Ripplet transform provides anisotropic high directional properties to the image features. The step by step algorithm implementation was done using MATLAB.
Experiment 2
A copy of source image in experiment 1 was reconstructed by conventional/directional DCT at different modes. This transform operated on edges in different modes namely mode 0,1,3,4,5,6,7,8. Here the modes aids to represent various directional features of the image along with its edges. This necessities the use of directional DCT over conventional DCT. The source image was read and reconstructed using numerous code lines in MATLAB software.
Experiment 3
Ripplet transform was able to represent the shape of the object but not textures [7]. Both DCT and Ripplet Transform work well on the edges and are able to preserve directional features of an image [7,11,12]. Now it was thought that combination of these two transforms would be able to cater the advantages provided by both the transforms in a single algorithm that is to visually and quantitatively enhance the texture details of medical and pharmaceutical images. The input image was therefore first passed through Ripplet at 50000 coefficient value then passed through DCT transform.
Experiment 4
In this experiment, the image reconstructed with Ripplet type-1 transform at 50000 coefficient value was combined with the same input source image reconstructed by DDCT at all the modes via addition operator which leads to the fusing of the image reconstructed at 50000 coefficient value with results from all the modes of DDCT.
Experiment 5
Using the similar methodology as used in experiment 4, the images were combined using multiplicative operator. The other mathematical operators like subtraction and division are not taken into consideration as they don’t act as the combinational operators.
Experiment 6
This was performed in a similar manner as experiment 3 except that first the input image was first passed through DCT then through Ripplet type-1 transform. The sequencing of these two transforms was of significant importance as the second experiment performs better which we will see later in detail.
Performance measurement metrics
The objective evaluation of the proposed method was done by calculating PSNR, MSE, average difference, maximum difference, normalized cross correlation, structural content, normalized absolute error.
(1) PSNR (Peak signal to noise ratio) [10,14] measured peak error. It was used in quantitative measurement of image enhancement, image restoration, image reconstruction excluding image sharpening and calculated between original and reconstructed image. The higher the PSNR, the better is the compressed or reconstructed image. In [14], it is clearly depicted that at low variances or low noise values the PSNR is higher, as noise keeps on increasing the PSNR value keeps on decreasing. The similar observation is reported in our results that higher the PSNR higher is the image enhancement quality shown in experiment 1 to 6.
(2) MSE (mean square error) [9,14] represents commutative squared error between compressed and original image. MSE should be low, so that image quality is more close to the original image.
(3) AD (average difference) [14] shows average difference between the pixel value of two images. Ideally it should be 0.
(4) MD (maximum difference) [14] shows maximum difference between the pixel value of the two images.
(5) NCC (normalized cross correlation) [14]-in image processing application is in which brightness of image can vary due to lighting and exposure conditions, though the image can first normalized.
(6) If SC (Structural content) [14] is low, then image quality is good. It can be seen from findings in [14] that at low variances or low noise values the PSNR has the highest value corresponding to lowest SC value. So it can be said that a high value of PSNR corresponds to a low SC value and high PSNR values implies better image quality. Majorly it can be witnessed from literature that in image quality parametric assessment PSNR and MSE plays a significant role whereas SC and NAE have little significance in image enhancement applications.[14] Structural content is one of the correlation based measurement. It measures closeness or relationship between two digital images which can also be quantified in terms of correlations functions. It measures similarity between two images.
(7) Normalized absolute error (NAE) [14] should be low to achieve better image quality results. The mathematical equations for these objective parameters are depicted in earlier report [14]. It can be seen from that when the coefficient value is changed from 10000 to 50000, the value of PSNR increased and the normalized absolute error decreases. Unlike previous reports, various other parameters like AD, MD, SC, NAE, NCC besides PSNR and MSE are used in our study so as to present an overall correlation amongst all the parameters, understand their behavior in various combinations as well as identify the various implication(s) associated with each parameter.
Results
A carefully chosen image () from medical data was selected from Google database. (a) shows original input image i.e. the MRI image with saggital view depicting the soft tissues of brain and figure 1(b-f) shows reconstructed images using Ripplet Type-1 transform while increasing the number of coefficients from 10000 to 50000. As we increased the coefficient value beyond 50000, the execution time was a lot higher comparatively. Therefore results were not depicted beyond 50000. The best reconstructed image was formed at 50000 coefficient value (). shows reconstructed image by conventional and directional DCT at various modes (0,1,3,4,5,6,7,8). The objective evaluation values computed for DCT mode 0 are similar to all the other modes (). Combination of Ripplet and DCT was done by direct combining method (Ripplet first and DCT afterwards; DCT first and Ripplet afterwards), addition operator, and multiplicative operator. The reconstructed images by direct combining of Ripplet transform first and DCT transform in the cascade manner is provided in . Resultant image at 50000 coefficient using Ripplet transform showed the best results () and hence only this image was combined with DCT transforms at all modes. In the output of combination of Ripplet and DCT transform by addition operator is shown. Here instead of directly combining both the transforms and applying it on images, the first image transformed using Ripplet at 50000 coefficient value (-f) and others by DCT transform at all eight modes ((a-h) were added together. Hence shows compounded images. The output of combination of Ripplet and DCT transform by multiplication operator is provided in . In this, the two transformed images by both DCT and other Ripplet transforms are combined. shows the resultant image using DCT first and then Ripplet; that is, the image frequency functions are first convolved with DDCT and then with Ripplet transform. This particular combination yielded the best results as it can be seen from the calculated objective evaluation parameters provided in Tables (1-6).
Discussion
This study has revealed that when an original image was reconstructed using Ripplet type-1 transformation, the image quality increases as the Ripplet coefficient, up to a maximum of 50000, increases. Although direct DCT produces better image than Ripplet type-1 transformation, some kind of artifacts which can be comprehended by the visual inspection of a radiologist are eminent. By applying DCT first and then Ripplet type-1 transformation, better images are produced.
From the calculated objective evaluation measures (Tables 2-6), it can be seen that the image quality obtained via addition method is inferior to the images obtained by direct combination of transforms but visual inspection is required by radiology expert to determine whether this kind of image can serve significant importance in any kind of medical research or diagnosis (). Quantitatively both experiment 4 and 5 i.e. addition and multiplication methods are inferior as compared to experiment 3 and 6 (direct combination methods). We can say that addition and multiplication methods are not suitable combinations for better representation of image details. Sometimes the quantitative analysis overshadows the visual quality of images as addition method shows high contrast image in spite of weaker quantitative values as compared to multiplication method.
The reconstructed image in Experiment 1 [(b-f) and ] looked closely like the original one. But at the same time, the time taken for coefficient computation and reconstruction increases exponentially with increment in the coefficient value. Memory requirement for storage and bandwidth requirement for transmission would also increase sharply.
From Experiment-2 (Figure-2 and Table-2), we can conclude that DDCT though being a primitive technique has performed better than Ripplet Type-1 transform. From the results given in and we can clearly deduce that DDCT outperforms Ripplet in terms of PSNR increment and MSE decrement. Also DDCT is able to perform equally well in all eight modes.
The combinational approach of fusing Ripplet and DDCT (Experiment 3, , ) is able to produce results which are comparable to original parent techniques along with high degree of feature preservation.
The PSNR of the addition combination is lowest as compared to the results when these transforms were applied individually or in cascade manner. Therefore quantitatively addition method is the most unsuitable combination. According to the objective measurements MD should be as low as possible as it is the pixel difference between the original image and the reconstructed image. Here (experiment-3) it has increased to 34 as compared to 29 in case of direct combination. Also MSE has increased beyond admissible value. All of these facts further support the unsuitability of the addition method. One thing which has to be taken into consideration is the contrast level of the images which has increased drastically which further needs expert radiologist’s advice.
From the quantitative results obtained by multiplication method, we can say that the results are better than the addition method and the individual parent techniques. So far we have been able to come to the conclusion that the direct combination of Ripplet and DDCT is the most appropriate method for better representation of medical images. However in experiment-6 we were able to better results when DDCT is used as the first processing technique and Ripplet as the second processing technique than the former case when Ripplet transform was used as the pre-processing technique. This fact can be looked into more detail from the tabular value of PSNR which has increased when DDCT was applied first i.e. experiment-6. The intuitive idea for using the DDCT as the first transform is that it gives higher PSNR value than the Ripplet transform along with its object depiction capability. Therefore using DDCT as the first case kind of serves an enhanced input image to Ripplet transform to further represent the image details in totality depict the shape of the object as well as the texture details. Thus, the use of DDCT first and followed by Ripplet as the second transform is the best suitable method to depict the shape of the object as well as the texture details.
This study signifies that various transformations can be done on magnetic resonance images to provide an enhanced image which leads to an improvement in the diagnostic quality, while preserving edge features and texture details. The enhanced image holds a lot of importance in medical imaging for accurate and precise diagnosis. This paper thus provide a method enhance MRI images which can be useful in abnormality detection in brain, lesion detection, skull based surgery and ear-nose-and-throat surgical procedures. However, further studies are needed to modify the selection of transforms for various combinations and many features could be targeted besides edges and textures. The future analysis could be done on CT images, PET images, SPECT images X-RAY and ultrasound imagery. Also the possibility of occurrence of various kinds of artifacts can be taken into consideration in further studies.
Conclusion
The reconstruction of images appears to be better with DCT rather than Ripplet transform though DCT is a more primitive technique than Ripplet transform. After this, the expedition of combining of both of these techniques was done. These individual image transformation techniques often do not often produce very good image texture details. Direct combination of RT and DDCT transforms in sequence provide much better images.
Although Ripplets are capable of representation of the shape of an object, but they are not apt as it comes to the representation of textures. Though the experiments have been done by combining the Ripplet transform with DCT, much better results may be obtained by trying various combinations of Ripplet with other transforms like direction –lets, Ridgelet, Curvelet and Contourlet.
References
Archives
News Updates