TY - JOUR
T1 - CN-BSRIQA
T2 - Cascaded network - blind super-resolution image quality assessment
AU - Rehman, Mobeen Ur
AU - Nizami, Imran Fareed
AU - Majid, Muhammad
AU - Ullah, Farman
AU - Hussain, Irfan
AU - Chong, Kil To
N1 - Publisher Copyright:
© 2024 The Author(s)
PY - 2024/3
Y1 - 2024/3
N2 - High resolution (HR) images consist of higher quality and more detail information in comparison to low-resolution images. But obtaining HR images entails higher costs and requires a larger workforce. The solution is using super-resolution (SR) images. Single image SR is the process of creating HR images from a single low-resolution image. Obtaining SR images from low-resolution images is a well-known problem in the domains of computer vision and image processing. Advancement in technology has given rise to many SR algorithms. The perceptual quality assessment of super-resolved images can be used to benchmark the techniques employed for image SR. In this work, a cascaded network-blind super-resolution image quality assessment (CN-BSRIQA) methodology is proposed. The proposed approach works under the cascaded architecture where a convolutional neural network (CNN) is cascaded with a deep belief network (DBN). CNN is employed as a shallow network in the proposed methodology to extract low-level information after partitioning the input image into patches. To assess the visual quality of the SR images, the features retrieved from CNN are incorporated into a DBN. Three databases are used to evaluate the performance of proposed CN-BSRIQA i.e., SR Quality Database (SRQD), SR Image Quality Database (SRID), and visual quality evaluation for super-resolved images (QADS). When compared to other state-of-the-art methodologies for assessing the visual quality of SR images, CN-BSRIQA outperforms them. For the perceptual quality assessment of SR images, the experimental results reveal that CNN-based techniques outperform techniques based on hand-crafted features. Furthermore, the shallow CNN proposed in the CN-BSRIQA can extract features that are content-independent i.e., they show better performance over cross-database evaluation in comparison to existing state-of-the-art techniques.
AB - High resolution (HR) images consist of higher quality and more detail information in comparison to low-resolution images. But obtaining HR images entails higher costs and requires a larger workforce. The solution is using super-resolution (SR) images. Single image SR is the process of creating HR images from a single low-resolution image. Obtaining SR images from low-resolution images is a well-known problem in the domains of computer vision and image processing. Advancement in technology has given rise to many SR algorithms. The perceptual quality assessment of super-resolved images can be used to benchmark the techniques employed for image SR. In this work, a cascaded network-blind super-resolution image quality assessment (CN-BSRIQA) methodology is proposed. The proposed approach works under the cascaded architecture where a convolutional neural network (CNN) is cascaded with a deep belief network (DBN). CNN is employed as a shallow network in the proposed methodology to extract low-level information after partitioning the input image into patches. To assess the visual quality of the SR images, the features retrieved from CNN are incorporated into a DBN. Three databases are used to evaluate the performance of proposed CN-BSRIQA i.e., SR Quality Database (SRQD), SR Image Quality Database (SRID), and visual quality evaluation for super-resolved images (QADS). When compared to other state-of-the-art methodologies for assessing the visual quality of SR images, CN-BSRIQA outperforms them. For the perceptual quality assessment of SR images, the experimental results reveal that CNN-based techniques outperform techniques based on hand-crafted features. Furthermore, the shallow CNN proposed in the CN-BSRIQA can extract features that are content-independent i.e., they show better performance over cross-database evaluation in comparison to existing state-of-the-art techniques.
KW - Cascaded network
KW - Convolution neural network
KW - Deep belief network
KW - Quality assessment
KW - Super-resolution
UR - http://www.scopus.com/inward/record.url?scp=85186127507&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85186127507&partnerID=8YFLogxK
U2 - 10.1016/j.aej.2024.02.007
DO - 10.1016/j.aej.2024.02.007
M3 - Article
AN - SCOPUS:85186127507
SN - 1110-0168
VL - 91
SP - 580
EP - 591
JO - Alexandria Engineering Journal
JF - Alexandria Engineering Journal
ER -