This is the official repo of the paper TIER: Text-Image Encoder-based Regression for AIGC Image Quality Assessment:
@misc{yuan2024tier,
title={TIER: Text-Image Encoder-based Regression for AIGC Image Quality Assessment},
author={Jiquan Yuan and Xinyan Cao and Jinming Che and Qinyuan Wang and Sen Liang and Wei Ren and Jinlong Lin and Xixin Cao},
year={2024},
eprint={2401.03854},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
Abstract: Recently, AIGC image quality assessment (AIGCIQA), which aims to assess the quality of AI-generated images from a human perception perspective, has emerged as a new topic in computer vision. Unlike common image quality assessment tasks where images are derived from original ones distorted by noise, blur, and compression, in AIGCIQA tasks, images are typically generated by generative models using text prompts. Considerable efforts have been made in the past years to advance AIGCIQA. However, most existing AIGCIQA methods regress predicted scores directly from individual generated images, overlooking the information contained in the text prompts of these images. This oversight partially limits the performance of these AIGCIQA methods. To address this issue, we propose a text-image encoder-based regression (TIER) framework. Specifically, we process the generated images and their corresponding text prompts as inputs, utilizing a text encoder and an image encoder to extract features from these text prompts and generated images, respectively. To demonstrate the effectiveness of our proposed TIER method, we conduct extensive experiments on several mainstream AIGCIQA databases, including AGIQA-1K, AGIQA-3K, and AIGCIQA2023. The experimental results indicate that our proposed TIER method generally demonstrates superior performance compared to baseline in most cases.
we conduct extensive experiments on three mainstream AIGCIQA databases, including:
The pipeline of our proposed TIER framework.
In our paper, we choose BERT as the text encoder for extracting features from text prompts. They are:
- bert-base-uncased
- bert-large-uncased
It can be downloaded using this link: [百度网盘 (提取码：text)].
or it can be accessed on huggingface.
For feature extraction from input images, we selected several backbone network models pre-trained on the ImageNet dataset as image encoder, including:
The log of our experiments is here
If you have any question, please contact [email protected]