CLIPImageQualityAssessment insists on prompt argument to be called 'beutiful'

[spezialspezial]

🐛 Bug

not working:
metric = CLIPImageQualityAssessment(prompts=("beautiful",))

working:
metric = CLIPImageQualityAssessment(prompts=("beutiful",))

This uses ClipVision, right? I assume it's not trained on 'beutiful' and there is just a typo in the CLIPImageQualityAssessment class

Expected behavior

prompt 'beautiful' should be valid

Environment

Linux, Python 3.10.13, torch 2.1.0+cu118, pip torchmetrics 1.2.0

[SkafteNicki]

Hi @spezialspezial, thanks for reporting this issue.
I sadly cannot reproduce the error. For me it works with "beautiful" and does not work with "beutiful":

Here is the specific dictionary that we check prompts against:

torchmetrics/src/torchmetrics/functional/multimodal/clip_iqa.py

Lines 42 to 59 in 0cb4c79

	_PROMPTS: Dict[str, Tuple[str, str]] = {
	"quality": ("Good photo.", "Bad photo."),
	"brightness": ("Bright photo.", "Dark photo."),
	"noisiness": ("Clean photo.", "Noisy photo."),
	"colorfullness": ("Colorful photo.", "Dull photo."),
	"sharpness": ("Sharp photo.", "Blurry photo."),
	"contrast": ("High contrast photo.", "Low contrast photo."),
	"complexity": ("Complex photo.", "Simple photo."),
	"natural": ("Natural photo.", "Synthetic photo."),
	"happy": ("Happy photo.", "Sad photo."),
	"scary": ("Scary photo.", "Peaceful photo."),
	"new": ("New photo.", "Old photo."),
	"warm": ("Warm photo.", "Cold photo."),
	"real": ("Real photo.", "Abstract photo."),
	"beautiful": ("Beautiful photo.", "Ugly photo."),
	"lonely": ("Lonely photo.", "Sociable photo."),
	"relaxing": ("Relaxing photo.", "Stressful photo."),
	}

as you can see it says beautiful in the dictionary.

[SkafteNicki]

I rechecked and it was fixed in this PR: #2103
That change is available in the newest release of torchmetrics v1.2.1 released today.
Closing issue.

[spezialspezial]

Thanks a lot