You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
While some traditional methods may not precisely capture human value preferences, they are usually faster and cheaper to compute. Therefore, we will integrate some traditional metrics into the SafeSora library, expecting they will complement feedback-based methods and enable comparative analysis.
Checklist
I have provided all relevant and necessary information above.
I have chosen a suitable title for this issue.
The text was updated successfully, but these errors were encountered:
PSNR vs. Informativeness: PSNR measures the quality of a reconstructed or compressed image/video by comparing it to the original, and assessing their similarity. We evaluate dynamic changes in the video by analyzing PSNR between the first and subsequent frames.
HPSv2 vs. Aesthetic: HPSv2 predicts human preferences for image beauty. We use it to assess the aesthetics of each video frame, averaging the results for an overall aesthetic measure.
CLIP vs. Instruction Following: CLIP assesses instruction adherence by evaluating the similarity between the prompt and video frames and averaging the results of frames for an overall instruction-following measure.
Required prerequisites
Motivation
While some traditional methods may not precisely capture human value preferences, they are usually faster and cheaper to compute. Therefore, we will integrate some traditional metrics into the SafeSora library, expecting they will complement feedback-based methods and enable comparative analysis.
Checklist
The text was updated successfully, but these errors were encountered: