-
Notifications
You must be signed in to change notification settings - Fork 23
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Running PDVC on Your Own Videos predict json file #52
Comments
The proposal score is the logit score of foreground, which is predict by a linear layer (before signmoid activation) with two nodes representing background and foreground. The sentence score is the log of perplexity of the generated sentence (multiplication of per-word confidence) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi, after I run the command
video_folder=visualization/videos output_folder=visualization/output pdvc_model_path=save/anet_tsp_pdvc/model-best.pth output_language=en bash test_and_visualize.sh $video_folder $output_folder $pdvc_model_path $output_language
I got a JSON file with the format as below,
![image](https://private-user-images.githubusercontent.com/94792611/292899440-fa8ebf3e-8e6d-4217-9fa0-6c1b37dd115c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQwMTU5MTgsIm5iZiI6MTcyNDAxNTYxOCwicGF0aCI6Ii85NDc5MjYxMS8yOTI4OTk0NDAtZmE4ZWJmM2UtOGU2ZC00MjE3LTlmYTAtNmMxYjM3ZGQxMTVjLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE4VDIxMTMzOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTIwMDA1ZWFhZWU2NjM4ZThkMWZiMmQ2MTk0YmI3ZTVlNzJjNjZjNzE1MWJjYzI0MWJlNmE5ZmE2YmQ4NmMwMDkmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.7frNcA5GIVSmdjXsNRXt_L6RKSPVRB07HZzqGGVurQw)
I am curious about the meaning of proposal_score and sentence_score. Could you give me some explanation?
I want to use these two metrics to select better captioning sentences .
thank you!
The text was updated successfully, but these errors were encountered: