You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
i tried to convert SperPoint onnx model to tensorrt engine by FP16, and i met trouble:
i used SuperPoint_FP16.engine to extract features and LightGlue_FP16.engine to match them, but the results was bad and could not perform as well as onnx model both of them. did you meet the same problem? and how to solve it?
The text was updated successfully, but these errors were encountered:
Hi @midskymid, thank you for your interest in LightGlue-ONNX.
If I recall correctly, I do think I've encountered a similar problem during my own experimentation. Depending on how you convert it to half-precision, it can happen that the values go outside the tolerable floating point range, leading to a drastic fall in # of keypoints detected, or even none detected. I don't think there's an easy solution to this other than fine-tuning (?) the model to be 'half-precision-aware' (sort of like mixed-precision training).
i tried to convert SperPoint onnx model to tensorrt engine by FP16, and i met trouble:
![1717517141647](https://private-user-images.githubusercontent.com/47935937/336526174-637184ef-ecd6-45b7-876c-a942697ac233.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQwMjE3MzUsIm5iZiI6MTcyNDAyMTQzNSwicGF0aCI6Ii80NzkzNTkzNy8zMzY1MjYxNzQtNjM3MTg0ZWYtZWNkNi00NWI3LTg3NmMtYTk0MjY5N2FjMjMzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE4VDIyNTAzNVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTUzNDBkYWU1MTY3YjA3ZDViYTliYmI1MzgwNTZiMTE2Y2VlNmEzZjkwMGIxYWQwOTU2ODI3NjFkM2VjOWJiNDQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.9b6gIZnqkeJEsrTx_KVLsuUBO_2wFhEJCSFilCkYxvU)
i used SuperPoint_FP16.engine to extract features and LightGlue_FP16.engine to match them, but the results was bad and could not perform as well as onnx model both of them. did you meet the same problem? and how to solve it?
The text was updated successfully, but these errors were encountered: