You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
When using DeepEval in a Git pre-push hook, the output includes all test results. This extensive output makes it difficult to quickly identify failed tests, hindering the efficiency of the pre-push process.
Describe the solution you’d like
I would like DeepEval to offer an option or flag that allows displaying only failed tests in the output.
Describe alternatives you’ve considered
Develop a custom script using Python API to evaluate LLM outputs, bypassing the DeepEval CLI.
Additional context
Implementing this feature would be particularly beneficial for devs who integrate DeepEval into CI pipelines or automated Git hooks, where concise and relevant output is crucial.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
When using DeepEval in a Git pre-push hook, the output includes all test results. This extensive output makes it difficult to quickly identify failed tests, hindering the efficiency of the pre-push process.
Describe the solution you’d like
I would like DeepEval to offer an option or flag that allows displaying only failed tests in the output.
Describe alternatives you’ve considered
Develop a custom script using Python API to evaluate LLM outputs, bypassing the DeepEval CLI.
Additional context
Implementing this feature would be particularly beneficial for devs who integrate DeepEval into CI pipelines or automated Git hooks, where concise and relevant output is crucial.
The text was updated successfully, but these errors were encountered: