Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: use node inspect to handle object types when running reporter #28

Merged
merged 6 commits into from
Dec 7, 2024

Conversation

dschlabach
Copy link
Contributor

Hi @mattpocock - curious if this is something that you'd like to support with evalite. I am going to be doing a lot of testing on structured data and I noticed that when running the reporter, it's not printing out the objects as expected.

Before:

CleanShot 2024-12-07 at 10 33 54

After
CleanShot 2024-12-07 at 10 29 12

P.S. - Also, curious if there's a way to specify globs - I noticed there's a subcommand with <glob> but I haven't been able to get path filtering working. Is that supported today? Was wanting to run evals for just 1 file so that I could see the report table.

Copy link

changeset-bot bot commented Dec 7, 2024

🦋 Changeset detected

Latest commit: 3f06cfc

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 3 packages
Name Type
evalite Patch
evalite-tests Patch
example Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@mattpocock
Copy link
Owner

100%, I had this idea before but forgot to note it down. Great minds!

@mattpocock
Copy link
Owner

@dschlabach Will get the paths working 👍 #29

@mattpocock mattpocock self-requested a review December 7, 2024 19:30
@mattpocock mattpocock merged commit f75a897 into main Dec 7, 2024
1 check failed
@mattpocock
Copy link
Owner

Merging despite CI, will debug CI on main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants