Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(js): Vitest/Jest evals #1343

Merged
merged 70 commits into from
Jan 20, 2025
Merged

feat(js): Vitest/Jest evals #1343

merged 70 commits into from
Jan 20, 2025

Conversation

jacoblee93
Copy link
Collaborator

No description provided.

@jacoblee93 jacoblee93 marked this pull request as draft December 18, 2024 01:59
@jacoblee93
Merge
5dd083a
@jacoblee93
Refactor and add matchers
8ab9e15
@jacoblee93
Fix bug
39b5ed8
@jacoblee93
Improve error message
0d424e2
@jacoblee93
Fix ALS issues
5903486
@jacoblee93
Fix lint
b5c54af
@jacoblee93
Fix ALS issue
c644b4d
@jacoblee93
Final fix for async local storage issue (hopefully)
70e94f5
@jacoblee93
Adds support for .each
8a7947c
@jacoblee93
Avoid default export
e702a07
@jacoblee93
Fix for Bun
96b0c55
@jacoblee93
Lint
8ec7fab
@jacoblee93
Use passed expect
0a91635
@jacoblee93
Merge branch 'main' of github.com:langchain-ai/langsmith-sdk into jac…
3fbfdd5 
…ob/unit
@jacoblee93
Add n parameter, fix deduping
4a62565
@jacoblee93
Allow more config for .each
06a7d44
@jacoblee93
Add test for custom matchers, typing tweaks
bbc628f
@jacoblee93
Update signature, typing, naming
05f17ae
@jacoblee93
Allow passing experiment creation information into describe
385910f
@jacoblee93
Add configurable test tracking
407470b
@jacoblee93
Allow running test over a LangSmith datset
cb7cb1a
@jacoblee93
Fix for bun
6b52759
@jacoblee93
Speed up latency, make tracking opt-out instead of opt-in
23c7466
@jacoblee93
Rename outputs to expected, refactor feedback logging, nicer errors
364ffad
@jacoblee93
Fix lint
6abd444
@jacoblee93
Add methods to manually log feedback/outputs
f14b31c
@jacoblee93
Fix eval run attribution
775cfbe
@jacoblee93
Fix local mode
d620051
@jacoblee93 jacoblee93 marked this pull request as ready for review January 15, 2025 07:53
@jacoblee93 jacoblee93 requested a review from dqbd January 15, 2025 07:53
@jacoblee93 jacoblee93 changed the title feat(js): Unit test form factor exploration feat(js): Jest/Vitest evals Jan 15, 2025
@jacoblee93
Copy link
Collaborator Author

TODO: Add CI testing Jest + Vitest + Bun directly with reporters

@jacoblee93 jacoblee93 changed the title feat(js): Jest/Vitest evals feat(js): Vitest/Jest evals Jan 17, 2025
@jacoblee93 jacoblee93 merged commit 98c9009 into main Jan 20, 2025
13 checks passed
@jacoblee93 jacoblee93 deleted the jacob/unit branch January 20, 2025 05:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dqbd dqbd dqbd approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jacoblee93 @dqbd