Skip to content

Issues: EleutherAI/elk

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

15 Open 75 Closed
15 Open 75 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Roadmaps of elk
#299 opened Oct 12, 2024 by merlinarer
Can this code suppot free-form QA task?
#298 opened Jul 4, 2024 by Tan-Hexiang
2
pip install from git doesn't work
#297 opened Jan 25, 2024 by Butanium
Make into a pytest.fixture which was a TODO in test_smoke_eval.py
#295 opened Jan 18, 2024 by RohitRathore1
Use shrinkage for (cross-)covariance estimation
#261 opened Jun 22, 2023 by norabelrose
3
Cannot run README command elk elicit microsoft/deberta-v2-xxlarge-mnli imdb
#256 opened Jun 15, 2023 by rusheb
2
Write smoke test for eval enhancement New feature or request good first issue Good for newcomers
#255 opened Jun 13, 2023 by derpyplops
Multiple choice datasets encounter a tensor error
#241 opened May 4, 2023 by ethanedwards
Save hidden states in bfloat16 bug Something isn't working
#208 opened Apr 21, 2023 by norabelrose
@Kyle1668 @norabelrose
Use dill and Apache Arrow directly for caching & storing hidden states enhancement New feature or request
#203 opened Apr 19, 2023 by norabelrose
1
Support exponential moving averages for the covariance statistics on EigenReporter enhancement New feature or request
#169 opened Apr 6, 2023 by norabelrose
@norabelrose
Make num_heads property on EigenReporter accessible via CLI enhancement New feature or request
#152 opened Mar 24, 2023 by norabelrose PyPI 0.2 Release
@norabelrose @ss-waree
Support Neel Nanda's counterfact dataset enhancement New feature or request
#70 opened Feb 15, 2023 by norabelrose PyPI 0.2 Release
@ss-waree
3
Plotting for individual predictions across depth enhancement New feature or request
#67 opened Feb 15, 2023 by norabelrose NeurIPS Paper
@Benw8888
Plot the correlation of unsupervised loss & accuracy across layers
#63 opened Feb 15, 2023 by norabelrose
@Benw8888
ProTip! Follow long discussions with comments:>50.