Skip to content

Issues: Lightning-AI/torchmetrics

Create gallery of realistic examples
#2438 opened Mar 7, 2024 by Borda
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

75 Open 819 Closed
75 Open 819 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Zero value MeanIoU for Absent Classes in Ground Truth bug / fix Something isn't working help wanted Extra attention is needed v1.5.x
#2866 opened Dec 11, 2024 by Niccolo-Tallone
1
Extend CLIP Score to image-to-image and text-to-text similarity enhancement New feature or request
#2865 opened Dec 10, 2024 by jonasricker
@rittik9
2
torchmetrics.classification.MultilabelConfusionMatrix throws an exception when plotting the confusion matrix for two labels bug / fix Something isn't working help wanted Extra attention is needed v1.6.x
#2857 opened Dec 3, 2024 by podgorki
1
1
Support tensors in edit distance computations enhancement New feature or request
#2856 opened Dec 1, 2024 by kylebgorman future
1
RetrievalRecall and RetrievalMRR seem to function differently for world_size > 1 and top_k=1 bug / fix Something isn't working help wanted Extra attention is needed v1.4.x
#2852 opened Nov 29, 2024 by AdrianM0
7
DiceScore(average="weighted") produces scores bigger than 1.0 bug / fix Something isn't working help wanted Extra attention is needed v1.6.x
#2851 opened Nov 29, 2024 by nkaenzig
1
@SkafteNicki
DiceScore yields 1.0 scores when using average="none" for samples where class is not present bug / fix Something isn't working help wanted Extra attention is needed v1.6.x
#2850 opened Nov 29, 2024 by nkaenzig
1
Dice: The ignore_index 255 is not valid for inputs with 6 classes bug / fix Something isn't working help wanted Extra attention is needed v1.6.x
#2849 opened Nov 28, 2024 by robmarkcole
2
GeneralizedDiceScore yields 0 scores when using per_class=True for samples where class is not present bug / fix Something isn't working help wanted Extra attention is needed
#2846 opened Nov 28, 2024 by nkaenzig
@SkafteNicki
1
num_classes should not be required when using micro averaging bug / fix Something isn't working help wanted Extra attention is needed v1.6.x
#2837 opened Nov 13, 2024 by edmcman
1
@SkafteNicki
2
MathJax rendering difficult to read for dark mode bug / fix Something isn't working documentation Improvements or additions to documentation
#2831 opened Nov 10, 2024 by agkphysics
4
Reference Metric in multiclass pecision recall unittests provides wrong answer when ignore_index is specified with average = 'macro' bug / fix Something isn't working help wanted Extra attention is needed v1.5.x
#2828 opened Nov 5, 2024 by rittik9
1
How to find recall for each class using MeanAveragePrecision question Further information is requested
#2821 opened Nov 4, 2024 by shanalikhan
@SkafteNicki
4
[Bug] torchmetrics.functional.classification.binary_auroc gives wrong results when logits are large bug / fix Something isn't working help wanted Extra attention is needed v1.4.x
#2819 opened Nov 2, 2024 by zbingsong
1
Implement clustering accuracy enhancement New feature or request New metric
#2767 opened Oct 3, 2024 by moetayuko v1.6.0
1
@SkafteNicki
4
Segmentation IOU compute Ignore some tagged values that don't need to be recorded (such as 255) enhancement New feature or request
#2747 opened Sep 16, 2024 by woldier
1
BERT score: maximum at self-comparison, symmetry, invariance to additional items bug / fix Something isn't working help wanted Extra attention is needed v1.4.x
#2728 opened Sep 9, 2024 by GPPassos
@stancld
2
Make ignore_index work when all batch elements are to be ignored enhancement New feature or request
#2685 opened Aug 12, 2024 by fteufel
1
Retrieval metrics are misleading - here's how it should be done instead enhancement New feature or request
#2611 opened Jun 26, 2024 by devinbost v1.6.0
6
Need higher level RAG metrics enhancement New feature or request Important milestonish New metric
#2598 opened Jun 14, 2024 by devinbost future
2
Classification Report, maybe with the option to select even more metrics enhancement New feature or request help wanted Extra attention is needed
#2580 opened Jun 1, 2024 by rakro101
@rittik9
3
Support for DLM (AIM) metric enhancement New feature or request New metric
#2562 opened May 25, 2024 by saswat0 future
1
Clarify that nan is supported in zero_division documentation Improvements or additions to documentation enhancement New feature or request v1.3.x
#2535 opened May 12, 2024 by robmarkcole v1.3.x
@SkafteNicki
4
Ordinal classification metrics enhancement New feature or request New metric
#2509 opened Apr 18, 2024 by Zhylkaaa future
1
Discrepancy in optimal threshold calculation between sklearn and torchmetrics ROC implementations bug / fix Something isn't working v1.3.x
#2489 opened Apr 4, 2024 by vitalwarley
@SkafteNicki
3
ProTip! Find all open issues with in progress development work with linked:pr.