-
Notifications
You must be signed in to change notification settings - Fork 11
Issues: groq/mlagility
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Add verbosity option for modulating the size of status print outs
enhancement
New feature or request
p1
mid priority
#334
opened Jun 23, 2023 by
ramkrishna2910
Model size assumes Fp16 data type
cli
Relating to the benchit CLI
p2
not a priority
#330
opened Jun 21, 2023 by
danielholanda
Benchmarking command benchmarks all models when Something isn't working
p1
mid priority
max_depth
is used
bug
#329
opened Jun 20, 2023 by
danielholanda
Add CPU/GPU benchmark methodology details to user guide and huggingface space
dashboard
Relating to the Hugging Face dashboard
documentation
Improvements or additions to documentation
new
Work that hasn't started yet
p1
mid priority
#321
opened Jun 12, 2023 by
jeremyfowers
ONNX model size on disk is not captured for models >2GB in size
api
Relating to the benchit API
bug
Something isn't working
new
Work that hasn't started yet
p2
not a priority
#318
opened Jun 8, 2023 by
jeremyfowers
Models with the same graph but different inputs have the same hash
api
Relating to the benchit API
bug
Something isn't working
new
Work that hasn't started yet
p2
not a priority
#316
opened Jun 7, 2023 by
jeremyfowers
[Usability bug]: KV-cache LLMs are difficult to add to MLAgility
bug
Something isn't working
models
Relating to the model corpus
new
Work that hasn't started yet
#315
opened Jun 6, 2023 by
jeremyfowers
Fix Azure CLI Relating to running jobs in the Azure cloud
bug
Something isn't working
new
Work that hasn't started yet
p2
not a priority
run
command interaction with the terminal
azure
#311
opened May 24, 2023 by
jeremyfowers
Automatically upload MLAgility reports to the internet
azure
Relating to running jobs in the Azure cloud
new
Work that hasn't started yet
p1
mid priority
packaging
Relating to packaging and releasing mlagility
Add multi-location support to Azure CLI
azure
Relating to running jobs in the Azure cloud
cli
Relating to the benchit CLI
enhancement
New feature or request
new
Work that hasn't started yet
#303
opened May 22, 2023 by
jeremyfowers
Export workflow
api
Relating to the benchit API
cli
Relating to the benchit CLI
enhancement
New feature or request
p0
top priority
Finish debugging Azure CLI gpu setup
azure
Relating to running jobs in the Azure cloud
bug
Something isn't working
new
Work that hasn't started yet
p1
mid priority
#299
opened May 22, 2023 by
jeremyfowers
Raise azure exceptions from child threads to parent threads
azure
Relating to running jobs in the Azure cloud
bug
Something isn't working
new
Work that hasn't started yet
p1
mid priority
#296
opened May 22, 2023 by
jeremyfowers
Ability to specify output node names in build_model() for PyTorch ONNX export
#293
opened May 12, 2023 by
pcolangelo1
Optimize azure create/setup performance
azure
Relating to running jobs in the Azure cloud
new
Work that hasn't started yet
p1
mid priority
#292
opened May 12, 2023 by
jeremyfowers
7 of 8 tasks
Back-to-back benchmarks with Relating to the benchit API
bug
Something isn't working
new
Work that hasn't started yet
p1
mid priority
--lean-cache
error
api
#290
opened May 11, 2023 by
jeremyfowers
benchit cache report
support for multiple devices of each type
cli
#289
opened May 11, 2023 by
jeremyfowers
Check NVIDIA driver version to avoid compatibility issues
api
Relating to the benchit API
bug
Something isn't working
p0
top priority
#288
opened May 11, 2023 by
jeremyfowers
Mismatch between Groq's latency and throughput
bug
Something isn't working
p0
top priority
#287
opened May 11, 2023 by
danielholanda
Calculate and record model MAC count
enhancement
New feature or request
question
Further information is requested
#284
opened May 8, 2023 by
danielholanda
CI/CD testing false positives on certain benchit example failures
bug
Something isn't working
new
Work that hasn't started yet
p2
not a priority
testing
Relating to testing
#268
opened May 2, 2023 by
jeremyfowers
'Config' object has no attribute 'onnx_opset' when device Something isn't working
p1
mid priority
groq
is selected
bug
#267
opened May 1, 2023 by
danielholanda
Place Groq support under CI testing
enhancement
New feature or request
new
Work that hasn't started yet
p2
not a priority
testing
Relating to testing
#251
opened Apr 26, 2023 by
jeremyfowers
Expand the Relating to the benchit CLI
enhancement
New feature or request
new
Work that hasn't started yet
p2
not a priority
benchit models
command set
cli
#247
opened Apr 25, 2023 by
jeremyfowers
Previous Next
ProTip!
Add no:assignee to see everything that’s not assigned.