Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TPU Support #359

Open
rdyro opened this issue Feb 19, 2025 · 3 comments
Open

TPU Support #359

rdyro opened this issue Feb 19, 2025 · 3 comments

Comments

@rdyro
Copy link

rdyro commented Feb 19, 2025

I'm a big fan of your tool and I was hoping we could add TPU support (I work for Google).

I wrote a prototype here: https://github.com/rdyro/nvtop-with-tpu

My current strategy involves calling Python tpu-info via popen and sscanf parsing the output.

Would you be open to upstreaming the TPU support in some version (perhaps a Python-less one eventually)?

For Python-less access to TPU data, the TPU metrics are available through a GRPC server, but a C client dependency might be heavy. Another possibility is a C++ or Go library loaded via dlopen .

@Syllo
Copy link
Owner

Syllo commented Feb 20, 2025

Hello,

I'm glad nvtop is appreciated 😉

Sure thing, that would be great!

I'd rather if we stick to loading a library dynamically (the way it's done for other devices, e.g. à la libnvidia-ml). But I'm not against having conditional build for TPUs using a sub-module (or external lib) that we would link with.

@rdyro
Copy link
Author

rdyro commented Feb 20, 2025

Great, thanks! I'll work on a prototype with a dynamic library and I can make a PR with actual code.

@rdyro
Copy link
Author

rdyro commented Feb 22, 2025

Hey, I made a PR here. Any feedback on C and about the cmake approach would be greatly appreciated!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants