feat(local-apps): Add Nexa SDK integration #1800
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…lation instructions
mengshengwu
changed the title
mengshengwu
requested review from
SBrandeis,
Wauplin,
gary149,
julien-c,
ngxson and
pcuenca
as code owners
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Introduction
Hello! Friends from Huggingface 👋
Thank you for maintaining this amazing library and ecosystem.
Following a recent discussion with Hugging Face (see here), your CEO expressed interest in exploring collaboration to bring on-device model inference to the community. This PR proposes adding Nexa SDK to the local apps section as a new runtime integration option.
About Nexa SDK
Nexa SDK is an on-device inference framework that runs any model on any device, across any backend. It runs on CPUs, GPUs, NPUs with backend support for CUDA, Metal, Vulkan, and Qualcomm / Intel / AMD NPU. It handles multiple input modalities including text 📝, image 🖼️, and audio 🎧. The SDK includes an OpenAI-compatible API server with support for JSON schema-based function calling and streaming. It supports model formats such as GGUF, MLX, Nexa AI's own
.nexaformat, enabling efficient quantized inference across diverse platforms.Example Demos
🖼️ Multi-Image Reasoning
Spot the difference across two images in multi-round dialogue.
🎤 Image + Text → Function Call
Snap a poster, add a voice note, and the AI agent creates a calendar event locally.
🎶 Multi-Audio Comparison
Identify differences between two music clips — fully offline.
Related Links
Logo File
Nexa-Logo-Black
Thank you for your time reviewing this PR!
We’re excited to explore how Nexa SDK can extend Hugging Face models to mobile and edge platforms. 🙏