QAI AppBuilder libraries for QNN SDK 2.29.0.241129 & Python

Update: We support Genie now. Here is sample code:

from qai_appbuilder import (GenieContext)

def response(text):
    print(text, end='', flush=True)
    return True

config = "..\\models\\config.json"
prompt = "<|im_start|>system\\nYou are a helpful assistant.<|im_end|>\\n<|im_start|>user\\nHow to fish?<|im_end|>\\n<|im_start|>assistant\\n"

d = GenieContext(config)
d.Query(prompt, rsp)

For Python(ARM64) projects, install Python extension for Python 3.12.8(ARM64) with command below:

pip install qai_appbuilder-2.31.0-cp312-cp312-win_arm64.whl

Here is ARM64 Python download links:
https://www.python.org/ftp/python/3.12.8/python-3.12.8-arm64.exe

For Python(x64) projects, the below wheels are ARM64EC architecture which are compatible with the x64 version of Python. It can work on WoS device well. You need to run with the QNN libraries in 'C:\Qualcomm\AIStack\QAIRT\2.28.0.241029\lib\arm64x-windows-msvc':

qai_appbuilder-2.29.0-cp312-cp312-win_amd64.whl

Here are x64 Python download links:
https://www.python.org/ftp/python/3.12.8/python-3.12.8-amd64.exe

For C++ projects, use the files in 'QAI_AppBuilder-win_arm64-QNN2.29.0-Release.zip':

libappbuilder.dll
libappbuilder.lib
QAIAppSvc.exe
include\LibAppBuilder.hpp