You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have seen that there are many backend drivers drivers:
LlamaSharp.Backend.CPU
LlamaSharp.Backend.Cuda12
LlamaSharp.Backend.Cuda11
LlamaSharp.Backend.OpenCL
LlamaSharp.Backend.MacMetal
LlamaSharp.Backend.Valkan
But an Azure vm like NC8ads_A10_v4 has NVIDIA A10 which is rt and tensor core based, on the other side in many articles cude is desribed as software layer. Can someone explain if lamasharp can work with NC8ads_A10_v4 and provide an explanation please?
The text was updated successfully, but these errors were encountered:
Description
I have seen that there are many backend drivers drivers:
But an Azure vm like NC8ads_A10_v4 has NVIDIA A10 which is rt and tensor core based, on the other side in many articles cude is desribed as software layer. Can someone explain if lamasharp can work with NC8ads_A10_v4 and provide an explanation please?
The text was updated successfully, but these errors were encountered: