Nvidia Spark / ARM64 #3337
daz-williams
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Having waited the best part of half a year to receive an Nvidia Spark, imagine my dismay when I realized that TGI will not work as the Spark uses ARM64 architecture.
Super sad that my only option is to use one of the alternatives such as Ollama or vLLM, instead of TGI which we've been happily using for the last 2 years and has been rock solid, serving us well.
-Daz
Beta Was this translation helpful? Give feedback.
All reactions