DGX Spark recipe
#5
by stelterlab - opened
For those GB10 enthusiasts like me, I did a test run of the model yesterday using eugr's optimized image for sm121 as base.
https://gist.github.com/stelterlab/8ff5d29f9d9fe10d7c6452a2b767c62b
Fits perfectly on one machine with a very nice generation speed (48 tok/s). Ideal for devs.