Anyone have one or using one? Any Pro tips or cool things to do?
Our company purchased and handful of these for us to test and learn on and I was given access to one, So far I'm using sparkrun util to load a bunch of different LLM models then installed a web dashboard to start/stop the different models. To access them I'm using a Chrome plugin (page assist) on my laptop which is basically the user interface API front end that supports the OpenAI models being served. So I can open the tab, chat with whatever model is running, have it write code or process data, and tell me yo mama jokes.
Our company purchased and handful of these for us to test and learn on and I was given access to one, So far I'm using sparkrun util to load a bunch of different LLM models then installed a web dashboard to start/stop the different models. To access them I'm using a Chrome plugin (page assist) on my laptop which is basically the user interface API front end that supports the OpenAI models being served. So I can open the tab, chat with whatever model is running, have it write code or process data, and tell me yo mama jokes.