HP Z4 Workstation

Computer Hardware & Server Infrastructure Builds
1

I purchased the HP Z4 workstation to use as an AI box. Will add dual PNY quadro rtx 5000 cards to use with Ollama or LM Studio to run local LLMs. What you your opinion of this setup?

2

Depends. Are you a windows user or a linux user?

Personally I am comfortable using linux headless running my LLM’s

3

I am a Windows user.

4

If you want an easy way to set this up I would use LM Studio on windows.