DeepSeek R1 7B 14B Med LLM AI Server 8x GPU NVidia V100 32GB Xeon 8260 256G RAM

DeepSeek R1 7B 14B Med LLM AI Server 8x GPU NVidia V100 32GB Xeon 8260 256G RAM

USD 6195.00 USD
SKU: qIIMoxPo
Brand: Inspur
MPN: NF5288M5, Deepseek, iNSPUR, Nvidia GPU, LLM Server, TeleCommunications PH:408-4762944
Condition: Used

Specifications

Network ConnectivityWired-Ethernet (RJ-45)
Network Management TypeFully Managed
Item Length36"
Processor TypeXeon
Memory TypeDDR4 SDRAM
BrandInspur
Network TypeFibre Channel
Form FactorRack-mountable 2U
TypeServer
Processor ManufacturerIntel
ModelNF5288M5
InterfaceEthernet (RJ-45)
Item Width17.5"
Product LineSuper Computer

Will require GPU Clustering and NVLINK. Can Run Multiple Small LLM such as 7B 14B. Large LLM may need Quantization. You will need to use NVLink to Cluster GPU's to handle Large LLM's. - 8x Nvidia V100 32GB SXM2 GPU.

Related Items