Give the procurement team a usable specification
You may know the model you need to run without having a final server configuration. We help identify the hardware requirements and the questions that need to be resolved before requesting supply options.
The planning scope can include a configuration brief, equipment options and a list of site and integration dependencies. We agree the required output at the start of the discussion.
- Training and fine-tuning
- Review model and dataset requirements, accelerator memory, data movement and checkpoint storage.
- Inference
- Define the serving workload: model size, precision, concurrency, latency targets and expected operating hours.
- Existing environments
- Account for available rack space, power, cooling, network interfaces, storage and the software stack you already use.