Inference
< GlossaryThe process of getting a response from a trained model — feeding input and generating output. Unlike training, inference requires significantly less compute.
The process of getting a response from a trained model — feeding input and generating output. Unlike training, inference requires significantly less compute.