POST
/v2/dedicated-inferencesCreate a Dedicated Inference
Create a new Dedicated Inference for your team. Send a POST request to
/v2/dedicated-inferences with a spec object (version, name, region, vpc,
enable_public_endpoint, model_deployments) and optional access_tokens (e.g.
hugging_face_token for gated models). The response code 202 Accepted indicates
the request was accepted for processing; it does not indicate success or failure.
The token value is returned only on create; store it securely.
- IdempotentThe SDK sends
Idempotency-Key, so a retried request is only applied once.
specobjectrequired
Structured configuration for a Dedicated Inference deployment.
access_tokensobjectoptional
Key-value pairs for provider tokens (e.g. Hugging Face).
202Dedicated Inference create/update accepted for processing (202). Success or failure is not indicated by the response code.
dedicated_inferenceobjectoptional
A Dedicated Inference instance.
tokenobjectoptional
Access token for authenticating to Dedicated Inference endpoints.
401Authentication failed due to invalid credentials.
idstringrequired
A short identifier corresponding to the HTTP status code returned. For example, the ID for a response returning a 404 status code would be "not_found."
messagestringrequired
A message providing additional information about the error, including details to help resolve it when possible.
request_idstringoptional
Optionally, some endpoints may include a request ID that should be provided when reporting bugs or opening support tickets to help identify the issue.
429The API rate limit has been exceeded.
idstringrequired
A short identifier corresponding to the HTTP status code returned. For example, the ID for a response returning a 404 status code would be "not_found."
messagestringrequired
A message providing additional information about the error, including details to help resolve it when possible.
request_idstringoptional
Optionally, some endpoints may include a request ID that should be provided when reporting bugs or opening support tickets to help identify the issue.
500There was a server error.
idstringrequired
A short identifier corresponding to the HTTP status code returned. For example, the ID for a response returning a 404 status code would be "not_found."
messagestringrequired
A message providing additional information about the error, including details to help resolve it when possible.
request_idstringoptional
Optionally, some endpoints may include a request ID that should be provided when reporting bugs or opening support tickets to help identify the issue.
defaultThere was an unexpected error.
idstringrequired
A short identifier corresponding to the HTTP status code returned. For example, the ID for a response returning a 404 status code would be "not_found."
messagestringrequired
A message providing additional information about the error, including details to help resolve it when possible.
request_idstringoptional
Optionally, some endpoints may include a request ID that should be provided when reporting bugs or opening support tickets to help identify the issue.
Error handling
A 401 is returned: Authentication failed due to invalid credentials. A 429 is returned: The API rate limit has been exceeded. A 500 is returned: There was a server error. Any other status is an error: There was an unexpected error.