Function: sendInference()
sendInference(
gateway,protocol,request,response):Promise<void>
Execute and stream one model request through Express with cancellation.
Parameters
Section titled “Parameters”gateway
Section titled “gateway”protocol
Section titled “protocol”"openai-responses" | "openai-chat" | "anthropic-messages" | "openai-embeddings"
request
Section titled “request”Request
response
Section titled “response”Response
Returns
Section titled “Returns”Promise<void>