Ask a question to get started
Enter to sendā¢Shift+Enter new line
ContentHandlerBase()
Generic[INPUT_TYPE, OUTPUT_TYPE]
The MIME type of the input data passed to endpoint
The MIME type of the response data returned from endpoint
Transforms the input to a format that model can accept as the request Body. Should return bytes or seekable file like object in the format specified in the content_type request header.
Transforms the output from the model to string that the LLM class expects.
Handler class to transform input from LLM to a format that SageMaker endpoint expects.
Similarly, the class handles transforming output from the SageMaker endpoint to a format that LLM class expects.