Return the prompt length given the documents passed in.
This can be used by a caller to determine whether passing in a list of documents would exceed a certain prompt length. This useful when trying to ensure that the size of a prompt remains below a certain context limit.
a list of documents to use to calculate the total prompt length.
additional parameters that may be needed to calculate the prompt length.
