You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
The dictionaries returned by generators have matching keys to an extent, but some are using different notations for the same concept, mainly within the metadata / usage keys. For example:
OpenAI generators use prompt_tokens/completion tokens, while Cohere/Anthropic/AmazonBedrock use input_tokens/output_tokens.
Some generators use finish_reason, while others use stop_reason
Describe the solution you'd like
I would like generators to output the same scheme and keys to the extent that it is possible, i.e. for matching concepts. In particular, I would prefer to use input_tokens/output_tokens and stop_reason.
Describe alternatives you've considered
So far, in apps where we swap generators depending on the use case, the alternative is:
Is your feature request related to a problem? Please describe.
The dictionaries returned by generators have matching keys to an extent, but some are using different notations for the same concept, mainly within the metadata / usage keys. For example:
Describe the solution you'd like
I would like generators to output the same scheme and keys to the extent that it is possible, i.e. for matching concepts. In particular, I would prefer to use input_tokens/output_tokens and stop_reason.
Describe alternatives you've considered
So far, in apps where we swap generators depending on the use case, the alternative is:
The text was updated successfully, but these errors were encountered: