You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The Inference API exposes some metadata about the inference computation via HTTP headers,
mainly:
x-compute-time
x-compute-type
Along with some task-specific info such as x-compute-characters for text-generation
It would be great to expose that metadata through the HfInference client. It will be especially useful when we integrate the inference client in widgets (#360 )
The text was updated successfully, but these errors were encountered:
The Inference API exposes some metadata about the inference computation via HTTP headers,
mainly:
x-compute-time
x-compute-type
Along with some task-specific info such as
x-compute-characters
fortext-generation
It would be great to expose that metadata through the
HfInference
client. It will be especially useful when we integrate the inference client in widgets (#360 )The text was updated successfully, but these errors were encountered: