Check for existing issues
The Feature
Scaleways supports reranking models (https://www.scaleway.com/en/docs/generative-apis/how-to/query-reranking-models/), however it is not supported by litellm (https://github.com/BerriAI/litellm)
User Flow
Before this feature I would have to give users scoped IAM keys to allow them to access the v1/rerankendpoints because I would have an error 500.
After this feature I could get my users to only target my litellm instance
How far you got
On version v1.104.0 I tried to set the providers as the ones listed on the rerank page https://docs.litellm.ai/docs/rerank#supported-providers
Which part of LiteLLM is this about?
LLM translation: a specific provider's request or response
LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?
No
Twitter / LinkedIn details
No response
Check for existing issues
The Feature
Scaleways supports reranking models (https://www.scaleway.com/en/docs/generative-apis/how-to/query-reranking-models/), however it is not supported by litellm (https://github.com/BerriAI/litellm)
User Flow
Before this feature I would have to give users scoped IAM keys to allow them to access the
v1/rerankendpoints because I would have an error 500.After this feature I could get my users to only target my litellm instance
How far you got
On version v1.104.0 I tried to set the providers as the ones listed on the rerank page https://docs.litellm.ai/docs/rerank#supported-providers
Which part of LiteLLM is this about?
LLM translation: a specific provider's request or response
LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?
No
Twitter / LinkedIn details
No response