-
Notifications
You must be signed in to change notification settings - Fork 1.3k
Add ModelProfile to let model-specific behaviors be configured independent of the model class #1835
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
PR Change SummaryEnhanced OpenAI compatibility by introducing specific provider classes for various models, allowing for more flexible configuration of model behaviors.
Modified Files
How can I customize these reviews?Check out the Hyperlint AI Reviewer docs for more information on how to customize the review. If you just want to ignore it on this PR, you can add the Note specifically for link checks, we only check the first 30 links in a file and we cache the results for several hours (for instance, if you just added a page, you might experience this). Our recommendation is to add |
Docs Preview
|
Can we include the providers on another PR? |
…dent of the model class
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think just the JsonSchemaTransformer thing to have a more specific name, otherwise LGTM
…hemaTransformer for those model profiles that need that
This is great and probably fixes a ton of issues I’m running into using OpenAI compatible APIs w/ vLLM |
…pSeek providers for backward compatibility
…l_profile functions change in the future
To do: