Skip to content

Conversation

drbh
Copy link
Collaborator

@drbh drbh commented Mar 4, 2024

This PR adds a new endpoint for vertex support and conditionally includes openapi docs for this endpoint when built with the google feature

Copy link
Contributor

@philschmid philschmid left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we need a whole new route?
Can't we use the regular "predict" route and just change the /path when AIP_X env are provided?

My bad we need a new route since the Vertex Request has the instances object again.

Comment on lines +1222 to +1223
// Vertex compat route
.route("/vertex", post(vertex_compatibility))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should not be needed since we only need the endpoint when /env is set.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in the TGI case we also always include the endpoint and only conditionally add the api docs. Should we avoid adding it in both cases if the feature is not on?

@drbh
Copy link
Collaborator Author

drbh commented Mar 5, 2024

closing in favor of newer PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants