-
Notifications
You must be signed in to change notification settings - Fork 165
Open
Labels
Feature RequestThe issue is a request for enhancement or new functionality rather than a bug.The issue is a request for enhancement or new functionality rather than a bug.TriagedThe issue has been reviewed. Issues without a “Triaged” label require triage/review.The issue has been reviewed. Issues without a “Triaged” label require triage/review.
Description
Problem Statement
Currently, WorkspaceClient
enables getting an OpenAI
client via .serving_endpoints.get_open_ai_client
, which is very convenient. However, it does not support AsyncOpenAI
, which enables asynchronous calls to serving endpoints.
Proposed Solution
Add a new method (get_async_open_ai_client
) with the same functionality as get_open_ai_client
, except returning an AsyncOpenAI
instance.
Metadata
Metadata
Assignees
Labels
Feature RequestThe issue is a request for enhancement or new functionality rather than a bug.The issue is a request for enhancement or new functionality rather than a bug.TriagedThe issue has been reviewed. Issues without a “Triaged” label require triage/review.The issue has been reviewed. Issues without a “Triaged” label require triage/review.