Skip to content

[FEATURE] Get an AsyncOpenAI client for a serving endpoint. #847

@mbelak-dtml

Description

@mbelak-dtml

Problem Statement
Currently, WorkspaceClient enables getting an OpenAI client via .serving_endpoints.get_open_ai_client, which is very convenient. However, it does not support AsyncOpenAI, which enables asynchronous calls to serving endpoints.

Proposed Solution

Add a new method (get_async_open_ai_client) with the same functionality as get_open_ai_client , except returning an AsyncOpenAI instance.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Feature RequestThe issue is a request for enhancement or new functionality rather than a bug.TriagedThe issue has been reviewed. Issues without a “Triaged” label require triage/review.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions