Skip to content

feat(generative): expose n on the OpenAI runtime config #2125

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Anai-Guo wants to merge 1 commit into
base: main
Choose a base branch
from
Open

feat(generative): expose n on the OpenAI runtime config #2125

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions weaviate/collections/classes/generative.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -353,6 +353,7 @@ class _GenerativeOpenAI(_GenerativeConfigRuntime):
is_azure: bool
max_tokens: Optional[int]
model: Optional[str]
n: Optional[int]
presence_penalty: Optional[float]
resource_name: Optional[str]
stop: Optional[List[str]]
Expand All @@ -371,6 +372,7 @@ def _to_grpc(self, opts: _GenerativeConfigRuntimeOptions) -> generative_pb2.Gene
frequency_penalty=self.frequency_penalty,
max_tokens=self.max_tokens,
model=self.model,
n=self.n,
presence_penalty=self.presence_penalty,
resource_name=self.resource_name,
stop=_to_text_array(self.stop),
Expand Down Expand Up @@ -1139,6 +1141,7 @@ def openai(
frequency_penalty: Optional[float] = None,
max_tokens: Optional[int] = None,
model: Optional[str] = None,
n: Optional[int] = None,
presence_penalty: Optional[float] = None,
reasoning_effort: Optional[Union[OpenAiReasoningEffort, str]] = None,
resource_name: Optional[str] = None,
Expand All @@ -1159,6 +1162,7 @@ def openai(
frequency_penalty: The frequency penalty to use. Defaults to `None`, which uses the server-defined default
max_tokens: The maximum number of tokens to generate. Defaults to `None`, which uses the server-defined default
model: The model to use. Defaults to `None`, which uses the server-defined default
n: The number of sequences to generate. Defaults to `None`, which uses the server-defined default
presence_penalty: The presence penalty to use. Defaults to `None`, which uses the server-defined default
reasoning_effort: The reasoning effort to use. Defaults to `None`, which uses the server-defined default
resource_name: The name of the OpenAI resource to use. Defaults to `None`, which uses the server-defined default
Expand All @@ -1176,6 +1180,7 @@ def openai(
frequency_penalty=frequency_penalty,
max_tokens=max_tokens,
model=model,
n=n,
presence_penalty=presence_penalty,
resource_name=resource_name,
stop=stop,
Expand All @@ -1195,6 +1200,7 @@ def azure_openai(
frequency_penalty: Optional[float] = None,
max_tokens: Optional[int] = None,
model: Optional[str] = None,
n: Optional[int] = None,
presence_penalty: Optional[float] = None,
resource_name: Optional[str] = None,
stop: Optional[List[str]] = None,
Expand All @@ -1213,6 +1219,7 @@ def azure_openai(
frequency_penalty: The frequency penalty to use. Defaults to `None`, which uses the server-defined default
max_tokens: The maximum number of tokens to generate. Defaults to `None`, which uses the server-defined default
model: The model to use. Defaults to `None`, which uses the server-defined default
n: The number of sequences to generate. Defaults to `None`, which uses the server-defined default
presence_penalty: The presence penalty to use. Defaults to `None`, which uses the server-defined default
resource_name: The name of the OpenAI resource to use. Defaults to `None`, which uses the server-defined default
stop: The stop sequences to use. Defaults to `None`, which uses the server-defined default
Expand All @@ -1228,6 +1235,7 @@ def azure_openai(
frequency_penalty=frequency_penalty,
max_tokens=max_tokens,
model=model,
n=n,
presence_penalty=presence_penalty,
resource_name=resource_name,
stop=stop,
Expand Down