Skip to content

azure-ai-agents and azure-ai-projects 2.6.0 initial generation - #50426

Merged
Kaylie (kaylieee) merged 16 commits into
mainfrom
kaylieee/release/2.6.0
Sep 15, 2026
Merged

azure-ai-agents and azure-ai-projects 2.6.0 initial generation#50426
Kaylie (kaylieee) merged 16 commits into
mainfrom
kaylieee/release/2.6.0

Conversation

@kaylieee

@kaylieee Kaylie (kaylieee) commented Sep 11, 2026

Copy link
Copy Markdown
Member

This pull request updates the Java SDK for Azure AI Agents with several important enhancements and documentation improvements. The main changes expand the agent definition schema to support new features, particularly around moderation and voice capabilities, and refine the documentation to reflect these updates.

Agent Schema and Documentation Enhancements:

  • Added support for the voice agent kind, expanding the possible values for the kind field in agent definitions. [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11]
  • Introduced a new optional invocations_moderation block under rai_config, allowing configuration of input/output content types, response modes (streaming/non-streaming/both), input/output paths, and stream selectors for event handling. [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11]

Agent State and Configuration:

  • Added a new required configuration_state field (enabled/disabled) to the agent metadata, improving tracking of agent readiness and configuration status. [1] [2] [3] [4] [5]

Build/Analysis Pipeline:

  • Updated the revapi-maven-plugin configuration in pom.xml to explicitly include class and package tree filters, ensuring more precise API analysis during builds.

These changes collectively improve the flexibility, moderation, and documentation of agent definitions, and enhance the maintainability of the SDK.

@azure-pipelines

azure-pipelines Bot commented Sep 11, 2026

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).
35 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Kaylie (kaylieee) and others added 3 commits September 14, 2026 13:20
@kaylieee
add new beta annotations
c4be69f
@kaylieee
remove browser automation
cb8a7c2
@kaylieee
Add voice functionality (#50427)
1ee2e17 
* initial voice gen

* dedup openai

* add voice beta client builers

* realtime rename

* telephony regen

* regen with voice agent subclients

* update builder for new client names

* update beta annotations

* rename ops to be subject based

* update beta annotations
@kaylieee Kaylie (kaylieee) changed the title Release branch for azure-ai-agents and azure-ai-projects 2.6.0 Release azure-ai-agents and azure-ai-projects 2.6.0 Sep 15, 2026
@kaylieee
Kaylie (kaylieee) marked this pull request as ready for review September 15, 2026 00:07
Copilot AI lite review requested due to automatic review settings September 15, 2026 00:07
Copilot AI reviewed Sep 15, 2026
View reviewed changes

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

A critical spelling-check failure, moderate release/test issues, and documentation corrections remain unresolved.

Get a fresh assessment by requesting another Copilot review.

Pull request overview

This PR updates the Azure AI Agents and Projects Java SDKs with preview voice, realtime, telephony, moderation, Copilot, and data-generation APIs.

Changes:

  • Adds generated voice, realtime, telephony, moderation, and Copilot capabilities.
  • Extends data-generation models with trace filtering and output write modes.
  • Updates TypeSpec revisions, annotations, module metadata, Revapi filters, suppressions, and release notes.
File summaries
File Summary
sdk/ai/azure-ai-projects/tsp-location.yaml Updates TypeSpec source revision.
sdk/ai/azure-ai-projects/src/main/java/com/azure/ai/projects/models/TracesDataGenerationJobSource.java Adds trace source support.
sdk/ai/azure-ai-projects/src/main/java/com/azure/ai/projects/models/ToolUseFineTuningDataGenerationJobOptions.java Updates fine-tuning options.
sdk/ai/azure-ai-projects/src/main/java/com/azure/ai/projects/models/SimpleQnADataGenerationJobOptions.java Updates Q&A generation options.
sdk/ai/azure-ai-projects/src/main/java/com/azure/ai/projects/models/DataGenerationJobOutputWriteMode.java Adds output write mode enum.
sdk/ai/azure-ai-projects/src/main/java/com/azure/ai/projects/models/DataGenerationJobOutputOptions.java Updates output options.
sdk/ai/azure-ai-projects/pom.xml Updates Revapi filters.
sdk/ai/azure-ai-projects/customizations/beta-annotations.csv Updates preview annotations.
sdk/ai/azure-ai-agents/tsp-location.yaml Updates TypeSpec source revision.
sdk/ai/azure-ai-agents/src/main/java/module-info.java Updates module exports.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceType.java Adds generated voice model enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceResponseBaseStatus.java Adds generated voice response enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceResponseBaseOutputModality.java Adds generated voice response enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceResponseBaseObject1.java Adds generated voice response model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceResponseBaseObject.java Adds generated voice response model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceResponseAudio.java Adds generated voice audio model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceOutputModality.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceModelType.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceConversationStatus.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAudioRole.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAudioContainerFormat.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAudioCodec.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentTurnDetectionType.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentTransport.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentToolResponseScheduling.java Adds generated voice model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentSystemToolName.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentSessionIncludeOption.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentSemanticVadTurnDetectionEagerness.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentResponseCreateParamsConversation.java Adds generated voice request model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentNoiseReductionType.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentInterimResponseTrigger.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentFunctionToolType.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentEndOfUtteranceThresholdLevel.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentEndOfUtteranceDetectionModel.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentEchoCancellationReferenceSource.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentAvatarType.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentAvatarOutputProtocol.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentAudioTimestampType.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentAudioInputConfigTranscriptionDelay.java Adds generated voice model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/VoiceAgentAnimationOutputType.java Adds generated voice enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TranscriptionLanguage.java Updates transcription enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/ToolType.java Updates generated tool enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/ToolConfig.java Updates generated tool model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/ToolChoiceOptions.java Updates generated tool model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/ToolboxVersions.java Updates toolbox model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/Tool.java Updates generated tool model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyTransferDestinationKind.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyProvider.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyOutboundRetryPolicyType.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyOutboundDestinationType.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyOperationStatus.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCampaignScheduleType.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCampaignRecipientImportStatus.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCampaignRecipientImportFormat.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCampaignDuplicateHandling.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCampaignConfigurationStatus.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCallTraceStatus.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCallTraceMode.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCallTimestampSource.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCallStatus.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCallLifecycleEventSource.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCallLifecycleEventOutcome.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyCallDurationBasis.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/TelephonyBindingStatus.java Adds telephony enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/SessionAffinitySource.java Adds session affinity enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/SessionAffinityRequestMode.java Adds session affinity enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/SessionAffinityMode.java Adds session affinity enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/SessionAffinityDecision.java Adds session affinity enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeTurnDetectionType.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeSessionCreateRequestUnionType.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeServerEventResponseContentPartDonePartType.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeServerEventResponseContentPartAddedPartType.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeServerEventRateLimitsUpdatedRateLimitsName.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeServerEventConversationCreatedConversationObject.java Adds realtime model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeMcpErrorType.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemObject.java Adds realtime model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemMessageUserStatus.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemMessageUserContentType.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemMessageUserContentDetail.java Adds realtime model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemMessageType.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemMessageSystemStatus.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemMessageSystemContentType.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemMessageAssistantStatus.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemMessageAssistantContentType.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemFunctionCallStatus.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeConversationItemFunctionCallOutputStatus.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeClientEventSessionUpdateSessionTruncation.java Adds realtime model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeClientEventSessionUpdateSessionOutputModality.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeAudioFormatsType.java Adds realtime enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeAudioFormatsAudioPcmu.java Adds realtime audio model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeAudioFormatsAudioPcmRate.java Adds realtime audio enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RealtimeAudioFormatsAudioPcma.java Adds realtime audio model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RaiInvocationMode.java Adds moderation enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/RaiInvocationContentType.java Adds moderation enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/ModelRouterDetails.java Adds model routing schema.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/McpListToolsToolInputSchema.java Adds MCP tool schema.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/McpListToolsToolAnnotations.java Adds MCP tool annotations.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/GitHubCopilotHarness.java Adds Copilot harness schema.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/GitHubCopilotBuiltInTool.java Adds Copilot tool schema.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/CreateTranscriptionResponseJsonUsageType.java Adds transcription enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/CreateAgentVersionInput.java Adds agent version input model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/BrowserAutomationToolParameters.java Adds browser automation schema.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/BrowserAutomationToolConnectionParameters.java Adds browser connection schema.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/AzureCreateResponseOptions.java Adds response options model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/AgentSessionResource.java Updates agent session model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/AgentKind.java Updates agent kind enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/AgentEndpointProtocol.java Updates endpoint protocol enum.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/AgentDetails.java Updates agent metadata model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/AgentDefinition.java Updates agent definition schema.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/implementation/OpenAIJsonHelper.java Updates JSON serialization support.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/implementation/models/TransferTelephonyCallRequest.java Adds telephony request model.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/implementation/models/AgentDefinitionOptInKeys.java Updates agent opt-in keys.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/implementation/JsonMergePatchHelper.java Updates merge-patch support.
sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/implementation/AgentsClientImpl.java Updates client implementation.
sdk/ai/azure-ai-agents/pom.xml Updates Revapi filters.
sdk/ai/azure-ai-agents/checkstyle-suppressions.xml Updates generated suppressions.
sdk/ai/azure-ai-agents/CHANGELOG.md Updates release notes.
Review details

Suppressed comments (1)

sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/models/AgentDefinition.java:118

  • The new voice discriminator and the large VoiceAgentDefinition serialization tree are not exercised by the existing model tests: the current tests cover prompt definitions and realtime response models, but there is no test that deserializes {"kind":"voice",...} through AgentDefinition.fromJson or round-trips representative voice fields. Add a focused round-trip test covering the discriminator and at least the nested audio/turn-detection configuration so regressions in this new wire contract are caught.
  • Files reviewed: 113/401 changed files
  • Comments generated: 5
  • Review effort level: Lite

💡 Add a code-review agent skill for context-aware, tailored reviews. Learn more in the docs.

Comment thread ...ure-ai-agents/src/main/java/com/azure/ai/agents/models/PstnTelephonyTransferDestination.java
Comment thread sdk/ai/azure-ai-agents/CHANGELOG.md
Comment thread sdk/ai/azure-ai-agents/CHANGELOG.md
Comment thread sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/AgentsClientBuilder.java Outdated
Comment thread sdk/ai/azure-ai-agents/src/main/java/com/azure/ai/agents/AgentsClientBuilder.java Outdated
This was referenced Sep 15, 2026
Merged
Open
@guotuofeng Mike Guo (guotuofeng) mentioned this pull request Sep 15, 2026
Open
4 tasks
@kaylieee Kaylie (kaylieee) changed the title Release azure-ai-agents and azure-ai-projects 2.6.0 azure-ai-agents and azure-ai-projects 2.6.0 initial generation Sep 15, 2026
@kaylieee
Kaylie (kaylieee) merged commit 1b9c37e into main Sep 15, 2026
29 checks passed
@kaylieee
Kaylie (kaylieee) deleted the kaylieee/release/2.6.0 branch September 15, 2026 16:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@guotuofeng Mike Guo (guotuofeng) guotuofeng left review comments
Copilot code review Copilot
Copilot review effort, defaults to Lite
Applies to this pull request for everyone.Learn more about Copilot code review.
Copilot left review comments
@jpalvarezl Jose Alvarez (jpalvarezl) jpalvarezl approved these changes
@dargilco Darren Cohen (dargilco) Awaiting requested review from dargilco dargilco is a code owner
@glharper Glenn Harper (glharper) Awaiting requested review from glharper glharper is a code owner
@glecaros Gerardo Lecaros (glecaros) Awaiting requested review from glecaros glecaros is a code owner
@rhurey Ryan Hurey (rhurey) Awaiting requested review from rhurey rhurey is a code owner

Assignees

No one assigned

Labels

AI Agents AI Projects

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@kaylieee @guotuofeng @jpalvarezl