Skip to content

[Cosmos][VectorSearch] Non Streaming Order By Query#40098

Merged
aayush3011 merged 54 commits into
Azure:feature/vector_searchfrom
aayush3011:users/akataria/nonStreamingOrderBy
May 9, 2024
Merged

[Cosmos][VectorSearch] Non Streaming Order By Query#40098
aayush3011 merged 54 commits into
Azure:feature/vector_searchfrom
aayush3011:users/akataria/nonStreamingOrderBy

Conversation

@aayush3011

Copy link
Copy Markdown
Member

Description

  • This update introduces support for non-streaming OrderBy, essential for vector search capabilities. Previously, the SDK operated under the assumption that documents returned in response to ORDER BY queries were fully ordered across all continuations. However, with the newly implemented non-streaming OrderBy feature in the backend, this assumption is no longer valid. The backend communicates this change through a new field in the Query Plan, _hasNonStreamingOrderBy, which is set to true when applicable.

  • In scenarios where _hasNonStreamingOrderBy is true, a new pipeline stage for non-streaming order by is established. This stage functions as a blocking pipeline stage, similar to the GROUP BY stage, and is designed to accumulate all backend responses before yielding any results.

  • A new query feature by the name of NonStreamingOrderBy has also been added.

.Net PR for the same: Azure/azure-cosmos-dotnet-v3#4362

All SDK Contribution checklist:

  • The pull request does not introduce [breaking changes]
  • CHANGELOG is updated for new features, bug fixes or other significant changes.
  • I have read the contribution guidelines.

General Guidelines and Best Practices

  • Title of the pull request is clear and informative.
  • There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

  • Pull request includes test coverage for the included changes.

aayush3011 and others added 30 commits April 24, 2024 08:09
Increment package versions for core releases
* Added Alpha3 Java Media Streaming Events

* updating readme to add the media streaming events to remove model

---------

Co-authored-by: Vinothini Dharmaraj <v-vdharmaraj@microsoft.com>
…re#40012)

Co-authored-by: James Suplizio <jasupliz@microsoft.com>
* SDK Review updates

* Update auto-generated models

* Add customization

* Fix customization

* Update package

* Update tests

* Linting
)

* fix fault injection rule failed to apply per partition in gateway mode

---------

Co-authored-by: annie-mac <xinlian@microsoft.com>
* release azure-cosmos-test 1.0.0.beta.7
---------

Co-authored-by: annie-mac <xinlian@microsoft.com>
* Fixed existsById API in ReactiveCosmosTemplate

* Added changelog
…ith Event recordings (Azure#40029)

Co-authored-by: Min Woo Lee 🧊 <77083090+minwoolee-ms@users.noreply.github.com>
* remove additional matrix

* Fix session processing and disposition instrumentation

* return matrix config

* review suggestions
* [CODEOWNERS] Updates for org changes

The focus of these changes is to remove an individual who no longer is responsible for the products which their GH account is associated to.
…zure#39744)

* Move from using the docker image to java2docfx for docs validation

* Temporarily turn on docs processing for template libraries for testing

* Actually install the rex validation tool

* Fix the if not Test-Path statement

* Update java2docfx version and add a couple of diagnostics output lines

* Add missing close paren

* Ensure that Sort-Object always returns an array even if there's only one item

* add another piece of diagnostics output

* trying one more thing

* remove some diag, add other

* Remove the additional diagnostics, add permanent output message

* Invoke java -jar on java2docfx to show the help command to ensure the install is okay

* fiddling with the java -jar command

* Set the working directory to the java2docfx directory before executing the mvn dependency download

* Actually create the directory before trying to set location...oops

* Update rex validation to verify MAVEN_HOME is set

* Updates for Java PR 39875 which had changes from this PR that were more immediate

* Update java2docfx version

* remove check for MAVEN_HOME which was only for testing

* Update the version of java2docfx to test a fix

* Update version of java2docfx to 1.0.4

* revert template's ci.yml changes that were only necessary to test java2docfx
Use ClientLogger in testing output
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Done
Status: Done

Development

Successfully merging this pull request may close these issues.