Skip to content

Support batch processing over the REST API. #1806

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
telackey wants to merge 10 commits into
base: main
Choose a base branch
from
Open

Support batch processing over the REST API. #1806

telackey wants to merge 10 commits into from
+479 −111

Conversation

@telackey
Copy link

@telackey telackey commented Dec 3, 2025 •
edited
Loading

Change Description

The REST API only supports analyzing one text at a time. This adds support for batch processing.

The implementation is backwards compatible: if text is a string, it returns identical results as before. This simply adds support for text to be supplied as a string[] instead, in which case it returns an array of results.

Issue reference

Fixes #XX

Checklist

  • I have reviewed the contribution guidelines
  • I have signed the CLA (if required)
  • My code includes unit tests
  • All unit tests and lint checks pass locally
  • My PR contains documentation updates / additions if required - (N/A)

@telackey
Copy link
Author

telackey commented Dec 3, 2025

@microsoft-github-policy-service agree company="SolidCore.ai"

@telackey telackey marked this pull request as ready for review December 3, 2025 20:57
@SharonHart
Copy link
Contributor

SharonHart commented Dec 7, 2025

Great addition @telackey!
Can you please update the openapi documentation, it is currenty not autogenerated from the routes defintion

@telackey
Copy link
Author

telackey commented Dec 9, 2025

Great addition @telackey! Can you please update the openapi documentation, it is currenty not autogenerated from the routes defintion

Can do

@telackey
Copy link
Author

telackey commented Dec 9, 2025 •
edited
Loading

@SharonHart, I think I updated the relevant docs. If I missed anything, just point me in the right direction and I'll update as needed.

@SharonHart
Copy link
Contributor

SharonHart commented Dec 10, 2025

@SharonHart, I think I updated the relevant docs. If I missed anything, just point me in the right direction and I'll update as needed.

spot on, looks good 🎯

SharonHart
SharonHart previously approved these changes Dec 10, 2025
View reviewed changes
RonShakutai and others added 2 commits December 11, 2025 19:15
@RonShakutai @omri374 @dorlugasigal
Change parameters in extraction in langextract (microsoft#1811)
2ac7a32 
* Refactor LangExtract recognizers to support customizable extraction parameters and improve configuration clarity for Azure OpenAI and Ollama.

* Add tests for parameter configuration and overrides in Ollama and Azure OpenAI recognizers

* Refactor Azure OpenAI and Ollama LangExtract recognizers to improve parameter handling and documentation clarity

* Update max_char_buffer parameter in OllamaLangExtractRecognizer to improve performance

* Update max_char_buffer parameter in Ollama configuration to enhance performance

* Update presidio-analyzer/presidio_analyzer/predefined_recognizers/third_party/langextract_recognizer.py

Co-authored-by: Dor Lugasi-Gal <dorlugasigal@gmail.com>

* lx to top level

---------

Co-authored-by: Omri Mendels <omri374@users.noreply.github.com>
Co-authored-by: Dor Lugasi-Gal <dorlugasigal@gmail.com>
@telackey
Merge branch 'main' into telackey/batch_app
fdd4e12
@telackey
Copy link
Author

telackey commented Dec 11, 2025

Thanks!

@SharonHart SharonHart dismissed their stale review December 17, 2025 11:42

The merge-base changed after approval.

@SharonHart
Copy link
Contributor

SharonHart commented Dec 17, 2025

@telackey
I accidentally made the branch behind main after a force-push :(
can you please update your branch?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@SharonHart SharonHart SharonHart left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

external

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@telackey @SharonHart @RonShakutai