Add HTTP retry logic and cancellation support for OpenAI services - #58

Merged

Devis Lucato (dluc) merged 22 commits into

microsoft:mainfrom

lemillermicrosoft:u/lemiller/http_retry_handler

Mar 14, 2023

Commits on Mar 14, 2023

Create IDelegatingHandlerFactory for HTTP retry
Lee Miller (lemillermicrosoft)
committed
451ae9d
Update tests for Retry
Lee Miller (lemillermicrosoft)
committed
fd33568
Refactor kernel retry mechanism, add new handler, and adjust logging levels
Lee Miller (lemillermicrosoft)
committed
0edec68
Make DefaultHttpRetryHandler and DefaultHttpRetryHandlerFactory public
Lee Miller (lemillermicrosoft)
committed
dae56cb
PR feedback on tests and samples
Lee Miller (lemillermicrosoft)
committed
3d1ccf0
kernel syntax examples
Lee Miller (lemillermicrosoft)
committed
3534768
Relocate HttpRetryConfig class to Reliability namespace
Lee Miller (lemillermicrosoft)
committed
0a6fd74
r# cleanup first, competes with format
Lee Miller (lemillermicrosoft)
committed
38a55d3
Improve retry logic and documentation in DefaultHttpRetryHandler
Lee Miller (lemillermicrosoft)
committed
cbeb264
Add test case for retry handler with max total delay
Lee Miller (lemillermicrosoft)
committed
2f6a82b
only drain response if we aren't returning the response as-is
Lee Miller (lemillermicrosoft)
committed
d1aba65
Remove request cloning and content draining in DefaultHttpRetryHandler
Lee Miller (lemillermicrosoft)
committed
eafebed
Fix rebase build error
Lee Miller (lemillermicrosoft)
committed
7a58ae2
Refactor OpenAIClientAbstract constructor to accept handler factory
Lee Miller (lemillermicrosoft)
committed
23c5b39
format method signature
Lee Miller (lemillermicrosoft)
committed
5c74caa
Fix HTTP handler factory configuration in KernelConfig and KernelBuilder
Lee Miller (lemillermicrosoft)
committed
05a24f9
xmldocs
Lee Miller (lemillermicrosoft)
committed
cb48216
wrap signatures
Lee Miller (lemillermicrosoft)
committed
989c786
Add time spent to error logging in DefaultHttpRetryHandler
Lee Miller (lemillermicrosoft)
committed
ec2e746
Rename SemanticKernel.Test project to SemanticKernel.UnitTests
Lee Miller (lemillermicrosoft)
committed
881730b
formatting
Lee Miller (lemillermicrosoft)
committed
0547680
fix time formatting in logs
Lee Miller (lemillermicrosoft)
committed
cfb83b3

Navigation Menu

Uh oh!

Add HTTP retry logic and cancellation support for OpenAI services - #58

Add HTTP retry logic and cancellation support for OpenAI services#58
Devis Lucato (dluc) merged 22 commits into
microsoft:mainfrom
lemillermicrosoft:u/lemiller/http_retry_handler

Commits on Mar 14, 2023

Create IDelegatingHandlerFactory for HTTP retry

Update tests for Retry

Refactor kernel retry mechanism, add new handler, and adjust logging levels

Make DefaultHttpRetryHandler and DefaultHttpRetryHandlerFactory public

PR feedback on tests and samples

kernel syntax examples

Relocate HttpRetryConfig class to Reliability namespace

r# cleanup first, competes with format

Improve retry logic and documentation in DefaultHttpRetryHandler

Add test case for retry handler with max total delay

only drain response if we aren't returning the response as-is

Remove request cloning and content draining in DefaultHttpRetryHandler

Fix rebase build error

Refactor OpenAIClientAbstract constructor to accept handler factory

format method signature

Fix HTTP handler factory configuration in KernelConfig and KernelBuilder

xmldocs

wrap signatures

Add time spent to error logging in DefaultHttpRetryHandler

Rename SemanticKernel.Test project to SemanticKernel.UnitTests

formatting

fix time formatting in logs