Skip to content

Commit 3a8a6c9

Browse files
committed
⚡ perf(timeout): increase timeouts and retries for unresponsive API
- Increase request timeout from 1 hour to 4 hours default - Increase max retries from 3 to 5 for non-streaming requests - Increase initial retry delay from 1s to 2s - Increase max retry delay from 30s to 60s
1 parent cfa0ba0 commit 3a8a6c9

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

src/server.ts

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -156,7 +156,7 @@ const PORT = process.env['PORT'] ?? 8765;
156156
const DEBUG = process.env['DEBUG'] === 'true' || process.env['DEBUG'] === '1';
157157
const DEFAULT_MODEL = modelsConfig.defaultModel;
158158
const POOL_SIZE = 5;
159-
const REQUEST_TIMEOUT_MS = parseInt(process.env['REQUEST_TIMEOUT_MS'] ?? '3600000', 10); // 1 hour default
159+
const REQUEST_TIMEOUT_MS = parseInt(process.env['REQUEST_TIMEOUT_MS'] ?? '14400000', 10); // 4 hours default
160160
const SHUTDOWN_TIMEOUT_MS = parseInt(process.env['SHUTDOWN_TIMEOUT_MS'] ?? '30000', 10); // 30 seconds default
161161

162162
// Server start time for uptime tracking
@@ -235,9 +235,9 @@ let isShuttingDown = false;
235235

236236
// Retry Configuration
237237
const RETRY_CONFIG = {
238-
maxRetries: 3,
239-
initialDelayMs: 1000,
240-
maxDelayMs: 30000,
238+
maxRetries: 5,
239+
initialDelayMs: 2000,
240+
maxDelayMs: 60000,
241241
backoffMultiplier: 2,
242242
jitterFactor: 0.1,
243243
} as const;

0 commit comments

Comments
 (0)