diff --git a/docs/content/docs/java/guides/core/index.mdx b/docs/content/docs/java/guides/core/index.mdx index 293e26dd..21f35f06 100644 --- a/docs/content/docs/java/guides/core/index.mdx +++ b/docs/content/docs/java/guides/core/index.mdx @@ -5,15 +5,55 @@ description: "The building blocks of every Java taskito application." The building blocks of every taskito application. -| Guide | Description | -|---|---| -| [Tasks](/java/guides/core/tasks) | Describe tasks with `Task.of()`, configure retries, timeouts, and options | -| [Queues & Priority](/java/guides/core/queues) | Named queues, priority levels, and routing | -| [Workers](/java/guides/core/workers) | Start workers, control concurrency, graceful shutdown | -| [Execution Models](/java/guides/core/execution-model) | How tasks move from enqueue to completion | -| [Enqueue options](/java/guides/core/enqueue-options) | Per-job delay, priority, uniqueness, and metadata | -| [Batching](/java/guides/core/batching) | Producer-side `Batcher`/`enqueueMany` and worker-side `batchSize` | -| [Predicates](/java/guides/core/predicates) | Gate an enqueue on a runtime condition | -| [Scheduling](/java/guides/core/scheduling) | Periodic tasks with cron expressions | -| [Cancellation](/java/guides/core/cancellation) | Cancel queued and in-flight jobs | -| [Streaming partial results](/java/guides/core/streaming) | Emit progress from a running task | + + + + + + + + + + + + diff --git a/docs/content/docs/java/guides/extensibility/index.mdx b/docs/content/docs/java/guides/extensibility/index.mdx index ea507a30..96d97448 100644 --- a/docs/content/docs/java/guides/extensibility/index.mdx +++ b/docs/content/docs/java/guides/extensibility/index.mdx @@ -5,9 +5,25 @@ description: "Extend the Java SDK at every stage of the task lifecycle." Extend taskito with custom behavior at every stage of the task lifecycle. -| Guide | Description | -|---|---| -| [Events](/java/guides/extensibility/events) | Subscribe to job outcome events on the worker | -| [Middleware](/java/guides/extensibility/middleware) | Wrap task execution with before/after/error and outcome hooks | -| [Webhooks](/java/guides/extensibility/webhooks) | Push signed notifications to external services | -| [Pluggable Serializers](/java/guides/extensibility/serializers) | Custom payload serialization — MessagePack, codecs, encryption | + + + + + + diff --git a/docs/content/docs/java/guides/integrations/index.mdx b/docs/content/docs/java/guides/integrations/index.mdx index 03e60cc8..866f6bd0 100644 --- a/docs/content/docs/java/guides/integrations/index.mdx +++ b/docs/content/docs/java/guides/integrations/index.mdx @@ -25,9 +25,25 @@ implementation("io.sentry:sentry:7.14.0") // contrib.SentryM ## Framework -- [Spring Boot](/java/guides/integrations/spring) — auto-configured `Taskito` bean from `taskito.*` properties. + + + ## Observability -- [Micrometer](/java/guides/integrations/micrometer) — one `Observation` per execution: a timer plus a trace span. -- [Sentry](/java/guides/integrations/sentry) — capture handler exceptions and dead-letters. + + + + diff --git a/docs/content/docs/java/guides/observability/index.mdx b/docs/content/docs/java/guides/observability/index.mdx index f0cdf56f..9a44ce61 100644 --- a/docs/content/docs/java/guides/observability/index.mdx +++ b/docs/content/docs/java/guides/observability/index.mdx @@ -7,10 +7,18 @@ See what the queue is doing — counts, per-execution metrics, live workers, per-job logs — and emit structured logs, all from the `Taskito` handle with no extra service. -| Page | What it covers | -|---|---| -| [Monitoring](/java/guides/observability/monitoring) | Stats, per-execution metrics, worker heartbeats, Micrometer/Sentry pointers | -| [Logging](/java/guides/observability/logging) | The built-in leveled logger and per-job task logs — levels, pluggable sink | + + + + Lifecycle [events](/java/guides/extensibility/events) and diff --git a/docs/content/docs/java/guides/operations/index.mdx b/docs/content/docs/java/guides/operations/index.mdx index 84586987..048d85e1 100644 --- a/docs/content/docs/java/guides/operations/index.mdx +++ b/docs/content/docs/java/guides/operations/index.mdx @@ -5,17 +5,65 @@ description: "Run the Java SDK reliably in production — deployment, scaling, i Run taskito reliably in production. -| Guide | Description | -|---|---| -| [Backends](/java/guides/operations/backends) | SQLite, Postgres, and Redis — setup and trade-offs | -| [Job Management](/java/guides/operations/inspection) | Inspect, cancel, replay, and clean up jobs | -| [Dashboard](/java/guides/operations/dashboard) | Serve the bundled web dashboard and its REST API | -| [SSO (OAuth & OIDC)](/java/guides/operations/sso) | Google, GitHub, and OIDC sign-in for the dashboard | -| [Mesh Scheduling](/java/guides/operations/mesh) | Decentralized work-stealing across worker nodes | -| [Autoscaling](/java/guides/operations/autoscaling) | In-process thread autoscaling and the KEDA scaler endpoint | -| [CLI](/java/guides/operations/cli) | Operate the queue from the terminal | -| [Testing](/java/guides/operations/testing) | The in-memory backend and integration patterns | -| [Security](/java/guides/operations/security) | Signing, encryption, and dashboard auth | -| [Troubleshooting](/java/guides/operations/troubleshooting) | Diagnose stuck jobs and worker issues | -| [Deployment](/java/guides/operations/deployment) | Process model, packaging, and graceful shutdown | -| [GraalVM Native Image](/java/guides/operations/graalvm) | Compile applications to a native binary | + + + + + + + + + + + + + + diff --git a/docs/content/docs/java/guides/reliability/index.mdx b/docs/content/docs/java/guides/reliability/index.mdx index 1a724916..5777e0d3 100644 --- a/docs/content/docs/java/guides/reliability/index.mdx +++ b/docs/content/docs/java/guides/reliability/index.mdx @@ -5,14 +5,50 @@ description: "Harden your Java task queue for production workloads." Harden your task queue for production workloads. -| Guide | Description | -|---|---| -| [Error Handling](/java/guides/reliability/error-handling) | Task failure lifecycle, error inspection, the exception hierarchy | -| [Delivery Guarantees](/java/guides/reliability/guarantees) | At-least-once delivery and exactly-once patterns | -| [Retries](/java/guides/reliability/retries) | Automatic retries with exponential backoff | -| [Timeouts](/java/guides/reliability/timeouts) | Bound task runtime per execution attempt | -| [Idempotency](/java/guides/reliability/idempotency) | Deduplicate enqueues with unique keys | -| [Rate Limiting](/java/guides/reliability/rate-limiting) | Throttle and defer enqueues with gates | -| [Concurrency](/java/guides/reliability/concurrency) | Size and autoscale the worker's handler pool | -| [Dead-letter queue](/java/guides/reliability/dead-letter) | Capture and replay exhausted jobs | -| [Distributed Locking](/java/guides/reliability/locks) | Mutual exclusion across workers with database-backed locks | + + + + + + + + + + + diff --git a/docs/content/docs/java/guides/resources/index.mdx b/docs/content/docs/java/guides/resources/index.mdx index 59bbe8cc..290fe225 100644 --- a/docs/content/docs/java/guides/resources/index.mdx +++ b/docs/content/docs/java/guides/resources/index.mdx @@ -22,14 +22,38 @@ try (Taskito queue = Taskito.builder().sqlite("tasks.db").open()) { } ``` -| Page | What it covers | -|---|---| -| [Dependency injection](/java/guides/resources/dependency-injection) | `Taskito.resource()`, the five scopes, `Resources.use`, annotation-driven injection, teardown, metrics | -| [Configuration](/java/guides/resources/configuration) | The `resource()` overloads, choosing a scope, teardown, and `PoolConfig` tuning | -| [Enqueue interception](/java/guides/resources/interception) | `Interceptor` strategies and the `onEnqueue` hook — validate, rewrite, redirect, and reject jobs before serialization | -| [Resource proxies](/java/guides/resources/proxies) | Signed `ProxyRef`s for non-serializable values — HMAC signing, TTL, purpose binding, sessions | -| [Observability](/java/guides/resources/observability) | Reading `resourceMetrics()` — created/disposed/active counters | -| [Testing](/java/guides/resources/testing) | Registering stub resources with `InMemoryTaskito` | + + + + + + + + ## The five scopes diff --git a/docs/content/docs/node/guides/core/index.mdx b/docs/content/docs/node/guides/core/index.mdx index 18933667..448d46fc 100644 --- a/docs/content/docs/node/guides/core/index.mdx +++ b/docs/content/docs/node/guides/core/index.mdx @@ -5,14 +5,50 @@ description: "The building blocks of every Node.js taskito application." The building blocks of every taskito application. -| Guide | Description | -|---|---| -| [Tasks](/node/guides/core/tasks) | Register tasks with `queue.task()`, configure retries, timeouts, and options | -| [Queues & Priority](/node/guides/core/queues) | Named queues, priority levels, and routing | -| [Workers](/node/guides/core/workers) | Start workers, control concurrency, graceful shutdown | -| [Execution Models](/node/guides/core/execution-model) | How tasks move from enqueue to completion | -| [Enqueue options](/node/guides/core/enqueue-options) | Per-job delay, priority, uniqueness, and metadata | -| [Predicates](/node/guides/core/predicates) | Gate an enqueue on a runtime condition | -| [Scheduling](/node/guides/core/scheduling) | Periodic tasks with cron expressions | -| [Cancellation](/node/guides/core/cancellation) | Cancel queued and in-flight jobs | -| [Streaming partial results](/node/guides/core/streaming) | Emit progress from a running task | + + + + + + + + + + + diff --git a/docs/content/docs/node/guides/extensibility/index.mdx b/docs/content/docs/node/guides/extensibility/index.mdx index d7975634..8b0e7d5e 100644 --- a/docs/content/docs/node/guides/extensibility/index.mdx +++ b/docs/content/docs/node/guides/extensibility/index.mdx @@ -5,9 +5,25 @@ description: "Extend the Node.js SDK at every stage of the task lifecycle." Extend taskito with custom behavior at every stage of the task lifecycle. -| Guide | Description | -|---|---| -| [Events](/node/guides/extensibility/events) | Subscribe to queue and worker lifecycle events | -| [Per-Task Middleware](/node/guides/extensibility/middleware) | Wrap task execution with before/after/error hooks | -| [Webhooks](/node/guides/extensibility/webhooks) | Push signed notifications to external services | -| [Pluggable Serializers](/node/guides/extensibility/serializers) | Custom payload serialization — msgpack, encryption | + + + + + + diff --git a/docs/content/docs/node/guides/integrations/index.mdx b/docs/content/docs/node/guides/integrations/index.mdx index b6c598fc..f0fb2d79 100644 --- a/docs/content/docs/node/guides/integrations/index.mdx +++ b/docs/content/docs/node/guides/integrations/index.mdx @@ -25,12 +25,40 @@ pnpm add @nestjs/common reflect-metadata # taskito/contrib/nest ## Observability -- [OpenTelemetry](/node/guides/integrations/otel) — one span per execution attempt. -- [Prometheus](/node/guides/integrations/prometheus) — execution metrics + polled depth gauges. -- [Sentry](/node/guides/integrations/sentry) — capture the original exception on dead-letter. + + + + + ## Web frameworks -- [Express](/node/guides/integrations/express) — REST router + dashboard mount. -- [Fastify](/node/guides/integrations/fastify) — REST + dashboard plugins. -- [NestJS](/node/guides/integrations/nest) — injectable `TaskitoService`. + + + + + diff --git a/docs/content/docs/node/guides/observability/index.mdx b/docs/content/docs/node/guides/observability/index.mdx index 2c342e77..8d01d01e 100644 --- a/docs/content/docs/node/guides/observability/index.mdx +++ b/docs/content/docs/node/guides/observability/index.mdx @@ -7,10 +7,18 @@ See what the queue is doing — counts, per-task latency, job progress, live workers — and emit structured logs, all from the `Queue` handle with no extra service. -| Page | What it covers | -|---|---| -| [Monitoring](/node/guides/observability/monitoring) | Stats, per-task metrics, progress, worker heartbeats, Prometheus/OTel/Sentry pointers | -| [Logging](/node/guides/observability/logging) | The built-in leveled logger — levels, namespaces, pluggable sink | + + + + Lifecycle [events](/node/guides/extensibility/events) and diff --git a/docs/content/docs/node/guides/operations/index.mdx b/docs/content/docs/node/guides/operations/index.mdx index 8f666d89..3250bc34 100644 --- a/docs/content/docs/node/guides/operations/index.mdx +++ b/docs/content/docs/node/guides/operations/index.mdx @@ -5,17 +5,65 @@ description: "Run the Node.js SDK reliably in production — deployment, scaling Run taskito reliably in production. -| Guide | Description | -|---|---| -| [Backends](/node/guides/operations/backends) | SQLite, Postgres, and Redis — setup and trade-offs | -| [Job Management](/node/guides/operations/inspection) | Inspect, cancel, replay, and clean up jobs | -| [Dashboard](/node/guides/operations/dashboard) | Serve the web dashboard from a Node worker | -| [Dashboard REST API](/node/guides/operations/dashboard-api) | The JSON API behind the dashboard | -| [Mesh Scheduling](/node/guides/operations/mesh) | Decentralized work-stealing across worker nodes | -| [KEDA Autoscaling](/node/guides/operations/keda) | Kubernetes event-driven autoscaling from queue depth | -| [CLI](/node/guides/operations/cli) | Manage queues and workers from the command line | -| [Testing](/node/guides/operations/testing) | Test mode, fixtures, and mocking | -| [Security](/node/guides/operations/security) | Signing, encryption, and dashboard auth | -| [Troubleshooting](/node/guides/operations/troubleshooting) | Diagnose stuck jobs and worker issues | -| [Deployment](/node/guides/operations/deployment) | Docker, process managers, and production checklists | -| [Migrating from BullMQ](/node/guides/operations/migration) | Side-by-side comparison and migration guide | + + + + + + + + + + + + + + diff --git a/docs/content/docs/node/guides/reliability/index.mdx b/docs/content/docs/node/guides/reliability/index.mdx index d0d009ef..cdf45588 100644 --- a/docs/content/docs/node/guides/reliability/index.mdx +++ b/docs/content/docs/node/guides/reliability/index.mdx @@ -5,15 +5,55 @@ description: "Harden your Node.js task queue for production workloads." Harden your task queue for production workloads. -| Guide | Description | -|---|---| -| [Error Handling](/node/guides/reliability/error-handling) | Task failure lifecycle, error inspection, debugging patterns | -| [Delivery Guarantees](/node/guides/reliability/guarantees) | At-least-once delivery and exactly-once patterns | -| [Retries](/node/guides/reliability/retries) | Automatic retries with exponential backoff | -| [Timeouts](/node/guides/reliability/timeouts) | Bound task runtime and reclaim stalled jobs | -| [Idempotency](/node/guides/reliability/idempotency) | Deduplicate enqueues with unique keys | -| [Rate Limiting](/node/guides/reliability/rate-limiting) | Throttle task execution with token-bucket limits | -| [Concurrency](/node/guides/reliability/concurrency) | Cap how many jobs of a task run at once | -| [Circuit Breakers](/node/guides/reliability/circuit-breakers) | Protect downstream services from cascading failures | -| [Dead-letter queue](/node/guides/reliability/dead-letter) | Capture and replay exhausted jobs | -| [Distributed Locking](/node/guides/reliability/locks) | Mutual exclusion across workers with database-backed locks | + + + + + + + + + + + + diff --git a/docs/content/docs/node/guides/resources/index.mdx b/docs/content/docs/node/guides/resources/index.mdx index 41176e46..93a5a7dd 100644 --- a/docs/content/docs/node/guides/resources/index.mdx +++ b/docs/content/docs/node/guides/resources/index.mdx @@ -21,10 +21,18 @@ queue.task("sync", async (id: string) => { }); ``` -| Page | What it covers | -|---|---| -| [Dependency injection](/node/guides/resources/dependency-injection) | `queue.resource()`, worker/task/pooled scopes, `useResource`, declarative `inject`, teardown | -| [Enqueue interception](/node/guides/resources/interception) | The `onEnqueue` hook — validate, redact, and rewrite jobs before serialization | + + + + Coming from Python? Node's resource system is intentionally lighter — no diff --git a/docs/content/docs/node/guides/workflows/index.mdx b/docs/content/docs/node/guides/workflows/index.mdx index b5898a6a..0613ebc2 100644 --- a/docs/content/docs/node/guides/workflows/index.mdx +++ b/docs/content/docs/node/guides/workflows/index.mdx @@ -3,9 +3,6 @@ title: Workflows description: "Orchestrate multi-step DAGs in Node.js with the Taskito workflow builder." --- -import { Cards, Card } from "fumadocs-ui/components/card"; -import { Callout } from "fumadocs-ui/components/callout"; - Orchestrate multi-step DAGs (directed acyclic graphs — steps with dependencies and no cycles) where each step is a registered task and `after` declares its dependencies. The Rust core schedules steps in topological order; a worker diff --git a/docs/content/docs/python/guides/advanced-execution/index.mdx b/docs/content/docs/python/guides/advanced-execution/index.mdx index addfcaba..c6b87cbd 100644 --- a/docs/content/docs/python/guides/advanced-execution/index.mdx +++ b/docs/content/docs/python/guides/advanced-execution/index.mdx @@ -5,11 +5,35 @@ description: "Patterns for scaling and optimizing task execution." Patterns for scaling and optimizing task execution. -| Guide | Description | -|---|---| -| [Prefork Pool](/python/guides/advanced-execution/prefork) | Process-based isolation for CPU-bound or memory-leaking tasks | -| [Native Async Tasks](/python/guides/advanced-execution/async-tasks) | `async def` tasks with native event loop integration | -| [Result Streaming](/python/guides/advanced-execution/streaming) | Stream partial results and progress updates in real time | -| [Dependencies](/python/guides/advanced-execution/dependencies) | DAG-based job dependencies — run tasks in order | -| [Batch Enqueue](/python/guides/advanced-execution/batch-enqueue) | Enqueue many jobs efficiently with `task.map()` and `enqueue_many()` | -| [Unique Tasks](/python/guides/advanced-execution/unique-tasks) | Deduplicate active jobs with unique keys | + + + + + + + + diff --git a/docs/content/docs/python/guides/core/index.mdx b/docs/content/docs/python/guides/core/index.mdx index cbd88918..a873b62f 100644 --- a/docs/content/docs/python/guides/core/index.mdx +++ b/docs/content/docs/python/guides/core/index.mdx @@ -5,13 +5,45 @@ description: "The building blocks of every taskito application." The building blocks of every taskito application. -| Guide | Description | -|---|---| -| [Tasks](/python/guides/core/tasks) | Define tasks with `@queue.task()`, configure retries, timeouts, and options | -| [Workers](/python/guides/core/workers) | Start workers, control concurrency, graceful shutdown | -| [Execution Models](/python/guides/core/execution-model) | How tasks move from enqueue to completion | -| [Queues & Priority](/python/guides/core/queues) | Named queues, priority levels, and routing | -| [Scheduling](/python/guides/core/scheduling) | Periodic tasks with cron expressions | -| [Predicates](/python/guides/core/predicates) | Gate execution with a serializable predicate DSL — time windows, feature flags | -| [Task Batching](/python/guides/core/batching) | Collect many small calls into a single job | -| [Workflows](/python/guides/core/workflows) | Chains, groups, and chords for multi-step pipelines | + + + + + + + + + + diff --git a/docs/content/docs/python/guides/dashboard/index.mdx b/docs/content/docs/python/guides/dashboard/index.mdx index 516816f7..8d2c49b1 100644 --- a/docs/content/docs/python/guides/dashboard/index.mdx +++ b/docs/content/docs/python/guides/dashboard/index.mdx @@ -3,9 +3,6 @@ title: Overview description: "Zero-dependency built-in web UI for browsing jobs, configuring webhooks, tuning per-task runtime limits, and managing the queue." --- -import { Callout } from "fumadocs-ui/components/callout"; -import { Tab, Tabs } from "fumadocs-ui/components/tabs"; - taskito ships with a built-in web dashboard for monitoring jobs, inspecting dead letters (the DLQ — a holding area for jobs that exhausted their retries), configuring webhooks, tuning per-task runtime limits, and managing your task queue in real time. The dashboard is a single-page @@ -17,6 +14,31 @@ dependencies required**. ![Overview page with stats cards, throughput chart, and recent activity](/screenshots/dashboard/overview.png) +## In this section + + + + + + + + ## Launching the dashboard diff --git a/docs/content/docs/python/guides/extensibility/index.mdx b/docs/content/docs/python/guides/extensibility/index.mdx index cb317909..667f6a8e 100644 --- a/docs/content/docs/python/guides/extensibility/index.mdx +++ b/docs/content/docs/python/guides/extensibility/index.mdx @@ -5,8 +5,20 @@ description: "Extend taskito at every stage of the task lifecycle." Extend taskito with custom behavior at every stage of the task lifecycle. -| Guide | Description | -|---|---| -| [Middleware](/python/guides/extensibility/middleware) | Hook into task execution with `before`, `after`, `on_retry`, and more | -| [Serializers](/python/guides/extensibility/serializers) | Custom payload serialization — msgpack, orjson, encryption | -| [Events & Webhooks](/python/guides/extensibility/events-webhooks) | React to queue events and push notifications to external services | + + + + + diff --git a/docs/content/docs/python/guides/index.mdx b/docs/content/docs/python/guides/index.mdx index 413886be..d0497801 100644 --- a/docs/content/docs/python/guides/index.mdx +++ b/docs/content/docs/python/guides/index.mdx @@ -14,6 +14,7 @@ import { Workflow, Plug, Puzzle, + LayoutDashboard, } from "lucide-react"; Pick the topic you're working through. Each guide is self-contained, with code @@ -52,6 +53,12 @@ overview of everything taskito does, see href="/python/guides/observability" description="Metrics, logs, dashboard, OpenTelemetry, Sentry, Prometheus." /> + } + title="Dashboard" + href="/python/guides/dashboard" + description="Built-in web UI — browse jobs, configure webhooks, tune per-task limits, manage the queue." + /> } title="Resources" diff --git a/docs/content/docs/python/guides/integrations/index.mdx b/docs/content/docs/python/guides/integrations/index.mdx index 94ba9e38..447e124b 100644 --- a/docs/content/docs/python/guides/integrations/index.mdx +++ b/docs/content/docs/python/guides/integrations/index.mdx @@ -30,15 +30,43 @@ tools. Install only what you need. ## Framework integrations -- **[Flask](/python/guides/integrations/flask)** — full Flask extension with app config, factory pattern, and CLI commands -- **[FastAPI](/python/guides/integrations/fastapi)** — pre-built `APIRouter` with job status, SSE progress, and DLQ management -- **[Django](/python/guides/integrations/django)** — admin views for browsing jobs, dead letters, and queue stats + + + + + ## Observability integrations -- **[OpenTelemetry](/python/guides/integrations/otel)** — distributed tracing with per-task spans -- **[Prometheus](/python/guides/integrations/prometheus)** — counters, histograms, and gauges for task execution -- **[Sentry](/python/guides/integrations/sentry)** — automatic error capture with task context + + + + + ## Combining integrations diff --git a/docs/content/docs/python/guides/observability/index.mdx b/docs/content/docs/python/guides/observability/index.mdx index 5fb72fa6..f21f50b7 100644 --- a/docs/content/docs/python/guides/observability/index.mdx +++ b/docs/content/docs/python/guides/observability/index.mdx @@ -5,11 +5,23 @@ description: "Monitor, log, and inspect your task queue in real time." Monitor, log, and inspect your task queue in real time. -| Guide | Description | -|---|---| -| [Monitoring & Hooks](/python/guides/observability/monitoring) | Queue stats, progress tracking, worker heartbeat, and alerting hooks | -| [Structured Logging](/python/guides/observability/logging) | Per-task structured logs with automatic context | -| [Structured Notes](/python/guides/observability/notes) | Operator-visible metadata attached to individual jobs | + + + + + For the built-in web UI, see the [Dashboard](/python/guides/dashboard) section — it covers the browser app, password and SSO login, runtime task/queue diff --git a/docs/content/docs/python/guides/operations/index.mdx b/docs/content/docs/python/guides/operations/index.mdx index b618fe97..5c47f1cb 100644 --- a/docs/content/docs/python/guides/operations/index.mdx +++ b/docs/content/docs/python/guides/operations/index.mdx @@ -6,16 +6,60 @@ description: "Run taskito reliably in production — testing, deployment, scalin Run taskito reliably in production — with no Redis or RabbitMQ broker to operate, just an embedded SQLite file or a Postgres instance. -| Guide | Description | -|---|---| -| [Testing](/python/guides/operations/testing) | Test mode, fixtures, mocking resources, and workflow testing | -| [Job Management](/python/guides/operations/job-management) | Cancel, pause, archive, revoke, replay, and clean up jobs | -| [Troubleshooting](/python/guides/operations/troubleshooting) | Diagnose stuck jobs, lock contention, and worker issues | -| [Security](/python/guides/operations/security) | Serializer signing/encryption, dashboard auth, and SSRF guards | -| [Deployment](/python/guides/operations/deployment) | systemd, Docker, WAL mode, Postgres, and production checklists | -| [Mesh Scheduling](/python/guides/operations/mesh) | Decentralized multi-worker work-stealing overlay | -| [Bare-Metal Autoscaler](/python/guides/operations/autoscaler) | Automatically scale worker processes without Kubernetes | -| [KEDA Autoscaling](/python/guides/operations/keda) | Kubernetes event-driven autoscaling for workers | -| [Postgres Backend](/python/guides/operations/postgres) | Set up and run taskito with PostgreSQL | -| [Migrating from Celery](/python/guides/operations/migration) | Side-by-side comparison and step-by-step migration guide | -| [Upgrading to 0.15](/python/guides/operations/upgrading-0.15) | Breaking changes and migration steps for the 0.15 release | + + + + + + + + + + + + + diff --git a/docs/content/docs/python/guides/reliability/index.mdx b/docs/content/docs/python/guides/reliability/index.mdx index 785af148..cfe3b96d 100644 --- a/docs/content/docs/python/guides/reliability/index.mdx +++ b/docs/content/docs/python/guides/reliability/index.mdx @@ -5,12 +5,40 @@ description: "Harden your task queue for production workloads." Harden your task queue for production workloads. -| Guide | Description | -|---|---| -| [Retries & Dead Letters](/python/guides/reliability/retries) | Automatic retries with exponential backoff, dead letter queue | -| [Error Handling](/python/guides/reliability/error-handling) | Task failure lifecycle, error inspection, debugging patterns | -| [Delivery Guarantees](/python/guides/reliability/guarantees) | At-least-once delivery, idempotency, and exactly-once patterns | -| [Idempotency](/python/guides/reliability/idempotency) | Auto-derived dedup keys — identical enqueues coalesce to one execution | -| [Rate Limiting](/python/guides/reliability/rate-limiting) | Throttle task execution with token bucket rate limits | -| [Circuit Breakers](/python/guides/reliability/circuit-breakers) | Protect downstream services from cascading failures | -| [Distributed Locking](/python/guides/reliability/locking) | Mutual exclusion across workers with database-backed locks | + + + + + + + + + diff --git a/docs/content/docs/python/guides/resources/index.mdx b/docs/content/docs/python/guides/resources/index.mdx index 188c868d..8d8f161f 100644 --- a/docs/content/docs/python/guides/resources/index.mdx +++ b/docs/content/docs/python/guides/resources/index.mdx @@ -101,11 +101,35 @@ taskito worker --app myapp.tasks:queue ## Section overview -| Page | What it covers | -|---|---| -| [Argument Interception](/python/guides/resources/interception) | Modes, strategies, custom types, `analyze()`, metrics | -| [Dependency Injection](/python/guides/resources/dependency-injection) | `worker_resource()`, scopes, dependencies, teardown, health checks | -| [Resource Proxies](/python/guides/resources/proxies) | Built-in handlers, HMAC signing, security, `NoProxy`, cloud handlers | -| [Configuration](/python/guides/resources/configuration) | TOML config, pool tuning, frozen and reloadable resources, hot reload | -| [Testing](/python/guides/resources/testing) | `test_mode(resources=)`, `MockResource`, pytest fixtures | -| [Observability](/python/guides/resources/observability) | Prometheus metrics, dashboard endpoints, CLI commands | + + + + + + + + diff --git a/docs/content/docs/python/guides/workflows/index.mdx b/docs/content/docs/python/guides/workflows/index.mdx index 234cf739..ca4da25c 100644 --- a/docs/content/docs/python/guides/workflows/index.mdx +++ b/docs/content/docs/python/guides/workflows/index.mdx @@ -64,13 +64,45 @@ in `wf.step(...)`. To pass a value between steps, use fan-out / fan-in or read ## Section overview -| Page | What it covers | -|---|---| -| [Building Workflows](/python/guides/workflows/building) | `Workflow.step()`, decorator pattern, step configuration, DAG structure | -| [Fan-Out & Fan-In](/python/guides/workflows/fan-out) | Splitting results into parallel jobs, collecting with aggregation | -| [Conditions & Error Handling](/python/guides/workflows/conditions) | `on_success`, `on_failure`, `always`, callable conditions, `on_failure` modes | -| [Approval Gates](/python/guides/workflows/gates) | Human-in-the-loop pause/resume, timeout, approve/reject API | -| [Sub-Workflows & Scheduling](/python/guides/workflows/composition) | Nesting workflows, cron-scheduled runs | -| [Incremental Runs](/python/guides/workflows/caching) | Result hashing, `CACHE_HIT`, dirty-set propagation, TTL | -| [Analysis & Visualization](/python/guides/workflows/analysis) | Critical path, bottleneck analysis, Mermaid/DOT rendering | -| [Canvas Primitives](/python/guides/workflows/canvas) | Chain, group, chord — simple composition without DAGs | + + + + + + + + + +