Skip to content

Write task logs to stdout for tasks run with KubernetesExecutor #46894

Description

@amoghrajesh

Body

We need to write the task logs from a task also to the stdout of the worker pods so that it can be streamed by the log reader and that can be shown to the UI as well.

Currently for non task sdk, it works by double logging -- both to the stdout as well as to the file. We should try and do the same for task sdk too. We’d have to write it ourselves, possibly make those log fn take multiple loggers to write too

Committer

  • I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Metadata

Metadata

Assignees

Labels

area:task-sdkpriority:highHigh priority bug that should be patched quickly but does not require immediate new releaseprovider:cncf-kubernetesKubernetes (k8s) provider related issues

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions