Add more provider module categories to the provider page#70190
Conversation
boring-cyborg
Bot
added
area:dev-tools
area:registry
backport-to-v3-3-test
| "dialect": { | ||
| "yaml_key": "dialects", | ||
| "level": "flat", | ||
| "suffixes": [], | ||
| "label": "Dialects", | ||
| "icon": "C", | ||
| }, |
There was a problem hiding this comment.
Queues look something like this:
And dialects look like this:
I'm a bit unsure about adding dialects, but I do think we should include queues.
I also considered removing all of these less common fields altogether, but in the end I decided to include them since they don't add much noise and may still be useful for some users.
There was a problem hiding this comment.
Aah Message Queues -- I think we should relabel it to "Message Queues" so folks aren't confused with things like "queue" argument on Base Operator.
https://airflow.apache.org/docs/apache-airflow-providers-common-messaging/stable/index.html
1bae222 to
e0be06b
Compare
| "secrets-backends": "secret", | ||
| "logging": "logging", | ||
| "executors": "executor", | ||
| "extra-links": "extra_link", |
There was a problem hiding this comment.
extract_versions.py doesn't read these CLASS_LEVEL_SECTIONS — it has its own hardcoded FQCN_SECTIONS (line 304) that still stops at notifications/secrets/logging/executors. So backfilled version pages won't show any of the new categories, only latest pages will. Was that intentional?
It'd be nice if extract_versions.py picked these up from here the way it already does with MODULE_LEVEL_SECTIONS.
extract_versions.py hardcoded a 4-entry FQCN_SECTIONS map, so backfilled (older) provider version pages only showed notifications, secrets backends, logging, and executors. The newer categories added for the provider page (extra links, queues, auth managers, db managers) only showed up on the latest version page, which used a separate code path already wired to all categories. extract_versions.py now derives its category list from CLASS_LEVEL_SECTIONS instead of duplicating it, and the category overrides that used to live only in extract_parameters.py move to a shared CLASS_LEVEL_CATEGORY_OVERRIDES constant so both scripts stay in sync going forward.
e0be06b to
a1ffe7e
Compare
4 participants
Why
Follow up of #70122. Extra links, queues, plugins, auth managers, DB managers, and dialects were not browsable in the registry
What
Add extra links, queues, plugins, auth managers, DB managers, and dialects. Each of them now gets it own category tab. The row now sorted by module count and tail collapses into a "More" menu so the page won't be too messy
Was generative AI tooling used to co-author this PR?
{pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.