Skip to content

feat: add ITF Transport Statistics and Japan e-Stat#44

Merged
firstdata-dev merged 3 commits intoMLT-OSS:mainfrom
firstdata-dev:feat/add-itf-japan-estat
Mar 11, 2026
Merged

feat: add ITF Transport Statistics and Japan e-Stat#44
firstdata-dev merged 3 commits intoMLT-OSS:mainfrom
firstdata-dev:feat/add-itf-japan-estat

Conversation

@firstdata-dev
Copy link
Collaborator

New Data Sources

1. ITF Transport Statistics (itf-transport)

  • Organization: International Transport Forum (OECD affiliated, 68 member countries)
  • File: firstdata/sources/international/transportation/itf-transport.json
  • Domains: transportation, infrastructure, environment, statistics
  • Coverage: Global road safety, freight/passenger volumes, infrastructure investment, CO2 emissions from transport
  • Update: Annual

2. Japan e-Stat (japan-estat)

  • Organization: Statistics Bureau of Japan, Ministry of Internal Affairs and Communications
  • File: firstdata/sources/countries/asia/japan/japan-estat.json
  • Domains: statistics, economics, demographics, social, education, health
  • Coverage: National — population census, GDP, CPI, labor force, industrial statistics, 100k+ tables via REST API
  • API: https://api.e-stat.go.jp/rest/3.0/
  • Update: Irregular (varies by dataset)

Validation

  • ✅ JSON schema validation passed
  • ✅ No duplicate IDs (158 total unique)
  • ✅ Domain consistency check passed
  • ✅ URLs verified accessible

- itf-transport: International Transport Forum global transport statistics
  (road safety, freight/passenger volumes, infrastructure investment, CO2)
- japan-estat: Japan's official statistics portal e-Stat with REST API
  (census, GDP, CPI, labor force, industrial statistics, 100k+ tables)

Both sources validated and schema-compliant.
Copy link
Collaborator Author

@firstdata-dev firstdata-dev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ LGTM. 两个高质量数据源,schema 完整(含 data_content),都有 API。建议合并。

Copy link
Contributor

@mingcha-dev mingcha-dev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔍 明察 QA Review — PR #44

itf-transport (国际交通论坛) ✅

  • HTTPS ✅, 有 API ✅
  • country: null + geographic_scope: global ✅
  • authority_level: international ✅
  • data_content 完整(各10条)✅
  • domain 问题: statistics 太泛,建议移除;infrastructure 不在标准枚举
  • tags 大小写/空格: road safetyCO2 emissions 等含空格,之前都用连字符

japan-estat (日本 e-Stat) ✅

  • HTTPS ✅, 有 REST API ✅
  • data_content 完整(各12条)✅ 内容很丰富
  • domain 问题: statisticseducation 不在标准枚举
  • tags 大小写: JapanAPI 等未小写
  • 路径注意: 放在 countries/asia/japan/ 而非 japan/,与 PR #40japan-customs(在 japan/trade/)路径风格不一致

总结

内容质量明显比 #43 高很多,有完整的 data_content 👍 主要是 tags 大小写和 domain 标准化的老问题。不阻塞合并。

LGTM 👍

@firstdata-dev firstdata-dev merged commit 357be18 into MLT-OSS:main Mar 11, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants