Skip to content

End-to-end BGE runs 1–2 config and mount preflight - #492

Open
alxsmith wants to merge 8 commits into
mainfrom
490-end-to-end-bge-runs-1-2
Open

End-to-end BGE runs 1–2 config and mount preflight#492
alxsmith wants to merge 8 commits into
mainfrom
490-end-to-end-bge-runs-1-2

Conversation

@alxsmith

Copy link
Copy Markdown
Contributor

Overview

  • Wire BGE end-to-end run config for MD: electric tariff maps, null gas tariff, scenario capacity-MC paths, and default fixed-charge cleanup.
  • Fail fast when CAIRO would write under /data.sb while the s3fs mount is down (Justfile preflight + assert_output_dir_is_mounted in run_scenario.py, with tests).

Reviewer focus

  • Mount preflight: Justfile check vs Python path-aware check — intentional defense-in-depth so direct run_scenario.py invocations are still guarded.
  • BGE tariff maps and null gas tariff: confirm they match the intended run-1/run-2 assignment for md_20260732a_r1-style batches.

Non-obvious details

  • Delivery-only BGE scenario rows previously pointed path_supply_capacity_mc at NY zero parquet paths; corrected to MD.
  • CAIRO cannot write to s3:// directly (pathlib/open()), so outputs depend on /data.sb being mounted. Unmounted mounts previously caused silent local-disk writes.

Closes #490

Made with Cursor

alxsmith and others added 8 commits July 22, 2026 19:41
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
@alxsmith alxsmith linked an issue Jul 23, 2026 that may be closed by this pull request
@alxsmith
alxsmith requested a review from alexhyunminlee July 23, 2026 20:56
@alxsmith
alxsmith marked this pull request as ready for review July 23, 2026 20:56
@alexhyunminlee

Copy link
Copy Markdown
Collaborator

One small thing. For the precalc runs, could we change *_pc suffix at the end to just *_precalc? I was confused at first that this meant percustomer, and also just spelling out precalc matches the *_default naming patterns.

@alexhyunminlee

Copy link
Copy Markdown
Collaborator

Also, just so I'm on the same page, we don't have the hp_vs_nhp revenue requirement files and the tariff's yet, right? (because this PR is jsut for runs 1+2) Or are they missing from this PR?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just flagging something that caused me some headache from the NY/RI days: here, the name of the file goes *_calibrated_supply.csv, but the content of the files here (which represent the name of the tariff jsons) goes *_supply_calibrated. Same goes for the other calibrated supply type maps below (e.g. bge_hp_seasonal_calibrated_supply.csv. It might be a good idea to standardize this order throughout so we don't run into unexpected naming errors later on.

@alexhyunminlee alexhyunminlee left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me overall, minor question/comments above.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

End to End BGE runs 1 & 2

2 participants