Add six real-world large-data notebooks

[Alek99]

Summary

• add six Jupyter notebooks covering Gaia DR3, gnomAD v4.1, Pan-UKBB, Dukascopy FX ticks, GWOSC GW150914 strain, and NYC TLC taxi pickups
• exercise XY scatter density, logarithmic axes, M4 line decimation, hexbin aggregation, and faceting on recognizable real-world workloads
• art-direct every example with a distinct, data-appropriate visual system: cosmic observatory, clinical genomic atlas, warm biobank editorial, institutional trading terminal, signal-lab oscilloscope, and night cartography
• add a labeled 3×2 screenshot gallery to the root README, with an explicit notebook link and featured workload count beneath every title
• link every dataset to its public source while keeping downloaded data and indexes out of Git

Design and data-integrity details

• all six gallery previews use the same 1200×700 canvas, with balanced padding and collision-free labels at both native and gallery size
• gallery cards report 250,000 stars, 164,000 gnomAD variants, 814,294 Pan-UKBB variants, 101,427 FX ticks, 16,777,216 LIGO raw samples / 3,441 reconstruction samples shown, and 300,000 taxi pickup records
• Gaia uses an editorial title hierarchy, larger annotated stellar populations, and an unobstructed density field
• gnomAD uses alternating clinical chromosome lanes and a computed rare-variant focal statistic without a redundant colorbar
• Pan-UKBB preserves the complete linear −log10(P) scale and labels the two actual leading loci
• Dukascopy uses subdued session bands, computed daily movement, four-decimal ticks, and one safely padded last-price tag
• LIGO retains the full 16.8M-sample raw M4 overview, adds a clearly labeled 35–350 Hz detector detail, and uses GWOSC's official Hanford template reconstruction for the signal-first hero
• NYC applies a local longitude projection at 40.75° N, preserves equal geographic scale in the landscape frame, labels ln(1 + pickups / hex) precisely, and adds restrained geographic callouts without a basemap

Why

ENG-10523 calls for six real-world examples that demonstrate XY on large, recognizable datasets. These notebooks make the examples copyable, scalable, and presentation-ready without adding source datasets to the repository.

Linear: https://linear.app/reflex-dev/issue/ENG-10523/come-up-with-a-list-of-6-real-world-examples

Validation

• make check-examples — 9 passed, 2 skipped
• ruff check examples/real_world/*.ipynb
• ruff format --check examples/real_world/*.ipynb
• executed live acquisition/schema probes against all six official sources
• rendered and independently reviewed all six PNGs at native and 50% gallery size
• verified the root gallery renders as three columns by two rows with six valid image and notebook targets
• verified every preview is a valid 1200×700 PNG with at least 17 px of non-frame content clearance on every edge
• verified all notebooks are output-free and no raw-data files are present under examples/real_world

Summary by CodeRabbit

• New Features

  • Added six real-world Jupyter notebook examples featuring interactive visualizations of astronomy, genetics, genomics, finance, gravitational waves, and NYC taxi data.
  • Added documentation with dataset links, setup guidance, workload controls, and rendered chart examples.
  • Added caching guidance for downloaded example data.

• Documentation

  • Added an examples section to the main README showcasing the new visualizations.

[linear-code]

ENG-10523

[coderabbitai]

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: dfc8d002-f639-450d-8414-e12c4c0d6737

📥 Commits

Reviewing files that changed from the base of the PR and between a7239b9 and e710597.

⛔ Files ignored due to path filters (6)

• examples/real_world/assets/01-gaia-hr-diagram.png is excluded by !**/*.png
• examples/real_world/assets/02-gnomad-allele-frequency.png is excluded by !**/*.png
• examples/real_world/assets/03-pan-ukbb-manhattan.png is excluded by !**/*.png
• examples/real_world/assets/04-dukascopy-fx-ticks.png is excluded by !**/*.png
• examples/real_world/assets/05-ligo-gw150914-strain.png is excluded by !**/*.png
• examples/real_world/assets/06-nyc-taxi-density.png is excluded by !**/*.png

📒 Files selected for processing (9)

• README.md
• examples/real_world/.gitignore
• examples/real_world/01_gaia_hr_diagram.ipynb
• examples/real_world/02_gnomad_allele_frequency.ipynb
• examples/real_world/03_pan_ukbb_manhattan.ipynb
• examples/real_world/04_dukascopy_fx_ticks.ipynb
• examples/real_world/05_ligo_gw150914_strain.ipynb
• examples/real_world/06_nyc_taxi_density.ipynb
• examples/real_world/README.md

---

📝 Walkthrough

Walkthrough

Six real-world Jupyter notebooks were added for Gaia, gnomAD, Pan-UKBB, Dukascopy, LIGO, and NYC TLC datasets. They include cached acquisition, preprocessing, and interactive XY visualizations, with README documentation and ignored local data directories.

Changes

Real-world examples

Layer / File(s)	Summary
Examples documentation and cache setup README.md, examples/real_world/README.md, examples/real_world/.gitignore	Documents the six notebooks, datasets, setup, workload controls, screenshots, and local cache behavior; ignores examples/real_world/data/.
Gaia and gnomAD visualizations examples/real_world/01_gaia_hr_diagram.ipynb, examples/real_world/02_gnomad_allele_frequency.ipynb	Adds cached/query-based genomic data workflows and annotated density charts for Gaia DR3 and gnomAD allele frequencies.
Pan-UKBB and FX visualizations examples/real_world/03_pan_ukbb_manhattan.ipynb, examples/real_world/04_dukascopy_fx_ticks.ipynb	Adds tabix-backed GWAS extraction and BI5 FX tick decoding, followed by interactive Manhattan and time-series charts.
LIGO strain and waveform charts examples/real_world/05_ligo_gw150914_strain.ipynb	Adds GWOSC strain and reconstruction downloads, signal processing, and three annotated waveform visualizations.
NYC taxi density visualizations examples/real_world/06_nyc_taxi_density.ipynb	Adds paginated taxi-data acquisition, coordinate projection, shared chart helpers, and scatter, hexbin, and hourly facet views.

Estimated code review effort: 5 (Critical) | ~120 minutes

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch alek/eng-10523-real-world-notebooks

---

_{Comment @coderabbitai help to get the list of available commands.}

[codspeed-hq]

Merging this PR will not alter performance

✅ 102 untouched benchmarks
⏩ 2 skipped benchmarks¹

---

_{Comparing alek/eng-10523-real-world-notebooks (e710597) with main (a7239b9)}

Footnotes

1. 2 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩