Draft
Conversation
- This is an intermediate step that will be replaced by a gsheets loader in the future
gpgarner
requested changes
Jul 28, 2025
Collaborator
gpgarner
left a comment
There was a problem hiding this comment.
think we need to look at the csv, if it needs to be added
and also just decide if a dtype check is necessary on the column
gpgarner
reviewed
Jul 29, 2025
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Manual mappings and metadata:
resources/manual_chain_mappings.csvfor chain ID conflicts, display names, and provider entities.New ingestion assets:
l2beat_daily,defillama_daily,dune_daily,bq_op_stack_daily,bq_goldsky_daily) inchain_metadata.pyfor fetching and deduplicating chain data from sources like L2Beat, DefiLlama, Dune, and BigQuery.aggregated_dailyto combine data for daily partitioning and validation.CLI updates:
build_metadatacommand inapp.pyfor usability and logging, replacing the old command.chains_appTyper application for chain commands.Testing:
scripts/test_real_loaders.pyfor testing chain metadata with live data.Code organization:
app.pyby reorganizing modules.Summary: Updated mappings, ingestion assets, CLI, testing, and code structure for improved data management and usability.
Architecture: