v0.6.1

This release transitions to using a more formalized schema called Chronicle Schema

Schema-related changes

• Remove internal models (activity.rb, etc) and use models from Chronicle Core
• add global cli flags --schema and --format to control schema and serialization
• connector plugins transform to Chronicle Schema by default
• move responsibility of serialization to Chronicle Core

Other changes

• Use rubocop rules from chronicle-core
• Support multiple sequential transformations in a job
• Add buffer, fields_limit, filter_fields, filter, format (for serialization), sampler, sort, transformers

v0.5.5

• Add internal list of known plugins in #60 and chronicle-etl plugins:list shows all known plugins
• Coerce dates (from yml files) into Time objects #57
• Always write yml config with string keys
• Add list of connectors from available plugins to README

v0.5.4

• Adds authorizer feature (#51) for doing oauth flows for third-party providers. Plugins can now implement their own authorizers

v0.5.3

• Chronicle Schema: add analogous edge; add provider_namespace attribute (in which provider_id is unique within) (285b1db)
• Improve output when CLI run without flags (#44)
• Improve error handling for bad runs (#26)

v0.5.2

• add homebrew installation
• better UX for saving/using saved jobs
• fix json/csv output when using STDOUT (#31)
• add non-line-separated JSON loading (#43)

v0.5.0

• Better handling of non-installed plugins (#34)
• Add fuzzy durations for --since and --until (e.g. $ chronicle-etl --since 10d). #32
• Add secret management system #36
• Set config file permission to 0600 #40
• Add specs for config related stuff (using FakeFS)

v0.4.3

• improve handling of plugins failing to load

v0.4.2

• Revamp connector installation system to be oriented around plugins (f5bfcfc)
• Add numeric type to settings (setting :foo, type: :numeric)
• Add ability to disable color output (#19)
• Improve CSV, JSON loaders

v0.4.1

• Add --silent flag for setting log level to SILENT (#17)
• Add better support for jobs which preserve raw extraction data
• Add basic type coercion for configuration settings
• Make TableLoader default and remove StdoutLoader
• Improve CSV, file, and JSON extractors

v0.4.0

• Add Configurable mixin for extractor/transformer/loader classes that gives a common pattern for registering settings for classes

Test < Chronicle::ETL::Extractor
  include Chronicle::ETL::Configurable
  setting :when, type: :date, required: true
end

t = Test.new(when: '2022-02-24')
t.config.when

• Add connectors:show PHASE IDENTIFIER command to CLI
• Add specs for CLI and many internal classes; add Guardfile; integrate CI with Github Actions
• Set minimum Ruby version to 2.7
• Add universal flags for jobs:run for common extractor/transformer/loader options
  • --input
  • --until
  • --since
  • --limit
  • --output
  • --fields