Test suite v0.4 - #637

Merged

teocns merged 46 commits into

mainfrom

feat/optimal-test-suite

Jan 15, 2025

Commits on Jan 12, 2025

test: add `__init__` to make `tests/` a package
teocns
committed
051a85b
test: add llm_event_spy fixture for tests
teocns
committed
2d97251
test: add VCR.py fixture for HTTP interaction recording
teocns
committed
4a19dab
deps: group integration-testing
teocns
committed
51e2da2
test: add fixture to mock package availability in tests
teocns
committed
0180e2c
test: Add integration tests for OpenAI provider and features
teocns
committed
73a0110
test: add tests for concurrent API requests handling
teocns
committed
538bf98
Improve vcr.py configuration
teocns
committed
d679b93
ruff
teocns
committed
93744ce
chore(pyproject): update pytest options and loop scope
teocns
committed
512c95d
chore(tests): update vcr.py ignore_hosts and options
teocns
committed
e29d2b2
pyproject.toml
teocns
committed
8f02961
centralize teardown in conftest.py (clear singletons, end all sessions)
teocns
committed
a012a0f
change vcr_config scope to session
teocns
committed
f51850e
integration: auto start agentops session
teocns
committed
e22513b
Move unit tests to dedicated folder (tests/unit)
teocns
committed
cb014b2
Isolate vcr_config import into tests/integration
teocns
committed
2c3b19d
configure pytest to run only unit tests by default, and include integration tests only when explicitly specified.
teocns
committed
6dbe54b
ci(python-tests): separate job between unit-integration tests
teocns
committed
fb2be21
set python-tests timeout to 5 minutes
teocns
committed
caa08df
ruff
teocns
committed
120c455
Implement jwt fixture, centralized reusable mock_req into conftest.py
teocns
committed
37edbc0
ci(python-tests): simplify env management, remove cov from integration-teests
teocns
committed
6be254a
ruff
teocns
committed
4d0d5a2
fix: cassette for test_concurrent_api_requests
teocns
committed
2a860c8

Commits on Jan 13, 2025

Cleanup vcr.py comments
teocns
committed
e65f646
add a `TODO` for removing `vcrpy` git version after its release
dot-agi
committed
fa96e79
refactor openai assistants response handling for easier testing
dot-agi
committed
d83210b
add more keys for different llm providers
dot-agi
committed
751873b
add integration tests for other providers
dot-agi
committed
558848a
remove openai version limitation
dot-agi
committed
fa7325b
add providers as deps
dot-agi
committed
64ce1d0
chore: add mistralai to test dependencies
teocns
committed
9af78b9

Commits on Jan 14, 2025

remove `mistral` from dependency since its incorrect
dot-agi
committed
3af0cd6
ruff
dot-agi
committed
6b94f37
re-record cassettes
dot-agi
committed
80c6a07
tests/fixtures/providers: fallback to `test-api-key` if no provider is found
teocns
committed
bcac9b8
set keys for `litellm`
dot-agi
committed
3eb9bc9
Improve tests/integration/test_llm_providers.py openai assistants
teocns
committed
7a6ac5a
Make integration tests appropriately skip, regenerate x1 cassette
teocns
committed
6ea858c
explicit tests/integration/conftest finxtures import
teocns
committed
8f1a958

Commits on Jan 15, 2025