Test Coverage¶
As of v0.7.3: 1389 passing, 102 skipped, 10 deselected (integration mark).
Skipped test categories¶
Bucket A — Optional dependency not installed (90 tests)¶
These tests skip automatically when optional packages are absent. They are correct behavior — each test runs when the optional dependency is installed.
| Optional package | Tests skipped | Test file(s) |
|---|---|---|
cedarpy |
35 | test_cedar_policy.py, test_phase2_govern.py, test_policy_protocol.py, test_phase2_cedar_engine.py, test_phase2_trifecta.py |
langgraph-checkpoint |
45 | test_phase7_langgraph.py |
opentelemetry-sdk |
0 (installed) | test_otel_bridge_conformance.py |
Install all optional extras to run the full suite:
pip install 'aevum-core[cedar,adk,maf,langchain,langgraph,crewai,openai-agents,anthropic]'
uv run pytest packages/
Bucket B — Integration tests requiring live external services (12 tests)¶
These tests require live external services and are also deselected (not just skipped)
in the default addopts = "-m 'not integration'" configuration for aevum-core and
aevum-conformance.
| Service | Tests skipped | Env var required | Test file(s) |
|---|---|---|---|
| PostgreSQL | 9 | AEVUM_TEST_POSTGRES_DSN |
test_ledger.py, test_pg_consent.py, test_pg_store.py |
| HashiCorp Vault | 3 | VAULT_ADDR |
test_vault_transit_signer.py |
To run integration tests locally:
# PostgreSQL
AEVUM_TEST_POSTGRES_DSN="postgresql://user:pass@localhost/aevum_test" \
uv run pytest packages/aevum-store-postgres/ -m integration
# Vault
VAULT_ADDR=http://localhost:8200 VAULT_TOKEN=dev-root \
uv run pytest packages/aevum-core/tests/test_vault_transit_signer.py -m integration
Rekor and TSA integration tests (@pytest.mark.integration in test_phase5_rekor.py
and test_phase1_tsa.py) are deselected by the default config — they do not appear
in the skipped count. Run them with:
Bucket C — Explicitly deferred (0 tests)¶
No tests with stale or unclear skip reasons were found as of v0.7.3.
All @pytest.mark.skip uses have valid, current reasons.
Bucket D — Unclear skip reason (0 tests)¶
No tests with missing or always-true skip conditions were found.
Deselected tests (10 tests)¶
Tests marked @pytest.mark.integration in aevum-core and aevum-conformance
are excluded from the default run via addopts = "-m 'not integration'".
These include Rekor anchoring tests and TSA network tests.
They do not appear in the pass or skip counts above.