#proxy #llm #observability #logging #record

app chronicle-api

The Chronicle LLM proxy packaged as an API

3 releases (breaking)

new 0.3.0 Jun 2, 2024
0.2.0 May 29, 2024
0.1.1 May 9, 2024

#984 in Database interfaces

Download history 103/week @ 2024-05-04 20/week @ 2024-05-11 2/week @ 2024-05-18 164/week @ 2024-05-25

289 downloads per month

Apache-2.0

275KB
6.5K SLoC

chronicle

Chronicle is a proxy for language model API calls which

  • Provides retries and optionally falls back to other providers on a failed call
  • Records each call in a database, and sends OpenTelemetry events
  • Lets you switch model provider APIs without changing your request format.
  • Supports both SQLite and PostgreSQL databases
  • Comes with a drop-in fetch function that will redirect OpenAI SDK calls to Chronicle instead.

See the roadmap for the current status and other notes.

Dependencies

~82MB
~1.5M SLoC