Inferly

About

Inferly gathers metadata from every LLM API request, including details like the model used, token count, cost, latency, and success status. This data is aggregated and displayed on a streamlined dashboard featuring spending alerts. The system does not access any prompt content.