Leiolai

About

Leiolai performs inference on the devices individuals already use, rather than relying on data centers. This approach conserves water through inference and compensates users for the computing power their devices contribute. The free application allows access to leiolai-1, which features an 11 million token context window and supports continuous generation. Developers can utilize the model via an OpenAI compatible API, with pricing beginning at $0.01 per million input tokens and $0.02 per million output tokens.