LocalAI is a free, Open Source OpenAI alternative. It acts as a drop-in replacement REST API that's compatible with OpenAI API specifications for local AI inferencing. It allows you to run LLMs, generate images, audio, and more locally or on-prem with consumer-grade hardware, supporting multiple model families without requiring a GPU.