E.L.L.A. is a local AI assistant designed with built-in safety directives at the architectural level. It processes data on-device to enhance privacy and ensure compliance with predefined ethical guidelines, aiming to provide a trustworthy alternative to cloud-based AI systems.
Background
- E.L.L.A. (Ethical Local Linguistic Agent) is an open-source, local-only AI assistant designed to run on consumer hardware (e.g., a Raspberry Pi) without an internet connection. It uses small language models (SLMs) like Llama 3.2 or Microsoft Phi-3.
- Its key innovation is an "architecturally enforced" safety layer: the user's request is first routed through a fixed, unmodifiable "directive model" that intercepts harmful or unethical queries before they reach the main language model. Unlike most chatbots, where safety relies on the AI's post-hoc judgment, E.L.L.A.'s safety rules are structurally impossible to bypass.
- E.L.L.A. is a reaction to growing concerns about AI safety in cloud-based assistants (data privacy, surveillance, "alignment faking," where models pretend to comply with rules), as well as to the trend of centralized AI controlled by large corporations.
- The project is led by German AI engineer Fabian Richter (Twitter: @richterfabian), who also built "Prometheus," an open-source AI evaluation framework.