State of the Union: Why Local, Why Now
Nader Khalil · Alex Cheema · Matthew Berman · Ahmad Osman · Joseph Nelson
AI Engineer World's Fair 2026 · 44:29
Private AI infrastructure and self-hosted AI
Osmantic designs, deploys and operates private AI infrastructure for organizations that want control over their compute, models, data and workflows. Its Osmantic Deployment System (ODS) is an Apache-2.0 open-source stack for individuals and teams running AI at home, in labs or on workstations. It connects model inference, browser chat, voice, agents, document retrieval, workflow automation and image generation. Local operation is the default, with optional cloud and hybrid modes.
Osmantic formed through Light Heart Labs joining forces with Ahmad M. Osman, its cofounder and CEO; fellow cofounder Michael J. Bradley serves as COO. Its engineering approach integrates existing tools into a common deployment and operations system. ODS detects hardware, selects a model that fits available memory and exposes service health and model management through a dashboard. Its Model Switchboard provides stable routing and context propagation across applications.
By August 2026, the ODS repository displayed approximately 4,700 GitHub stars and 724 forks, indicating open-source engagement. Alongside the free software, Osmantic offers GPU strategy, inference engineering, governed agents and continuous evaluation, with implementation services extending from physical installations to ongoing operations, support and maintenance.
Nader Khalil · Alex Cheema · Matthew Berman · Ahmad Osman · Joseph Nelson
AI Engineer World's Fair 2026 · 44:29
Affiliations reflect their AIE appearances, not necessarily current employment.