Making AI operational in constrained public sector environments
Summary
Public sector organizations face unique challenges deploying AI due to strict data security requirements, limited internet connectivity, and lack of GPU (graphics processing units, specialized computer hardware for running complex AI models) infrastructure. Small language models (SLMs, specialized AI models using billions rather than hundreds of billions of parameters) offer a practical solution because they can run locally on government systems, use less computing power than large language models (LLMs, the biggest AI systems like ChatGPT), and keep sensitive data under government control.
Solution / Mitigation
Use small language models (SLMs) instead of large language models (LLMs) in public sector environments. SLMs can be housed locally for greater security and control, are less computationally demanding, and allow sensitive information to be used effectively while avoiding operational complexity. Implement methods such as smart retrieval, vector search, and verifiable source grounding to build AI systems that meet public sector needs. Store data securely outside the model and access it only when queried, using carefully engineered prompts to retrieve only the most relevant information.
Classification
Affected Vendors
Original source: https://www.technologyreview.com/2026/04/16/1135216/making-ai-operational-in-constrained-public-sector-environments/
First tracked: April 16, 2026 at 02:00 PM
Classified by LLM (prompt v3) · confidence: 75%