EIGR-infer: a blockchain-governed framework for decentralised LLM inference via encrypted intent-guided routing, semantic sharding, and four novel privacy mechanisms

Summary

EIGR-Infer is a decentralised LLM inference framework that spreads model execution across a peer-to-peer mesh of consumer edge devices. Its core encrypted intent-guided routing protocol hashes query intent on-device and uses Kademlia-DHT discovery to route queries without revealing their content, and it adds four new privacy mechanisms. Discrete-event simulation on a 1000-node mesh reports 47 ms discovery latency at the 95th percentile, 460 ms end-to-end latency for 512-token prompts, and a 98.3% ghost shard detection rate.