Cactus Compute’s Needle framework runs a 45M-parameter model completely offline on a $10 ESP32-S3 chip.

Seyr
138 1 0 1 2mo ago