I would not recommend LocalAI. There documentation is somewhat lacking and it’s an all in one utility with many moving parts. The parts also tend to break, quite often.

deleted by creator

I am currently migrating away from my 6th gen i5 to a newer N100.

Speed wise, it was about the same as the coral, about 6-8ms on the i5.

I have a similar setup and it’s been a huge pain when I when I have to do the OS updates.

The Coral needs a dkms module, but the sources and Google’s own documentation for it are out of date. I would highly recommend using the iGPU for inference.