Ollama now runs Jev-like decision models locally, including Nimble
Ollama says Jev-like decision models now run entirely on a local machine. Nimble can be installed with ollama pull nimble and used through a new local /v1/systemone API.
#local-inference
View all AI newsArtificial Analysis open-sources AA-AgentPerf-Local for laptop and workstation inference
Artificial Analysis has open-sourced AA-AgentPerf-Local, which replays recorded agent sessions to measure local inference speed, and published initial 4-bit results for four systems. On models that fit in 32 GB, the GeForce RTX 5090 finished more than 3.5 times faster than the other systems tested.
Hassan trains Tev1 0.8B, a tiny Jev-like classifier
The model runs entirely on his Mac through Ollama and, by his account, classifies tasks in about 50 ms end to end. Weights and benchmarks are not available yet; Hassan says both will be released very soon.