Uptime Industries wants to boost localized AI usage with an ‘AI-in-a-box’ called Lemony AI

Uptime Industries Lemon is betting on an “AI-in-A-Box” handheld device on the on-primis AI infrastructure called AI.

The size of a sandwich, Lemon AI Perhaps a node can run all big language models (LLMs), AI agents and AI workflos. Running in each lemon requires only 65 watts, the equivalent of a laptop charge and it can be stacked and attached to the formation of a large AI cluster.

Sasha Buehrail, co-founder and CEO of Uptime, told TechCrunch that each node could maintain an LLM up to 75 billion parameters in size and host re-construction versions of open-source models or closed models. In a cluster of lemon nodes, each device can run a separate model.

Uptime is launched with IBM and Jetbrane to provide easy access to customers with IBM’s closed models.

Like most of the Tech Startups, Lemon AI’s concept derived from a side project: APTIME CO co-founder, Buuharail and Ivan Kuleshov, they were trying to determine whether they could distribute language models Raspberry Pie’s micro computerAnd it was originally not related to the generator AI, when it worked, they began to try to see what the raspberry PIs could manage.

When they realized that the models running on local devices could prove the key to unlocking more AI by the company-the initiatives that do not want to use cloud-based models-they begin to create a device on their own. They can accelerate AI quickly with the emphasis on data privacy.

“We need to create something small that can easily go into the squad and which one [does] He added that there is no need to make an organization-dilapidated decision-making to bring on-prime generator AI solutions to business teams, “Buuharail said. The clusters of small and powerful devices could help increase the system to the customer’s needs, he added.

The company has said that they have already seen the demand from business in heavy-controlled industries like money, health care and law.

“Everything is in your box,” said Buiharail. “So your documents, your files, your emails – the models are hosted in the box, agents are running locally in the box, and nothing is leaving the box” “

Uptime has collected $ 2 million so far in a seed funding round led by former Ventabnes, Jetbranes and some angel investors. The company will use funds to further develop its devices.

Startup says the plan is now that it is made to work on the hardware of other companies like its micro AI computer, Lemon OS that has made the software that has been created for the Lemon OS Nvidia DGX sparkThe It wants to extend the software from its current, single-consuming focus on one of the parties that can use.

It costs $ 499 a month to use Lemon AI and can be accessed by five users.