Exclusive: Honor Debuts a New AI Agent That Can Read and Understand Your Screen

It chose a restaurant, but could not complete the process then because the spot it chose requires a credit card requirement to ensure a reservation, where the user had to take responsibility. You can be flexible in your queue – in another example, asking it to book a “high rated” restaurant means it will look at reviews with high scores, though the agent does no research than that. It is not cross-referencing, especially since all these data are processed on the device and not transmitted to the clouds.

This type of agent is artificial intelligence The current budget of the technology fieldThe My colleague Night Will Recently tested an AI assistant It can browse web and perform work online. Google unveiled it by the end of last year Gemini 2 AI Model Trained to take action on your behalf. It also renewed the idea of ​​a generator user interface for smartphones on MW 2024, we saw a few companies working with ways Interact by not using apps at all with applicationsInstead you issue a command as soon as you issue a user interface, AI is rising to AI assistants.

The Honor approach looks like somewhat notorious rabbit Rabbit r 1– doing with it Teaching modeWhere you manually train its assistant to finish a job. No app is required to access programming interfaces (APIs), which is the traditional way to communicate with each other. The agent memorizes the process, then lets you issue the command and perform it.

However, Honar states that its self-reliant AI execution model is not trained to follow strict steps-it is enabled in the context of the multimodal screen to perform the job autonomously. Instead of training the assistant to learn each part of the open application, it is capable of understanding the semantic components of the user interface and will follow a multi-step process to implement your request. Honor highlighted that this process was more effective: “Contrary to competitors like Apple, Samsung and Google, which depends on the external API – reviewing the expenditure of higher operations – Honor’s AI agent operates various types of work independently.”

Photograph: Julian Chokkatu