Exclusive: Honor debuts to read and understand your screen

It chose a restaurant but couldn’t complete the process because the location it chose required a credit card to confirm the reservation, when the user had to take over. You can be flexible in your query – In another example, asking it to book a “highly rated” restaurant means it will view highly rated reviews, although the agency’s research hasn’t done more research. It is not a comment that cross-references with data from other parts of the network, especially since all of this data is processed on the device and not sent to the cloud.

This proxy artificial intelligence is a current buzzword in the field of technology. My colleague Will Knight recently tested an AI assistant that can browse the web and perform tasks online. Google unveiled its Gemini 2 AI model late last year, which is well-trained to act on your behalf. It also updated the idea of ​​generating user interfaces for smartphones – at MWC 2024, we saw some companies dealing with interacting with applications without using them, relying on AI Assistants to generate user interfaces when issuing commands.

The Honor method feels a bit like the infamous rabbit R1’s rabbit is using teaching mode where you can manually train its assistant to complete tasks. There is no need to access the application’s application programming interface (API), which is the way traditional applications or services communicate with each other. The agent remembers the process, allowing you to issue commands and execute tasks.

But Honor says its self-reliant AI execution model is not trained to follow strict steps – it is able to perform multimodal screen context recognition autonomously. Instead of training the assistant to learn every part of the Opentable App, it is able to understand the semantic elements of the user interface and will follow up through a multi-step process to perform your request. Honor emphasizes that the process is more cost-effective: “Unlike competitors like Apple, Samsung and Google that rely on external APIs – holding higher operating costs – Honor’s AI agents independently manage a wide range of tasks.”