Zhipu AI, a Chinese artificial intelligence (AI) startup, is experimenting with tools designed to complete tasks based on smartphone users’ voice commands, paving the way for a future where our digital lives are automated. It’s proven.
The Beijing-based company says its AI agent app AutoGLM can understand relatively complex voice commands, such as “repeat the most recently ordered cereal from your shopping history” or “order a latte at the nearest cafe.” .
Zhipu AI, which runs a series of AI models and related chatbots such as ChatGLM, says the tool plans the steps involved in each task, “reads” the information displayed on the screen, and takes the necessary actions on your smartphone. It can be executed.
Do you have questions about the biggest topics and trends from around the world? Find the answers with SCMP Knowledge. SCMP Knowledge is a new platform of curated content with explainers, FAQs, analyzes and infographics brought to you by our award-winning team.
AutoGLM is the latest example of how Chinese startups are developing products that provide AI capabilities to consumers via smartphones in a market with few strong foreign competitors.
Zhipu AI is one of China’s top startups working on generative AI. Photo: Handout alt=Zhipu AI is one of China’s top startups working on generative AI. Photo: Handout >
Apple this week rolled out its on-device AI system, Apple Intelligence, in U.S. English in most regions, but the service is not available in mainland China, where the company is still facing regulatory hurdles to launch the service. We are working with local authorities to clear the issue.
China is also excluded from the list of countries and regions where ChatGPT maker OpenAI and rival Anthropic provide access to their generated AI products. Last week, Anthropic debuted Zhipu AI’s AutoGLM-like feature called “Computer Usage,” which automates certain computer operations, such as organizing spreadsheets or finding specific information from thousands of rows of data. Ta.
AutoGLM is a product marketed to Chinese users and is compatible with popular local apps.
For example, when a Post reporter asked an AI agent to order a latte on Monday, the app automatically opened food delivery platform Meituan to search for cafes, rank them based on distance, and find the closest cafe. and selected the appropriate drink. For security reasons, the app continued to ask users for manual confirmation before making payments.
AutoGLM currently operates Tencent Holdings’ multipurpose app WeChat, Alibaba Group Holdings’ Taobao Marketplace, Alibaba-backed navigation apps Amap and Meituan, crowdsourcing review platform Dianping, and online travel. It can be operated in collaboration with agencies such as Trip.com. Alibaba owns the South China Morning Post.
the story continues
Zhipu AI’s AutoGLM can complete specific tasks through a selected group of apps, such as WeChat and Meituan. Photo: Screenshot alt=Zhipu AI’s AutoGLM can complete specific tasks through a selected group of apps, such as WeChat and Meituan. Photo: Screenshot>
Still, AutoGLM is far from perfect.
AI Agent is still in the trial phase and can only be downloaded by invited Android users. I made some mistakes during the Post paper test. The AI agent sent WeChat messages to the wrong recipients, booked hotel rooms for 30 days instead of the requested two days, and summarized webpage reviews without writing them when asked.
In a user manual for early adopters, Zhipu AI noted that the tool’s speech recognition module “still has many issues to fix.”
Another common complaint from test users is slow response times.
According to one user in the WeChat group, the AI is too slow and there is still a lot of room for improvement. Users added that unless they were really busy, it would be faster to complete the tasks themselves.
This article originally appeared in the South China Morning Post (SCMP), the most authoritative news organization on China and Asia for more than a century. For more stories from SCMP, explore the SCMP app or visit SCMP on Facebook. Twitter page. Copyright © 2024 South China Morning Post Publishers Ltd. All rights reserved.
Copyright (c) 2024. South China Morning Post Publishers Ltd. All rights reserved.
