Duolingo, known primarily for its language-learning app, is expanding into hardware with the launch of a digital piano for students of its music courses. The company is also rolling out OpenAI-powered video calling to all its Duolingo Max iOS subscribers and adding more game-like “adventures” to explore in new virtual settings.
Duolingo has teamed up with Loog, a musical instrument manufacturer that makes keyboards and guitars for children, to release a digital piano that will cost $249 and be available for purchase on the Duolingo website.
The learning company also launched a video calling feature that was beta-tested with some paid Duolingo Max users this year. Video calls consist of chats with “Lily,” a 2D Duolingo character with purple hair and a big personality. These conversations can be about just about anything and don’t have to follow a strict lesson plan; instead, they’re a chance for language learners to improve their language production and listening skills through spontaneous conversations in real time.
Lily is essentially a tweaked version of ChatGPT. The chat uses OpenAI technology to speak to you in English, French, and Spanish. Lily also remembers what you’ve said before, so you don’t have to repeat yourself when you meet again. Lily should remember what you said in the last few sessions, according to Duolingo product manager Zan Gilani.
“We’ve been trying a lot of different things,” Gilani told PCMag in an interview, “and with large language models, we’re finally able to simulate real-world conversations and give you an experience that you can actually get better at, because ultimately it’s like a muscle that you have to exercise.”
If you want to talk to Lily, you can. (Credit: Duolingo)
Lily is just a 2D AI-powered character, but she does show some basic mouth shapes (visemes) to roughly match the words she’s speaking. It won’t feel like a conversation with a real human, but it’s definitely better than nothing for those who want more real-time practice. Duolingo is modifying its own GPT, so it might feel a bit different than talking to OpenAI’s chatbot yourself.
“If she can understand what you’re trying to say, she’ll withstand the blow,” Gilani says of the AI-powered Lily. “If we correct your mistakes too much in real time, the parts of the brain that self-correct, the monitoring parts, start to get active. And that gets in the way of active communication.”
Editor’s Recommendation
Duolingo is also adding content for people who are tired of its gamified, incremental learning model of gaining XP and climbing leaderboards. “Adventures” are essentially top-down, 2D, room-like environments with interactive characters. These new settings include existing Duolingo characters like Oscar and Lily, and they train you for real-world situations like ordering a coffee at a cafe or having your passport checked while traveling.
Duolingo Adventures (Credit: Duolingo)
“Some experiences are fun, like games, and some are more directly learning-oriented. But overall, we always think there are ways to do both,” Gilani says, “and they don’t have to be at odds with each other.”
Get the best stories!
Sign up for What’s New Now to get the top stories delivered to your inbox every morning.
This newsletter may contain ads, deals or affiliate links. By subscribing to our newsletter, you agree to our Terms of Use and Privacy Policy. You can unsubscribe from our newsletter at any time.
About Kate Irwin
Reporter
I’m a reporter covering the early morning news. Prior to joining PCMag in 2024, I was a reporter and producer at Decrypt where I launched the company’s gaming division, GG. I’ve also contributed to Input, Game Rant, and Dot Esports. I’ve been a PC gamer since The Sims (yes, the original version). In 2020, I finally built my first PC with a 3090 graphics card, but I also regularly use Mac and iOS devices. As a reporter, I’m passionate about uncovering the scoop and chronicling the wide world of technology and how it affects our daily lives.
Read Kate’s full biography
Read the latest from Kate Irwin
Source link
