Google's Gemini can now make calls, shop and sort your bills
Most AI chatbots answer questions. Google now wants its Gemini assistant to do jobs for you as well. A new feature called Tasks lets Gemini book appointments, phone businesses, look through your bills and do some of your shopping.
Josh Woodward, who leads Google Labs, the Gemini app and AI Studio, announced the update. It is free and is rolling out to people in the U.S., Japan, Korea, Canada, Australia and India. Google says it runs on a new model called Gemini 4 Hydrogen, and some extra features are starting in the U.S. first.
What it actually does
The main change is that Gemini can now carry a job through several steps. To do that, it connects to things you already use, such as your email, your calendar and your payment cards.
Woodward gave a few examples from his own life. When his family's minivan needed a service, he asked Gemini to call the two nearest dealerships. Gemini called both at once, sat through the hold music, found a time when he was free and put the appointment in his calendar. He says it took less than five minutes.
Another time, his family got a surprise electric bill of $389. He let Gemini look at their utility account and the old bills in his email, and it worked out that their heat pump was switching on around 4 p.m., right when electricity costs the most.
He also used it to:
- compare USB-C chargers, pay for one and find a discount code that saved $10
- add groceries to an Instacart order by text message, including a photo of an empty cereal box
- turn a batch of forwarded school emails into calendar dates, spotting a clash with basketball practice
Gemini now connects to more than 60 popular apps. Developers can apply to join what Google calls its Connected Apps Platform.
How does it handle money and private data?
Letting an assistant spend your money is a big step, and Google has explained how it tries to keep that safe.
For shopping, Gemini follows a set of payment rules Google calls the Agent Payments Protocol, or AP2. Google says it is working with Mastercard and Visa, with American Express coming soon. Your card details are swapped for digital tokens (a bit like a stand-in code), so the real numbers are kept safer. You still earn your card's points, cashback or purchase protections, and you can set a firm spending limit before you start. Receipts and tracking details go into Google Wallet, which is now coming to iPhones too.
While Gemini works on a task, it runs inside a virtual machine. Think of it as a separate, locked room on Google's computers, set aside for your account alone and never shared. Google says its security teams test these regularly. Filters also check web pages for hidden instructions that might try to trick the assistant, and Google limits which links Gemini can open.
You can jump in with new instructions at any point. Gemini is designed to stop and ask before important steps, such as pressing "Buy", and to ask questions if your request is unclear. For small things you trust, like adding the usual cereal to your grocery order, you can choose "Always allow". You can also disconnect apps or delete your chat history whenever you like.
What if you run a small business?
If you own a shop, salon or garage, you may start getting calls from Gemini on behalf of customers. Google says Gemini tells the business straight away that it is an AI, and businesses can opt out whenever they want. Gemini will not hand over the customer's payment or private account details unless the customer says so.
What are the limits?
Google admits the system is not perfect. It says it has tested Tasks a lot but has not got rid of every mistake, so a task may sometimes fail to finish or get things wrong. Users are asked to give a "thumbs down" when that happens.
Websites are also still catching up. On some sites, Gemini may get most of the way through and then hand the screen back to you to press the final button. For years, websites blocked automated visitors because most of them were harmful, so this is new ground.
The phone-calling feature is not available in Indiana, Louisiana, Minnesota, Montana or Nebraska, and texting Gemini needs a U.S. phone number on an eligible mobile network. Google also points out that Gemini works best if your emails, calendar, passwords and payment cards are already with Google. If you mostly use other services, you may get less out of it.
How to try it
Open the Gemini app, switch the toggle on the home screen from Chat to Task, and tell it what you need doing.
In the U.S., you can also forward emails to gemini@google.com. To text Gemini, open the app on Android or iPhone, go to Settings, tap Channels, choose Set up under Text with Gemini and verify your phone number.
It is still early and the rough edges show, but if your to-do list never seems to shrink, it may be worth a try.
Source: Tasks in Gemini, Google (Josh Woodward, Labs, Gemini app and AI Studio). Listed in AI News Week 48, where we track every AI release each week.