Google Gemini is a pretty multimodal as it is right now, but it doesn’t quite have the qualities demonstrated by Project Astra last year. Yet, anyway, as it seems that the internet search giant has started rolling out the ability to use live prompts. Examples of Gemini being able to use your screen recording as a prompt have started showing up online.
One such example comes via Reddit, with user u/Kien_PS sharing a video of it in action. The clip shows Google Gemini Live describing what is available on one page of the phone, as well as taking a guess that the app Code Editor may have something to do with the user’s major. Worth noting though that the clip shows a clock that doesn’t tick down despite it being over a minute long. The user describes this as a conflict for when two screen recordings are happening at the same time.

In a statement to The Verge, Google spokesperson Alex Joseph says that the company has started rolling out these features, though the report doesn’t come with an exact timeline. Of course, using screen recordings as a prompt is only one of two features of Gemini that are touted as real-time prompts, with the other letting the chatbot see the world through your phone’s camera.
While this all sounds like good news, it remains to be seen if the rollout affects all users, or only paying ones. Google has said earlier in the month that this part of Gemini will be “rolling out to Gemini Advanced subscribers as part of the Google One AI Premium plan on Android devices later this month”. The Reddit user also confirms that they are a Gemini Advanced user. On one hand, the company has always kept its coolest features as a reason to pay it money. But on the other, it has also recently allowed people to use Gemini without signing in.