Date: March 24, 2025
Gemini's new real-time screen and camera features bring Google’s AI assistant one step closer to becoming truly context-aware and visual.
Gemini, Google’s increasingly powerful AI assistant, is stepping up its game—literally watching and understanding what’s on your phone’s screen and through your camera in real time.
The tech giant has begun a gradual rollout of live video and screen-sharing features for Gemini, first teased last year under “Project Astra.” Now, users with a Google One AI Premium plan are starting to see these capabilities go live on Android devices.
With the new update, Gemini can now watch your screen in real time and help you out based on what it sees. Planning a trip? It can summarize the travel itinerary you’re looking at. Confused about an app setting? Just ask—no need to switch tabs or copy-paste anything.
But it doesn’t stop at screens. Google is also enabling live camera access, turning Gemini into something closer to a pocket-sized assistant with eyes. During a demo, Gemini was asked to help pick the right paint color for pottery—it scanned the live image and offered contextual advice. That’s not just smart, that’s next-level smart.
Here’s the video!
Google hasn’t gone full throttle with the rollout yet. As reported by The Verge and Tech in Asia, the features are coming gradually to Android users. The approach is cautious, but the impact could be huge.
"We’re building a future where helpful AI can see and respond to the world just like you do," Google said in a previous keynote, hinting at its vision behind Astra.
The features are not just about flash. These features could mark a major leap forward in AI-human interaction—giving Gemini a better sense of context, visual awareness, and relevance.
Instead of typing long prompts or explaining what’s happening on your screen, it gives you a way to show it. Gemini handles the rest.
Whether it’s troubleshooting, shopping help, or even just identifying stuff around you, Google wants Gemini to be your go-to digital co-pilot. And while it’s still early days Gemini is clearly no longer just about chat. It’s learning to see.
By Arpit Dubey
Arpit is a dreamer, wanderer, and tech nerd who loves to jot down tech musings and updates. Armed with a Bachelor's in Business Administration and a knack for crafting compelling narratives and a sharp specialization in everything from Predictive Analytics to FinTech—and let’s not forget SaaS, healthcare, and more. Arpit crafts content that’s as strategic as it is compelling. With a Logician mind, he is always chasing sunrises and tech advancements while secretly preparing for the robot uprising.
Apple Taps Anthropic to Supercharge Xcode with AI-Powered Coding Assistant
Apple collaborates with Amazon-backed Anthropic to create a next-gen AI assistant for Xcode, aiming to revolutionize how developers write, edit, and test code through an intuitive “vibe-coding” experience.
How Much Does a Digital Marketing Agency Cost?
Discover the factors that manipulate the marketing agency costs and drive you to hefty bills. Observe and plan smartly! We got some tips too.
Quantum Leap: Amaravati to Build India’s First Tech Village
Amravati’s quantum computing village, India’s first, pioneers a tech revolution with IBM, TCS, and L&T, fostering innovation in quantum research and collaboration.
Microsoft Goes Passwordless by Default, Pushing Passkeys Mainstream
Microsoft ditches passwords for new users—passkeys are in, friction is out. Is this the tech giants’ way of embracing smarter sign-ins?