Pixel Screenshots & Gemini Live: The first steps towards visual AI; Google shows the future of smart glasses (video)

Google has made a lot of announcements about the Pixel smartphones and the Gemini AI in recent weeks, and there have of course been one or two highlights. Two completely independent new products that may have flown under the radar until now could play a very important role in the future, especially together. Because they are the harbingers of the visual Gemini AI.

As part of the 'Made by Google' event in August, Google presented the new Gemini format Twins Live Announced as well as the new Pixel feature Pixel screenshots officially shown for the first time. We have presented both functions in detail in the linked articles, which will initially only be offered to Advanced subscribers without delay. This has now changed for Live, as Gemini Live was opened to all users a few days ago.

Gemini Live could be described as a further development of continuous communication with the Google Assistant and Pixel Screenshots is nothing more than image recognition with integrated text storage. Both are very practical, but not exciting. But if we go a step further and combine the possibilities of these two technologies, we suddenly end up with a completely different product that Google has already promised: namely the Gemini visual AI for smart glasses.

We have already presented the visual Gemini AI in detail in the linked article, which Google described as a pure concept at the presentation in May. In fact, Gemini Live and Pixel Screenshots provide exactly the ingredients needed to soon be able to implement this tool in the form that was promised in the video embedded below in May.

Pixel Screenshots searches images for text and objects, which it remembers. For the new product, the whole thing has to be expanded from a static image to a live video, which will require a lot of computing power, but has long been demonstrated with Google Lens or Google Lookout. For the multimodal Gemini, it makes no difference whether it is an image or a video. Instead of also recording an infinite live video, Gemini will only remember information, positions, descriptions and meta data.

Gemini Live comes into play to watch for such things, wait for instructions from the user or answer questions. Gemini Live is the interface between AI and humans, while Pixel Screenshots (then with a different name, of course) takes care of the visual component. All of this doesn't seem as far away as one might think in the video above.

My prediction is therefore that the above demo video will be shown again at the next Google I/O, this time with a real product, and around “Made by Google 2025” we will get the first smart glasses for which Google is currently looking for partners.

preview	product	Price
	Google Pixel 9 – unlocked Android smartphone with Gemini, advanced camera, 24-hour battery and 6.3″…	999,00 EUR	Buy on Amazon
	Google Pixel 9 Pro – Android smartphone with Gemini without SIM lock, triple rear camera system, 24…	1,329.00 EUR	Buy on Amazon
	Google Pixel 9 Pro Fold – Android smartphone with Gemini without SIM lock – advanced…	1,899.00 EUR	Buy on Amazon
	Google Pixel Watch 3 (45 mm) – Android smartwatch with heart rate tracking, advanced running …	438,23 EUR	Buy on Amazon

Last updated on September 16, 2024 / Images from the Amazon Product Advertising API / Affiliate Links, thank you for your support!

---

---