Google Gemini: innovations presented at Made By Google 2024

During the event Made by Google, based in San Francisco, California, this Tuesday (13), the technology giant revealed significant news for the Gemini:, the company's artificial intelligence, through the broadcast of the event on its channel YouTube. The tool promises to transform users' interaction with their devices, increasing creativity and productivity through an advanced and even more multifaceted AI assistant. See the details.

What is Gemini?

Launched in December last year, the Gemini replaced Bard and stands out for its ability to handle complex tasks, from coding to advanced logical reasoning. This artificial intelligence is designed to assist users with a variety of tasks by manipulating and combining different types of files and information, including:

• Texts
• Images
• News
• Videos
• Programming languages

Gemini has three operating modes, each with specific characteristics:

• Gemini Nano: Ideal for tasks on mobile devices, offering efficiency and practicality, and allowing you to perform AI activities directly on the device, even without internet access. It is the most democratic version, available on the largest number of devices.
• Gemini Ultra: Suitable for highly complex tasks, with greater processing capacity.
• Gemini Pro: Perfect for scaling a wide range of tasks, and the new Gemini 1.5 Pro version promises to outperform the competition with its advanced capabilities.

Gemini Live

The highlight of the event was the launch of the Gemini Live, a feature that promises to make interaction with the Google assistant more natural and fluid. Gemini Live simulates human dialogue, providing a more everyday conversation, with 10 different voice options to personalize the user experience.

Jenny Blackburn, vice president of User Experience (UX) at Google, highlighted that these improvements help users in creative activities, brainstorming, problem solving, and offer valuable support for teachers and students, making learning more engaging and fun.

Notes while consuming video content

Another important innovation is the new function of IA that allows the Gemini: read the screen Android and perform actions without interrupting what is being displayed. For example, the assistant can provide additional information while a YouTube video is playing, making it easier to understand the content with annotations about what is being displayed. With the assistant active, it will be possible to obtain information and give commands to the AI ​​from the “Ask about this screen” button. Additionally, Gemini can now generate and share images directly in applications like email and messaging.

Call transcription

When on a call on Pixel 9, tap the “More” overflow menu to access “Call Notes”. From there, Google will inform call participants that recording is in progress, with the screen indicating that the process is in progress. Calls must last longer than 30 seconds for the transcription feature to be used.

After the call ends, it will take a moment for Call Notes to generate the summary. It will appear in the 'Recents' tab with an option to view the full transcript and listen to the audio, based on Gemini Nano's functionality.

AI now connects to Google apps

It was confirmed during the event that the new update for Gemini: will allow AI to connect to other Google applications, such as Gmail, calendar, agenda, YouTube, docs, spreadsheets, among others. This connection takes place from the Google workspace, which will act precisely to speed up processes during the user experience with the platform.

In the live example during the presentation, Google Gemini was able to simplify organizing a dinner party. All it took was asking the artificial intelligence to find the lasagna recipe in Gmail, add the ingredients to the shopping list on Google Keep and, finally, it even created a playlist on YouTube Music for this special night. All of this is done in an integrated way, without the need to switch between applications. Soon, the expectation is that new extensions will allow even greater integration between services.

Search from screenshots and photos

The new features of Gemini: allow AI to have access to the cell phone's image bank, as well as the device's camera. Therefore, the user can take a photo of an informative poster for a concert, for example, and question the assistant about the dates contained therein, to find out if there is any appointment scheduled for the day of the musical performance.

It will also be possible to search screenshot data, screenshots. Based on the content displayed, other information will be easily searched, with the device's search field being accessible, such as texts, telephone numbers and even products.

Pixel Studio and Gemini: Creating innovative images with AI

O Pixel Studio is an innovative tool that uses Generative AI to create new images from text commands. With Pixel Studio, you can generate unique, personalized images, making it easier to create visual materials like invitations. During the launch event, the functionality was demonstrated by creating an invitation, highlighting the tool's flexibility.

Besides the Pixel Studio, Gemini AI it also offers advanced imaging capabilities. Based on instructions and details provided by the user, Gemini can generate images in seconds.

An example demonstrated in the Gemini promotional video on Google's YouTube channel was the creation of a flamingo wearing a hat, with clouds in the background, illustrating AI's bold and creative ability to generate personalized and complex images.

Availability and launch for tablets and smartphones

Gemini Live is available starting today for Gemini Advanced plan subscribers, initially in English only, with additional languages ​​expected to be added in the coming weeks. The feature is only available for smartphones from pixel and from the line Galaxy. The price, which also includes 2 TB of storage on Google Drive, is R$96,99 per month and the subscription can be made at Google One website.

Google also announced that Gemini will be released for Android tablets in the coming days, optimizing the assistant to work efficiently both in the cloud and locally, as in the case of the line Pixel 9, which uses the language model Gemini Nano.

Improvements to Circle to Search

Originally launched with the line Samsung Galaxy S24, Circle to Search now allows you to share clippings directly with contacts via message or WhatsApp.

The operation remains the same: press the lower navigation bar to activate the Circle to Search and select the desired object. What's new is the addition of a “share” button that opens the Android sharing menu, facilitating the distribution of information.

Check out the video showcasing the features below.

Made By Google 2024

What did you think of all of today's announcements? Tell us here Comment!

See also:

reviewed by Victor Pacheco in 13 / 08 / 2024