Samsung Galaxy AI: Here are all the AI features launched with the Galaxy S24 Ultra

Samsung has officially launched its flagship for 2024, the Galaxy S24 series, with a significant focus on the smartphones’ AI capabilities powered by Google’s Gemini

The multi-year deal between Samsung and Google involves incorporating Gemini Nano, Google’s highly efficient large-language model, into the flagship series.

Additionally, access to Gemini Pro and Imagen 2 text-to-image technology through the cloud will be provided, making Samsung the first Google Cloud partner to implement these features.

Janghyun Yoon, Corporate EVP and Head of Software Office of Mobile eXperience Business at Samsung Electronics, expressed excitement about the collaboration, emphasizing shared values with Google in making technology more helpful and accessible.

The Galaxy S24 series introduces several AI features, including the Live Translate function for real-time voice and text translations within the native app, eliminating the need for third-party applications. The Interpreter feature provides split-screen view translations for live conversations, even without cellular data or Wi-Fi.

The AI Live Translate function in the Galaxy S24 series facilitates two-way, real-time voice and text translations for phone calls within the native app, eliminating the need for third-party applications. Taking it a step further, the Interpreter feature provides split-screen view translations for live conversations, even without cellular data or Wi-Fi.

AI Chat Assist enhances messaging and various applications by ensuring that conversational tones are tailored for different contexts. The Samsung Keyboard incorporates AI to translate messages in real-time across 13 languages.

On the go, Android Auto streamlines connectivity by summarizing incoming messages and suggesting relevant replies and actions while driving.

AI Note Assist in Samsung Notes assists in organizing random notes taken during meetings. This feature includes AI-generated summaries, streamlined note templates, and cover creation for easy note identification. Transcript Assist employs AI and Speech-to-Text technology to transcribe, summarize, and translate voice recordings, even in scenarios with multiple speakers.

The Galaxy S24 series also introduces a gesture-driven Circle to Search feature in collaboration with Google. Users can conduct intuitive searches by circling, highlighting, scribbling, or tapping on anything displayed on the screen, providing high-quality search results without leaving the app. Generative AI-powered overviews offer context and information for specific searches.

AI extends its influence to photo editing in the Galaxy S24 series. Edit Suggestion uses Galaxy AI to recommend suitable adjustments for each photo, while Generative Edit allows users to fill in parts of an image background with AI assistance. To maintain transparency, a watermark appears on the image and in metadata whenever the Galaxy S24 utilizes generative AI to enhance an image.

The competitive landscape between Google and Microsoft involves a race to embed GenAI in everyday applications and devices, including smartphones, personal computers, and productivity software. This competition reflects the companies’ pursuit of new avenues to monetize these advanced tools.

(With inputs from agencies)