Unboxing Gemini Ultra 1.0 – Reasoning, Algebra, Calculus, JSON extraction

Discussion of Google's release of Gemini Ultra, following the November launch of the Gemini Suite of models, including Gemini Nano and Gemini Pro.

Gemini Ultra Overview

• Availability: Initially, Gemini Nano and Gemini Pro were available only through AI studio and API. Gemini Ultra is introduced as a consumer app with web interface and mobile apps for Android and iOS.
• Features: Integration with Google Assistant on Android, requirement of a subscription through Google using a personal account, and pricing details.

First Impressions and Setup

• Subscription and Access: Emanuel discusses the process of subscribing to Gemini Ultra and accessing the app.
• User Interface: Comparison of Gemini Ultra's interface with Chat GPT, mentioning different modes such as "light theme" and options for Gemini Advanced or Gemini (possibly Gemini Pro and Ultra).

Testing Gemini Ultra

• Sending Prompts: Emanuel tests Gemini Ultra by sending various prompts to evaluate its responses.
• City Description: A prompt about Oakland, California showcases the app's ability to generate descriptions with different tones.
• Response Customization: Features for customizing responses, including options for making the responses shorter, longer, simpler, or more casual.
• Fact-Checking Feature: Introduction of a double-check feature that verifies responses against Google Search results.

Specific Tests

• Riddles and Logic Puzzles: Testing Gemini Ultra's reasoning capabilities with riddles and puzzles.
• Mathematical and Coding Challenges: Evaluating Gemini Ultra's performance on arithmetic, calculus, and coding exercises.
• Data Extraction and Conversion: Attempts to perform tasks like JSON extraction and summarizing a CNN article, with mixed results.
• Image Generation: Testing the app's ability to generate images based on prompts.

Conclusion

• Evaluation: Emanuel concludes that Gemini Ultra is similar to Chat GPT in capabilities but notes some shortcomings in reasoning and data extraction.
• Closing Thoughts: Invitation for viewers to share their opinions on Gemini Ultra and a reminder to subscribe for more content.

‍