In its new spring update, OpenAI released a native Mac app for ChatGPT, and also unveiled its newest flagship model: GPT-4o.
There were stunning demonstrations and a palpable feeling in the air—so much so that Apple users were highly speculating about a possible Apple-OpenAI collaboration for iOS 18.
One of the exciting moments from the event was when it released a sneak peek of a new feature for the ChatGPT app, though details were not made available.
This feature would make ChatGPT see what’s going on on every pixel of your device’s screen.
The desktop application, designed to open in a small window, may be particularly useful.
It lets the AI assistant view your screen to assist in tasks such as coding problems.
In this way, the functionality aspires to make it easier to use ChatGPT for daily tasks.
Would you feel confident sharing your screen with ChatGPT?
At launch, users are able to manually screenshot capture or upload files for ChatGPT to assess.
In the near future, as shown in the video, the app will let users unlock full access to your screen content with a single click.
Later, as the video below shows, users will be able to allow the app full access to what’s on their screen in a single click.
It will not be restricted to Macs, though; the iOS and iPadOS apps also displayed this technology in a tutoring context.
The timeline for the release of these screen-viewing features in ChatGPT remains uncertain but is viewed as a natural enhancement to a more interactive user experience.
Apple provides APIs that developers can use to access screen content, with user consent, ensuring that OpenAI’s approach is ethical.
At the launch of GPT-4o, OpenAI underlined its potential to revolutionize work.
Initially, the World Economic Forum estimated that LLMs would impact about 40% of working hours.
Now, some believe this could increase to 90%, potentially making workers either significantly more productive or much lazier.
Sam Altman stressed that an AI assistant should act like a “senior employee” rather than an “agent.”
Unlike an agent that follows commands without question, a senior employee would challenge requests that seem illogical.
The new feature allows ChatGPT to see and interact with the content on your screen, aiding tasks such as coding problems.
Initially, users can manually capture or upload screenshots, with future updates enabling full screen access with a single click.
Yes, the screen-viewing feature will also be available on iOS and iPadOS apps, demonstrating its utility in a tutoring context and providing a more interactive user experience across devices.
GPT-4o is OpenAI’s latest flagship model, offering significantly faster response times, improved natural language processing, and the ability to integrate with various applications.
It aims to enhance productivity and provide more nuanced responses.
While there is speculation about a potential Apple-OpenAI collaboration for iOS 18, no official confirmation has been made.
The anticipation is based on the new AI features and the native Mac app for ChatGPT.
Also Read: OpenAI Board Reshuffled Following Employee Pushback and Reinstatement of Sam Altman
Also Read: Sam Altman’s iPhone Crashed From Influx of Messages After News of His Termination from OpenAI
Also Read: 2023’s Biggest Controversies in Tech: DeepFakes, Sam Altman, Google Bard, Twitter, and More
Also Read: Apple’s iPhone 16 to Revolutionize with AI Integration in iOS 18
Also Read: Apple Reportedly Acquires DarwinAI to Boost iOS 18 AI Features and More
Highlights Snapdragon 8 Elite Gen 6 Pro may debut HPB (Heat Pass Block) cooling, enabling…
Highlights Google has confirmed the Pixel 10a India launch with pre-orders starting February 18 via…
Highlights Meta is developing a new standalone app called Instants. It is designed to rival…
Highlights Nothing has teased the Phone (4a) and Phone (4a) Pro, along with Headphone (a).…
Highlights Apple’s AirPods Pro 4 may feature built-in cameras or infrared sensors to enable spatial…
Highlights OPPO has launched the Oppo K14x 5G in India, priced at ₹14,999 for the…
This website uses cookies.