Apple is dabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
SEE ALSO:Tim Cook says big Apple AI announcement is coming later this yearWhether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
TopicsAppleArtificial Intelligence
(责任编辑：時尚)
Katy Perry talks 'Rise,' her next batch of songs, and how to survive TwitterThe deep sea discoveries and sightings of 2022 are fascinatingJohn Deere won't rest until farmers are the new techiesChatGPT essays and more: How teachers and schools are dealing with AI writing
Darth Vader is back. Why do we still care?This 'sh*tpost' bot makes terrible memes so you don't have to
The internet is awash in trashy memes just waiting for your late-night retweet spree. Why waste prec
...[详细]John Deere won't rest until farmers are the new techies
John Deere — yep, the tractor company — drew accolades at CES 2022 with its fully autono
...[详细]How does the head of New York Times Games play Wordle?
Can't get enough of Wordle? Try Mashable's free version nowIf there was a five-letter Wordle solutio
...[详细]How does the head of New York Times Games play Wordle?
Can't get enough of Wordle? Try Mashable's free version nowIf there was a five-letter Wordle solutio
...[详细]Plane makes emergency landing after engine rips apart during flight
A Southwest Airlines flight bound for Orlando, Florida, made an emergency landing Saturday morning d
...[详细]Twitter goes down for many after upgrade, Elon Musk says 'works for me'
On Wednesday, Twitter CEO Elon Musk said that Twitter should "feel faster" due to "significant backe
...[详细]John Deere won't rest until farmers are the new techies
John Deere — yep, the tractor company — drew accolades at CES 2022 with its fully autono
...[详细]Owners of new Android phones will have a much easier time getting out of emergencies later this year
...[详细]Tourist survives for month in frozen New Zealand wilderness after partner dies
A tourist from the Czech Republic, whose partner fell to his death, survived a harrowing month in th
...[详细]Owners of new Android phones will have a much easier time getting out of emergencies later this year
...[详细]Tourist survives for month in frozen New Zealand wilderness after partner dies
Wordle today: Here's the answer, hints for December 24