1. Home
  2. Newsletter
  3. Weekly
  4. 😺 AI for good
newsletter icon
The Roundup

Every Sunday

AI for good

This newsletter was brought to you byAuth0
PRODUCT HIGHLIGHT

Apple released a new model for image editing

Apple teamed up with researchers at the University of California, Santa Barbara (Go gauchos!) to create a new AI model called MGIE (MLLM-Guided Image Editing).

The model can edit images — think of the stuff you do in Photoshop, but with plain English prompts. It can crop, resize, rotate, brighten, sharpen, remove objects, and so on, plus edit specific parts of your image, like changing the shape, size, and texture of items.

Perhaps the most interesting or “revolutionary” thing about the model is that it derives expressive instruction from your prompt.

Imagine using a phrase to ask AI to edit your photo for you. It might look something like this: “Make the sky more blue.” But MGIE can produce instructions like this: “Increase the saturation of the sky region by 20%,” explains Michael Nuñez for VentureBeat.

The model also works by creating a representation of the edit that the end user wouldn’t see, which it uses as a guide for how to manipulate pixels — “an end-to-end training scheme that jointly optimizes the instruction derivation, visual imagination, and image editing modules.”

That’s a lot for me to process too, but the key point is that the model is being recognized as a breakthrough for using multimodal large language models (MLLMs) for interpreting user input and making edits at the pixel-level. People are also loving that it's open-source. The project is on GitHub and a demo is on Hugging Face.

TALES FROM PLANET INTERNET

🤗 AI for Good: Sensay is a platform that uses AI to help dementia patients and their families preserve cherished memories, likenesses, stories, and personalities while also assisting patients by digitally replicating people closest to them.

🔨 Midjourney phone: Okay, maybe not a phone, but it does look like Midjourney could be cooking up something in the hardware department. The company recently hired an engineer from the Apple Vision Pro to be its “Head of Hardware.”

newsletter icon
The Roundup

Every Sunday

Everything you missed this past week on Product Hunt: Top products, spicy community discourse, key trends on the site, and long-form pieces we’ve recently published.