About Meta
Meta Platforms, Inc. is an American tech company headquartered in Menlo Park, California. Meta owns and operates several prominent social media platforms and communication services, including Facebook, Instagram, WhatsApp, Messenger and Threads. Meta’s mission is to Build the future of human connection and the technology that makes it possible.
headlines
social networks
news article
-
Meta’s New AI Model Can Segment Anything – Even Video
BY
>>
|
full read
Takeaways
- Today we’re introducing the Segment Anything Model 2 (SAM 2), the first unified model that can identify which pixels belong to a target object in an image or video.
- SAM 2 can segment any object and consistently follow it across all frames of a video in real-time – unlocking new possibilities for video editing and new experiences in mixed reality.
Segmentation – identifying which image pixels belong to an object – helps with tasks like analyzing scientific imagery or editing photos. Our original Segment Anything Model released last year inspired new AI-enabled image editing tools in our apps, such as Backdrop and Cutouts on Instagram. SAM has also catalyzed diverse applications in science, medicine and numerous other industries. For example, SAM has been used in marine science to segment sonar images and analyze coral reefs, satellite imagery analysis for disaster relief, and in the medical field, segmenting cellular images and aiding in detecting skin cancer.
Our new Segment Anything Model 2 (SAM 2) extends these capabilities to video. SAM 2 can segment any object in an image or video, and consistently follow it across all frames of a video in real-time. Existing models have fallen short in enabling this as segmentation in video is significantly more challenging than in images. In videos, objects can move fast, change in appearance and be concealed by other objects or parts of the scene. We solved many of these challenges in building SAM 2.
We believe this research can unlock new possibilities such as easier video editing and generation, and allow new experiences to be created in mixed reality. SAM 2 could also be used to track a target object in a video to aid in faster annotation of visual data for training computer vision systems, including the ones used in autonomous vehicles. It could also enable creative ways of selecting and interacting with objects in real-time or in live videos.
Keeping with our open science approach, we’re sharing our research on SAM 2 so others can explore new capabilities and use cases. We’re excited to see what the AI community does with this research.
(Source: Meta)
