Meta Unveils SAM 2 a Unified Model for Real-Time Object Segmentation

Meta has created a new, super smart tool called SAM 2.

[{"selector":"#anim-d0783b37-b490-498a-bc8d-7b7334cf852f","keyframes":{"transform":["translate3d(-116.66667%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-1c1d90ed-d047-48a2-96c2-f3b9823d5038","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}] [{"selector":"#anim-2fb7eb3a-4412-4ddc-a9fa-0d85c2441599 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-11.948529180869857%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}]

This tool can cut out any picture or moving object from a video, really fast and accurately.

[{"selector":"#anim-6fc25bb7-2c93-45a3-8158-a47378c5a364","keyframes":{"transform":["translate3d(-116.66667%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-b7a23a0b-800c-4875-a134-46d30c550210","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}] [{"selector":"#anim-74b21274-4dea-4c8c-bccf-cd719e6bec1f [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-10.717974968249768%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}]

It's like having a magic wand that can perfectly separate things from their background.

[{"selector":"#anim-02769512-aa65-4ddf-9d6b-1fb97a052b37","keyframes":{"transform":["translate3d(-116.66667%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-f8b40543-d947-473f-8bf1-f7742cff6698","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}] [{"selector":"#anim-0332179e-2201-49ba-878b-e1f9b7255b0f [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-14.846292734247438%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}]

SAM 2 can quickly look at videos one by one and understand what's happening.

[{"selector":"#anim-13e0ebc6-779d-4f98-a806-60a5f4ad0a46","keyframes":{"transform":["translate3d(-116.66667%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-348ad975-4220-4a53-9bd1-ab83f220bf3e","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}] [{"selector":"#anim-7ea007c2-b740-4ef6-8ebc-68e37e707fbf [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(31.371753133717768%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}]

It can learn to cut out things it's never seen before, making it very versatile.

[{"selector":"#anim-9d59a2cd-ce52-4d6a-81a3-56fc8117b29c","keyframes":{"transform":["translate3d(-116.66667%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-54a8ac81-f60d-4ab0-99e2-d7fc5af15a06","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}] [{"selector":"#anim-91b08326-0de2-469b-a8bd-b47c9394bea1 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-31.248172757000063%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}]

Meta is sharing SAM 2 with everyone so that other smart people can make it even better.

[{"selector":"#anim-e433f9c8-f381-424a-9824-c84d9f988c5d","keyframes":{"transform":["translate3d(-116.66667%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-9e105997-3d5f-4318-9e36-103ba7c23c36","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}] [{"selector":"#anim-f05fff7e-2e88-4c5b-9f70-aa182f7b61f9 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-7.812499744007886%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}]

SAM 2 is a huge step forward in how computers understand pictures and videos.

[{"selector":"#anim-5a0aab2d-23e4-4a46-9bdf-2044012480fa","keyframes":{"transform":["translate3d(-116.66667%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-d8ced8b3-b4be-460e-b24f-99cfabda2a99","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}] [{"selector":"#anim-b46c2ffb-a06f-44aa-b72d-e495b7cffbb6 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(29.756042849407542%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}]

It has the potential to change how we use technology in many different ways.

[{"selector":"#anim-59968930-2bd5-4f85-8234-d45cfb3348c7","keyframes":{"transform":["translate3d(-116.66667%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-ecf19be4-a5a8-455b-a148-892cc9a20b90","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}] [{"selector":"#anim-d56218b4-4507-453c-82db-ef3b27807afe [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-7.812499744007886%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}]