topic Re: Re: Object Eraser AI Video in AI

Object Eraser AI Video

xmrdevi1ishx — Wed, 14 Aug 2024 14:21:51 GMT

Hello,

I am interested in learning more about the possibility of using AI to remove objects from videos, similar to how it can be done with photos. I recall seeing a demonstration of this capability in a Snapdragon 8 Gen 3 trailer, but I have been unable to locate any further information on the subject.

I would appreciate any insights or resources you may have on this topic.

Thank you for your assistance.

Re: Object Eraser AI Video

Star_girl — Sat, 02 Mar 2024 11:13:33 GMT

Following.

Re: Object Eraser AI Video

Babishko — Sat, 02 Mar 2024 12:22:48 GMT

This is an interesting query @xmrdevi1ishx. AI video boost and object removal was being rumoured to feature on the S24 series as far back as December 2023. The 8Gen3 chipset will easily be capable of such actions, so I see no reason why Video boost and Object removal won't come to the S24 series at some point over the next year. It is unlikely we will have to wait for the S25 series for such video abilities.

Re: Object Eraser AI Video

Reylob — Sat, 02 Mar 2024 12:28:48 GMT

Object eraser AI on a video is a very different proposition. There some video editing programs but they are more PC than phone orientated.

Object eraser on an image is tricky still and the final results depends very much on the particular case, some of them very far from perfect. In a video, that has to be done seamless for each frame. I do not know if the phone will have or be able to sustain enough computing power for this task. This would be very compute intense, heat generation and dissipation could be an issue and battery life will suffer terribly.

Re: Object Eraser AI Video

Ms_D — Sat, 02 Mar 2024 14:07:09 GMT

It's something that the new Google handset does (Pixel 8), but Samsung, at the moment, doesn't, as far as I know, do this for videos.

Re: Object Eraser AI Video

Reylob — Sat, 02 Mar 2024 16:57:29 GMT

I really hope you are right, but I do not share your optimism. Other than the commercial material from Qualcomm, I have not seen the Video Object eraser in action. I did this post about object removal on a picture.

https://eu.community.samsung.com/t5/galaxy-s24-series/object-eraser-how-to/m-p/9264572

The final result is not bad but very far from perfect. Using the AI feature was even less than desirable. The object was replaced not erased.

On a video, we have fixed object and moving objects. Imagine that I would like to remove from a video a person walking, that person must be tracked in all frames, erased, and generated accordingly. Depending on length of the video and fps, it could take a fair bit of time. Will the phone battery be enough? Removing small static objects from a scene, like a glass might be easier to do, but it would be quite resource intensive still.

Other AI features like live translation is completely unusable after two firmware updates. Like I said at the start, I really hope that you are right.

Re: Object Eraser AI Video

Reylob — Sat, 02 Mar 2024 17:44:37 GMT

Hi @Ms_D

Do you have any link to a video object eraser video on YT?

Video boost in done on Google's data centres not on the phone.

I have tried to find a video showing the video object eraser and cannot find it.

Re: Re: Object Eraser AI Video

Ms_D — Sat, 02 Mar 2024 18:45:34 GMT

This is one of many I saw on yt. https://youtube.com/watch?v=s89YemDxxhI&si=tcynR7vVmsUMkJRs

Re: Re: Object Eraser AI Video

Reylob — Sat, 02 Mar 2024 19:22:57 GMT

That is object remover on a picture not a on video.

Re: Re: Object Eraser AI Video

Babishko — Sun, 03 Mar 2024 09:45:11 GMT

I definitely agree with you @Reylob when you explain what a resource intensive feature a video erasure tool could be. There would have to be limitations on the amount of time that such a feature could be used for within the video itself at first. To track and erase an object for say 5 full minutes in a 4K 60 video would be neigh on impossible as you rightly say. If this feature had a time limit of only ten seconds per video then that may only be of limited use anyway?. And it may not look that impressive when done. Then again it MAY look very impressive?. The fact though that we are actively talking about the introduction of such features to our devices just shows what an exciting time it is, with AI enhancing our user experiences and offering almost boundless possibilities. If not now this instant, then in the near future.

Re: Re: Object Eraser AI Video

Reylob — Sun, 03 Mar 2024 10:46:52 GMT

Hi @Babishko

I also agree with you, we are living very exciting times. There is no doubt about it.

Google boost is done on Google's datacentres and it can take a few hours depending on the video. That would be a reasonable work around. Of course, the boosted video might not necessarily be better. Especially when "better" depends on what we prefer. e.g. vividness, detail.

An object eraser on a video may come to light with some limitations. For instance, the slow motion on a video, only works if the resolution is not 8K or HDR is not active. In similar fashion, we could have object eraser on certain videos and static objects within the videos.

All of these was science fiction not that long ago.

Re: Re: Re: Object Eraser AI Video

Ms_D — Tue, 05 Mar 2024 02:31:20 GMT

Aside from downloading apps claiming to do this, or getting the new Google handset, the Samsung handset doesn't, at the moment, do this. I say at the moment because Samsung is using the Ai technology from Google and they've only allowed them to use "some" of the technology.

Re: Re: Re: Object Eraser AI Video

Reylob — Tue, 05 Mar 2024 05:42:46 GMT

Hi @Ms_D

I have not seen any info on Object Eraser on a video in any of Google's commercial videos. The only reference was on a commercial material from Qualcomm.

There are some videos about Video boost, but no an Object eraser on a video, for pixel phones or any phone. The video boost is done by uploading the video to google data centres to do the boosting and then downloading the video back to the phone.

Object eraser on a picture has been available since the S22 series at least.

Re: Re: Re: Re: Object Eraser AI Video

Ms_D — Tue, 05 Mar 2024 08:09:09 GMT

So it's on the previous model/s but not on the newer ones 🤔 Thry (Samsung) should implement it if that's so. Especially if they're customers are requesting it. 🤷🏾‍♀️

Re: Re: Re: Re: Object Eraser AI Video

Reylob — Tue, 05 Mar 2024 08:31:33 GMT

@Ms_D

I think there is a misunderstanding on the function Object eraser. They are similar but work in different media. Object eraser on pictures and Object eraser on videos.

On previous model and the S24 there is a function called object eraser which can delete objects from a picture. It works and results depended on the object and the picture.

But I the OP was talking about object eraser on a video, which should delete an "object" from the whole video. For instance, you take a video on a beauty spot and a person comes into the frame. This function would allow you to remove the person from the video.

Qualcomm made some reference to that function when they announced the 8Gen3 chipset. However, I have not seen any commercial material from Samsung or Google alluding this functionality.

The chipset seems to be capable of doing so, but the implementation might be too resource intensive for a phone. e.i. it might consume too much battery or might produce too much heat.

A possible solution could be like Video Boost from Google which upload the video to the cloud and does all the heavy work on the cloud. Another possible solution, it is implemented the functionality but with limited scope, like only on very short videos and static objects in the video. Similar to the super slow motion of the S22 which could only record a few seconds.

Re: Object Eraser AI Video

Chris8881 — Sat, 28 Feb 2026 09:23:35 GMT

That feature was part of Qualcomm's 'Video Magic Eraser' showcase. While mobile hardware is catching up, high-quality video object removal usually requires specialized AI models. I've been using ObjectRemover.video recently — it’s powered by SAM3 Model and lets you remove objects just by typing a sentence. Might be exactly the resource you're looking for!