• IllNess
    link
    fedilink
    arrow-up
    9
    ·
    5 months ago

    Plugins can add controls and it can download videos, but plugins can’t interact with videos directly I think.

    Maybe use the Youtube API closed captions and figure out the patterns for ads that way?

    • Creat@discuss.tchncs.de
      link
      fedilink
      arrow-up
      2
      ·
      5 months ago

      Of course they can interact with it just fine, look at “sponsorblock” plug-in. It would also solve this problem completely. It already exists and works well, it just isn’t “AI” nonsense.

      • Jeena@piefed.jeena.net
        link
        fedilink
        arrow-up
        4
        ·
        5 months ago

        You are missing the point that sponsorblock only works without AI because everyone gets the same video delivered. Once they have targeted ads of variable length and amount you need someone to watch your specific version of the video and do the tagging where the ads ans sponsors are. You could pay someone to do it for you but that is expensive and very slow. Or you can train a ML model to recognize the patterns and tag it for you hopefully pretty fast.

      • IllNess
        link
        fedilink
        arrow-up
        2
        ·
        5 months ago

        Yes, that is adding controls and using a database from the SponsorBlock server.

        What I mean is a plugin cannot see the video. Like you can’t write

        if(screen == adScreen) {
             then skipToNextSegment();
        }
        

        The plugin isn’t reading the video, it is getting info from a database. For AI or machine learning to work ad injection, which might change for every user, doing what SponsorBlock is doing is not enough.