We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Intelligent Machines

Algorithmic Video Editor Turns Amateur Athletes into GoPro Heroes

Automated video and sound editing software can make any bumbling idiot into an extreme-sports movie star.

Improvements to mobile devices and digital cameras have made it easier to capture video, but editing footage still requires significant expertise and time.

Visit any surf break, mountain bike trail, or ski resort and you’ll see people diligently filming their best moves and worst falls–and a lot of tedium in between–using smartphones and action cameras such as GoPros. Startup Shred Video has developed technology that tries to edit collections of such footage into short, slick, and shareable movies at the push of a button.

The company’s software uses algorithms that analyze and edit or remix video and music to try and make short movies in the style of those produced by extreme-sports brands to show off the exploits of their sponsored athletes. The final results are generally two minutes long or less. The company’s software is available to download for Apple computers.

Shred CEO Mike Allen says the company wants to be something like the video equivalent of Instagram, which by providing photo filters made it easy for anyone to make mobile snaps more interesting to other people. However, because producing video is more complex, Shred has had to develop more sophisticated technology. “It takes more than a sepia filter to make video great, it takes curation, pacing, synchronized audio and video,” said Allen, launching his company at an event held by the YCombinator accelerator program on Wednesday.

Software isn’t capable of creative decisions, but Allen says the relatively formulaic structure of extreme-sports videos is within its grasp. Shred’s software sets out to make movies that begin with slow-moving establishing shots (for example, showing the beach or ski slope at the start of a trip), transition to highlights of the adrenaline-pumping action, and then wind down with more shots of scenery and people at the end. “That formula still works even though you’re not doing the most extreme back flips,” says Allen.

The software selects footage to use by looking at time stamps and the pattern of acceleration in the frame. It can also shorten and remix any song provided by the user, using algorithms that can identify and edit the different musical parts of a track. The software aims to play the intro to a song during the establishing footage, and then switch to the chorus or a more up-tempo section just as the action begins. Cuts between clips are all made on the beat.

Last year, users of Facebook and Google’s social network, Google+, were offered automatically generated “year in review” movies combining both photos and video. They used music but didn’t let you choose it, and didn’t appear to remix it to fit the visuals. Google’s Photos service automatically creates movies for, say, vacations and allows you to choose from a menu of music and some visual filters, but it is not focused on action footage.

Allen concedes that his more ambitious software doesn’t always get it right the first time, but he says that it makes it easy enough to provide quick feedback—for example, to include or leave out some footage. A slick 2.5-minute video Allen made of a surf trip with friends took less than five minutes of work to produce from a collection of more than six gigabytes of raw footage, he says.

Shred will currently edit your video for free but charges $1 or more to save it.

AI is here.
Own what happens next at EmTech Digital 2019.

Register now
More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Insider Online Only.
  • Insider Online Only {! insider.prices.online !}*

    {! insider.display.menuOptionsLabel !}

    Unlimited online access including articles and video, plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    Unlimited online access including all articles, multimedia, and more

    The Download newsletter with top tech stories delivered daily to your inbox

You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.