Upscaled frame rate moon landing and other footage

[Alberon]

I've not done a space post for ages and this one is slightly different. It's about how old footage from the Apollo moon landings shot at around 12 frames per second have been upscaled to 60fps using AI software and the results are astonishing.

Here's footage from the Rover during Apollo 16
https://youtu.be/bTQ-SmeLTl8

Here's footage from Apollo 14 upscalled from 12fps to 24fps
https://youtu.be/7WAWY-DktT0

From another user here is upscaled and stabilised footage of the Apollo 16 astronauts arsing about with the Rover near the lunar lander.
https://youtu.be/az9nFrnCK60

The technology is getting good enough that even the oldest films can be given a fresh look. Here's the Arrival of a train at La Ciotat from 1896 upscaled to 60fps
https://www.youtube.com/watch?v=3RYNThid23g

Most of the above are done by a method called DAIN which stands for Depth-Aware video frame INterpolation. It generates intermediate frames between the actual ones. The trick is making it look realistic.

Here is an example taking a recent film using lego characters shot at 15fps boosted to 60fps
https://www.youtube.com/watch?v=sFN9dzw0qH8

The app itself is available here, but it needs a computer with a good GPU and will take many hours to render even short snippets of film.
https://www.patreon.com/DAINAPP

Yeah, the results can look a little weird as you see 120 year old material looking like it was shot on video, but there are very few artifacts and does seem to remove the distance that low frame rates in old films generate.

[Mr_Simnock]

Could someone apply this to the Little and Large 1984 christmas special and see if it gives Sid any more life

[Non Stop Dancer]

Incredible.

[Bence Fekete]

These are fun.

But on an entertainment level, those astronauts were a bit boring weren't they? The by numbers planting of the flag; the aimless moon-buggying (just go round again you cunt). No flair or zeal. Shame they didn't send up physical comedians instead. A real shame.

[idunnosomename]

what the fuck can you do on the moon. i mean you could roll about like a fucking dickhead but what if it broke your spacesuit? then you'd be in a pickle. no wonder they waddled about a bit, scooted around, and like did one golf drive. i'd be scared shitless my suit would break and i would die

[bgmnts]

Surely half the fun is watching it as it is, its moment in time?

[Pearly-Dewdrops Drops]

what the fuck can you do on the moon. i mean you could roll about like a fucking dickhead but what if it broke your spacesuit? then you'd be in a pickle. no wonder they waddled about a bit, scooted around, and like did one golf drive. i'd be scared shitless my suit would break and i would die

If they'd bothered to put in the least effort for our amusement:
https://www.youtube.com/watch?v=wbAF1EExpek

[El Unicornio, mang]

Surely half the fun is watching it as it is, its moment in time?

It can be appreciated in its original form, but these upscaled versions are showing how it actually was (or close enough), not how it was through the filter of antiquated technology. It's harder to relate to low fps/black and white footage. They Shall Not Grow Old illustrates this perfectly in the scene where it transitions from the herky jerky 12fps old footage to 24fps/color.

[Shoulders?-Stomach!]

I'm sure I made a thread about this or similar not long back, it's a fascinating technology.

Older footage puts more cognitive distance between the events and modern life. Cleaning up and modernising the footage helps bring you into the scene and the lives of those featuring in a way that fuzzy juddery wee little stick men film just doesn't (the train clip is a great example).

Now, who will volunteer for the task of increasing the quality of vintage porn? I see a few hands at the back..

[Tony Tony Tony]

Now, who will volunteer for the task of increasing the quality of vintage porn? I see a few hands at the back..

I'll bet you can you dirty bollocks.

I for one am looking forward to the software that removes a hairy snatch.

[PlanktonSideburns]

Amazing

[PlanktonSideburns]

Would quite like to see it pushed to its limits - trying to do things at picture book level framerates

[olliebean]

Around 1:40 in the Lego one you can see the interpolation seems to have added a brief movement to the floor that presumably wasn't there in the original.

[Alberon]

Would quite like to see it pushed to its limits - trying to do things at picture book level framerates

This one takes a 1fps of the Apollo 11 flag raising and boosts it to 8fps.

https://www.youtube.com/watch?v=80EgRSggLag

As you can see there's only so much the software can do.

[PlanktonSideburns]

Great look tho!

[PlanktonSideburns]

Around 1:40 in the Lego one you can see the interpolation seems to have added a brief movement to the floor that presumably wasn't there in the original.

Stupid fucking cunts

[Johnny Yesno]

That's great, Alberon. I like space but the train station clip is the stand-out video me. The technique really turns what looks like a stop motion animation into a strange contemporary piece of film. Very weird feeling.

Tenuously related, I had the following video in my recommendations when watching the lunar videos. You might be interested, if you haven't already seen it:

New: Mars In 4K: https://www.youtube.com/watch?v=ZEyAs3NWH4A

For the avoidance of disappointment, this is not upscaled video from the Mars rovers but a video panning across a composite static image stitched together using the latest software. Still pretty impressive, though.

Also, get your popcorn ready as there's only just over 199 days till the next Mars rover arrives at its destination:

WATCH: NASA Mars 2020 Perseverance Rover #CountdownToMars: https://www.youtube.com/watch?v=h1-Y2JQkk_k

[PlanktonSideburns]

gonna download this and have a play. thanks for this post abes!

[Elderly Sumo Prophecy]

I was expecting it to look more like those Benny Hill sketches where he chases the women around then pats the man on the head.

[PlanktonSideburns]

Wow, you can just drop files in here no bov

Gonna mess with this tomorrow

[Alberon]

What are you planning to stick in there?

[Hand Solo]

So let me get this straight, the software AI is sophisticated enough to create in-between frames if there are enough points-of-reference for it to tie the images together? Therefore you couldn't plug something like La Jetée into it.. well you could, and you'd probably get something more interesting than the slide-show, with incoherent images slowly morphing into eachother, could be an interesting experiment actually.

But if you drew some frames of animation that were reasonably close it could piece them together like the traditional 'inbetweener' underling animators had to do in the old days whereas the old hands did the 'key frames'.

Or you could take photographs of a journey through a landscape and as long as there's a reference point, for example walking down a path and seeing a landmark further down into the distance and taking another photograph at this landmark, it could animate the journey between.. Allowing there's enough key frames along that journey for it to make sense of the environment passing by?

[PlanktonSideburns]

What are you planning to stick in there?

Currently working on some music videos involving a Welsh hatsune miku like vocaloid pop creation, who's animated at a low fps, will chuck her in there defiantly, see what it does to her motion

Might film some stuff, lower the frame rate, chuck it though, see where the limits are

Love the idea of throwing la-jete in there, gonna try do that! Might have to accelerate it a bit I guess

Chucked a video of said vocaloid pop star in there yesterday while working on something else, but it said my machine couldn't handle it, but I did have a load of video stuff open. Will give it another go tomorrow before I start anything else up

[Uncle TechTip]

Here's a chap with a few more and I'm very excited he's done Roundhay Garden Scene

https://youtu.be/Fxd8XJ_J0Gc

[olliebean]

I'd like to think it was intelligent enough to recognise a change of scene or shot and not try to interpolate between them, but that does mean the results from La Jetée might not be especially interesting.

[Hand Solo]

I'd like to think it was intelligent enough to recognise a change of scene or shot and not try to interpolate between them, but that does mean the results from La Jetée might not be especially interesting.

What if you introduced a slow cross-fade?

[Hand Solo]

Or you could take photographs of a journey through a landscape and as long as there's a reference point, for example walking down a path and seeing a landmark further down into the distance and taking another photograph at this landmark, it could animate the journey between.. Allowing there's enough key frames along that journey for it to make sense of the environment passing by?

I forgot.. There's a bit right near the beginning of Limitless that looks like it was done this way, with a sort of endless zoom through the city streets of New York that definitely looks like it relies on morphing between key frames. I'm guessing it was done via that sort of method, anyway?

[olliebean]

No, there wasn't any morphing. Just an awful lot of zooming.

[Captain Z]

That zooming runs on the same algorithm as "enhance" in all those crime thriller movies.

[Mr_Simnock]

No, there wasn't any morphing. Just an awful lot of zooming.

No chance, lol, how many cars did it zoom through? The distortion from the taxi windscreens would be enough to make the picture all dark and fuzzy.