Become a fan of Slashdot on Facebook

 



Forgot your password?
typodupeerror
×
Graphics Software Media Movies Data Storage Entertainment Technology

Delivering 8K VFX Shots For the Dark Knight 263

agent4256 writes "Barbara Robertson over at Studio Daily put forth this article featuring the technical background for the production of The Dark Knight. With most of the film shot with IMAX cameras (producing a theoretical resolution of 18k), the studios could not handle the size. Instead, they cut the resolution by more than half, down to 8K, the maximum resolution for scanned film. 'A single 8K frame requires 200 MB of data,' Franklin says. 'So we had to upgrade our whole infrastructure. We needed faster network speeds to move data around, massively beefed up servers, and — the most important thing — a new compositing solution.' To give you an idea of how far technology has taken us: 'In 1999, when we worked on Pitch Black [released in 2000], we needed to access 2 TB of data,' Franklin says. 'This show used over 100 TB of data.'"
This discussion has been archived. No new comments can be posted.

Delivering 8K VFX Shots For the Dark Knight

Comments Filter:
  • by Wandering Wombat ( 531833 ) <mightyjalapeno&gmail,com> on Friday July 25, 2008 @03:32PM (#24340895) Homepage Journal
    "I thought you said the hardware was clear!"
    "I said it looked clear!" "Well, what's it look like now?" "... Looks clear."
  • What is the meaning of these "k's" they are referencing here? I'm thinking it's not "kilo" in this case if 18k of them takes 200 gigs to store, unless they are using some kind of anti-compression on the data.

    • Re: (Score:2, Funny)

      Thousand. Duh. Context is everything.
      • Re: (Score:2, Informative)

        by Anonymous Coward

        Note that the poster that you replied to already said kilo, and I'm pretty sure every person on this website knows what the prefix for thousand is. What we want to know is what the K is specifically, there are eighteen-thousand _______ per frame, and we want to know what the _______ is.

    • Re:18k? 8k? (Score:5, Informative)

      by jonnythan ( 79727 ) on Friday July 25, 2008 @03:39PM (#24341037)

      K = thousand, and they're referring to lines of resolution.

      For comparison, 1080p HDTV has 1080 lines of resolution. That IMAX camera records around 18,000 lines.

    • Re:18k? 8k? (Score:5, Informative)

      by MyNymWasTaken ( 879908 ) on Friday July 25, 2008 @03:40PM (#24341051)

      The 'k' refers to the horizontal resolution. The vertical resolution is a given since the aspect ratio is a fixed 1.34:1.

      18K means a 18000 x 13433 resolution frame.

    • From TFA article comments, it's horizontal resolution

      5.6K = 5616x4096

      8K = 8192x6144
    • 8K plates are typically 8192x4320

      At 16 bits per channel, it's 71MB per channel.

      That'd be 212MB for the color plate alone, not to mention the shadow, specular, and reflection plates.

  • 100TB! (Score:5, Funny)

    by Gr33nNight ( 679837 ) on Friday July 25, 2008 @03:41PM (#24341073)
    That's almost as much as my porn collection!
  • Besides consuming 100TB, anybody have any better ideas on a) how this stuff was stored and b) how it was backed up? SAN/NAS or internal disk on the servers?

    • If its anything like LOTR was, its on a huge SAN, and most likely fiber optic.

      • I would vote for some high speed NAS heads covering the arrays. These tend to get a lot of use, though they are really just LSI engenios. http://www.bluearc.com/html/products/titan-3000.shtml [bluearc.com]
        • 100T isn't much by storage standards. It translates to roughly 2 racks of hardware for high-speed/low-latency serving plus roughly half a rack for archival. I'd say $150-$200k ballpark which is a drop in the bucket for hollywood. So, serving the stuff at 4 Gbit/s ain't so hard, *processing* it at that rate is a different story.

    • Re:Storage? (Score:5, Informative)

      by evenmoreconfused ( 451154 ) on Friday July 25, 2008 @04:37PM (#24341983)

      We at the StereoLab in the National Film Board of Canada have an infrastructure set up specifically to manage a number of simultaneous 3D productions, several in "Large Format" (i.e. Imax) resolutions and the rest in various HD and 35mm formats. It's been to make over a dozen 3D digital films in the last few years or so.

      In practice we use about an equal mix of internal data server drives, SAN, NAS, and a pool of bare drives with a stack of empty shells. Often people drop a drive in a shell and attach it (via eSATA, FW800 or USB in that order of preference) to whatever machine they need it on, because it reduces network load. This technique works especially well for intermediate data that is output, reinput, and then discarded.

  • ...but only about 25 - 30% of the film was shot in IMAX, at four times the cost of regular the anamorphic process used for the rest of the film.

    Digital is dead! Long live film!

    • by Thagg ( 9904 ) <thadbeier@gmail.com> on Friday July 25, 2008 @04:21PM (#24341735) Journal

      Darren,

      In the Good Old Days of photochemical process work, say on Star Wars, it was not uncommon to shoot the visual effects shots on VistaVision and the rest of the movie at normal film resolution. The idea was that the process work at the time added significant grain, blurriness, and reduced contrast to the image, so starting from a larger format with less grain helped make the visual effects shots blend in somewhat more seamlessly.

      Doing the process shots on IMAX is a bit of a step up from VistaVision (ok, maybe two steps up!) but it makes some sense. Modern film stocks are much better than what was used on Star Wars, but there will always be something to be said for having more film acreage to work with.

      That said -- there is a bit of "because we can" here as well. When they made The Dark Knight, they apparently didn't want to compromise in any way.

      [disclaimer: I'm VFX supervisor for a film in production right now, with some 1000 shots...none of which we are doing at 8K]

  • 2TB - 100TB (Score:3, Insightful)

    by Arthur B. ( 806360 ) on Friday July 25, 2008 @04:07PM (#24341507)

    So it's a factor 50 in 10 years ? And we're supposed to be impressed ? That's doubling only every 7 quarters.

    • by jd ( 1658 )
      Be grateful. Hollywood is looking more and more to 3D films, and that means halving the resolution or framerate (if they use polarized light, which is the only way to get 3D in color without shuttered lenses).
      • Bah. 3d films should be delivered to the viewer with modeling, lighting and textures, but with just a recommended viewing angle. If I can't move the camera, it's not really 3d.
  • by Woundweavr ( 37873 ) on Friday July 25, 2008 @04:09PM (#24341523)

    -A single 8K frame requires 200 MB of data.
    -The Dark Knight is officially listed at 2hrs 30 minutes (150 minutes= 9000seconds)
    -Total usage 100 TB (5 frames a Gig, 5120 per T, 512,000+ frames)

    Minimal frame rate [wikipedia.org] is ~24/s.

    200 MB/frame x 9,000 sec/movie x 24 frames/second = 43200000 MB=42187.5 GB = 41.2 TB.
    If the frame rate was 60 frames/second then that would be the whole film (no retakes, extras, bloopers etc).

    I never realized the sheer amount of compression that is going on between the raw footage and getting it into a DVD.

    • Re: (Score:3, Insightful)

      by mr_matticus ( 928346 )
      Not all of the footage shot makes it into the finished film; this includes alternate angles, scenes shot but never finished, and deleted scenes cut after post-production...and probably other stuff. Even if it is included, it is sometimes composited from multiple source shots, which each need to be stored on disk, on top of the finished shot.
    • The data set for a show in a VFX studio includes several revisions of every shot, data such as models and textures (in this case a centimeter scan of an entire road), and thousands of revisions of project files, compositing data, etc etc etc.

    • IMAX (Score:3, Informative)

      by HaeMaker ( 221642 )

      Some IMAX is 48 fps. 3D IMAX can be 96 fps.

    • I never realized the sheer amount of compression that is going on between the raw footage and getting it into a DVD.

      More impressive is the IO bandwidth necessary to play back the uncompressed source in realtime.

    • That's 8k resolution. DVD only supports 0.7K resolution.

      So one of steps is to cut the image down by a factor of 10 IN BOTH DIRECTIONS.

      That means 99% of the pixels are thrown away before the compression even starts.

      BluRay would keep 6% of the pixels, which is a lot more, but still nothing compared to the original.

      And remember the theoretical resolution of IMAX is about 5x as much again (2.3x more in each direction).

  • by Space cowboy ( 13680 ) * on Friday July 25, 2008 @04:16PM (#24341629) Journal

    Back in the mists of time, I wrote the database for the content management system that Lucas used on Star Wars I (the Phantom Menace). For reasons I won't go into, it was called 'Cakes [digitalcon...oducer.com]', but ILM rebranded it internally as Media-DB.

    At the peak of filming, it was coping with 40 DTF tapes/day being ingested. A DTF held 120GB back then (I think), and they were filming for ~3 months. At the same time as ingesting, it had to stream low-res proxies of all the footage to multiple destinations (some local, some not), and deliver high-res frames across the internal network to the animators etc.

    Now, I doubt it was doing 40 tapes/day solidly - it'd depend on filming, but even taking 20 tapes/day, over 3 months that comes to ~160TB (assuming a 22-working-day month).

    I do have fond memories of doing the James Bond intro-sequence (The world is not enough) with Smoke & Mirrors in London. When there were thousands of frames of nearly-naked highly-attractive women having oil poured all over their bodies, the visualisation tools became... significantly more advanced at a rapid rate :-)

    Simon.

  • IMAX - not so much (Score:3, Interesting)

    by bill_mcgonigle ( 4333 ) * on Friday July 25, 2008 @04:18PM (#24341673) Homepage Journal

    TFA says:

    Nolan shot footage for the major visual-effects sequences with IMAX cameras

    Wikipedia says [wikipedia.org]:

    The July 2008 Batman Begins sequel The Dark Knight features six sequences shot using IMAX technology, which the movie's press notes describe as the "first time ever that a major feature film has been even partially shot using IMAX cameras"

    TFS says:

    With most of the film shot with IMAX cameras

    I went to see this in IMAX, a three hour drive from here. Don't waste your time if you're thinking of doing it. It looked no better than Iron Man, which I saw in a nice new theater, non-IMAX. This wasn't IMAX at a major science center, like in NYC or Baltimore, where the screens are massive - it was in a shopping-mall IMAX where the screen was no bigger than any other in the complex. Smaller, even, I think, then their best theatre. It had a very minor curvature, I think: this isn't fill-your-visual-field like I was expecting.

    Sure, the sound was punchy. But I was expecting a 60FPS 70mm 4-story extravaganza, and got a simply nice theatre, but with plenty of flicker, 35mm presentation, and no discernible benefits. It seems IMAX is following in the footsteps of THX. Moral of the story: not all IMAX theatres are created equal - check first.

    I hope this will save somebody else some gas.

    • I went to see this in IMAX, a three hour drive from here. Don't waste your time if you're thinking of doing it. It looked no better than Iron Man, which I saw in a nice new theater, non-IMAX. This wasn't IMAX at a major science center, like in NYC or Baltimore, where the screens are massive - it was in a shopping-mall IMAX where the screen was no bigger than any other in the complex. Smaller, even, I think, then their best theatre. It had a very minor curvature, I think: this isn't fill-your-visual-field li

      • Doesn't this mean it's not worth driving to your IMAX theater for any movie; not it's not worth driving to any IMAX theater for any showing of the Dark Knight?

        As I understand it, 'real' IMAX movies (the relatively short documentaries, typically) are presented in the high-quality format. The IMAX.com website is hard to dissect.

    • by Apotsy ( 84148 )
      Unfortunately, it sounds like you saw it in one of the IMAX MPX [google.com] theaters, which is (as you saw) a scaled-down version of the full IMAX system.

      Sorry to hear you had such a bad experience, but as I posted here [slashdot.org], they are going to replace it with something even worse soon, so if you can make it to one of those large installations in a major city like you mentioned, you should. This could be your last chance to see anything like this.

      Also, according to this [ascmag.com], about 30 minutes of the movie was shot in IMAX,
  • At 24fps = nearly 5GB/sec for playback.

    That's a mighty impressive I/O subsystem (at every level).

    (Assuming realtime, of course, which I doubt happens.)

  • by Apotsy ( 84148 ) on Friday July 25, 2008 @04:55PM (#24342193)
    For reference, the vast majority of digital projectors in existence are 2K. There are a few 4K ones in the wild, but the most popular tech for electronic projection (namely DLP) currently maxes out at 2K. Sony has some 4K SXRD projectors available, but very few theaters have installed them.

    The IMAX company is currently still running most of their theaters on the 15-perf 70mm film systems, so you can still see the full 8K image to day if you want to. The problem is, they are planning to install DLP-based systems [forbes.com] that will reduce the resolution to 2K x 2K (although the article doesn't mention that). Once those are installed, you will not be able to see images like we're seeing today. The resolution will be far lower.

    Even if Nolan and his team go for these kinds of high resolution images again for the next movie, there might not be any place to see it that can do it justice.

    Now I know someone is going to chime in and say that film is analog, so anything digital is automatically better, but ask yourself: Would you replace a high quality analog sound system with 4-bit digital sound? That's approximately what we're talking about here. If the IMAX company were planning to tile a bunch of 2K x 2K images on the screen to produce an 8K image, or maybe use some other technology to achieve the kind of resolution they have today, then it would be a different story. But they aren't.

    See it now, before they take it away.
  • From TFA (Score:2, Interesting)

    by Peeet ( 730301 )
    There are a couple of mentions about how they had to go in and hand code some tools specifically for the work on this movie (mostly because current tools couldn't handle the amount of data needing to be worked on at any one time) but what I found most interesting was:

    Matte painters worked in 8K resolution, and the artists painted texture maps in either 8K or 16K resolution, depending on the view. âoeThat was a bottleneck,â Franklin says. âoePhotoshop doesnâ(TM)t handle images above 4K very efficiently and itâ(TM)s a closed tool, so we couldnâ(TM)t get in there and add stuff to it. Working with Photoshop was possible, but slow. It took three or four times longer than usual to paint the textures.â

    I doubt the GIMP would have been able to do it either, but I wonder if in the future, it might get used for a project similar to this because it is open source and can be modified for special use like this.

Children begin by loving their parents. After a time they judge them. Rarely, if ever, do they forgive them. - Oscar Wilde

Working...