More on LoTR Special Effects 270
sushi writes: "Another LoTR article: this one focusing on the technology used at Weta Digital (the CG shop). Interesting that they are undertaking "major" R&D into running more Linux, and that Linux "delivers about two times the price performance compared to systems running proprietary operating systems". I've been lucky enough to have seen inside this place, and it's cool to see a render-wall of linux boxen. Full story
from a New Zealand newspaper." We linked to another good article about WETA a month ago.
What would be the best way to build this? (Score:1)
vs. Pixar (Score:1)
Re:vs. Pixar (Score:2)
Pixar probably pushes more ultra-high resolution CG than any other house, and therefore they own one hell of a farm, athough they don't use much in the way of OSS. You can read about their latest hardware (purchased this spring) on Sun's site [sun.com], basically they have 250 SunFire 3800's, with 8 750MHz SunSparc IIIs, 16GB of RAM, and 108GB of disk space each, plus some addtional disk space, for a total of 1.5THz processing power, 4TB of ram, and 27TB of disk space.
Re:vs. Pixar (Score:2)
The comparison probably isn't fair because Pixar and Weta do very different jobs. Weta does visual effects and Pixar does character animation. They are superficially similar in that they often use the same modelling and rendering tools.
VFX houses generally have to produce "elements" to match existing photography (matching camera motion, set lighting and so on). That's actually where most of the trouble happens: getting things to match. So a VFX house's best friend is not necessarily the modeller and renderer, but the compositing system (Cineon, Shake, Avid, After Effects etc).
OTOH, Pixar has to build characters and worlds from scratch, like in traditional 3D animation (e.g. that of Aardman). Every prop and every piece of set decoration needs to be modelled, placed and rendered. Their best friend is the animation system (in Pixar's case, often incorrectly referred to by marketroids as "Marionette", but known to everyone inside the company as "Menv").
Note that this skips over a lot of detail (and I'll no doubt be corrected/chastised for oversimplifying things), so take this with the appropriate sodium chloride.
Re:vs. Pixar (Score:2)
Interesting, isn't it? (Score:5, Interesting)
I'll tell you why -- good old fashioned ego. Whereas the low end (kernel developers, compiler writers, etc.) and high end (clustering software, 3D modelling and rendering, etc.) of development is led by strong, well-organised teams of well-trained developers with vision and understanding, the middle ground of the Linux is polluted with warring egos that suffer too much from the problematic NIH (Not Invented Here) syndrome. There are a myriad of competing, mutually incompatible yet separately inadequate office suites (Star Office, KOffice, Applix,...), desktop environments (KDE, Gnome, XFCE, CDE, UDE, ROX,...), and X servers (XFree86, MetroX, XiG). We can't even decide [cups.org] on a [lprng.com] printing system [ghostscript.com]! I realize that, according to Eric S. Raymond's famous "Cathedral and Bazaar" text, that open-source software is primarily written to scratch an itch and get peer recognition, but this is taking it too far. If all the man-hours poured into KDE and GNOME were combined into a common vision, we would have one perfect end-user desktop, instead of two poor imitations of Windows.
Don't give me the old "competition" argument either. There is only one Linux kernel, which seems to progress just fine without another competing project nipping at its feet and instigating flamewars. The endless KDE vs. GNOME, Applix vs. StarOffice, and other feuds have wasted more productivity than would be gained by and competitive drive.
I, for one, am somewhat miffed that while my operating system powers Hollywood blockbusters and NASA supercomputers, it still can't fully replace Windows on my office desktop. Linux is growing up; its users need to grow up with it, shed their egos and work towards the common goal of creating an excellent working environment.
Re:Interesting, isn't it? (Score:1)
Do you know *anybody* other then MicroSoft that has maged to render MSword files corrently?
The StarOffice folks giving up and going with XML instead was the best idea they had in a long time.
Re:Interesting, isn't it? (Score:2, Offtopic)
Opening a Word document is difficult, because it requires lots of reverse engineering, and many people do play Quake at roughly equal performance under Linux or Windows. XFree is popular because it is FREE, the others you mentioned are commercial (and with other advantages and disadvantages).
So, no, it really isn't all that interesting. It is a banal view point; if things aren't improving in your specific area quick enough for you, then do something about it (coding, guidance, money, bug fixing, bug reporting, whatever) It seems to me that YOU have the ego problem, expecting that everything should do exactly what you want.
Besides, you are WAY off topic.
Re:Interesting, isn't it? (Score:3, Funny)
Besides, you are WAY off topic.
No he isn't. Won't all these Linux Render Farms be used to animate Trolls?
Mod this up, and its parent down (Score:1)
Re:Interesting, isn't it? (Score:2, Informative)
Linux has started to become the platform of choice for extremely complex and involved multimedia production, powering enormous render farms and video storage RAID arrays, yet still, Linux falls on its face for mundane day-to-day productivity work.
A rendering application is fairly operating system independent. It only requires ANSI C level functions for opening the source files, crunching the data, and writing the output. There is a little bit of OS stuff for communication between nodes etc, but really nothing compared to making a wordprocesssor.
So if you have a Solaris or SGI renderfarm program, and you recompile it for linux, you quickly get a userbase of happy users who start wanting to run the modeller on this cheap hardware. So you port that too, which might not be that hard if it was coming from another unix.
Writing a spreadsheet that reads Excel files is more difficult than porting your own application which you know you can sell, for actual money.
Re:Interesting, isn't it? (Score:2)
Monsters, Inc was modelled, animated and lit on SGIs and final rendering was done on Suns. No Linux here (yet).
I think you meant Shrek.
Re:Interesting, isn't it? (Score:1)
Re:Interesting, isn't it? (Score:2)
Er... that's what I said, wasn't it?
What Astral Traveller said was:
Now of course this is true. Linux can do the job. (Rumour has it that Pixar has found that FreeBSD running with Linux emulation is actually slightly faster at running prman than Linux itself for their kind of scenes, though. It's probably virtual memory performance dominating.) However, until someone comes up with a 14-CPU-per-box Linux machine, Pixar will stick with their Suns.
Well. (Score:2)
And lets not forget that there are a lot of competing companies and products out there for high-end graphic synthesis. The difference is that they are in 'traditional' competition with each other, I mean, you could argue using the same logic that if all the major graphic companies merged and worked together you'd end up with something truly amazing, but I doubt that. I think you'd end up becoming stagnant. (and don't forget that these products aren't even Linux exclusives or open source. You can get a lot of these programs for windows or other UNIXs)
And there's another reason that we have competing standards, people have different visions for software, and since they're working for free, they are going to do what they want to do. Who knows of KDE people would be working on GENOME if there was no KDE or vise versa? How do you know it would result in a Super-gui and not some boring half-done shell whose developers are complacent in their lack of competition?
Re:Well. (Score:2)
Would you be happier with GNU/Linux? *duck*
Re:Interesting, isn't it? (Score:1)
Mixed Messages, Movies and Linux (Score:1, Insightful)
Meanwhile, the production side has realized that it is really useful and is wholeheartedly embracing it.
You have to wonder if sooner or later some pointy-haired boss at the MPAA is going to wake up and go "WHAT! We USE Linux!? We use that communist, anti-American.... Well that had better stop immediately!"
I wonder how the "copyright" industries will try to resolve this - they don't want regular people to have powerful tools like programmable PCs and free software. But they sure want to use free software to make movies.
Maybe they'll go for an approach of requiring "computer licensing" but only if you use "non-approved" software. Most people wouldn't care because most people just run Windows, and they wouldn't need a license. Only Linux users, software developers, and computer science students would have to get licensed.
Kind of like you need a license for a car, but not for a bicycle. (Or continuing the analogy, Windows XP == tricycle...)
Quake?? (Score:1)
Re:Interesting, isn't it? (Score:4, Funny)
I'll tell you why -- good old fashioned ego.
No no no... I think you mean id.
Re:Interesting, isn't it? (Score:2)
> Linux has started to become the platform of choice for extremely complex and involved multimedia production, powering enormous render farms and video storage RAID arrays, yet still, Linux falls on its face for mundane day-to-day productivity work.
That's funny... I've been using Linux for mundane day-to-day productivity work for years.
And it's still getting better.
Re:Interesting, isn't it? (Score:1)
Re:Interesting, isn't it? (Score:1)
BTW, not that it matters, but for the record I'm a "he."
Re:Troll? (Score:2)
Why are you so small-minded and petty that you cry troll at the slightest provocation?
They tend to do that when you make points that they can't refute logically.
Re:Troll? (Score:2, Insightful)
Why are you so small-minded and petty that you cry troll at the slightest provocation?
Possibly, because the link between 'suitability of Linux in Office aps' and 'use of Linux as a render farm for LOTR' was fairly tenuous.
And after you see so many Slashdot Stories turn into Microsoft v. Linux for SOHO users falme wars, you get a bit jaded.
Though if you wait about 10, 20 minutes, someone'll post a story about KDE, Gnome, OpenOffice, etc. where your post will fit in perfectly.
Also, you forget the rallying cry of the Linux coders (myself not included): if you don't like it, change it!
I'm also annoyed that it does all this flashy stuff while still not getting the basics right
That's an interesting point - many Linux advocates (myself included on this point) would say that Windows is the flashy one, and Linux gets the basics right. Basics like stability, security....
Re:Troll? (Score:2, Offtopic)
Fine, I'll bite. That's not slightest provocation. You offer one paragraph of barely on-topicness immediately sequeing into three paragraphs of rehashed rant.
Linux falls on its face for mundane day-to-day productivity work.
That depends on what you use it for doesn't it?
it can't even open a simple Word document without formatting errors.
StarOffice (you did say "simple" Word documents..)
Linux stills falls short of Windows when playing Quake.
Client benchmarks that I have seen are dominated by graphics card/driver combinations and as such are dependent on the card vendor. Indeed in the case of the matrox g200 I could actually *play* qIII linux while matrox sat on their asses and refused to release a working windows opengl driver for the longest time. People generally favor linux for quake servers.
If all the man-hours poured into KDE and GNOME were combined into a common vision, we would have one perfect end-user desktop, instead of two poor imitations of Windows.
My guess is we'd just have one "poor imitation of Windows" as you call it. The practical weakness in your argument is deciding whose vision should be followed.
Don't give me the old "competition" argument either. There is only one Linux kernel, which seems to progress just fine without another competing project nipping at its feet and instigating flamewars.
*BSD. To a lesser extent, Windows itself. And to a still-lesser extent, GNU/Hurd, which if everybody had swallowed their ego (and worked on it instead of that upstart Linux) probably still wouldn't be ready for prime time.
The endless KDE vs. GNOME, Applix vs. StarOffice, and other feuds have wasted more productivity than would be gained by and competitive drive.
These feuds are generally propagated by users such as yourself rather than the actual developers. As such, little productivity is lost.
I, for one, am somewhat miffed that while my operating system powers Hollywood blockbusters and NASA supercomputers, it still can't fully replace Windows on my office desktop.
Show me one instance where you have properly submitted a bug report/feature request for any of these office programs you need and I'll reconsider dismissing you as an opinionated parasite.
Sincerely, a fellow opinionated parasite
Re:Troll? (Score:2)
Not to call attention to the devil its self, windowsXP, but now when something crashes (i.e. "the playa" *.divx player) in windowsXP, it asks if you want to send an error report to microsoft.
Also, people submit bugs for mozilla, windows platform [mozilla.org] all the time, microsoft themselves have a bug submit page [microsoft.com]... i mean, it does happen, and rather often.
All i'm saying is that not all windows users are idiots. However, all idiots use windows.... or something.
~z
Re:Troll? (Score:1)
Re:Troll? (Score:2)
Re:Troll? (Score:2)
--
Evan "Mr. IronyFish"
Re:Troll? (Score:2)
Where, pray tell, then can I download it and the libraries it depends upon, and what license is they all under? Are you *sure* I can get MFC at no cost? Or do I have to buy products from Microsoft? Qt is avilable GPLed from ftp.trolltech.com, ftp.kde.org, or from the KDE CVS.
--
Evan "Paid member of MSDN till 1999"
Re:Troll? (Score:1)
How much Visual studio costs? lets be modest and say $500? now you know thats for only 1 platform, so if you want you app, for Unix for example - you need something like umm, this? [mainsoft.com] (hint - the price is MUCH more then $1000).
So yes, if you're writing commercial applications for Windows - then you really don't need QT, and MS solution would be much cheaper.
However - if you want a multi platform solution (Linux, Solaris, IRIX, HP-UX, SCO, Mac OS X, Windows [95/98/ME/NT/2K/XP]) along with the best documents - then GTK will be thrown out by any serious developer and they'll go with QT.
Of course - IMHO QT should make what I call a "student" edition - but you'll have to write it to them [mailto]. Maybe if lots of people will write to them they'll do something about it.
Re:Troll? (Score:2)
Fine. Send me a licensed copy of Windows for free. Or, to end this thread and spell it out for you - you pay for it when you *buy* windows. You know - when you slap down your money at CompUSA, or what Dell charges you to cover what they pay Microsoft per computer shipped.
*Sigh*... Plus, as others have pointed out in this thread, MS is even moving away from this, charging seperately for developers for the .NET experience. In the past. they have always charged for documentation, Resource Kits, etc. I've been a developer for ten years, a good chunk of it on Windows, and I have paid quite a bit to Microsoft in that time. Now that MSDN is finally coming together online, they are charging for it. KDE has insanely great [andamooka.org] documentation [kde.org] for free, and their source is available in CVS [kde.org], and all their libaraies down to the OS level (and potentially the OS itself) is available for free (and is Free).
--
Evan
Re:Troll? (Score:2)
Re:Interesting, isn't it? (Score:1, Offtopic)
Don't be. I am not a troll, and am well-fed besides. :-)
First, who has the right approach, KDE or GNOME? Which system is better? If we don't know that it would be a mistake to devote all of our energy to one.
Well it should have been obvious from day one that KDE was the better target. GNOME was a hastily-thrown-together mishmash of whatever GPL programs were available at the time, put out solely for the purpose of avoiding the "corrupting" influence of Qt (a point which is moot today) and destroying KDE. KDE was and is planned out; detailed release schedules are maintained and are met more often than not, because everything being done to the core KDE framework is well-planned in advance. Can you tell me, with any certainty, when the next version of GNOME will be thrown together, and what improvements the new version will bring? (I'm sorry for sounding trollish, but GNOME really is a mess. What were they thinking when they decided to do everything in C? Why do I need to install 34 different packages with extremely fragile version dependencies in order to get it running?)
Second, the kernel has no competition? What about BSD?
The *BSD developers make no pretensions of competing with Linux; their development focuses most on its strengths as a server, router and general network bit-pusher. If they were attempting to compete with Linux, you would see more work put in towards implementing 3D support, low-latency patches and other multimedia enhancements Linux has been making great strides in. The fact is, 200FPS in Quake is worthless on a server, and they don't try to compete in this arena. BSD and Linux complement each other, they don't compete.
Re:Interesting, isn't it? (Score:2)
KDE certainly doesn't seem to need much help; they are improving very fast (each release of the KDE/KOffice/other associated packages seems to contain as many improvements or more than a release of Microsoft Whatever, which takes longer to come out). Not that I would know, I just use KDE applications whenever possible.
In any case, according to you, it's hopelss. Windows has more customers, and a "functional" Windows XP Advanced Server installation probably involves more lines of code than a functional Linux install with a variety of desktop and server applications, so let's all contribute code to Microsoft!
Hey wait, he's arguing against freedom for coders... could it be RMS???
Re:GNOME is just as good as KDE (Score:2)
Re:Interesting, isn't it? (Score:2)
Imagine... (Score:1, Funny)
poundincludegeek
CGI with Maya on Linux (Score:3, Interesting)
PC does anybody know if Alias is going to port MAYA onto the Visual PC
but running Linux ? The MAYA renderer should be easy to port as it
requires no graphics capability.
I am thinking of setting up a MAYA render farm and my preferred
platforms would be the Visual PC running Linux. I am VERY wary of using
NT which has an appalling reputation for unstability, requires far more
support than Linux, is subject to multiple upgrades/service packs and
has VERY poor performance under load. Linux would provide superior
through-put, superb stability/reliability and also integrate very well
and easily into my otherwise SGI dominated setup.
Anybody else interested in a MAYA renderer port to Linux ?
Please do not reply if you are trying to tell me how good NT is - the
growth of Linux in comparision to NT tells me what I need to know - even
with Microsoft spending millions of dollars advertising NT its sales are
only comparable with Linux sales - virtually unadvertised compared to
NT.....
Re:CGI with Maya on Linux (Score:2)
Re:CGI with Maya on Linux (Score:2)
Eeehhh, Alias Wavefront ported the Maya batch renderer to Linux and announced it at SIGGRAPH 99. And of course if you are looking for a reneder farm for Maya, there is also Phortorealistic RenderMan from Pixar (couple it with RAT: RenderMan Artists Tools) which is also available from Linux for a couple of years at least.
Maya itself has already been ported to Linux (v. 4) and to Mac OS X (V. 3.5 I think).
Check it at the Maya press releases page:
Maya Press releases [aliaswavefront.com]Re:CGI with Maya on Linux (Score:2)
Re:CGI with Maya on Linux (Score:2)
The speed is there on Linux, most studios are looking at moving from IRIX in the future, or they have moved. We are looking at moving from IRIX in the near future.
Most larger production studios have in house tools as well as Maya and other pieces of software, so A|W's port is only one part of the solution.
What happens to the old clusters??? (Score:1, Redundant)
What I would like to know is what they do to the old computers... I hope that they do things like donate them to local schools and the such, I know that for most applications it doesn't realy matter if you don't have this year's Pentium 54 with 5gigs of ram, but I would imagine that these machines are tricked out pretty nicely. Does anyone know what does happen to them?
1000 machines x $2000 = $2,000,000
Thats still cheaper than a bigname actor... shocking
Re:What happens to the old clusters??? (Score:2)
Re:What happens to the old clusters??? (Score:1)
I have a friend who recently spent some time at Weta, and by the sounds of it the boxes are all high spec, and therefore probably not going to any developing nations anytime soon
Re:What happens to the old clusters??? (Score:1)
Re:What happens to the old clusters??? (Score:2)
Re:What happens to the old clusters??? (Score:2)
Re:What happens to the old clusters??? (Score:2)
Re:What happens to the old clusters??? (Score:2)
They have worked in several Peter Jackson movies most notable Heavenly Creatures and the Frighteners. But they have also done other work like most of "The Ride" sequence in Contact.
The only question left is what will WETA Digital be like after 2003. For the time being they are concentrating almost exclusively on LOTR.
Linux rendering farm (Score:1, Informative)
entrenched as a major rendering farm OS and is starting to move into the
workstation environment! Get it? Workstations ARE on the desktop! Remember
that it was the workstations were the Winvocates claimed the real work was
done! Seems Linux is continuing on it's course to become of becoming the
dominate OS in computer generated special affects in the movies!
http://www2.linuxjournal.com/lj-issues/issue88/
A great quote:
"Some wonder how Linux will dislodge Windows on the desktop because leading
desktop applications such as Microsoft Office (Word, Excel and Access)
aren't there. But, if you are a motion picture animator most of your
everyday tools are already available on Linux, and the number being ported
or even produced specifically for Linux is increasing at a remarkable rate."
Seems that when the tools are ready, people are more than willing to
switch! Hell, there more than ready, they'll even developed their own tools!
"For character animation, a scan of a paper sketch is done using
ToonShooter. Production software lead Derek Chan explains, ``ToonShooter is
an internal tool we wrote for Linux. It captures low resolution 640 × 480
line art that the artists use to time the film.'' Created more than a year
ago, this Linux capture stand software is deployed in three animation
departments. Chan says, ``Demand was keen for this Linux software, and we
delivered it ahead of schedule. DreamWorks has 60 units in production
now.''
Hmmm, It all sounds like the work that winvocates claimed as the domain for
NT. Departmental changes in OS's. Could this be how Linux takes over the
desk top? One department at a time?
Ironic (Score:2, Interesting)
Weta has a "major" research and development effort under way at the moment into running more Linux-based workstations.
Ironic that Linux was used to make this movie & DVD but Linux users would be prevented [slashdot.org] (in the US) from distributing the software to watch the movie.
LotR Topic (Score:2, Insightful)
Isn't this enough to merit a topic already or will LotR continue to play second fiddle to the increasingly mediocre Star Wars franchise?
too much thought involved (Score:2, Funny)
What rendering software are they using? (Score:3, Interesting)
Re:What rendering software are they using? (Score:1)
Re:What rendering software are they using? (Score:4, Informative)
Ohhh, and WETA Digital is using PRMan. There is one guy from there that frequently posts at the RenderMan newsgroup. He even posted at least once job openings for shader writers. They also use Houdini, which has a Linux port and it has a great RenderMan connection.
Re:What rendering software are they using? (Score:2)
For comparison both SGI and Alias started in 1982, Softimage in 1986, Wavefront and TDI in 1984. Blue Sky started in 1987, but most people came in from MAGI (like Dr. Troubetskoy sp.?), which itself started in 1966. Some of the Blue Sky studio founders at least were at MAGI in the late 70s or early 80s. Rhythm and Hues was founded also in 1987 but the founders (like John Hughes and Keith Goldfarb) came from Robert Abel's company (itself started in 1971). All these places only had propietary software (and many of the old ones used Crays).
Next year a special edition DVD of Tron will come out. Hopefully the extras will include plenty of info from this earlier era of CGI.
Re:What rendering software are they using? (Score:2)
My own perspective is from pro audio- specifically, mastering. You might say that you wouldn't see open source people do serious stuff in wordlength reduction or mastering processing, except that it wasn't- the person who did serious work in wordlength reduction wasn't 'open source people', it was me. And I suck at coding, am miserable at file handling, but got the basic algorithms down- in the pure GPL sphere. Enough people know about that now that it can't be taken away...
On the basis of this experience I'd suggest that what will happen is not OSS coders _learning_ to do 3d, but instead some iconoclastic 3D coder, possibly one with poor coding skills _outside_ of the central problem, will throw together something that works because _they_ believe in the concept. It's gotta be an insider rather than a coder project meant to meet a goal- but it may still be somewhat 'hobbyist', for instance it might be directly comparable in output quality but not capable of pro-level workflow (that's what bit _me_ with my own project). But there's likely to be something- possibly even soon. Whether you'll hear of it is another story because it'll be done by a person or people who are primarily geeking out on the project because it interests them and meets their immediate needs- publicity comes much later, if at all.
Re:What rendering software are they using? (Score:2)
Re:What rendering software are they using? (Score:2)
Massive (Score:3, Insightful)
Aside from the impressive technological feat, imagine looking forward to the day when effects like these are availble for Gaming Engines.
Imagine Quake IX out in an open plane of battle with literally hundreds of thousands of soldiers and other things out there all at once.
I am reminded of something similar to the weekend dogfights/lanparties at the Airforce Academy, but with a much larger field of action.
[smile]
Re:Massive (Score:2)
With that much going on in one place, I don't think it would be much fun because the overall hit rate would preclude survival for a significant amount of time.
Re:Massive (Score:2)
I don't know, you could always spawn in a dead zone where everyone has been killed off already, more or less...
But I am sure that there is a whole crowd of people who would go for it. Just as described. say, in an over-sized and semi dormant volcano caldera.
Ten thousand people in a square mile equals one person per 50 foot square (roughly) for a large distance. not so bad until they start mobbing. Start looking for many hole covers really quick.
Re:Massive (Score:2)
Re:Massive (Score:2)
It's not all that fascinating as there's only 20-50 enemies in your immediate vicinity at any given time. Most of the fun is firing big ol' weapons into _crowds_ of enemies. They can't be projectile-using enemies or you're just hosed instantly ;)
That said- there _is_ a coolness factor to this type of gaming. It's very unlike Quake, but I'm told Serious Sam is more prone to hitting you with a fairly large number of enemies.
Re:Massive (Score:2)
Re:Massive (Score:2)
The solution employed at WETA is to use state-of-the-art graphics hardware to render the view from the eyes of each simulated actor. He then plans his actions based on this view, correctly placing his feet on the changing terrain, correctly attacking bad guys while avoiding attacking good guys, and so on.
Of course, this is only one part of the system. There are a few thousand motion-captured full-body gestures used for each simulated actor to implement these desired goals; for example.
I have been extremely impressed, stunned even, by the astonishing pace of development on this movie. They've come up with shockingly great solutions to very hard problems, on a time scale that I wouldn't have thought possible. If you read the article, John Labrie says that he wishes that he had more time to plan, and didn't have to just react -- but I can't believe that there is any better way to make a movie. When the director-artist-programmer team really starts to hum, you can get amazing progress in a very short time.
thad
Treebeard? (Score:1)
Text of article (Score:3, Informative)
Lord of the special effects
03 December 2001
By AMANDA WELLS
Weta Digital chief technical officer Jon Labrie was looking forward to a lull after delivering the special effects for The Fellowship of the Ring, the first in Peter Jackson's Lord of the Rings film trilogy.
The facility, based in the Wellington suburb of Miramar, delivered the effects shots in early October, with the film's Australasian premiere scheduled for December 19.
But, Mr Labrie says, things are not proving quite as quiet as expected, and Weta's biggest workload is yet to come.
Work has started on key shots for the second film, The Two Towers, and a detailed plan is being drawn up for tackling the sophisticated effects needed in this film and its successor.
Weta will deliver The Two Towers effects by October 1, 2002.
Mr Labrie says the facility has yet to get a clear picture of the workload for the film, which involves animating several key characters.
Gollum, an evil creature bent on retrieving the One ring he once possessed, emerges in the second film, and Weta's graphic artists have begun bringing him to life. Gollum is shown close-up and must appear believable.
Treebeard, an ent or talking tree, also appears in the second film, along with other creatures for which Weta has developed digital fur.
Mr Labrie says Weta will probably have to grow by another 10 per cent to complete The Two Towers, up to about 250 staff.
The trilogy's second and third instalments contain some impressive special effects set pieces, he says.
The third film features "an extraordinary number of battle sequences".
Weta crowd supervisor Stephen Regelous has created software, dubbed Massive, that creates realistic crowds. Every individual in the crowd moves in response to stimulus such as terrain, and to the actions of others.
The battles in The Return of the King will see hundreds of thousands of these intelligent agents in frame at the same time, Mr Labrie says, stretching the software to its limits.
Massive was developed on SGI operating system Irix and has since been ported to open source operating system Linux.
The deadline for delivering the third film's effects has not yet finalised, but could be October 2003.
In terms of the facility's workload, creating effects for The Return of the King will be equivalent to the first two films combined, he says.
Mr Jackson has kept tabs on filming and effects while offshore through extensive use of videoconferencing. He could view the output of a camera remotely, and artists could transfer frames via an FTP connection.
Mr Labrie says that at the start of the project in 1998, it was hard to conceive how much work it would be to complete simultaneously all three films based on the 1200-page epic.
JRR Tolkien's world is hugely detailed, with a vast variety of landscapes and diverse array of creatures.
Elves, dwarfs, hobbits, trolls, orcs, ents, wraiths and balrogs populate Middle Earth, and purists will be watching keenly for a literal rendition.
Mr Labrie says Weta's naivety was probably a good thing.
"Nobody would want to tackle three films again, not at the same time."
Weta grows seven-fold
Mr Labrie joined Weta Digital in 1995, when the company was set up to provide effects for Mr Jackson's films.
Weta is privately owned, with Mr Jackson's 34 per cent the largest individual stake.
Mr Labrie came to Weta from the US, where he had mostly recently worked on effects for science fiction blockbuster Independence Day.
He has overseen the facility's expansion from 30 to 230 staff.
Weta has created effects for previous Jackson films Heavenly Creatures and The Frighteners, but the Lord of the Rings trilogy far outstrips these in complexity and volume of effects.
About 1500 effects shots will be created in total.
Mr Labrie says if he was doing it again, he would spend more time up-front on planning for growth and "less time reacting".
Planning of this kind is underway for films two and three at the moment.
In terms of technology, "there's not a lot I'd do differently," though getting digital asset management up and running was problematic.
"There are still issues to be addressed, but for the most part we have done it right."
The growth of the facility has been "far greater than we anticipated". Originally, Mr Labrie thought Weta would need between 80 and 90 graphic artists to complete the trilogy's special effects.
But artist numbers hit 167 in August, at the peak of The Fellowship of the Ring production, with 225 staff in total.
At the moment, the facility has about 205 staff, with some people leaving to work on other projects or heading home to other countries after the first film was completed.
Numbers will ramp up again in the New Year to hit between 230 and 235 in April or May.
Finding graphic artists for the project is not a problem, Mr Labrie says.
"Everybody wants to work on Lord of the Rings."
Just under 40 per cent of the artists are Kiwis, 31 per cent from the US, 11 per cent from Australia, 5 per cent from Britain and the rest from countries as diverse as Japan, Egypt, China, Germany, Korea, Russia and France.
Weta has amassed substantial world-class talent, he says.
"In terms of pure technical infrastructure, we are one of the three largest facilities in the world.
"We consider ourselves, at the moment, to be one of the top five visual-effects facilities on the planet."
He says Weta staff are focused on the work remaining during the next two years, with the future of the facility after that yet to be decided.
Weta will not be able to support existing staff numbers when Lord of the Rings work is completed without securing another project of the same magnitude, which seems a tall order.
Effects artists tend to be nomadic, Mr Labrie says, and will head off to the next project in which they are interested.
Mr Labrie says the business could become more broad-based, tackling interactive gaming or commercials. "It's hard to make a profit out of visual effects."
This time next year, serious consideration of Weta's future will start.
The Hardware
of the Rings
The facility's technological infrastructure has mostly coped well with its exponential growth, Mr Labrie says.
Adjustments are being made at the moment to network switches and data distribution systems to ensure Weta's technology will scale up again when facility growth peaks for The Two Towers work.
The machine room, housing the processing power at the heart of the facility, will probably be enlarged, and work will be done to increase electricity flow and the Uninterruptible Power Supply service into the premises.
Mr Labrie says Weta will probably look at buying more hardware in February or March to meet The Two Towers' requirements.
Between $20 million and $30 million has been spent on Weta's IT infrastructure so far.
The total is "a little more than we expected", because of some unanticipated costs near the end of the first film's work.
A "rendering crunch" of last-minute work meant more processors were needed to complete the final six weeks of visual effects production, partly because of some late additions to the cut.
Mr Labrie says he has probably exceeded budget estimates made three years ago by about $1 million.
Weta does not have formal hardware agreements in place, but has developed strong relationships with vendors SGI, Auckland-based DVT, and Infinity Solutions, and Mr Labrie says he would go to them first to see if they could supply the hardware he needs.
About 90 per cent of the company's systems are from SGI.
The machine room has about 12 terabytes of storage, with about 20 terabytes in total at the facility.
Mr Labrie says working storage needs will probably hit 30 terabytes for the second and third films.
But adding storage is not as difficult as it used to be, and prices have come down.
By the time the effects for the third film are finished, between 70 and 80 per cent of the hardware will be out of date. These systems will be written down.
Some PCs will be able to be used for the company's next project, along with a StorageTek tape robot which has a long lifespan.
Mr Labrie says Linux is gradually replacing Irix as the operating system of choice in the effects world.
Weta has a "major" research and development effort under way at the moment into running more Linux-based workstations.
Mr Labrie says the facility is running a substantial amount of Linux at the moment, on processors in the machine room that are "the core of the rendering wall".
Between 40 and 50 workstations run Alias/Wavefront's Maya character animation software or Nothing Real's Shake compositing system on Linux.
He says he is looking at "making a more determined move" into Linux for the second film and will probably at least double the facility's number of installed Linux systems.
Linux delivers about two times the price performance compared to systems running proprietary operating systems, he says. Unlike several years ago, sophisticated animation applications are increasingly able to run on the free operating system.
The project has brought with it huge public and media interest.
Mr Labrie says he is receiving a couple of interview requests a day at the moment, from New Zealand and offshore media.
"I thought maybe we'd be able to keep a low profile for a bit longer."
Fans will be keen to check that technology has brought Middle Earth to life correctly.
Mr Labrie says visual effects in The Fellowship of the Ring are "all over the film", with audiences not going for long without seeing footage that has been manipulated in some way.
"There's always some kind of trick going on."
But these are seamlessly integrated into the film's background.
Weta is gathering material from its archives for use in The Fellowship of the Ring DVD release at the moment.
The DVD, which is being produced by New Line, will contain information about the making of the film.
American software company Electronic Arts is creating a Lord of the Rings game, for which Weta is supplying images and models.
The facility has a fulltime staff member dedicated to finding material for the game, though has no involvement in its production.
Mr Labrie is setting up a games company at the moment, with details under wraps for another couple of months.
He has written film scripts in the past, and says he will write storylines for the interactive games the company will produce.
The company will probably launch early next year, and Mr Labrie will continue in his Weta role.
As the facility's infrastructure becomes complete, being chief technical officer is more administrative and takes up less time, he says.
But his focus will remain on the enormous project till it is completed, sometime towards the end of 2003.
Friend of mine works for Weta... (Score:2)
BTW AFAICT from the guarded comments he's let slip, the film - the FX at any rate - is going to absolutely rock. My local fleapit is taking bookings now, oddly enough it's on my to-do list for tomorrow.
Re:Friend of mine works for Weta... (Score:1)
hmm (Score:5, Funny)
I've seen some screenshots and they don't look that hot, have a look for yourself [ucla.edu]
I vote the guy who made that the least likely to ever have sex...
NOOOOOOO!!!!! (Score:2)
Have you seen the network they run? (Score:3, Funny)
Apparently it's a Tolkien Ring network - yuk yuk.
It's big... reliability is important. (Score:2, Interesting)
Re:It's big... reliability is important. (Score:2)
While Token Ring initially had a scalability advantage over Ethernet in that Ethernet was contention-based and Token Ring wasn't, any such advantage died out long, long ago. In the age of switches, Ethernet is no longer contention-based either (unless you're one of the five people on the planet still using hubs), which kills the only disadvantage it ever had. Then, compare the base speeds -- 16 Mbit versus 100 Mbit (or, using Gigabit Ethernet hardware, you can actually get reasonably close to a gigabit using ordinary Cat5 UTP).
Token ring just will not cut it any more, and certainly can't scale nearly as far as switch-based Ethernet can. How exactly would you implement your 1000-node Token Ring network? One big ring? Assuming an average of 1ms between nodes, that's a full second for a complete traversal of the ring -- and with the ring being as busy as it is, it'd instantly collapse under the load. Okay, maybe you want to bridge multiple rings together. You're still going to have terrible network performance compared to switched Ethernet, where everything is effectively bridged.
And reliability? Are we talking about the same "token ring" here? Moses on a stick -- I still have nightmares.
For rendering, the OS barely matters (Score:3, Interesting)
The main reason not to run a Microsoft OS for a farm of anything is that it's getting harder and harder to turn the resource-wasting crap off.
I just found my own NT application loading Internet Exploder whenever I bring up a file open dialog. As soon as you call for a common dialog, an incredible amount of crap gets loaded and three more threads start up within your app, doing who knows what. It looks like the file browser in the open box uses IE.
Unwanted loading of IE, all MS apps are bloatware (Score:2)
Loaded 'C:\WINNT\system32\USER32.DLL'
Loaded 'C:\WINNT\system32\KERNEL32.DLL'
Loaded 'C:\WINNT\system32\GDI32.DLL'
Loaded 'C:\WINNT\system32\COMDLG32.DLL'
Loaded 'C:\WINNT\system32\shlwapi.dll'
Loaded 'C:\WINNT\system32\ADVAPI32.DLL'
Loaded 'C:\WINNT\system32\rpcrt4.dll'
Loaded 'C:\WINNT\system32\COMCTL32.DLL'
Loaded 'C:\WINNT\system32\SHELL32.DLL'
Loaded 'C:\WINNT\system32\msvcrt.dll'
Loaded 'C:\WINNT\system32\OPENGL32.DLL'
Loaded 'C:\WINNT\system32\glu32.dll'
Loaded 'C:\WINNT\system32\ddraw.dll'
Loaded 'C:\WINNT\system32\dciman32.dll'
Loaded 'D:\local\bin\glut32.dll'
Loaded 'C:\WINNT\system32\winmm.dll'
Loaded 'C:\WINNT\system32\serwvdrv.dll'
Loaded 'C:\WINNT\system32\umdmxfrm.dll'
Loaded 'C:\WINNT\system32\Sxgb.dll'
Loaded 'C:\WINNT\system32\psapi.dll'
Loaded 'C:\WINNT\system32\Sxgbsys.dll'
Loaded 'C:\WINNT\system32\mmdrv.dll'
Loaded 'C:\WINNT\system32\nvoglnt.dll'
Loaded 'C:\WINNT\system32\mcd32.dll'
Loaded 'C:\WINNT\system32\clbcatq.dll'
Loaded 'C:\WINNT\system32\OLEAUT32.DLL'
Loaded 'C:\WINNT\system32\cscui.dll'
Loaded 'C:\WINNT\system32\cscdll.dll'
Loaded 'C:\WINNT\system32\ntshrui.dll'
Loaded 'C:\WINNT\system32\atl.dll'
Loaded 'C:\WINNT\system32\NETAPI32.DLL'
Loaded 'C:\WINNT\system32\secur32.dll'
Loaded 'C:\WINNT\system32\netrap.dll'
Loaded 'C:\WINNT\system32\samlib.dll'
Loaded 'C:\WINNT\system32\ws2_32.dll'
Loaded 'C:\WINNT\system32\ws2help.dll'
Loaded 'C:\WINNT\system32\WLDAP32.DLL'
Loaded 'C:\WINNT\system32\dnsapi.dll'
Loaded 'C:\WINNT\system32\wsock32.dll'
Loaded 'C:\WINNT\system32\browseui.dll'
Loaded 'C:\WINNT\system32\shdocvw.dll'
And if you actually click on a networked file, you get, in addition
Loaded 'C:\WINNT\system32\shdocvw.dll'
Loaded 'C:\WINNT\system32\msieftp.dll'
Loaded 'C:\WINNT\system32\urlmon.dll'
Loaded 'C:\WINNT\system32\version.dll'
Loaded 'C:\WINNT\system32\lz32.dll'
Loaded 'C:\WINNT\system32\wininet.dll'
Loaded 'C:\WINNT\system32\mpr.dll'
Loaded 'C:\WINNT\system32\ntlanman.dll'
Loaded 'C:\WINNT\system32\netui0.dll'
Loaded 'C:\WINNT\system32\netui1.dll'
Loaded 'C:\WINNT\system32\WINSPOOL.DRV'
Loaded 'C:\WINNT\system32\mstask.dll'
Loaded 'C:\WINNT\system32\USERENV.DLL'
I can see why if you're building a dedicated crunch system, you might want to move away from Microsoft, just to get the irrelevant dreck out of your software.
Artists, not technology (Score:4, Insightful)
You could have all the rendering boxes in the world. If you have high-school hacks, you're going to end up doing hack-level work.
Directors at Pixar once said that they hire artists that can use computers, not computer people who claim they are artists. This movie would have been just as impressive if it was made without the technology.
And let's not forget the artistry involved in writing the book, which required millenia-old technology.
Amusing anecdote (Score:2)
According to one of the Weta guys speaking at a function, this had some downsides, not least of which was semi-autonomous soldiers running away from battles. Not quite the look they were after.
Weta (Score:2)
Re:Just out of curiousity.. (Score:2)
Re:Just out of curiousity.. (Score:1)
Most likely, the server render farm is running a completely proprietary software that was developed in house. Most graphics houses the size of Weta have their own proprietary software. After all, thats how Blender [blender.nl] came to be, in house software for a Dutch graphics company that they decided to release to the general public. I know that Rythm and Hues (everything from Tron to you name it) in Los Angeles run SGI boxes with their own proprietary software that seems similar to Maya.
Re:Just out of curiousity.. (Score:4, Informative)
Most old timers in the CG arena have in house tools because there wasn't any off the shelf stuff to buy. Besides Rhythm and Hues, you have places like PDI, Blue Sky Studios, Pixar (though they decided to sell their renderer most of their other tools are propietary) and others. Most FX studios run on a mix off commercial and in built software. Most places run mostly SGI but many are switching or at least experimenting with Linux. Rhythm and hues is even helping develop the Film version of the Gimp (for 16 bit work, tha's 16 bit per component).
Re:Just out of curiousity.. (Score:2)
But these days a -lot- of companies use Maya in the production chain somewhere -because- its completely extensible; it's written in its own scripting language (MELscript) and it has a very open API.
So if you need to write AI code that controls blending of motion-capture data to provide an autonomous Orc then you can; if you want to have seemless interdependence with your established top-quality rendering system, then you can (ie RenderMan).
Re:say what? (Score:1)
He only appears in a flashback (Score:1)
I imagine he should look as good as FF: Spirits within, and since he's practically non-human looking, it shouldn't be too hard to pull off.
"Linux is only free if you're time is wothless" (Score:2, Insightful)
That's not true at all (actually you would say the price/performance ratio is zero if it were). I Linux takes time to install and get running. If you're just a student with some free time then it is free. But if you're running a company with pay by the hour, or actually has work for salaried employees, then Installing and running Linux does cost money. It may be less money then the cost of installing and running windows (even without purchase costs) but you can't just say that Linux has a zero price/performance ratio.
Re:Price perfomance (Score:1)
Re:Rendering HOWTO. 25 mins setup. (Score:1)
BTW, the "s" in Photoshop is lower case. And GoLive sucks almost as bad as FrontPage. And since when is MS Office highly productive?
Typical of someone who apparently thinks that web design consists of clicking widgets and drawing pretty pictures. Check this -- Linux is quite often the preferred OS of people who write those nice little pointy-clicky apps you enjoy so much.
[Sorry -- I know I oughtn't be feeding the trolls, I'm just in a pissy mood tonight. Note, however, that I'm not abusing my +1 for this.]
Re:Fat Pipe ? (Score:3, Informative)
For ordinary home users, in the main centres there is a choice between ADSL or cable modem, depending where you are.
Then there is the cost of labour, they are probably paying about half what they would have to pay in the US or in Europe. There are some countervailing advantages of course, depending on your interests. For instance there is a good surfing beach about ten minutes drive from Weta's site. Then check out the movie itself for some samples of the local scenery.
Incidently the Weta is a large fearsome looking NZ insect that you would rather not find crawling up your trouser leg, although it is mostly harmless.
Re:I don't understand linux zealots (Score:2, Insightful)
I am completely in agreement. I do a ton of 3D models and animating, for money, even, and I have to tell you that a tool is a tool is a tool. I would go a step or two farther, and say that the application matters more than the OS (by leaps and bounds), and this is precisely why most professional studios write their own.
The competitive edge has got to be who can render the best fur, flesh, crowds, etc. Flock of Seagulls was written to do crowd scenes by one group, and Massive is simply the code written to do the crowds in LOTR. As with FoS, Massive will live on after the 3 films, be refined a bunch, overhauled, and tweaked. But in part, Massive will be why this company is chosen for a project over CompetitorX.
See, in the real world, it doesn't matter what car you drive, as long as it gets you to work. Even in school, the brand of notebook paper has damned little to do with your GPA. The only consideration for what OS to use for a major company is, "will it run the software I want on the hardware I want, quickly and well?"
The idea that the "cost" of Linux having anything to do with the decisions of the directors to use it is really funny. Does anyone really think that a cost of even $500 per box would make or break this deal? That's why you budget, kids. Some elementary business knowlege will quickly show that in the budget for the effects for three films, the cost of any OS on rendering stations is absurdly inconsequential.
FWIW, I use a few different systems in my 3D work. Some use an OS from Redmond. Some don't. It doesn't matter to me in the least. As long as I can maintain a good throughput of work at a decent billable rate, I make money.
Re:I don't understand linux zealots (Score:3, Insightful)
In my experience, and based on what I've read on the mailing lists and newsgroups, Linux has by far the widest hardware support. I've personally installed it on a huge range of machines, only finding one machine I could never get it to install on (and that was a BIOS problem). Conversely, the few times I've tried BSDs have been unmitigated disasters.
On the other hand, a Ford Escort can't haul half a ton of widgets across town to a client's emergency, and even an SUV would have trouble with an emergency sheet of plywood. Fortunately when it comes to operating systems you can, in fact, "drive a cargo truck to work". Sticker price is not the only cost. Adaptation and maintenance dominate, and Linux has significant benefits over many other operating systems. Need Beowulf-style clustering to do your rendering? Linux has excellent tools. Have software written for a 32-processor machine? Use the Mosix patches for Linux to tie together 32 ordinary PCs. Want to be able to rapidly upgrade and reinstall all 1000 machines in a cluster? Network boot Linux using the well-documented tools, and watch the entire cluster reboot in less than 10 minutes. (Try that with Windows sometime.) Big jobs are different in kind from small jobs, not just different in size. A 10% mistake in a small job means you stay late that day. A 10% mistake in a one month, 1000 CPU job means you threw away the company. IMHO, the key to keeping large projects running smoothly is having flexible, adaptible tools, and the Unices come standard with awesome tools of all kinds. Windows, on the other hand, is worthless out of the box and remains inflexible even when you shell out the $$$ for the official tools.Re:I don't understand linux zealots (Score:2)
Linux is winning the renderfarms because the software used has little or no reliance on underlying system or hardware support and is thus not locked into Windows. Most rendering has to read and write files and do a lot of number crunching, so reliance on Windows-proprieterary libraries and interfaces is eliminated (reliance on Unix is also eliminated, the "Linux is Unix and thus easy to port to" argument is greatly exaggerated here).
In such a playing field Linux wins easily. Linux offers a few unimportant technical advantages (much better networking support, and a lot smaller memory usage when no GUI is running), so I think about 50% of the reason for Linux's popularity is due to cost, and about 50% due to the preferences (biases, if you want) of the IT staff.
Re:No, not "boxen" not now, not ever! (Score:2, Informative)
Dictionary.com:
boxen /bok'sn/ pl.n. [very common; by analogy with VAXen] Fanciful plural of box often encountered in the phrase `Unix boxen', used to describe commodity {Unix} hardware. The connotation is that any two Unix boxen are interchangeable.
Check for yourself:
Dictionary.com [dictionary.com]
Note: I find the word annoying dont get me wrong, but it looks like it has slid its way into the english language..
Zeno
Re:No, not "boxen" not now, not ever! (Score:2)
Re:No, not "boxen" not now, not ever! (Score:2)
My larger point was simply that using words like "boxen" makes all technical folks look like the jerks that many are...