Help Slashdot Test Our New Data Center

After many years of living in California, Slashdot is preparing to move to a new data center in Chicago, and we need your help. We have our new site running a dump of our database from a few days ago. You can hit it at beta.slashdot.org. Please go there, post comments, submit stories, and do whatever you do normally. Or maybe abnormally — run crawlers, write poll spamming robots or something. If you find any crazy issues, please submit them to our sourceforge tracker. If you're curious, the new system features 18 2x quad-core 2.3 GHz webservers each with 8 gigs of RAM, and 4 quad-core 2.3 GHz databases with 16 gigs of RAM.

well done slashdot

[nih]

it's working gre

Re:

[BSAtHome]

It didn't accept my test-comment a la "(asdf )+" due to lameness. I thought that tests always were to accept lame comments for the purpose of testing. Oh well, I'm off to install Lingua::ManagementSpeak for some real tests then.

Wow...all that computer power!

[Anonymous Coward]

Wow...all that power just to push a few kilobytes of text to my computer.

Re:Wow...all that computer power!

[Anonymous Coward]

Well, with a mysql and perl combination... it's not hard to see why they need all that power.

Obligitory

[BluffBlank]

But does it run linux?

Re:

[tkid]

Did you read the history of Slashdot when it hit 10 year anniversary mark? I think someone should go read and stop asking silly questions.

Re:

[thtrgremlin]

Ok, I don't know how that was off topic if you knew what tkid was talking about. Were you there? I am wearing the shirt right now as a matter of fact and it is clear what tkid meant. (Ok, not actually wearing the shirt right now, but I do have the shirt and remember what it says, so I was telling the truth because I'll wear it tomorrow and claim time lapse doctrine applies)

Re:Obligitory

[Schemat1c]

Did you read the history of Slashdot when it hit 10 year anniversary mark? I think someone should go read and stop asking silly questions.

Whoosh!

Re:Obligitory

[brxndxn]

Imagine a Beowulf cluster of those!

Re:Obligitory

[krgallagher]

"But does it run linux?"

I know that was meant to be a joke, but that is my question. What is the OS? What is the Database engine? What is the web server? Are you using a load balancer? Details! I want details!

Re:

[__aanjtz122]

$ lynx -dump -head http://beta.slashdot.org/ [slashdot.org] | grep Server

Server: Apache/1.3.41 (Unix) mod_perl/1.31-rc4

So that's one question answered :-)

Re:Obligitory

[Hatta]

iblis% sudo nmap -A -T4 beta.slashdot.org

Starting Nmap 4.53 ( http://insecure.org/ [insecure.org] ) at 2008-05-23 15:00 CDT
SCRIPT ENGINE: rpcinfo.nse is not a file.
SCRIPT ENGINE: Aborting script scan.
Interesting ports on beta.slashdot.org (216.34.181.45):
Not shown: 1704 closed ports
PORT STATE SERVICE VERSION
21/tcp open tcpwrapped
25/tcp filtered smtp
80/tcp open http Apache httpd 1.3.41 ((Unix) mod_perl/1.31-rc4)
135/tcp filtered msrpc
136/tcp filtered profile
137/tcp filtered netbios-ns
138/tcp filtered netbios-dgm
139/tcp filtered netbios-ssn
443/tcp open ssl/http Apache httpd 1.3.41 ((Unix) mod_perl/1.31-rc4)
445/tcp filtered microsoft-ds
Device type: general purpose
Running (JUST GUESSING) : OpenBSD 4.X (91%)
Aggressive OS guesses: OpenBSD 4.1 (x86) (91%), OpenBSD 4.0 - 4.2 (90%), OpenBSD 4.0 (88%), OpenBSD 4.0 (x86) (86%)
No exact OS matches for host (test conditions non-ideal).
Network Distance: 10 hops

TRACEROUTE (using port 21/tcp)
HOP RTT ADDRESS
1 0.25 beta.slashdot.org (216.34.181.45)

OS and Service detection performed. Please report any incorrect results at http://insecure.org/nmap/submit/ [insecure.org] .
Nmap done: 1 IP address (1 host up) scanned in 32.605 seconds

Looks like they're running OpenBSD of some sort.

Re:Obligitory

[moderatorrater]

That's impossible. I thought BSD was dead, or at least dying.

Re:Obligitory

[livingdeadline]

Netcraft [netcraft.com] thinks it's an F5 BIG-IP device, which probably means that they've got a big, fancy load balancer. If my memory doesn't fail me, F5's appliance OS is BSD based.

Re:

[account_deleted]

Comment removed based on user account deletion

oh yeah

[stoolpigeon]

my cowboy neal bot has already gained complete control of all survey functionality.
 
A Natalie Portman statue and a 10 gallon tub of hot grits or I wont give control back. Oh - and I want the ponies theme back. Permanently.

Abnormally?

[FooAtWFU]

Run abnormally? So, throw a few of these out there?

ab -n 10000 -c 10 http://beta.slashdot.org/

Re:Abnormally?

[Anonymous Coward]

So it was really a typo: Run ab normally.

Re:Abnormally?

[FooAtWFU]

Apache benchmarker. If you have the right packages installed (e.g. 'apache2-utils' on Debian) it certainly exists on any Linux distro worth its salt.

Re:

[Obfuscant]

ab used to be Sun's Answerbook. Online documentation.

Re:

[Fweeky]

Known problem on *BSD [apache.org].

L8r D00dz

[FurtiveGlancer]

I'm off to ride the new iron!

Tracerouted

[Anonymous Coward]

3 fewer hops to 11, latency tripled to 85ms

Re:

[Joe The Dragon]

I get 10ms

Re:

[mnslinky]

wow, 5 fewer hops to me, with about half the latency

Re:

[Odin_Tiger]

5 fewer for me, about 2/3 latency.

Re:

[Anubis350]

I'm in NYC, dropped latency rather impressively from 96ms to 36ms, dropped hops from 16 to 13, all depends on where you live and what networks your traffic is going over

Re:

[truthsearch]

Same results here in the NYC suburbs (via speakeasy). Soon I'll be able to read slashdot 3 times faster!

Re:

[Anubis350]

speakeasy here too :-p. Schweet, faster /. :-D

Re:

[DerekLyons]

It's not as if on a text based site anyone can really notice latency below a couple of hundred microseconds.

"dump"...

[MadFarmAnimalz]

I can't explain it (oh okay, maybe I can) when the database in question contains /. comments and old Jon Katz stories (quite apart from Taco's nicely spelled and eloquent posts), calling it a dump somehow seems appropriate in the more scatological sense of that word...

you're done

[amazon10x]

I have access to the storm botnet. Should I try to DDoS the new data center?

Re:you're done

[idiotwithastick]

Alternatively, we could always just try the Slashdot effect.

Re:

[compro01]

so we're gonna slashdot slashdot?

Re:you're done

[Culture20]

Does having your computer be a zombie node equate to "access"? ;-)

new account

[altair1230]

I couldn't create a new account on beta.slashdot.org

Re:new account

[Anonymous Coward]

Funny, *mine* still works...

Re:

[kesuki]

okay i've tried 4 of my slashdot accounts, in opera for linux, and none of them lets me log into beta.slashdot.org...

mine was low 6 digits..
the rest were in the high 6 digits...

tried with wand asking, enabled and disables, as well as 'public terminal' checked, no dice, can't log in with opera at all.

I think....

[ForestGrump]

I think slashdot slashdotted themselves.

Re:I think....

[Idbar]

They just wanted to coin the term: "recursive slashdotting".

Slashdot hardware specs...

[madskyllz]

"If you're curious, the new system features 18 2x quad-core 2.3 GHz webservers each with 8 gigs of RAM, and 4 quad-core 2.3 GHz databases with 16 gigs of RAM" What do you mean, "If" ?

Re:Slashdot hardware specs...

[Talen317]

Does this mean that "If I'm not curious" the system runs on some other hardware?
Perhaps an Apple IIe?

What if I'm curious one day but not curious the other day?
Will that dramatically affect my user experience?

Re:

[Shadow Wrought]

What if I'm curious one day but not curious the other day?
Will that dramatically affect my user experience?

YES! Slashdot runs on the Schoedinger Inc., Curiosity Wave Reaction Vessel®. If you're NOT curious slashdot will simply cease to exist. Something about curiosity killing the cat...

Seems recursive

[linuxwrangler]

So let me get this straight. You want us to Slashdot....Slashdot?

Re:

[Bovius]

Stop it, you're freaking me out.

Re:Seems recursive

[Dachannien]

Here's a Coral Cache link [nyud.net], just in case. ;)

Re:

[cashman73]

In Soviet Russia,... Slashdot slashdots Slashdot. :-)

So, here's the plan:

1. Set up new test website for popular web forum.
2. Announce it as a test.
3. Encourage others to slashdot slashdot.
4. ???
5. Profit!

Power consumption?

[Anne_Nonymous]

> If you're curious, the new system features 18 2x quad-core 2.3 GHz webservers each with 8 gigs of RAM, and 4 quad-core 2.3 GHz databases with 16 gigs of RAM.

What's the power consumption on this set up?

Re:Power consumption?

[AKAImBatman]

What's the power consumption on this set up?

Probably less than you'd expect. Intel's latest line of Quad-core Xeon processors use 45nm fab technology. If these are 2.33GHz "Harpertown" chips, then each chip (not core!) uses only ~50 watts. That means these machines could be running in as little as 150 watts for the dual processor machines, and 250 watts for the quad processor machines. (Though the quad core machines are most likely drawing a lot more power than that for a full RAID array.) Which really isn't too shabby.

Re:

[legoman666]

And that's only if they're at 100% load, which they won't be except in rare cases.

Re:Power consumption?

[zdzichu]

This is /.. If there were 2.33 chips they would write 2.33. 2.3 GHz clearly show it's Barcelona Opteron. They've TDP of 137W (or 74W in case of High Efficiency chips).

Re:Power consumption?

[hansamurai]

Three puppies and a hair from CmdrTaco's head every 108 minutes.

Re:

[StarfishOne]

What's the power consumption on this set up?

Where do you think all those hot grits are produced? :))

Re:

[HogGeek]

I have to build a datacenter and infrastructure to "fit" in a LEEDS Platinum [usgbc.org] building, so I care!

Re:

[sYkSh0n3]

Now if we can just find a way to get the datacenter up to 88mph...

Re:

[linuxpyro]

That would explain the dupes.

Re:

[Joe The Dragon]

Put on the truck and run on the area toll roads.

I'm in downtown Chicago right now

[lpangelrob]

If you want me to try to walk out with your servers, just post the address. I'll let you know if I'm successful, but odds are you'll know long before then...

Re:

[cmacb]

And furthermore, more background on the reasons for the move would be fun. For example, do you have some inside information about California that we could all use? There has been quite a bit of earthquake activity around the world lately.

Best of luck,

[hwyengr]

Hopefully it's just downtown and not at 64th and Oakley. http://maps.google.com/maps?f=q&hl=en&geocode=&q=6436+S+Oakley+Ave,+Chicago,+IL+60636&sll=37.0625,-95.677068&sspn=28.611123,60.292969&ie=UTF8&ll=41.780049,-87.680275&spn=0.00656,0.01472&t=k&z=16&layer=c&cbll=41.776747,-87.681011&panoid=R4fqWJEJkVCRco2uu3GK9Q&cbp=1,248.03517600888696,,1,8.383780676689486 [google.com] Security's pretty tight down there.

Re:

[Al Dimond]

Nice try, Jake and Elwood.

Not a problem

[dedazo]

18 2x quad-core 2.3 GHz webservers each with 8 gigs of RAM, and 4 quad-core 2.3 GHz databases with 16 gigs of RAM.

twitter will create a few more sockpuppets and bring this rig to its rack-mounted knees.

ey, you need insurance?

[swschrad]

Vinnie and Rocco, here, they do a good job for the others in the neighborhood. shame to have anybody run any of them viruses or whatever on ya. we can work somethin' out.

More info about the hardware?

[Joe The Dragon]

AMD or INTEL?

What is the raid setup?

Hardware raid? raid 5? raid 6? raid 50? others?

SAS? scsi?

MB chipset?

How are they linked to each other Dual or more teamed gig-e

10 gig-e?

others?

Re:More info about the hardware?

[Precision]

On the Web servers, the specs are

Dual Quad Core Intel E5345 with RAID 1 of 2xSATA drives

On the Database boxes

Single Quad Core Intel E5345 with RAID 5 of 7xSAS drives w/ a hot spare

All machines are 2xGigE connected to cabinet switches which are 10G connected to our cores and our Dual 10G uplinks

Re:

[Joe The Dragon]

Why 7 disks and only raid 5 and not raid 6?

on the Database is that a hardware raid card?

Re:

[Precision]

Yes, all machines have hardware RAID cards, even the webservers. The reason for RAID 5 vs 6 was purely a performance thing. Some sites choose to use RAID 10, some RAID 5+spare.

Re:More info about the hardware?

[felipekk]

Yeah, what version of IIS are they running?

And SQL 2008 I suppose?

*hides*

Only on Slashdot

[FurtiveGlancer]

do they intentionally slashdot the beta.slashdot.

What is the current hardware?

[llZENll]

Your FAQ is from 2000 http://slashdot.org/faq/tech.shtml#te050 [slashdot.org]

Re:What is the current hardware?

[Odin_Tiger]

http://meta.slashdot.org/article.pl?sid=07/10/18/1641203 [slashdot.org]

Slashdot currently has 16 web servers all of which are running Red Hat 9. Two serve static content: javascript, images, and the front page for non logged-in users. Four serve the front page to logged in users. And the remaining ten handle comment pages. All web servers are Rackable 1U servers with 2 Xeon 2.66Ghz processors, 2GB of RAM, and 2x80GB IDE hard drives. The web servers all NFS mount the NFS server, which is a Rackable 2U with 2 Xeon 2.4Ghz processors, 2GB of RAM, and 4x36GB 15K RPM SCSI drives. (CT: Just as a note, we frequently shuffle these 16 servers from one task to another to handle changes in load or performance. Next week's software story will explain in much more detail exactly what we do with those machines. Also as a note- the NFS is read-only, which was really the only safe way to use NFS around 1999 when we started doing it this way.)

Besides the 16 web servers, we have 7 databases. They currently are all running CentOS 4. They breakdown as follows: 2 Dual Opteron 270's with 16GB RAM, 4x36GB 15K RPM SCSI Drives These are doing multiple-master replication, with one acting as Slashdot's single write-only DB, and the other acting as a reader. We have the ability to swap their functions dynamically at any time, providing an acceptable level of failover.

2 Dual Opteron 270's with 8GB RAM, 4x36GB 15K RPM SCSI Drives These are Slashdot's reader DBs. Each derives data from a specific master database (listed above). The idea is that we can add more reader databases as we need to scale. These boxes are barely a year old now -- and still are plenty fast for our needs.

Lastly, we have 3 Quad P3 Xeon 700Mhz with 4GB RAM, 8x36GB 10K RPM SCSI Drives which are sort of our miscellaneous 'other' boxes. They are used to host our accesslog writer, an accesslog reader, and Slashdot's search database. We need this much for accesslogs because moderation and stats require a lot of CPU time for computation.

WooHOO! Let's slashdot SlashDot!!

[haruchai]

  I'm sure my lethal DoS over my 2 Meg ADSL line will
bring your site to its knees!!!

Mehehehahehahehahhhhhehahhhh!!!!

Ah, the Data Center robbery center of America!

[snarfies]

How soon we forget.

http://it.slashdot.org/article.pl?sid=07/11/03/2054208 [slashdot.org]

WISE choice, Slashdot. Wise choice.

Re:Ah, the Data Center robbery center of America!

[hakr89]

They're not being hosted out of CI Host, they're being hosted out of Savvis.

great choice

[ILuvRamen]

Nobody should have any sort of datacenter in CA cuz it's too hot and the power to cool it is too expensive. Chicago was a far better choice! Plus it's closer to Wisconsin where I live so the response time will be better. That's even more important ;)

Re:

[account_deleted]

Comment removed based on user account deletion

Re:

[ILuvRamen]

you know how much electricity costs up there?! Then again they'd need basically no cooling and just open windows but you still have to run the servers

I'm sure I'm not alone...

[Anonymous Coward]

"the new system features 18 2x quad-core 2.3 GHz webservers each with 8 gigs of RAM, and 4 quad-core 2.3 GHz databases with 16 gigs of RAM"
I just got an erection

Re:I'm sure I'm not alone...

[StarfishOne]

You just gave my mind a way to fast association with "uptime"... ;o

And to be ahead of obvious replies: has Netcraft confirmed it? :P

Weaker Databases?

[TheNinjaroach]

If you're curious, the new system features 18 2x quad-core 2.3 GHz webservers each with 8 gigs of RAM, and 4 quad-core 2.3 GHz databases with 16 gigs of RAM.

I read this as "two quad-cores per webserver, and a single quad-core per database." Is this correct?

I was always under the impression that database servers needed more CPU horsepower than webservers.

Re:

[bol]

Depending on their architecture they very well be more web server bound than DB.

If they are more web server bound than DB I would suspect that they are using a high degree of server side caching to remove as much dependency on the database as possible. The DBs are also likely scaled out across the web servers and load balanced as well with possibly a distributed data set. This would require the front end web servers to do more work in querying the databases and displaying the results.

For example, a mod on t

Re:

[FesterDaFelcher]

Caching lets the webservers take much of the strain from the DBs. Higher scalability that way.

Re:

[jpbelang]

I remember a USENIX talk about Altavista's servers and they had many more web servers than DB servers (like 3 to 1).

So I'm not surprised.

Oblig

[felipekk]

I, for one, welcome our new beta Slashdot overlords.

But ...

[Midnight Thunder]

Oh right, another of one of these 'upgrades' where we don't get any flashy improvements. Its backend you say? How do I as an average user know for sure? </sarcasm>

Tempus Interruptus!

[FurtiveGlancer]

Please, kill the 2-minute comment delay timer on beta.slashdot. We really want to test it!

some advice ..

[rs232]

If those flash adverts were a little less intrusive and didn't have those anoying animations then I wouldn't feel the need to install noscript.

On another site, they have talking adverts, I forget the name, I ain't ever going back there.

Don't the advertisers realize that pissing people off isn't the way to sell product.

Also, the page freezing on google-analytics.com and doubleclick.net is .. wait ... waaaaiit .... wait some more ..now why did I click on that link, what was I thinking .. never mind,

Bring it on

[Cracked Pottery]

So you want a king hell DDOS attack to test your new servers? Slashdot Slashdot. Let's roll.

Morbo crush your puny data center

[davidwr]

If you're curious, the new system features 18 2x quad-core 2.3 GHz webservers each with 8 gigs of RAM, and 4 quad-core 2.3 GHz databases with 16 gigs of RAM.

Morbo [wikipedia.org] crush your puny data center with his mighty story submissions!

To Words: Uriah Rocks!

[bangzilla]

Nice work!

Down Already!

[Shuh]

Should have bought a Mac!

Pictures?

[Matt Perry]

Some pictures of the new setup would be great.

It's all about the Pizza, isn't it?

[Spinlock_1977]

Been to California (4 weeks), New York (7 years), and Chicago (2 weeks). The pizza in California sux. NYC is better, but I think Chicago gets the nod. Good move Slashdot!

Can't log in using Opera

[RobertB-DC]

I can't log in to the new site using Opera. IE works just fine. But with Opera, the system returns me to the screen it should, but not logged in. The login doesn't work in any access technique -- main page, sidebar, even the Ajax-y popup thing.

It's validating, because if I use invalid data, I get "Danger Will Robinson!" But if I use my actual login/pwd, it silently fails.

I'm not about to create a Sourceforge account just for this, though... I suspect they'll find enough bugs without my direct help.

IPv6 please

[ptudor]

Can you please start listening on a v6 address?

Re:

[marxmarv]

It can't be that it's thirty minutes from everything, could it?

I am curious. Why would they be moving? Is it just a coinkydink that SourceForge is updating their privacy policy at the same time?

Re:

[Hatta]

That works out well. We don't want you in the midwest anyway.

Re:

[Omestes]

Then why do you guys keep moving to my state, and messing it up?

We have no beaches, we have 2 cities, the weather is NEVER mild, but yet we have an endless stream of Californians coming to to mess everything up.

Living in AZ, sometimes I wonder if Californians are like locusts, they all swarmed to CA, killed it, and now have to move on to somewhere else.

Re:Old content

[larry bagina]

Those aren't old stories, they're dupes.

Aha. The old fractal compression trick

[Fallen Andy]

(which is why CmdrTaco doesn't mention disk capacity - it's all stored on an old USB memory stick) - with CowboyNeal being the grad student...

Andy