Slashdot is powered by your submissions, so send in your scoop

 


Forgot your password?
Close
typodupeerror
×
Slashdot.org News

We're Experiencing Technical Difficulties (Again) 105

Posted by CmdrTaco from the please-bash-my-head-in-with-a-brick dept.
Proof once again that I shouldn't be allowed anywhere near a root password, Slashdot's httpd has begun crashing. It dies about every 4 minutes for no apparent reason. Nothing shows up in any of the logs. I haven't changed a single thing on this damn machine since last wed, and this started yesterday, so its either gremlins or script kiddies. Anyhoo, please hang in there- I'm working as fast as I can. I'm going to be shuffling around some hardware soon (including a much faster box for Slashdot) so hopefully that will help. This puts a delay on the new moderation system (grr) but I'll get to it. I'll be a bit balder but I'll get to it. I gotta hire a sysadmin. Ugh. Update: 03/08 01:15 by CT : Please stop sending resumes!
This discussion has been archived. No new comments can be posted.

We're Experiencing Technical Difficulties (Again) More

We're Experiencing Technical Difficulties (Again)

Comments Filter:

  • btw (Score:2)

    by CmdrTaco ( 1 )
    Wrong on both counts.
    Rob "CmdrTaco" Malda
    Pants are Optional
  • wasnt that near the 500k hit/day?

    ---
  • Linus was just a small tot when OSS was concieved.

  • heh (Score:1)

    by drwiii ( 434 )
    Look on the bright side.. At least you're not administrator [linuxonline.org] of an NT box.
  • I noticed that cachedot accesses http://www.slashdot.org/ and not http://slashdot.org/

    cachedot is evil - *eeeeevviiiiiiilllll*

    or maybe not

    ...j
    (I hope this was setup by a non-BSI chap/chapette)
  • My (not at all interesting) point is that normally people 'round here get hyper about publishing the URL as http://www.slashdot.org/ and not http://slashdot.org/

    Interesting, huh?

    ...j
  • Posted by neuralfraud:

    Doesnt slashdot run redhat?

    I knew that dist was funky, I using stampede have never experienced a httpd failure, but then again 250 hits/day doesnt compare to 25000 :)


  • Rob, is it individual httpd's crashing, or is the main root-owned process disappearing on you? Regardless, try attaching gdb to one of your processes and see what happens when it goes down.
    You may be able to catch a seg fault or a bus error and then get a backtrace to get some idea of where things are going wrong.

  • sysadmin (Score:1)

    by alta ( 1263 )
    Exactly where do I send my resume?
  • Update: 03/08 01:15 by CT: Please stop sending resumes!

    Hmmm... Why not start (yet another) resume and job opening listing service?

    "Slashjobs, Jobs for Nerds, Pay that Matters"

    Nevermind.
  • The key to Microsoft.com's stability is clustering. BIGTIME clustering. I think with a cluster a 99.5% uptime isn't that great - it means that at some point in time, for a few hours in the year, all the servers in the cluster are down. Not good.
  • Yeah, run Slashdot on your NT box. Go for it.

  • Hopefully you don't want it in .doc format...
    (that's for the sysadmin job, btw)
  • It's my statement on rampant consumerism. The irony
    is that I don't even really LIEK pepsi. Go figure.
  • I think the most long term solution at this point
    is to start thinking server farm as opposed to a
    single server and a 'cache' server.

    *shrug*

    The problem with httpd crashing is nifty. You'll have to get a stacktrace or other information in order to fix it though unless it gets fixed through blind luck.

    Brian
  • Doubt this will get read, but there are things like a Cisco redirector which will redirect a single ip to multiple private server machines. Load balancing solutions exist which can tie into an OS's system load to more intelligently balance but I'm not sure if anything supports the Linux kernel.

    Brian
  • Comment removed based on user account deletion
  • What is Cachedot? I have never heard of it before.
  • This makes a lot of sence! A reciprocal Slashdot effect, costing Rob his hair...
  • You forgot to mis-spell "request"


  • Are you sure that those 200 people would have gotten through if he had been running NT?


  • No doubt the site is groaning under the burden of grateful slashdotters everywhere constantly flooding Slashdot.org with messages of appreciation for such a fine and free service to us all and of admiration for all those who make it possible. Yeah, that's gotta be it!

  • Rob, please tell us that you weren't actually wearing a Microsoft shirt. Tell us that it was digitally "airbrushed" in... tell us that aliens kidnapped you and put it on you, and the picture was taken just as you were coming to... tell us that isn't a disguised Monica Lewinsky in the other picture...
    ________________________


  • Where can I send my resume? >:)



    --
  • Why use Linux? Just switch to FreeBSD...or at the very least give it a try.

    JB
  • I know! It's the ghosts of all those servers that have melted down over the months come back to wreak their revenge! It makes perfect sense.

    Anyway, I still love ya'll. I can accept some rocky roads in this affair.
  • so shoudl this be changed?
  • and make sure you allow the damn thing to dump core, and know hwere the cores will go. as a last resort, strace -p to random httpd processes (not the master one, unless you have 10x the cpu /. currentyl takes!) see if you can catch where the fault happens.
  • please.. must... move... somewhere... else!

    any format you prefer for applications? :)

    I only live like 3.5 hours away, (ever heard of Boyne City, MI)
  • Also that program really starts thrashing around when you are getting a lot of accesses. It would kill slashdot's performance.
  • Perhaps you should try out iplog. Although the logs for /. would probably be horrendously huge.

  • In case you hadn't noticed, something is already killing /.'s performance, every four minutes ;-)
  • Since I first started playing with linux in '95... of course my machine is definately NOT production and I've broken it many times, but I really like that feeling of power! :)
  • I think I recognize that small text :)
    Just got it on my own screen, or, at least, a similar one...

  • If you were running NT, I would have to look at 200 people bitching about how bad NT is.
  • If you find out it's hacking, I'd sugest a nice sturdy firewall built on a 2.2 kernel with IPCHAINS and IPPORTFW. After going live on the net I had some problems with hackers. Placing an IPCHAINS/IPPORTWD based firewall inbetween my systems and the world has really helped secure my home network. It really narrowed down the number of configuration files I have to set security up in. Now if I don't want X site to be able to access my network, I just deny it in the IPCHAINS config. I've got it enabled on a couple of sites due to their sysadmin being in denial or totally clueless. Currrently I only have a couple of ports open, and can open/close ports on an as needed basis. The rest of them are denied without even a NACK.

    It's interesting to see all the accesses against services with known problems. I'm surprised how many times someone tries to use a socks proxy server on my firewall when there isn't one available. The other fun thing is the reactions of sysadmins to my telling them their system was compromized. Currently I log all SYN connection request packets, and all packets to some ports. All logging goes via klogd/syslogd so it can be remotely logged on a log host.

    As for speed, it seams to be keeping up nicely with a DSL link to the outside, and transfers from my local net to the DMZ net over 100mbit connections.

    It may not be a panacea, but it's cheep, and can run on an antiquated system. I'm using a P-100 with 4 PCI slots and 24M Ram, and a 100MB HD.

  • As I said, I only had a couple of ports open, Auth(113) is one of them...
  • I've often though it would be nice to have a site for tracking sites where attacks have come from. One problem is determining if an attack is using spoofed addresses or not. There are other issues like falsified reports. As for addressing some of the problems I see, requireing posters to use verifiable PGP sdignatures would help with some of the integrity issues, but wouldn't fix them all.

    I know the probes I've see on my system come from many different systems, and only probe one port per system probing. I'd like to know if X system is doing probes against other systems.

  • Try running ANYTHING on an NT box for a week.
    And then tell me if you had no problems. I will buy an NT license the next day!
    Btw, anything is anything worthy of running.
    I have not seen Office run all day without by end of day tell me I don't have enough space to save a 10 page .doc even though I had 1gig of space!
  • I don't know if you would believe it. BUT I don't hate MS. I hate Windows. I love Visual Studio. I hate Windows, 95/98/NT. They aren't reliable. PERIOD>
  • Do the following:
    (1) Erase disk!
    (2) Make a clean install of Windows.
    (3) Download Regclean.
    (4) Run Regclean
    (5) Fix Registry errors!!!!!!!!!!!!!!
  • yeah...Richard Stallman would
    be pissed at the idea that Linus
    invented the OSS concept. :)
    Someone didn't read that article posted
    this weekend of his interview!

  • Perhaps a general intrusion detection system would be a good approach if you're concerned that it might be script kiddies. ISS makes a good one, but then I'm biased :-) Network Flight Recorder would probably also be a good one though I have no direct experience with them.

    I think that you can download an evaluation copy of ISS' RealSecure from http://www.iss.net. Or,
    NFR is at http://www.nfr.com. They say that they have eval copies for download.

    Good Luck
  • Yep, he'll just shoot himself...
    His problems will ALL go away :P

    Actually, NT is convenient... With loads like Slashdot it reboots all by itself every few hours... So it eliminates these problems :)
  • Just as any follow the leader organization, RH has mirrored the post on it's front page....
  • where do we send resumes? :>

Slashdot Top Deals

Life is cheap, but the accessories can kill you.

Close