Introducing the Slashdot Firehose

Logged in users have noticed for some time the request to drink from the Slashdot Firehose. Well now we're ready to start having everybody test it out. It's partially a collaborative news system, partially a redesigned & dynamic next-generation Slashdot index. It's got a lot of really cool features, and a lot of equally annoying new problems for us to find and fix for the next few weeks. I've attached a rough draft of the FAQ to the end of this article. A quick read of it will probably answer most questions from how it works, what all the color codes mean, to what we intend to do with it.

What is the Slashdot Firehose?

The Slashdot Firehose is a way for you to participate in the Slashdot editorial process. You are able to see all the content submitted to Slashdot: from RSS Feeds and user submissions, to journal entries and successful completed Slashdot stories.

You can participate by voting on these entries: click the minus icon if you don't think the story is great for Slashdot, and click the plus if you do. Better yet, when you make these choices you can help further refine your decision by clarifying why you made the choice you did. You can tell us if a story was binspam, or a dupe, or insightful. If you don't like the options provided in the pop-up windows, you can always open the tagging box and provide whatever tags you think will help Slashdot Editors, and other Slashdot Readers make informed decisions about the content they are reading.

Why does the Firehose have articles in it?

The Firehose has all data on Slashdot. RSS Feeds. Journal Entries. Story Submissions. And of course, accepted Slashdot Stories. The idea is that this view of Slashdot can provide you a single place to view all Slashdot content in one interface.

If you don't like any particular data type, you can filter it out. If you don't like journals, you can just filter on -journal and they are gone. If you don't want Slashdot stories, -story will get you there.

You will note a variety of interesting options that allow you to control how this page is displayed. For example, if you filter on 'story' and set 'expand top rated' you will see a page that is very similar to Slashdot's main page today... except that it dynamically updates and allows voting and in-place expansion of sectional content. Alternatively, filtering to -story and toggling 'abbreviated mode' will let you see a real-time stream of reader contributions. It's really up to you

What do the colors mean?

The spectrum of colors represents an overall quality rating for content. Red is the most popular, the highest rated, and hopefully the best content on Slashdot. There is relatively little Red content, although most stories we post default to red. Some stories show up as orange. As you work down the spectrum you will find more content. Default submissions to the Firehose start at blue. At indigo you will find a number of RSS feeds and journal entries. At violet you are probably wasting your time, and at black you definitely are!

Play with the color slider to find the level you enjoy reading most at. Use Red or Orange for busy days or if you are a casual reader. The lower you pull the slider, the more content you will see.

How does the calendar widget work?

The Firehose is usable in 3 "Modes". In "latest content" mode you are looking at the last few days of Slashdot content. Display is optimized for you to easily navigate within this small bit of time. In 'Day Of' mode you will see content only from (surprise) any day you specify in the calender. Finally in 'Search Archive' mode you will search the entire database. For now, this goes back only perhaps 6 months but eventually we think this can replace our existing search infrastructure.

What can I do with the Firehose Tabs?

We've found that we like to use the firehose in a number of different ways. Sometimes I want a casual view of Slashdot, and other times i want to see more stories. Sometimes I want to see only the stories I've tagged. Other times I just want to see Journals. Well, shockingly enough, each tab will remember your settings and allow you to quickly return to them later.

If you change your settings, you do so in an 'Untitled' tab. If you click on your tab, you can name it which will save it for later. Also, you can subscribe to an RSS feed for any particular tab if that's your cup of tea. Please keep in mind that we have a robots.txt file that restricts the rate that you refresh pages. I'd suggest a 30 minute minimum.

What browsers are supported?

Currently we work great under Firefox 1.5 and 2.0, as well as Safari. IE7 is functional but has glitches that we are working to fix. The iPhone functions as well with a number of optimizations for small screens (although the bandwidth requirements are still fairly steep so you are probably better off on a WiFi connection for now)

IE6 is known to be broken. Other browsers might work, but we haven't really tested them.

Why didn't you post a submission that made it to red?

Slashdot is a complex beast with readers with a wide variety of interests. Part of the job of Slashdot Editor is to create a website that is interesting to all of us. That means that sometimes our opinions may differ from yours. We use the voting in the Firehose as an indicator of value, but not as the definitive measure of if something is a Slashdot story.

If you don't like that, you can simply remove our Slashdot stories by putting -story in your filter. The firehose you read will be then be completely reader driven. We believe that the way we've built this system can appeal to the wide variety of Slashdot readers without compromising the story quality for our core audience.

Doesn't this make you just like

Well first of all, we're happy to use good ideas when we see them. Countless websites have knocked off our cool ideas, just like we joyously took ideas from those that came before us. But ultimately the idea here is not to imitate any other social network news site. We feel that the editorial layer that exists on top of Slashdot is important. But we also think that having many eyeballs will help us more efficiently sort through the ever increasing volume of content on this here internet of ours. That's why we'll aim to strike a balance. Slashdot stories will continue to be posted by our editors. We will use the advice given to us by our readers. Sometimes we will agree, and other times we won't. You are welcome to read more or less editor content depending on your tastes.

At the end of the day, striking a balance between the wisdom of crowds and the tyranny of mobs is a difficult one. It's also a personal one: some people might regard it as having a moral component. Others may just want to read a bunch of good stories no matter what the methodology. We're hoping that we can strike a balance that will work for everyone. Your feedback can only improve the system for everyone.

The "firehose" reference...

[KingSkippus]

In case anyone misses the reference, the invitation to "drink from the firehose" is referring to UHF, the 1989 movie [imdb.com] by "Weird Al" Yankovic, in which Stanley Spadowski (played by a pre-Seinfeld Michael Richards) treats a kid who wins a game on his Captain Kangaroo-type show to drink from the firehose. The kid opens his mouth wide to the hose's nozzle, Stanly pulls the lever back, and the kid is promptly blown several feet off his seat.

Really funny stuff, including lots of television and movie genre parodies. If you like Weird Al's music and haven't seen the movie, I highly recommend you check it out. It's gained a cult following (obviously, with obscure references on Slashdot and all...) after having a disappointing theatrical release.

(But to be fair, that summer was particularly strong, with the release of Batman, Indiana Jones and the Last Crusade, Lethal Weapon 2, Back to the Future Part II, Ghostbusters II, The Little Mermaid... Any other year, and it probably would have been a moderate success. As you can tell, I wish Al would make another.)

A much older reference "firehose" reference...

[i_like_spam]

"Drinking from a firehose" was coined long before UHF.

MIT President ['71-'80] Jerome Weisner coined the phrase "getting an Education from MIT is like taking a drink from a Fire Hose." [mit.edu]

Opera

[jeevesbond]

Other browsers might work, but we haven't really tested them.

I use the Firehose quite often with Opera and it seems to work as expected. I'll be letting you know if it stops working. ;)

Having seen the evolution of the Firehose over the last few months I can say that it's definitely going in the right direction. Looks good, am particularly happy that a reason has to be given for modding stuff up/down. It makes me stop and think, rather than just modding things based upon my predisposed opinions.

Re:Color coding, bad idea.

[lawpoop]

You'll find that about 9% of your male audience will also be unable to use it correctly.

In other words, about 8.99999% of the slashdot audience :)

Especially contiguous spectrums.

Don't such interfaces mitigate the problems of color coded interfaces for color-blind users? Instead of looking at the colors, you know what the value is by it's position on the spectrum.

Re:Color coding, bad idea.

[MontyApollo]

I'm one of those 9% - I still see color, I just see red and green differently than normal color vision people do. Firehose uses only a handful of different colors and is no problem.

I differentiate red and green fine as long as the tint isn't too light, but as the tint gets lighter and lighter it turns gray for me quicker than it does for people with normal color vision.

Re:Color coding, bad idea.

[nelsonal]

Further to the left means better further to the right means worse, I'm color blind too, and it's worked ok so far (protanomalous, so YMMV).

Re:Story submission now based on subject quality?

[CmdrTaco]

We've seen a marked increase in spammers flooding us with garbage. hopefully the additional eyeballs will help in squashing that stuff faster. As with anything like this, it has mixed results, but I think overall the effect is good. People like feedback and participating... we've had a few dozen active taggers in the hose and their help is noticable. It's really more about scalling the system cleanly to handling as many readers as choose to participate.

My hope is that the net result will be that we can 'cast a wider net' by importing RSS feeds and such from commonly cool sites. If you throw your slider down to indigo, you will see CNet, Bruce Schneir's blog, Penny Arcade etc. Things that we generally like to see. The hope is that with more participants we can add more RSS feeds and eventually be quicker at finding the good stuff.

Re: not flamebait, but it does (kinda) suck.

[CmdrTaco]

The real problem with that is that we have historically very low data sampling for purple and lower stories. The hope is that once a few hundred readers turn their OCD juices on, that we'll have enough data to make better judgement on this content. It doesn't really take many people to make that happen. It just takes more than what we have now. Since almost everyone reads at blue, the purple area rapidly become a skeleton graveyard of RSS feeds.

Re:Color coding, bad idea.

[CmdrTaco]

We considered color blindedness early on and decided to deal with it by providing alt-text and mouseovers wherever it made sense for now. There are philisophical reasons for this... I could see us labeling things more blatantly or having a more ugly version of the color tags where you see 'red' spelled out or something, but I figured I'd wait and see what actual color blind people had to say on the subject before we coded something that there wasn't a demand for. So thanks for your feedback (as well as the other folks who've had other comments on the subject)

Re:Firehose questions

[CmdrTaco]

For now most of the labels in there are just place holders. We'll see what works. More so- those labels are just tags. You can tag a story as 'flamebait' or 'troll' if you like. We intend to watch what people organically choose, and incorporate those ideas as they rise up. The plan is that subscribers will have an option to view 50 entries at a time. It's on the list. The minus will still work. All you are doing is tagging the story as 'nix'. But if you tag it as 'Offtopic' then you are tagging it with both nix AND offtopic. We like more data. It can only better inform the system.

Re:Story submission now based on subject quality?

[CmdrTaco]

This is actually one of the problems that we've discussed extensively and not come up with a good answer for yet. The problem is that stories fall into many categories... some are time-critical and others are timeless... things like "I want a new laptop is Dell good" or "Here's a guy who tatood the BSD on his arm". Stuff like that never really needs to be 'rejected' since it could theoretically be a good story tomorrow. Or next wednesday. But other stories are very time sensitive and 24 hours later are a waste of time (Shuttle Launches etc). It's hard coming up with a clean solution to all of this.

I still don't have a good answer. I think the plan is that we internally have a 'put on hold' bit... and any story that isn't posted in a week or so will be 'rejected' unless it has the 'hold' bit. So hopefully most stuff that might get picked up later will have that bit set. Maybe we should have another state for submissions between 'pending' and 'rejected' because there really is something to be said for the whole 'maybe later' story.

Of course, firehose readers will be able to enjoy that content in real time, so it will matter less to them.

Re:Color coding, bad idea.

[Jah-Wren Ryel]

http://colorfilter.wickline.org/ [wickline.org]

That site lets a normal person see how a web-page looks to people with different kinds of color blindness.

Re:Opera

[CmdrTaco]

Start tagging things then... we'll see what sticks... 'badsummary' has been tossed around 'typo' or 'badtitle'? We don't have the answers, but the hope is that a few weeks from now it will be very obvious what needs to happen.

Re:Bug? Feature? Weirdness?

[CmdrTaco]

This is intentional. The hope is that readers will find benefit from the ability to discuss entries as they rise and fall in the hose.

Re:Story submission now based on subject quality?

[CmdrTaco]

There are ways of dealing with that I think. We can wrap low-rated content in search engine aware tags and use the no-referral thign to make sure search engines don't crawl lowly rated content. It's something we'll need to deal with no doubt.

As for your 'thinly veiled slashvertisements' I take offense at that. We pick what we pick because we like what we like. Sometimes we pick stuff that may be a simple press release. Hell, I might post a straight up commercial if I thought it was interesting. But we still to this day pick what we pick because WE want to pick it, and not because we're paid to pick it.

The other practical reality is that we're trying to post a story every 40-50 minutes. By the end of the day, the best stuff is gone... sometimes you choose stories that simply aren't as good. And sometimes those may be advertising or something. We're still choosing it because we think it's the best of what's available, but I don't like when people accuse us of taking bribes for the homepage. Believe me, if we did that, this would be a different site (Like I wouldn't be here).

Re:The "firehose" reference...

[jollyreaper]

In case anyone misses the reference, the invitation to "drink from the firehose" is referring to UHF, the 1989 movie by "Weird Al" Yankovic, in which Stanley Spadowski (played by a pre-Seinfeld Michael Richards) treats a kid who wins a game on his Captain Kangaroo-type show to drink from the firehose. The kid opens his mouth wide to the hose's nozzle, Stanly pulls the lever back, and the kid is promptly blown several feet off his seat.

Yes, but nowadays he just turns the firehose on black protesters.

Ok, let me explain this for the mod who doesn't get the reference. Michael Richards doesn't like black people. Segregationists who didn't like black people in the 60's used firehoses to break up the civil rights protests. -1 Troll? Michael Richards doesn't read Slashdot. If I was making fun of Wesley Crusher, THAT would be trolling.

Re:Color coding, bad idea.

[ChoGGi]

stick this in usercontent.css (red=1 black=8)

@-moz-document url-prefix("http://slashdot.org/firehose"),url-pre fix("http://www.slashdot.org/firehose"){
#fh_slid er_img{display:none!important}
#colorsliderthumb{ background:#000!important;cursor:pointer!important ;font-size:1.5em!important}
#colorsliderthumb[sty le*="left: 0px"]::after{content:"1"!important}
#colorslidert humb[style*="left: 15px"]::after{content:"2"!important}
#colorslider thumb[style*="left: 30px"]::after{content:"3"!important}
#colorslider thumb[style*="left: 45px"]::after{content:"4"!important}
#colorslider thumb[style*="left: 60px"]::after{content:"5"!important}
#colorslider thumb[style*="left: 75px"]::after{content:"6"!important}
#colorslider thumb[style*="left: 90px"]::after{content:"7"!important}
#colorslider thumb[style*="left: 105px"]::after{content:"8"!important}
[class^="so da pop"]>span{background:none!important}
[class^="so da pop"]{text-indent:0!important;background:none #FFF!important;font-size:1.5em!important}
[class^ ="soda pop"]::before{color:#000!important}
.pop0::before {content:"0"!important}
.pop1::before{content:"1" !important}
.pop2::before{content:"2"!important}
.pop3::before{content:"3"!important}
.pop4::befo re{content:"4"!important}
.pop5::before{content:" 5"!important}
.pop6::before{content:"6"!important }
.pop7::before{content:"7"!important}
.pop8::be fore{content:"8"!important}
}

Re: not flamebait, but it does (kinda) suck.

[CmdrTaco]

I don't know what to tell you except that once a story falls from blue to indigo, the small group of active hose users won't see it any more because they mostly browse at blue or so. And all RSS feeds start at indigo. Like I said- it's messy down there, and only more involved eyeballs will really solve the "Problem" which I don't think is that big of a deal. Blue is the middle of the curve. It's where the action is. Go from there. If you really got time to kill, visit indigo.

Re:Like usual..

[Anonymous Coward]

it doesnt work right on my toaster either. but that's not the sites fault, it's my fault for trying to browse the web on something that doesnt comply with web standards.

Re:The "firehose" reference...

[Anonymous Coward]

For those who've not seen UHF, here's the clip in question courtesy of YouTube.
Firehose [youtube.com]

Re:A much older reference "firehose" reference...

[Gulthek]

GP means that since you have a high user id, you must be too young to associate the phrase with MIT instead of UHF. Theory is, an older person would have heard the MIT quote first; a younger person would have heard the UHF quote first. Your reply demonstrates that the GP made a correct assumption.

On another note, etymology is weird to you? Only interested in the here and now eh?

Oh well, since you didn't ask:

To bite the bullet is 1700s military slang, from old medical custom of having the patient bite a bullet during an operation to divert attention from pain and reduce screaming. To bite (one's) tongue "refrain from speaking" is 1593. To bite the dust "die" is 1750. To bite off more than one can chew (c.1880) is U.S. slang, from plug tobacco. - http://dictionary.reference.com/cite.html?qh=BITE& ia=etymon [reference.com]