Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror
×
The Media The Internet

Data Mining Rescues Investigative Journalism 91

John Mecklin sends in word of initiatives through which the digital revolution that has been undermining in-depth reportage may be ready to give something back, through a new academic and professional discipline known as "computational journalism." "James Hamilton, director of the DeWitt Wallace Center for Media and Democracy at Duke University, is in the process of filling an endowed chair with a professor who will develop sophisticated computing tools that enhance the capabilities — and, perhaps more important in this economic climate, the efficiency — of journalists and other citizens who are trying to hold public officials and institutions accountable. The goal: Computer algorithms that can sort through the huge amounts of databased information available on the Internet, providing public-interest reporters with sets of potential story leads they otherwise might never have found. Or, in short, data mining in the public interest."
This discussion has been archived. No new comments can be posted.

Data Mining Rescues Investigative Journalism

Comments Filter:
  • Re:Dont get it (Score:2, Insightful)

    by Creepy Crawler ( 680178 ) on Sunday January 04, 2009 @05:53PM (#26323091)

    It means "Clean the red sharpie off your screen".

    no red here, btw. :P

  • by Lumenary7204 ( 706407 ) on Sunday January 04, 2009 @05:58PM (#26323123)
    It doesn't matter how efficient journalistic gum-shoeing becomes, because the end product will still be subject to a certain amount of spin by the publisher.
  • by spiffmastercow ( 1001386 ) on Sunday January 04, 2009 @05:59PM (#26323131)
    so does this mean maybe reporters will stop pulling statistics out of their asses once they have a tool to provide reliable statistics with a minimum of effort?
  • Comment removed (Score:5, Insightful)

    by account_deleted ( 4530225 ) on Sunday January 04, 2009 @06:03PM (#26323159)
    Comment removed based on user account deletion
  • by mac1235 ( 962716 ) on Sunday January 04, 2009 @06:03PM (#26323165)
    No, most reporters will continue to copy PR releases into articles.
  • by Lumenary7204 ( 706407 ) on Sunday January 04, 2009 @06:04PM (#26323173)
    No, it just means they will shove the statistics with which they don't agree back up their asses where the sun don't shine.

    Out of sight, out of mind...
  • In other news... (Score:4, Insightful)

    by djupedal ( 584558 ) on Sunday January 04, 2009 @06:09PM (#26323219)
    Investigative Journalism Rescues Data Mining [nytimes.com]
  • by Anonymous Coward on Sunday January 04, 2009 @06:31PM (#26323391)

    The digital revolution didn't do-in journalism. That was Watergate. After that, and the Left's orgasm over the idea of reporters taking down presidents, propagandists are now all we have. Remember the 'fight' over which reporter would fly with Obama to Iraq, while no one was fighting to go with McCain all those times he went.

    Ask them: "Why be a journalist?"
                        "To make a difference." is the reply.

    By definition, journalists don't "make a difference", they tell a story. Propagandists "make a difference". Just ask Himmler.

    It's gotten so bad that, despite all the channels, and all the money-losing newsrooms on cable/satellite TV, the stories all use the same words. It's because the left owns almost all of them.

    Some might say this consensus makes them right, but it really doesn't. How many times is Fox News chided because they don't agree? Who's programmed, the TV, or us?

    What they leave OUT of a story is just as important as what gets IN.

    Until just the other day, Charlie Rose and (I think it was) Dan Rather were discussing Obama. "We don't know anything about him- who are his heroes?"

    Meanwhile so much was known about "Joe the plumber" that he could barely get work in his town.

    Meanwhile they sent 30+ reporters to scam information in Alaska about Palin, making up things when nothing was available.

    But no...two years of investigation on Obama turned up nothing. Not a word on broadcast TV about Bill Ayers (an unrepentant bomber of the Pentagon and murderer who got free on a technicality). Not a word about Obama's heros like Saul Alinsky (sp?) who is so far Left he bumps elbows with Stalin.

    These people are not in the periphery; these are people with whom he's tightly tied. But that doesn't matter any more, he's elected. Just remember you asked for it. He'll make history, alright.

    But now I suppose, we expect reporters to dig through computer data, and the digital revolution might do something for the industry. Well after being the top radio show host for two decades, they still think Limbaugh is racist. (Not hard to disprove) or fat (that was a decade ago). Yeah, those reporters are really hard working investigators. All they need do is *listen* to the show, and they won't do that.

    Journalism suffers from the same thing science does: loss of integrity. "Show me the money". And "vote for my guy". Truth no longer matters to these people, though it should to you.

    This 'digital revolution' will do nothing but help THEIR causes, not truth.

  • by EmbeddedJanitor ( 597831 ) on Sunday January 04, 2009 @06:50PM (#26323539)
    Journalism is not about reporting the truth, it is about contributing to and competing in an advertising and entertainment industry. In depth is not important, quickly generating good TV and print images to attract eyeballs and thus newspaper/advertising sales is everything. Getting access to the information and sources is an absolute must.

    The journalists groom their resources and need to keep in their sources good books to keep up access. Play ball and you get indented with a patrol so you can send back gripping combat footage. Piss off the brass and you get indented with the guys washing trucks at the transport park.

    It is no wonder that editors and TV execs are quick to fire and distance themselves from any journalists that forget this and start snooping too deeply. Just look at http://en.wikipedia.org/wiki/Peter_Arnett [wikipedia.org]

  • Subject (Score:4, Insightful)

    by z-j-y ( 1056250 ) on Sunday January 04, 2009 @06:50PM (#26323549)

    It's not what journalists don't know. It's what they don't report.

    And basically people just don't care. Have we decided who to blame for the economy collapse yet? But bathroom foot tapping, wow, that's the shit we have to get to the bottom of it.

  • by DrEasy ( 559739 ) on Sunday January 04, 2009 @07:50PM (#26324117) Journal

    To me a journalist is someone who provides the raw data. In the "Web 2.0" world (pardon the buzzword), anybody can do the data mining and editorializing, and it's great to be able to read different interpretations of the same data by different people.

    This is what happens in the sabermetrics world (i.e. baseball stats analysis). Some source provides the raw data, but people merrily discuss and disagree on its meaning on various blog sites. There is none of this confusing mix of data and biased interpretation that you get in most news reporting nowadays.

    If a blog is commercially successful, it will be an incentive to the blogger to dig out more raw data, or rather get a journalist to find him some, as it's not necessarily the same skill.

  • by smittyoneeach ( 243267 ) * on Sunday January 04, 2009 @09:33PM (#26324867) Homepage Journal
    More to the point, I want to know how you preclude all these shiny-miney algorithms from being tweaked with misinformation.
    Sure, the really gross stuff is going to get dumped, but the real Machiavellis will engage in propaganda oh so subtly...
  • by Anonymous Coward on Sunday January 04, 2009 @09:47PM (#26324991)

    Great is truth, but still greater, from a practical point of view, is silence about truth. By simply not mentioning certain subjects... totalitarian propagandists have influenced opinion much more effectively than they could have by the most eloquent denunciations. -Aldus Huxley

  • by lysergic.acid ( 845423 ) on Sunday January 04, 2009 @09:52PM (#26325027) Homepage

    to be fair, what you're describing is the media industry, not journalism itself. journalism is a trade/discipline that serves a crucial role in a free & democratic society. that it has been bastardized and corrupted by commercial interests does not preclude the existence of true journalism which is based on professional integrity and a civic duty to keep the public informed.

    what i'm confused about is why the poster accuses the "digital revolution" of undermining in-depth reportage. there's a huge difference between undermining the profit margins of mainstream media news outlets and undermining the quality of journalism. if anything, the "digital revolution" has only fueled investigative journalism by breaking the monopoly previously held by mainstream news outlets.

    the web has given independent journalists an easy means of reaching a global audience, and it has also given the public an easy means of sampling a much wider variety of diverse news sources. this means that any inherent biases (and there will always be some bias) a particular news outlet demonstrates can be more easily identified and compensated for by the reader.

    and unlike the past where errors in reporting were rarely corrected or even acknowledged beyond a minor footnote buried in the back of the paper, the blogosphere ensures that any misreported information is quickly identified and that corrections are quickly propagated through the web. there have always been millions of eyes reading the news, but now those millions of eyes can easily do their own online research & fact checking and call journalists out when they report incorrect information.

  • by DynaSoar ( 714234 ) on Monday January 05, 2009 @12:31AM (#26326123) Journal

    > a new academic and professional discipline
    > known as "computational journalism."

    Differing only in complexity but not principle from the same sort of search engine journalism that's resulted in decline of both accountability and accuracy of news over the past decade. Perhaps some investigative journalism into the lack of actual investigation into investigation is in order. "Hits" != veracity.

  • You may as well rename this, "Crackpottery goes mainstream". Instead of calling a few people, doing a couple of interviews, writing up their impressions as a story, journalists will now have automation to help them do what nuts do. Just like so-called UFO, alien and jfk assassination researchers do manually, journalists will be able to arrange players, dates and events to fit any tale imaginable. Government, UN, corporate, environmental conspiracy stories will abound, and the sky is the limit.

I've noticed several design suggestions in your code.

Working...