Please create an account to participate in the Slashdot moderation system

 



Forgot your password?
typodupeerror
×
Books Media Businesses Google Sci-Fi The Internet Software

Boiling Down Books, Algorithmically 177

destinyland writes "A year ago, Aaron Stanton harangued Google over his new project, a web site analyzing patterns in books to generate infallible recommendations. In March he finally finished a prototype which he showed to Google, Yahoo, and Amazon, and he's just announced that he's finally received a big contract which 'gives us a great deal of potential data to work with.' The 25-year-old's original prototype examined over 200 books, plotting 729,000 data points across 30,293 scenes — but its universe of analyzed novels is about to become much, much bigger."
This discussion has been archived. No new comments can be posted.

Boiling Down Books, Algorithmically

Comments Filter:
  • Re:Newspeak (Score:5, Informative)

    by log1385 ( 1199377 ) on Sunday July 06, 2008 @07:46PM (#24078493)
    From the FAQ [booklamp.org]:
    "Does 1984 really match the U.S. Patriot Act?
    No, that is an easter-egg. A bit of a joke on our part."
  • It already happened (Score:3, Informative)

    by themushroom ( 197365 ) on Sunday July 06, 2008 @07:57PM (#24078559) Homepage

    ...considering the quantity of "classic" tripe that I had to read in high school and college. Who needs an algorithm when you have English teachers who follow flawed formulae?

  • by dnwq ( 910646 ) on Sunday July 06, 2008 @08:25PM (#24078717)
    The researchers publishing these papers typically don't get much more than citations - the money mostly goes to publishers like Elsevier. Blame them instead.
  • by Sir Holo ( 531007 ) on Sunday July 06, 2008 @08:26PM (#24078721)
    blahplusplus: What really hits a nerve with me is why the scientific community hasn't opened up all their journals for others to read.

    We scientists would absolutely love to have all of the journals opened up for free access to everyone. But, you see, the publishers own the copyright to our articles. The system requires us to give them the copyright, in order to get our stuff published. Then you, me, and everybody else has to pay to read recent research.

    Thankfully, some established journals are going open-access.

    That's very promising. But the fact remains that publishers such as Elsevier own the copyright to many decades-worth of scientific literature. And they're not about to give any of it away.
  • by zappepcs ( 820751 ) on Sunday July 06, 2008 @08:35PM (#24078773) Journal

    I don't mean to throw stones, but books cost money, many people afford to be on the Internet, yet buying books has become old hat. When you can go on the Internet and get the latest information, books are ... well, a waste of money for the most part. The delay between discovery and publishing and reading is no longer tolerable, not in this throw away society. Look at some science fiction ideals... such delays are always intolerable. I will cite an event that is not even related to show that delay is not right: junteenth. It took several years for emancipation news to reach Texas. Is that right? The point is that information and knowledge should be universal, and instant. The great promise of the Internet was just that. If you wish to spend your nights reading information from 2+ years ago, that is your problem. The rest of us want today's information, and now. Good luck with the personal library.

  • Comment removed (Score:3, Informative)

    by account_deleted ( 4530225 ) on Sunday July 06, 2008 @10:56PM (#24079731)
    Comment removed based on user account deletion
  • by Skreems ( 598317 ) on Monday July 07, 2008 @12:34AM (#24080291) Homepage
    Yes, that's quite true. The important thing in both, though, is that they're good, while this algorithm may just as easily recommend something absolutely terrible that happens to contain a lot of the same words and phrases unless it relies heavily on human input for that elusive quality assessment.
  • by cpricejones ( 950353 ) on Monday July 07, 2008 @08:31AM (#24082259)

    Access Brutal honesty, we don't really care about the access restrictions. Every university has license to pretty much all the major journals. We can get them from wherever with a quick login and so can everyone we know. Sorry, but that's the truth.

    This is simply not true. I work at a very large university, and it still amazes me to find that some electronic journals have not been purchased by the university. When I need these articles pronto, I must email friends at other universities. But what about smaller colleges? Enthusiasts? (I doubt there are that many biochemistry enthusiasts, but I'm sure there are a few who would love reading the new Methods in Enzymology or Nature, Science, Cell, what have you. The field needs these enthusiasts.)

  • by Illserve ( 56215 ) on Monday July 07, 2008 @09:13AM (#24082633)

    We did.

    http://www.plos.org/ [plos.org]

    (not me personally, I had no role in this but as a member of the community I applaud)

  • by Irvu ( 248207 ) on Monday July 07, 2008 @05:12PM (#24089609)

    The problem is not with the researchers so much as the beuraucracies of univiersities and funding, and the problems of peer review.

    Many universities, especially those outside the U.S. use metrics for rating their researchers that are weighted towords publications from Elsevier and others. England is especially bad about this. For that reason many scientists don't have much of a choice in that they are forced to publish there is go without pay.

    So totally open spaces raise issues of what it means to be published and the cost of maintaining the system must be borne somewhere. For that reason alone some money must go to journal publishing. However it is very possible for that funding to come from something other than overpriced subscriptions.

    Finally, and optimistically most scientists are recityfying this themselves. Most authors post copies of their academic papers online and make them available through Citeseer and other locations so even though the journal is costly the paper may still be obtained even if a few months later.

If all else fails, lower your standards.

Working...