J.K. Rowling Should Try the Voting Algorithm 128
Rowling confirmed (after the information leaked accidentally) that she had authored a new book, The Cuckoo's Calling, under the male pseudonym Robert Galbraith, which went on to sell only about 1,500 copies before she announced that she was the real author and sales of the book spiked 150,000%.
Stephen King actually tried something similar in the 1970s, publishing a series of books under the pseudonym "Richard Bachman," which he later said was partly an attempt to answer the question of whether his success was due to talent or luck. (The Richard Bachman books sold 10 times as many copies after King was revealed as the author.) Rowling has not said whether she was attempting a similar experiment, having issued a statement that before the revelation, it had been "wonderful to publish without hype or expectation, and pure pleasure to get feedback under a different name."
But if either J.K. Rowling or Stephen King really wants to find the answer to the question of talent vs. luck, the solution lies in the random-sample voting algorithm that I've been advocating in occasional articles for years now, going back to "Censorship By Glut" in 2006. Here's how the experiment could work, for evaluating the quality of fiction writing:
-
Rowling or King could approach a pre-established amateur fiction hosting site with a large number of registered users. Or they could create their own fiction hosting site and announce it to the world for the purpose of running the experiment, which would almost certainly attract a large number of users to sign up. (The experiment only works if the site has a large number of users, for reasons that will become clear.)
-
When a user submits a new short story to the site, the site randomly selects a small subset of other users on the site (say, 20 other users), emails them a link to the new story, and invites them to read it and rate its content. There are several ways you could incentivize those users to read the link and rate the story on a scale of 1 to 10. You could bill it as the "civic duty" of registered users of the site (in the same way that it's the civic duty of registered Wikipedia editors to maintain the quality of articles, even though the editors are working for free). You could require registered users to read and rate any stories that are emailed to them (although of course there'd be no way to stop someone from lazily submitting a rating without even reading the story). You could actually require payments from users who submit stories, and then use that money to distribute small payments to the raters as compensation for reading the story (although that seems like it would be the biggest headache, since you'd have to jump through legal and logistical hoops to set it up, and it would attract cheaters who would try to abuse the system just for the free small payments). But in any case, you don't need every user who gets emailed a story, to actually click through to read the story and rate it. All that matters is that out of those 20 users, enough of them click through to read the story, that you get a statistically representative sample of what users think of the quality.
Optionally, the story raters could also submit written feedback about why they liked or did not like a story. But the important part is collecting the numeric ratings so that they can be averaged into a single overall rating for the piece of content.
-
If a story gets a high enough average rating in the first round of voting, then it gets emailed out to a larger random sample of voters, say, 200. The ratings given by this larger sample can be used to distinguish the very best stories from the merely good. (We expect that for good stories, the ratings would tend to cluster around the high end of the scale, so with that smaller variance, it would take a larger sample size to find a statistically significant difference between the quality of two stories.)
-
The stories that get the highest ratings can be featured on the front page of the site, so that everybody can have the benefit of enjoying the "best" stories. Meanwhile, J.K. Rowling and Stephen King have the benefit of finding out how their stories compare against stories written by unpublished amateur writers.
It all sounds deceptively simple, but the important feature is that you've taken the arbitrariness out of the outcome. As long as your sample sizes are large enough, the rating that a story obtains in this system, will be approximately equal to the average rating it would get from all users across the site. "Luck" is no longer a factor, because you could re-run the experiment twice with the same set of stories, and get approximately the same outcome.
This is important, because numerous experiments and real-world studies have shown that in any environment where users can recommend content to each other and browse content that is already known to be popular — in other words, how most of us discover content in the real world — luck plays a much greater role in which content becomes wildly successful. The generally accepted explanation is that an initial stroke of luck can have a self-reinforcing snowball effect — if a few key influencers happen to discover and recommend a piece of content at the same time, their friends and followers will be drawn to that content as well, and once it crosses that threshold, the content has now become "popular" enough that even more users will be drawn to it just because it's popular.
This is also why any of the existing fiction-rating sites would not work for this experiment — because most such sites allow authors to invite their friends to sign up and give high ratings to their stories, or to form cliques that all give high ratings to each other's writings. It's usually in the site's best interests to allow these tricks, because it gives authors the incentive to promote the site to their friends in order to get them to sign up. But it also means that (a) authors can easily game the system, and the highest-rated stories may not be the highest-quality ones but the ones whose authors simply play the game the best, and (b) even without "gaming the system", the fact that users can see other users' ratings and can seek out "most popular" or "trending" stories, creates the snowball effects discussed above, and introduces a huge amount of arbitrariness into the process.
Duncan Watts' excellent book Everything Is Obvious (Once You Know The Answer) is an excellent introduction to the arbitrariness phenomenon, but if you don't have time to read the whole book, just read about the Matthew Salganik 'many-worlds' experiment", which Watts co-authored and which I've linked to in pretty much every other article I've written about the random-sample-voting algorithm. The gist was that if you divide users into multiple artificial "worlds," where users can recommend content only to other users within those worlds, and seed all artificial worlds with the same content (in this case, songs), then songs which become wildly popular in some worlds will become duds in others.
The whole of Everything is Obvious is at least as insightful as anything ever written by Malcolm Gladwell, and would appeal to the same people, but it never became a bestseller, because — well, probably because we live in one of the many possible worlds of a Salganik experiment, and in the world we happen to live in, the luck of the draw meant that book didn't take off.
But back to the proposed experiment. It is true that the votes of the average users would not tell us anything about whether the winning stories were "artistically" good, however you define that. But in King's case, he was not trying to answer questions about artistic merit. he was trying to find out if his bestselling-author status was due to talent or luck, so the average rating from regular readers would be quite on point. Rowling said that she wanted to write without any hype and receive honest feedback, and it's hard to imagine a better place to do that than writing under a pseudonym for a fiction site that distributes your content directly to the public.
Both King and Rowling deserve some credit for even addressing the question of whether their success was due to talent or luck. It would have been easy for them to assume that their global success was due to their innate skill and hard work, and 99% of the world would have accepted that explanation, so it took no small amount of courage to even raise the question of how luck might have played a role. (We all know plenty of successful people who take umbrage if you even mention "the L word".)
But King did say that he thought he was outed too early to obtain any conclusive results from the experiment (and Rowling also said she wished she could have kept writing under the pseudonym, although she didn't say whether she had any similar "experiment" in mind). The random-sample-voting algorithm would provide instant feedback, not just to King and Rowling, but to any other writer who wanted to see how their writings would stack up against others in the field, from unpublished amateurs to worldwide bestselling authors.
My prediction, if such an experiment is ever conducted: King's and Rowling's writings would be rated very good, but so would many other writers' stories, including struggling writers who have never been published. Or as economist Daniel Kahneman put it: "success = talent + luck; great success = a little more talent + a lot of luck." (That took a certain amount of modesty on his part too, having achieved "great success" himself in the form of a Nobel Prize.) If J.K. Rowling or Stephen King ever launched such an experiment, the biggest favor they'd be doing for the world would not be to boost the egos of a few struggling writers, but to call more attention to the role that luck plays the world.
It's not as if their own egos would have to be bruised in the process. Donald Trump, the last person in the world that I would have guessed to have uttered these words, actually said that "Everything in life is luck," but it didn't seem to deflate his opinion of himself. You don't have to be a jerk like Trump, but just because some unpublished author's story gets a higher rating than yours, doesn't mean you have to let him come live in your mansion.
JK Rowling! (Score:5, Insightful)
Now that a famous person's name has gotten your attention, please use our website and give us money!
tl;dr (Score:5, Insightful)
no ones going to read all this you huge nerd
quality vs popularity (Score:5, Insightful)
Socially, the New York Times is supposed to be representative of American media and literacy.
In reality, the National Enquirer is the most _popular_ 'news' paper in America.
imo, you should decide what you want to measure first. Not measure (vote) and then say that is the highest quality because quality is not what is being measured when you count popularity.
Re:A practical algorithm for manuscript quality. (Score:4, Insightful)
Actually, that's a lousy average. If the standard is 1 good, money-making book per three-hundred, then you can expect to waste 250 hours sorting through trash to find a good moneymaker. Then, assuming that you don't miss it -- which I suspect happens at least 3 times in 4, putting you up at perhaps 1000 hours now -- you can capitalize on it, and make some money.
That 1000 hours has to be split with other duties, so you're talking about one new find every 3 or four years, per reviewer.
Throw each and every one in the waste bin, unopened, eand you're down to one new find every, what, 100 years? 1000 years? 10000 years? You haven't given a criteria of acceptance, and therefore it'll take however long it takes for you to learn that it was you, yourself, who was stupid.
Here's the criteria that publishers use, according to one respected, published, source [tinaja.com]:
A book publisher is more likely to publish something by someone who has already written a couple years' of articles for magazines.
A magazine publisher is more likely to publish magazine articles if the topic meets the criteria of interest of their special magazine.
There are over a million special interest catered to by magazines. Write for those.
A magazine publisher is more likely to publish something by a person with a higher degree (MS or PHD) in the field of study, or who is earning that higher degree.
They are also more likely to publish something by someone who has a venue in another media, like radio. Nowadays, possibly a blogger with a huge twitter following might also get published.
There's your algorithm. It works pretty well.
It increases the hit rate.
The parent's post only increases the hit rate of egos. Which, admittedly, in this day and age is great for getting government funding, which in turn is more and more critical to the appearance of success, since the economy is going away.
Re:JK Rowling! (Score:5, Insightful)
Now that a famous person's name has gotten your attention, please use our website and give us money!
More or less, yeah. It's "Hey, here's a famous artist who could have used something I wrote my thesis about, but didn't." And we're supposed to gloss over the why they didn't. Here's the thing... algorithms and voting mechanics are fine for thesis projects, but this is an author. She makes her living selling books. And the best litmus test for whether it's the name, or the work itself, that people are buying, is to put it on the market under a pseudonym and find out.
Which is what she did. Shame on her for doing the same thing so many famous authors have done for thousands of years instead of opting for little college boy's pet thesis project!
Talent only gives you a chance (Score:5, Insightful)
But Luck makes you a superstar. J.K.R. is certainly talented, no doubt (no book I wrote would get even 1,500 people to buy it!), but there are lots of talented people. Too many for the average person to keep track of, in fact too many for experts in most cases. There are thousands, maybe millions of great works of art I will never have time to appreciate.
Also, there is a certain amount of luck in creating a classic. The number of artists who can create more than one true classic is extraordinarily rare! Even the best have many mediocre works besides their great ones, if you want to produce more than once classic it requires an insane amount of dedication and time devoted to it along with accepting that most of your work will not really be great.
Meta-Vote (Score:5, Insightful)