Follow Slashdot stories on Twitter

 


Forgot your password?
Close
typodupeerror
×
Wikipedia News

The Curious Case of Increasing Misspelling Rates On Wikipedia 285

Posted by Soulskill from the curiouser-adn-cuoriuesr dept.
An anonymous reader writes "The crowd-sourced nature of Wikipedia might imply that its content should be more 'correct' than other sources. As the saying goes, the more eyes the better. One particular student who was curious about this conducted rudimentary text mining on a sampling of the Wikipedia corpus to discover how misspelling rates on Wikipedia change through time. The results appear to indicate an increasing rate of misspellings through time. The author proposes that this consistent increase is the result of Wikipedia contributors using more complex language, which the test is unable to cope with. How do the results of this test compare to your own observations on the detail accuracy of massively crowd-sourced applications?"
This discussion has been archived. No new comments can be posted.

The Curious Case of Increasing Misspelling Rates On Wikipedia More

The Curious Case of Increasing Misspelling Rates On Wikipedia

Comments Filter:

  • Spellink chekers. Duh! (Score:5, Insightful)

    by icebike ( 68054 ) * on Friday December 23, 2011 @07:44PM (#38477428)

    Every web browser as auto spell-check capabilities these days. Most of them correct as you type.
    So why should there be any misspellings on something that is managed strictly from a web interface?

    Is it part of the arrogance of those electing themselves to write and editing articles on wiki that they refuse to use a spell checker, or
    is it that the words are simply unknown to the normal spell-check dictionaries?

    I find occasional misspellings in mainstream news articles as well (and I am by no means a natural born speller).

    But most maddening to me is the "they're their there" errors, and similar wrong word usage.
    Spell checkers offer little help in catching these, but a 6th grade education usually suffices.

    Maybe the same people who wont waist there time checking they're spelling also cant be bothered to use the write word. ;-)

    • Re: (Score:3, Funny)

      by vawarayer ( 1035638 )
      wat u talkin aboutte?

    • Re:Spellink chekers. Duh! (Score:5, Funny)

      by hairyfish ( 1653411 ) on Friday December 23, 2011 @07:57PM (#38477540)
      your definately fighting a loosing battle their.

    • They're They're your probably just making a mountain out of a mole hill, but it's a mute point.

      But really. I'm going to side with complex language there are numerous technical words that aren't in any of my dictionaries. Especially when you get into latin based names and medical terms.

    • Re: (Score:3)

      by wjcofkc ( 964165 )

      Every web browser as auto spell-check capabilities these days. Most of them correct as you type. So why should there be any misspellings on something that is managed strictly from a web interface?

      Is it part of the arrogance of those electing themselves to write and editing articles on wiki that they refuse to use a spell checker, or is it that the words are simply unknown to the normal spell-check dictionaries?

      I find occasional misspellings in mainstream news articles as well (and I am by no means a natural born speller).

      But most maddening to me is the "they're their there" errors, and similar wrong word usage. Spell checkers offer little help in catching these, but a 6th grade education usually suffices.

      Maybe the same people who wont waist there time checking they're spelling also cant be bothered to use the write word. ;-)

      HAI! U R A Cleaver 1! BAI!

      • Muphry's Law (Score:5, Informative)

        by AnotherScratchMonkey ( 592037 ) on Friday December 23, 2011 @08:20PM (#38477738) Homepage

        icebike is a victim of Muphry's Law [wikipedia.org].

        • Re: (Score:2)

          by dgatwood ( 11270 )

          Most of that had to be deliberate. I think that every single homophone in that entire last sentence was wrong. The "has" was an amusing typo. The "edit" versus "editing" thing was actually not wrong, though it was awkward. Reread it as "electing... or editing" instead.

          • Re: (Score:2)

            by icebike ( 68054 ) *

            Typo and tense change were unintentional. I'll cop to the Muphry's Law violation. It bites me all the time. But hey, this is Slashdot.

            The last sentence, on the other hand, totally intentional, and watching all the whoosh posts has been fun.

      • Re: (Score:2)

        by jd ( 1658 )

        The problem is that spell-checkers aren't grammar-checkers. There hasn't been a decent grammar checker since the days of Grammatik. The ones out there now are, frankly, pathetic.

        • Before that, I think the problem is that writing an article is easy/fun. Proofreading an article is boring/tedious. The idea of the crowd sourcing is that the crowd can correct the errors. But this only works if people are willing to help correct the errors. And people are notorious for not doing hard tedious work for nothing. So as Wikipedia grows from people doing the fun stuff, so do the errors. Too bad there isn't a big enough carrot to hold out in front of the people editing.

          • Re:Spellink chekers. Duh! (Score:5, Interesting)

            by Teancum ( 67324 ) <robert_horning&netzero,net> on Friday December 23, 2011 @10:46PM (#38478790) Homepage Journal

            I have seen articles on Wikipedia that stick around for any reasonable length of time (about six months to a year being typical) usually attract grammar nazis (or people who are annoyed by bad grammar in general) that do a copy edit and try to fix the article to make it read better. Longer articles tend to attract more people than stubs, particularly if they are well linked to other articles. The subject matter doesn't seem to make a difference, and there are a few bots on Wikipedia which try to scan articles for spelling errors and other minor issues.

            The issue of British vs. American spellings has been a long resolved issue, and for the most part consistency is more the rule than anything else. Sometimes I've seen protracted edit wars over grammar usage between several editors, but even that tends to be rather harmless.

            My point here is that the proofreading does happen, it just happens on a slower time scale and is something that usually only shows up for more mature articles, mature as in more well developed articles that seem to be trying to say something. Articles that are in a constant flux of revision will be less likely to see this kind of activity, or more accurately will tend to see such efforts wasted as the article content changes. Still, if you can get an article to "B quality" status or better, the grammar and quality of the article in terms of spelling and other aspects will be reviewed by at least somebody over time.

        • Comment removed based on user account deletion

      • Re:Spellink chekers. Duh! (Score:4, Funny)

        by S.O.B. ( 136083 ) on Friday December 23, 2011 @08:46PM (#38477928)

        You missed:

        Maybe the same people who wont waist there time checking they're spelling also cant be bothered to use the write word. ;-)

    • older IE's do not have spell check.

    • Maybe regional differences are being reported as spelling errors. Desktop systems at my work use the French dictionary by default. Not much use to me.

    • Every web browser as auto spell-check capabilities these days. So why should there be any misspellings on something that is managed strictly from a web interface?

      Talent?

    • Is it part of the arrogance of those electing themselves to write and editing articles on wiki that they refuse to use a spell checker, or is it that the words are simply unknown to the normal spell-check dictionaries?

      Maybe it's that aggressive as-you-type spell checkers seem to introduce more errors than they catch. Seriously. I've never seen one that doesn't try to replace rare but valid words with more common words that look vaguely similar (often just similar enough to be missed in proofreading) but have completely unrelated meanings. In general, as-you-type "correction" is an insult to anyone writing above a third-grade level.

      • In general, as-you-type "correction" is an insult to anyone writing above a third-grade level.

        So.. I guess it's hear to stay then.

        here to stay, dammit.

    • No, it's because spellcheckers are often WRONG.
      They don't like foreign words, they don't like unusual words, they don't like domain-specific words; they don't like any words they haven't been programmed for.

      Lately, when I write, I have to fight the spell-correction to make things properly correct more than it corrects me.

    • Hmm. Firefox's dictionary needs some work. It has an addiction to adding hyphens to common non-hyphenated words, and has some serious difficulties with pluralized nouns.

    • Re: (Score:2)

      by http ( 589131 )
      Not that anyone else does this, but one of the first changes I make in my browser settings is deactivating automatic spell checking. Call it a holdover from the days where leaving it on meant the top rate of entering text would be about one or two characters per second.
      The performance difference is non-zero.

      • Re: (Score:2)

        by icebike ( 68054 ) *

        Not that anyone else does this, but one of the
        first changes I make in my browser settings is deactivating automatic spell checking. Call it a holdover from the days where leaving it on meant the top rate of entering text would be about one or two characters per second.

        The performance difference is non-zero.

        Well, true, it is non-zero, but nobody else runs an 8088 processor anymore either.

        If this still bothers you, remember that there will be great deals in the After Christmas sales from most computer vendors.
        You might be able to step up to a 486 or something.

    • Re: (Score:3)

      by fdrebin ( 846000 )
      Spelling checkers don't help with grammatical context. I see that few people don't know when to use "fewer than" vs "less than", or the difference between "insure" and "ensure". They are indeed different.
      If Joe SixPack (or for UK, "Joe Pint" (or equivalent slang)) doesn't know the difference, well, so what. When I see professional authors not knowing the difference, I am... disappointed, I guess.
      And crap, I'm an engineer, I'm not even supposed to know how to spell.

      /F

    • Comment removed based on user account deletion

    • Re:Spellink chekers. Duh! (Score:4, Insightful)

      by Idarubicin ( 579475 ) on Saturday December 24, 2011 @02:39PM (#38483508) Journal

      Is it part of the arrogance of those electing themselves to write and editing articles on wiki that they refuse to use a spell checker, or is it that the words are simply unknown to the normal spell-check dictionaries?

      You might know the answer to this if you had read the linked article instead of immediately jumping in to editorialize (and no, I'm not new here).

      While there are a number of serious methodological concerns I've discussed in another post [slashdot.org], the author's Table 4 ought to raise a screaming red flag. The algorithm the author used flagged about 5% of articles as having more than 25% of their words misspelled--and the author didn't discuss any sort of manual follow-up on those articles to determine where the problem lay. I'm sorry, but misspelling one word in four just isn't a plausible result.

      I suspect that the parser is failing to properly handle tables of data, scientific terminology, some unusual formatting and template markup, and foreign words. All of these categories will have been expanded greatly since Wikipedia's early days, and their presence is a sign that the encyclopedia is increasing in quality and coverage, not being degraded.

  • Many of the smart people have been driven away? (Score:5, Insightful)

    by Anonymous Coward on Friday December 23, 2011 @07:51PM (#38477480)

    Whether it's open source software or online collaborative projects, the smart people always get driven away over the long term. Smarter people are usually more interested in creating high-quality content, whereas stupider people end up putting out crap purely for political reasons. Eventually these stupider people start trying to modify the work of the smarter people, but do a poor job at it. When they're called out on their shitty work by the smart people, the fools make a huge stink. This soon devolves into a political mess where the smarter contributor is severely inhibited from contributing by the constant moaning and bitching of the idiots. Not wanting to waste time with such shenanigans, the smarter person leaves for some other endeavor. After a while, many of the smarter people are driven away, and the end result is that the stupider people make up the bulk of the project's contributions.

    We've seen this happen with many open source software projects, and I don't think that other kinds of online collaborative projects are any different.

    • Says the guy that uses the word stupider.

    • Re:Many of the smart people have been driven away? (Score:5, Interesting)

      by jd ( 1658 ) <imipak@ y a hoo.com> on Friday December 23, 2011 @08:41PM (#38477882) Homepage Journal

      I can't say I've seen that on all articles on Wikipedia, but certainly I have seen it on some. I've seen articles dumbed down to suit the majority of the readers, rather than split and refined to allow the majority a summary and those wanting more information access to that. This certainly discourages those who are subject matter experts - what's the point in being an expert in something if all that's wanted is pub quiz grade?

      However, I emphasize that this is NOT what I've seen for the majority of articles. Some articles have been abandoned (occasionally in mid-edit, from the looks of it), some are constantly being updated with updates in conflict with each other, yet others are updated and are of extraordinarily high quality. It runs the full gamut.

      I would far prefer a layered approach, so that you could get access to whatever level of detail you wanted, but the contributors just aren't there to get that. It's a pity, and the net result is uneven quality, but Wikipedia is a case where it's better to have an imperfect something than a perfect nothing.

  • The bad drives out the good (Score:5, Insightful)

    by timholman ( 71886 ) on Friday December 23, 2011 @08:00PM (#38477568)

    I can offer my own opinion of this phenomenon: the bad is driving out the good. Fewer competent writers are bothering to edit Wikipedia articles nowadays. Not only do contributions get reverted / deleted by editors who think they "own" the article, but good writers simply get tired of fixing the semi-literate ramblings of people who cannot write a coherent sentence.

    It's the old axiom that incompetent people cannot recognize their own incompetence, and so do not realize that their "contributions" are not improving the article, but instead are making it worse. Eventually the good contributors get tired of sweeping back the ocean with a broom, and just walk away from Wikipedia.

    • Re:The bad drives out the good (Score:5, Insightful)

      by FridayBob ( 619244 ) on Saturday December 24, 2011 @12:11AM (#38479278)

      Totally agree! I spend the best part of *three years* working on a relatively obscure corner of WP's biology department involving some 500 articles and over 20,000 edits before finally throwing in the towel. I learned a lot during my time there, but eventually the idea of putting more effort into it just didn't make any more sense. One of their main problems is that the only thing preventing good articles from deteriorating is constant policing by knowledgeable editors -- and preferably by the people who are responsible for all the important contributions. I like to think that my contributions to WP have not been a complete waste, but if enough time goes by before anyone fills my shoes, I fear they will be. After all, what good is an article that's now only 99% accurate? 98%, 97%, 96%...

  • Worth Posting. (Score:5, Insightful)

    by DarwinSurvivor ( 1752106 ) on Friday December 23, 2011 @08:04PM (#38477594)
    So slashdot has just posted an article about a test where even the test's AUTHOR believes the results are due to shortcomings in the test itself. This has to be the most pointless article I've read in a while...

  • Um... (Score:5, Funny)

    by 93 Escort Wagon ( 326346 ) on Friday December 23, 2011 @08:07PM (#38477618)

    The crowd-sourced nature of Wikipedia might imply that its content should be more 'correct' than other sources.

    [citation needed]

  • Here is a typical example:

    Person A and B are on the ground floor of some building.
    Person A would like person B to have some parcel delivered to the 7th floor of the building.

    Here's how person A delivers the request:

    "Buddy, please bring this parcel up to the seventh floor, thanks".

    I posit that this grammar is wrong. He should say:

    "Buddy, please take this parcel to the seventh floor, thanks", because they are in the same area and buddy B, by doing the needful, will be leaving that place.

    Worse still, you even

    • Re: (Score:2)

      by frisket ( 149522 )

      "please bring this parcel up to the seventh floor, thanks".

      Except that in some forms of English, this is perfectly correct (Hiberno-English, for example).

      "datum" and "medium"

      That battle was lost many decades ago, if it even got fought.

    • People who say "the data is" are treating "data" as a synonym for "information". They are usually referring to more than one piece of information, so "datum" would not be correct.

    • Re: (Score:2)

      by Mashiki ( 184564 )

      Since english itself is a dynamic language, you can argue both are correct. Remember, that the grammatical rules between what's spoken and what's written are usually 110-150 year apart.

    • Re: (Score:2)

      by sycodon ( 149926 )

      At least he said please.

  • Eye don't no (Score:2, Interesting)

    by istartedi ( 132515 )

    Eye don't no how ewe can automate proof reading. You still knead a human in the loupe.

  • Unless the article is locked, just fix the spelling errors yourself instead of whining about them getting worse.

  • The ever growing number of articles... (Score:4, Insightful)

    by FridayBob ( 619244 ) on Friday December 23, 2011 @08:12PM (#38477680)
    ... and the growth in size of many articles, combined with the limited number of Wikipedia editors, is one possible reason why spelling errors may be on the increase. Also, one form of vandalism is the intentional introduction of spelling errors.
  • I would guess that this is nothing to do with spellcheckers (which are useful for catching typos, but fairly useless for catching mis-spellings). As this was observed over time, might it not be possible that the decreasing level of literacy may be being exposed by a decrease in the average age of the contributors?

  • I think some the issue here is that a new generation is showing up with poor literacy skills. The primary schools are under pressure to meet their government mandated competency requirements, budget cuts, and various other issues, and have cut back on some of the basic skills that were once taught.

    I work at a tutoring center / assistance center at a college and it is depressing what students are coming out of high school in their basic literacy skills. Writing skills are non-existing, were some of them do

  • Lol (Score:5, Funny)

    by lightknight ( 213164 ) on Friday December 23, 2011 @09:40PM (#38478384) Homepage

    It's sad. Through all this web content, I am slowly unlearning how to spell or use proper grammar.

    English teachers / professors (with a few exceptions) used to be my arch-enemies (as a math / science person) and wished them all a pleasant, if sudden, death for their batshit-insane insistence on making mountains out of molehills (i before e, except after c; can't end a sentence with a preposition; this {subject}) with regards to the language, and yet lately I finding myself wishing there were more of them.

    It's not fair: I've nursed some of those grudges for years!

  • I believe this is due to Wikipedia becomnig more diverse. As more people learn about Wikipedia, the more people contribute to it. It's overall becoming more accessible to everyone and therefore everyone is putting their two cents. Where as in the beginning you could argue that the population was more centered around a niche crowd who are more pedantic then those that just wish to contribute in some form.
  • Surely one factor is that early in its history much of the content on Wikipedia was copied from a public domain edition (1911?) of the Encyclopaedia Britannica, in which one would expect to find very few spelling errors. Over time more and more of the content is user-generated, so naturally it is more likely to contain typos.

  • The increase in the percentage of spelling errors is an artifact of his experimental procedure. He randomly takes a Wikipedia article instead of analyzing the most popular ones. As Wikipedia has become larger, it has attracted more fringe topics, probably from authors in different countries in the world where English is not their first language. Wikipedia now probably has more articles that aren’t viewed and revised as much. Thus, randomly sampling has now higher chances of selecting such articles and

    • Re: (Score:2)

      by tool462 ( 677306 )

      It's reasonable to hit all the pages at random, but the results should be weighted by the popularity of the page. That would be a better measure of how good crowd-sourcing is at solving these types of problems. Including the low-popularity pages in the results is important to this because it covers another issue with crowd-sourcing--it takes at least three to make a crowd. If wikipedia's breadth gets too large, the crowd sourcing method breaks down since there's nobody looking at most pages. It brings t

  • Grammar editors like me got scared off Wikipedia (Score:4, Informative)

    by sandytaru ( 1158959 ) on Friday December 23, 2011 @09:55PM (#38478472) Journal
    After the last time I tried to clean up some grammar and spelling in an article and it was immediately reverted with "didn't cite sources" I gave up.
    • "was immediately reverted with "didn't cite sources" " - Could you provide a link to the diff? One problem could be a lacking edit summary in combination with extensive rearranging of text. In such cases, it is difficult for an other editor to see what changed by looking at the diff. If the edit comes from an anonymous IP address and does not have an edit summary, a hurried editor could misunderstand your intentions.

  • As the saying goes, the more eyes the better.

    That's a myth. If those eyes aren't attached to competent people, having more of them will do no good.

  • We awl noe wot ure saeng no mader howe u spell it.

  • Lazy writers and poor writing skills (Score:3, Informative)

    by PoopMonkey ( 932637 ) on Friday December 23, 2011 @11:14PM (#38478944)

    This may sound like a get off my lawn type post, but from what I've seen it seems that the writing ability of younger people has severely declined. And it's not even that big a difference in age that I'm talking about here, I'm talking about people less than 10 years younger than me. I "abuse" the language a fair amount myself, but I'm talking about seeing people thinking column has a b in it, and despair doesn't have an e. There are fluctuations in the language that I'm used to; such as the color vs. colour thing; but basic spelling problems that would not be correct in any dialect seems to be pretty common. And of course we have the their vs. there problem.

  • Wikipedia is not immune to entropy.

  • Badly flawed methodology (Score:3)

    by Idarubicin ( 579475 ) on Saturday December 24, 2011 @01:10AM (#38479530) Journal
    Just looking at the raw result presented, I see a claim that more than 6% of Wikipedia is supposedly "misspelled content". This doesn't make sense--even though Wikipedia articles aren't perfect, it's not plausible that 1 in 16 words are misspelled. That's pretty much one spelling error in every sentence.

    Part of the problem is the article selection methodology. By pulling random articles, the study author is going to be getting mostly articles that have received little attention, and mostly short articles. (Table 2 and Graph 2 show this very clearly--of the 2400 articles examined, only 14 existed in 2001. Half of them didn't exist until 2007. A quarter were created between 2009 and the present.) It's possible that what has been demonstrated is simply that relatively new articles on relatively unimportant topics tend to be less-well maintained.

    The major issue is the corpus used for the study. While a half-million-word dictionary sounds impressive, it's still going to fall down in a couple of key areas. For one, foreign-language terms are likely to be nearly completely unrepresented. For another, a lot of proper nouns are going to be missing. If I write an article about Japanese manga or a Norwegian village, I'm going to be including all kinds of things that an English-language dictionary just isn't going to contain. (Worse, I'll get two misspellings for each Japanese term, since I'll have it in the article with both the original Japanese word plus the romanized transliteration). Another problem area will almost certainly be articles on highly technical topics (molecular biology is full of new and unusual abbreviations).

    While certain classes of 'obvious' non-words aren't counted, many will be missed. For example, the article preprocessor filters out percentages, but will pass through numbers followed by the degree symbol (which will show up in scientific and geographic articles).

    What is noticeably lacking from the report is any mention of manual checking performed by the author to evaluate the accuracy of the results generated by the spell checker. Table 4 reports that about five percent of articles contain more than 25% misspelled words(!); honestly, even people on Twitter don't (generally) show that level of illiteracy. Are there certain types of articles which are responsible for these grossly inflated counts?

    In summary -- sloppy methods give useless results. No news.

Slashdot Top Deals

Love may laugh at locksmiths, but he has a profound respect for money bags. -- Sidney Paternoster, "The Folly of the Wise"

Close