Optimizing News Sites For Google News 422
malibucreek writes "More trouble for Google News? Yesterday, it was Google News censoring stories for China. Today, the Online Journalism Review details a potential conservative bias in the site's algorithm for news search results. The story also includes some details about how Google ranks stories on its news page. Turns out that on Google News, backlinks do *not* improve search positioning."
It's google's job to give balanced news (Score:4, Insightful)
The article also suggests that using the name is full form, repeatedly, and using keywords in your title makes it receive a higher rank of google news.
Yahoo news is filtered by people; google news is completely automated.
From porn to religion... from the left to the right... many groups have figured out how to manipulate search results. It's life or death in the web world to optimize, It's google's responsibility if they are going to deliver news that they deliver both sides of a story.
Re:It's google's job to give balanced news (Score:5, Funny)
Regards,
Dan Rather
Re:It's google's job to give balanced news (Score:3, Interesting)
Re:It's google's job to give balanced news (Score:5, Interesting)
Re:It's google's job to give balanced news (Score:5, Funny)
Re:It's google's job to give balanced news (Score:4, Funny)
Re:It's google's job to give balanced news (Score:2)
Re:It's google's job to give balanced news (Score:3, Funny)
Re:It's google's job to give balanced news (Score:4, Interesting)
Obviously the content is current events, however, Google doesn't write any of the content. Where does their responsibility lie?
It's really simple; hell, it's even in the subject you're responding to. As a news aggregate, just as with a search engine, bias is a bad thing for Google. I run an aggregate of my own (plug, plug [subsume.com] :-), and the very idea that I should favor one site over another (aside from the stated goal of who gives a more timely announcement) is completely bankrupt of any ethical responsibility my site has to it's users.
The old standard of "appearance of impropriety" holds at least as well for Google, too. Same is true for Slashdot article selection. If anyone is getting kickbacks or has some other unstated criteria for selection, that is irresponsible and should not be tolerated. If it's just a bug in their code, a fix will keep their reputation intact. If it's intended at any level, it just gets added to the scorecard that people have started due to questionable action as of late on Google's part.
Re:It's google's job to give balanced news (Score:4, Interesting)
I don't see Google as the place to go when I want to find out what is happening today. I find it the place to go when I read a blurb on one news site and want to get more details or an alternate view from another site.
It would be like using a stock exchange ticker to decide what company is making news
Re:It's google's job to give balanced news (Score:4, Insightful)
But if it wants to remain relevant, it needs to make sure it index those sites in such a way that a balanced presentation of respectable news sites are presented for a query. If the top stories continually run along the lines of "John Kerry is a Gay Commie Space Alien" just because some 2nd tier nutso conservative blog figured out how to best exploit the indexing algorithm, Google News will quickly become useless.
Re:It's google's job to give balanced news (Score:3, Interesting)
It's a tough call to say what's "balanced". A rather crude method is to say "50-50". But that doesn't take into account the "fringe" parties, independants, etc. Should all candidates be given equal airtime? Personally, I don't think that would be ideal - I really could care less about hearing about most of the other candidates.
Suppose, then, we come up with some sort of hand-waving idea of balanced being relative to the vote that each candidate will receive. Ignoring for a minute the obvious time-con
Re:It's google's job to give balanced news (Score:5, Interesting)
All of us geeks have just learned how to search on google news to get a ballanced index, search for "kerry" + "john kerry" that's all
Re:It's google's job to give balanced news (Score:3, Insightful)
Since when has any news organization been concerned with reporting "both sides of a story"? Every news source puts their own spin on things based on however they lean and/or what will sell more copies.
If anything, Google's less likely to be biased than most places, since it just mechanically indexes things. If people are manipulating the results, then it might be in Google's interest to change the algor
Hey (Score:2)
$10 a month - search basics
$100 a month - search basics + more porn
$1000 a month - search basics + real china news
$5000 a month - search anything + gmail account
Re:It's google's job to give balanced news (Score:3, Insightful)
Granted, a lot do put some spin on it. But I'd say that there's some that at least attempt to maintain some level of objectivity. No one's going to be 100% successful, of course.
Re:It's google's job to give balanced news (Score:2)
What next, links to the KKK's newsletter and OsamaBinLadensBlog.com?
Re:It's google's job to give balanced news (Score:2)
Re:It's google's job to give balanced news (Score:2)
What I was trying to get it was how they seem to be going farther and farther into the "reliable/balanced" category.
The job is to make money (Score:2, Insightful)
One aspect of being profitable is to keep costs down. This includes labor costs. If a computer algorithm can perform a job adequately and for less money than a human
So there really was something to see here! (Score:3, Funny)
Here come the naysayers! (Score:4, Funny)
The bias is in american culture (Score:2, Insightful)
Re:The bias is in american culture (Score:5, Insightful)
Time and Newsweek both have significantly higher weekly circulation. US News doesn't even seem to try to hide its bias; it seems like the very first thing in every issue is an editorial expressing views slightly to the right of Karl Rove.
Re:The bias is in american culture (Score:2, Insightful)
Which is one of the great things about it. (Not to say that it's a great magazine. I don't read it that often myself, so I wouldn't know.)
Everybody has a bias. Everybody has political leanings. The idea of "objective journalism" is a very new one, only cooked up since the 1950's. The problem with "objective journalism" is that it's inherently impossible. Not just because all people have biases, but because the way "objective journalism" has been concocted
Re:Definitely a troll (Score:4, Insightful)
A thing may indeed be impossible to achieve, but that does not mean one should not attempt it anyway. I don't think we'd be well served to go back to the yellow journalism days. Thompson's Gonzo journalistic style--which is really just a first person narrative or even documentary--has a place but there are those of use who want a more complete perspective.
This does not mean getting exact opposite pieces of information from both sides. It means getting both sides to comment on a topic.
Aiming for a high standard but not reaching it is better in my mind than aiming for a low standard and hitting your mark.
True. (Score:3, Interesting)
Re:True. (Score:2)
I believe it has been this way ever since big media became involved
(probably since the Nixon vx JFK televised debate).
Re:The bias is in american culture (Score:3, Interesting)
I went to school in Pennsylvania, which is fairly middle of the road overall, where my public school principal informed my senior class, a month after the Supreme Court ruled clearl
Re:The bias is in american culture (Score:4, Interesting)
Not to mention--but I couldn't find the source--that I think over 50% of newspapers endorsed Bush in 2000.
Re:The bias is in american culture (Score:3, Insightful)
Re:The bias is in american culture (Score:3, Insightful)
Re:The bias is in american culture (Score:2)
Yeah. It pisses at me off when I see a "conserve natural resources" or "John Kerry for President" sticker on an SUV. If these people actually believed what they espoused on their car-asses, they'd be driving Honda Insights or a Prius.
It is not Googles responsibility (Score:3, Insightful)
No, its not going to crawl through a Ih8tebu5h's livejournal entry for 'news' or other blogger oriented 'news'.
Wasn't there a slashdot article a while ago about Google having a seperate section for bloggers so they didn't skew news? Not that all bloggers are liberal, but most of the internet savvy folks I've met are.
Re:It is not Googles responsibility (Score:5, Funny)
Re:It is not Googles responsibility (Score:4, Insightful)
Re:It is not Googles responsibility (Score:2)
Simple fact is that if Google wanted to have this bias, they could do it very easily. Whether or not they do have this bias is up for question, but the story gives a good demonstration of how negative Google's results made Kerry look.
Re:It is not Googles responsibility (Score:2)
Re:It is not Googles responsibility (Score:2)
Did you read the article? Several of the sites are blatantly pro-bush. What's the difference between a blog, and a blog pretending to be a news site so that they can get on Google news?
Re:It is not Googles responsibility (Score:3, Insightful)
It's possible because the leaning doesn't have to be intentional. (At least not on Google's part.) It could be an accidental result of how their code works, and/or it could be a result of the system being intentionally gamed by people trying to skew Google's results.
Re:It is not Googles responsibility (Score:2, Informative)
Re:It is not Googles responsibility (Score:2)
Of course, the alternative is for media sites to just start writing lauding pieces on Kerry...
Re:It is not Googles responsibility (Score:5, Insightful)
No, the article shows that Google News *does* use popular blogs in its results; in fact that's the whole point of the story: that searching for "John Kerry" on Google News presents you with an inordinate number of anti-Kerry rants on conservative blogs, rather than the "mainstream" news results that you get when searching for "George Bush".
The article doesn't try to infer some kind of conspiracy from this; rather, it's probably due to the fact that bloggers typically repeat the full name throughout their articles ("John Kerry is unfit for command! John Kerry is flippity-floppity, and John Kerry speaks French!"), whereas actual news articles tend to revert to "Mr. Kerry" or simply "Kerry". It is mildly interesting that GN indexes these political blogs, though.
Re:It is not Googles responsibility (Score:5, Insightful)
News reports try to be fair... but the people who do such reporting tend to altruistic people who have a hard-to-hide bias towards the left, always wanting to file a feel-bad-for-this-person report that paints the little guy as a victim and the big company as the bad guy.
Then there's news analysis... that usually lands on the right because the best bigmouths tend to be right-wingers. Even if you disagree with every word they say, they're still more fun to listen two than a left-winger. Fox News Channel frequently has one-from-the-left, one-from-the-right debates on their air, and the right-winger usually is able to talk in soundbytes and talk over the opponent to the point that they appear to "win" the debate more often.
Here's what throws Google for the loop... There's only one AP, and there's only one Reuters. Stories that come out of those two agencies appear in hundreds of web pages, yet there are hundreds of right-wing opinon writers who all express similar ideas in completely different words. Therefore, the right-wing opinion pages sometimes can drown out the left-wing reporting by simply having more entries in the list.
So.... (Score:3, Insightful)
Re:So.... (Score:5, Insightful)
Bias is okee-fine, so long as your bias and my bias are the same.
Re:So.... (Score:2)
Running across this article today after reading this item [littlegreenfootballs.com] yesterday on Google News' inclusion of the Daily Kos hatesite as a "news" source is amusing. The last article on the page (at this time) gives this explanation from Google:
Re:Hatesites? (Score:4, Funny)
I can tell you don't read it, or rather, don't read it in context of the rest of the national press here. You're woefully misinformed: the Mail is somewhat to the Right of centre.
Here's an approximate right-to-left split of the national press (Sunday papers omitted for simplicity):
Alternatively, there's the traditional definition set of the national press [hps.com] quoted for the benefit of novices such as yourself, which is still sufficiently accurate to be a useful rule of thumb:
Re:Hatesites? (Score:3, Informative)
Forgot to mention: most of the UK press - including the Telegraph - have pretty clear divisions between news and editorial. The newspaper editorial positions above are much less obvious in news coverage, particularly in the upmarket newspapers aimed at an intelligent, educated readership:
Re:So.... (Score:5, Insightful)
Our local newspaper (the Milwaukee Journal) is awful when it comes to being liberally slanted, and while the conservatively slanted public radio shows often try pointing out the bias, it's just ignored by the newspaper and the public. There is NO unbiased news. That's just something we have to live with.
Re:So.... (Score:3, Interesting)
I'm curious as to how "liberal" slashdot is. I have never seen a link to The Nation or Common Dreams, but have seen links to WSJ, Fox, etc. I never see articles about socializing healthcare, the legal system, etc. If anything slashdot reflects the opinions of educated city dwellers/tech workers/gen x/y'ers.
To some people the lack of "The Bible is the inerrant word of the one true God" and "We must privatize everything!" equals a liberal
Re:So.... (Score:5, Insightful)
Not trying to troll here, I don't understand why people are trying to call shinanigans on Google, if they have a bias then that is their right to.
Sure, but if they paint themselves as being equananimous in their presentation then they should be held up to that standard, and criticized when they don't meet up to it. If they want to be biased one way or another then so be it, but they should be upfront about it. It's like Fox; it's not so much the fact that they are conservative I disagree with, it is that they are dishonest in saying they are fair. I actually subscribe to a couple of conservative magazines because of their quality, but they do not deny or try to hide their slant.
To put it another way: Lying is wrong.
Re:So.... (Score:3, Insightful)
As a small-l libertarian I don't see much in the way of unbiased news regardless of the source. The very assumptions that most stories are based on are biased in and of themselves, even if the piece is written in the most unbiased mann
Re:So.... (Score:2)
To put it another way its a "Systemic Anomoly".
Sorry, that just popped into my head and I couldn't resist, but really thats what this seems to be.
Re:So.... (Score:5, Interesting)
"I think what you're seeing is an odd little linguistic artifact," said Zuckerman, former vice president of Tripod.com and now a fellow at Harvard's Berkman Center for Internet and Society who studies search engines. The chief culprit, he theorized, is that mainstream news publications refer to the senator on second reference as Kerry, while alternative news sites often use the phrase "John Kerry" multiple times, for effect or derision. To Google News' eye, that's a more exact search result.
Basically, google is doing exactly what we told it too: looking for the most links with 'john kerry' in it.
"Computers are out to destroy us. This can be proven by the fact that they do exactly what we tell them."
Re:So.... (Score:2)
Let's ignore for a second that this story is about Google: Isn't part of the problem that people with slanted opinions also think those opinions are "right"? ("right" as in "correct", not "right vs. left") I mean,
Re:So.... (Score:2)
No, I'm sorry that is the definition of an idiot.
Re:So.... (Score:2)
So I guess I'm presuming that Google, having everything automated, isn't trying for any particular political slant. If they're showing up with any unfortunate informational slant (including that when you search for almost anything, you'll get a couple porn sites in there), I'm presuming it's because of imperfect search technology.
I think the problem is that I phrased my original message poorly. I actually don't think Google has done anything wrong here, and agree with the entirety of your reply. What I wa
Re:So.... (Score:2, Insightful)
As I said in another post, The Milwaukee Journal often uses AP stories which seem to be very well balanced, but then will exclude certain paragraphs they deem unnecessary, or filler, and the articles end up having a liberal slant.
Also, if you get on Fox's case, you need to get on CBS's as well, since they both claim to provide balance
Re:So.... (Score:2)
The media bias is annoying, which is why I read liberal papers (Milwaukee Journal, NY Times, cnn.com) and watch liberal news shows (NBC, ABC, CBS) but listen to conservative radio.
To be blunt: that is a load of shit. A recent example illustrates this perfectly. Remember Sandy Berger? He was accused of stealing documents from the 9/11 Committee. The NYT and Washington Post both ran lengthy articles about this on their front pages. It led all three evening newsbroadcasts for two straight days. But after Ber [google.com]
This just in... (Score:4, Insightful)
ii) man who is actually President gets more genuine international news coverage (speeches, commentary, policy, state visits and campaigning) than man who isn't (basically just campaigning).
Thus aforementioned blogs tend to show up prominently in News digests about non-President, because there isn't much to say about him.
/ ~Rocket Science
google? (Score:2, Funny)
Article text has excellent theory. (Score:5, Insightful)
"I think what you're seeing is an odd little linguistic artifact," said Zuckerman, former vice president of Tripod.com and now a fellow at Harvard's Berkman Center for Internet and Society who studies search engines. The chief culprit, he theorized, is that mainstream news publications refer to the senator on second reference as Kerry, while alternative news sites often use the phrase "John Kerry" multiple times, for effect or derision. To Google News' eye, that's a more exact search result.
Seems reasonable enough to me. Most of the major news I catch does indeed refer to Kerry without his first name. Likewise for Bush.
Hardly an intentional bias.
Re:Article text has excellent theory. (Score:2)
Re:Article text has excellent theory. (Score:2)
Re:Article text has excellent theory. (Score:3, Interesting)
See, that's why there's a conservative bias. Liberal media labels Bush as the "antichrist", "devil", "shrub", "@sshole"... any number of derogatory terms; and each time some term is used is one less time the name is mentioned, and thus you get a very low ranking.
I've seen anti-bush articles where his name is not even mentioned because anyone reading the article *knows* who it's talking about... I'd guess
Re:Article text has excellent theory. (Score:5, Informative)
Raises more questions (Score:2)
The next paragraph partially answers this:
With an occasional exception, Weblogs are generally not found among the Google News results, so Zuckerman had some advice for aspiring political publishers who want to game the search engines: Don't blog -- start an alternative news network. Use te
Re:Article text has excellent theory. (Score:2)
I think the article's theory is correct -- searching for George-W-Bush or George-Bush rather than Bush (as the article did for John-Kerry as opposed to Kerry) turns up mainly anti-Bush stories. This goes a good way towards confirming the suggestion that it's a usage difference between establishment and alternative news sources.
Crosshairs (Score:4, Interesting)
Pre-IPO couple of college kids that worked hard and are smart and made the world better.
Post-IPO, this company is the new MS, look at all the sinister, conspiring things they do, always knew they were no good.
Whats next Google supports terrorism? I guess whatever sells papers or click throughs.
Thank God (Score:2, Funny)
News Flash: There is no unbiased news (Score:5, Insightful)
"The chairman of the entertainment giant Viacom said the reason was simple: Republican values are what U.S. companies need."
It's nice to know the media is deciding what to let through and what to report "in our best interest".
Re:News Flash: There is no unbiased news (Score:2)
I would further argue that there never have been unbiased news sources - just fewer sources from which to to choose, logically leading to more discrete stratification of opinion in years gone by.
Re:News Flash: There is no unbiased news (Score:5, Funny)
1. What you do with your body is our business.
2. Telling other countries what to do is our business.
3. What you think is our business.
4. Giving your tax dollars to the wealthy is our business.
5. What you say is our business.
6. Your religious beliefs are our business.
7. Ensuring big business pays its fair share is none of our business.
Clear that up for you?
Our polarized society is the problem (Score:4, Insightful)
The article really just re-enforces my thought that it doesn't really matter what news source you read at any point in time, as long as you are reading many different sources on every side of an issue [to the extent possible]. Then you can settle on the truth being somewhere in the middle.
but this is just bullsh!t no matter which side you are on:
http://www.cbsnews.com/stories/2004/09/24/politic
Beta? (Score:3, Insightful)
Re:Beta? (Score:3, Informative)
My iPod has a liberal bias (Score:3, Funny)
Optimizing is Evil. (Score:3, Interesting)
Anyway, in the briefing for the product, I found out that the name they had given to the product was very generic, stright out of the english dictionary (for sake of the story, lets call the product "Apple").
So I asked the marketing guy and one of the directors who was there why they had chosen "Apple" when if soembody were to google Apple, they would get 1001 links about the computer company, then about the fruit, before people would get to their company.
The answer? They said they paid a company who promised that for their fee, they could get the company's page on their product called "Apple" within the top 4 search results on EVERY search engine. (Fat chance)
My point is, optimizing is an evil business every step of the way. If you ask me, it's downright fraud.
I realize it's anecdotal, but (Score:4, Insightful)
Apparently, it falls the other way as well, but the very fact that a blog on either extreme of the spectrum is showing up that much is a little disconcerting.
Punditry of all stripes is great and I read a ton of them from both camps regularly, but I come to Google News for news, not the OpEd page.
I have a simpler explanation (Score:5, Insightful)
The "second tier" conservative sites write positive things about George Bush and negative things about John Kerry. The analogous liberal/left sites (who don't seem to rate sneering comments about their importance) write negative things about George Bush but have zero positive enthusiasm for Kerry. Therefore, "George Bush" gets both pro and con results; "John Kerry" only gets con. No conspiracy required, just an uninspiring candidate.
You can see the same thing, by the way, on bumpers. Here in John Kerry's home state, there are a zillion anti-Bush bumper stickers and about as many pro-Bush stickers as pro-Kerry stickers. Are cars optimizing their bumpers for my eyes?
Re:I have a simpler explanation (Score:3, Informative)
Kerry doesn't have the best delivery on his speeches (read: is totally
Google-like Systems Need to Understand Expertise (Score:5, Insightful)
Re:Google-like Systems Need to Understand Expertis (Score:4, Insightful)
is not to be taken for granted. In particular, it is often the case that foreign reporting of domesitic issues is more balanced and useful than what we get from American news sources.
Particularly under this latest administration.
Bias (Score:2)
Statement of bias: I am a conservative so perhaps by judgment is being colored. Also, Google News has run a number of stories from my onli
hey, it has a disclaimer! (Score:2)
Sounds fishy (Score:4, Insightful)
What are the odds that the political landscape Google is surveying actually is more conservative than OJR thinks? If they detected a difference between the sites which use human editors and the Google aggregators which do not, what are they really measuring here - the biases of the Google algorithms or the biases of the other human editors? Correct me if I'm wrong, but Google only knows what it finds.
Just a hunch, but I bet these guys are still trying to figger out why Fox News is so dang-ole popular.
umm.. (Score:5, Insightful)
But then, I suspect the reason this article was approved is because it appeals to michael's left leaning bias, which he unapologetically admits he has [slashdot.org]. As he said: "I'm trying to dispel all notion that I'm unbiased, or that I'll be presenting everything in an entirely unbiased fashion. If my biases totally offend you, you might want to go right now to your user preferences and check the box to block stories posted by me."
censorship through google ignorance/laziness (Score:4, Informative)
But if on the google.ca page you click on Google.ca offered in: Français, then on Actualités (News), you're forwarded to the google.fr (France) news page.
France != French Canada
Conservative bias? (Score:3, Informative)
I believe the study is slanted.
Potential is key (Score:4, Insightful)
Conservatives probably see articles like the following and start sniffing around for conspiracy. Whether a conspiracy exists or not. I'm starting to see a common thread amongst conservatives of boycotting orginizations that even hint liberal ideals. As a conservative myself I see a large movement away from the major media by most of my conservative friends around the nation and world due to "media bias" and its presentation of liberal ideals. (I'm probably redudant here.)
The advent of the internet, blogs, and talk radio allow this to happen. It saddens me because I feel that there hasn't been substantive debate in over a decade because both "new" and "old" media has bias and both camps are clinging on to the media that shares their views and shuns out the opposition.
I'm longing to have a healthy debate about issues rather than a shouting match where both people leave mad feeling more "right" than when they began.
Article [worldnetdaily.com]
Article [worldnetdaily.com]
If you want neutrality... (Score:4, Informative)
Oh? What's that? It's not as comprehensive? Well, it's a wiki, not a search engine! Seems you just can't have it both ways...
Note that there is talk of a WikiNews run by the MediaWiki foundation, but at present it is mostly idle speculation, and no real plans to make such a site.
Conservative Bias? (Score:4, Insightful)
Bush: 17 negative headlines
Kerry: 6 negative headlines
(For the record, I am not reading each and every article, just counting it if the headline appears to be negative. Also, I am also counting headlines that bash both candidates as negative).
Sorry folks, I don't see the 'conservative bias'. Granted one would probably expect a few more negative results with regard to the current president regardless of which party is in office, today Bush had nearly three times as many.
No, I'm not arguing that Google news always has a liberal bias (it uses algorithms, not editors, to decide what to post), just that finding a few conservative-leaning headlines after a few experiments (they only loosely document two, though they claim there were others) is not evidence of a conservative bias.
Of course backlinks aren't used for news (Score:4, Insightful)
Turns out that on Google News, backlinks do *not* improve search positioning.
Seems quite reasonable. After all, being news, how is it going to have many backlinks? And how are they all going to be found while the news is still new? By the time the news is old enough to appear in Google's regular results, backlinks become useful. Am I missing something?
Re:Google News Republican Bias? (Score:5, Funny)
Re:Google News Republican Bias? (Score:2, Informative)
So basically, visiting a flame site is not the same as visiting a biased news site that honors it's duty to give inches of column space to both sides of the spectrum. Yes, they pick and choose, but at least somtehing from the opposising side is there.
Crying
Re:In other news... (Score:4, Interesting)
People are damned cynical. I think that Google will be recieving a lot of flak in the future for doing what it should do as a company: make a profit. If leaning towards the right makes them a buck, then I find it hard to believe they'd do otherwise. It may not be right, but it is their right.
Re:In other news... (Score:3, Funny)
So let's get right to the point, rightaway. So, right now, Google has the right to lean towards the right, eventhough it may not be right because they don't write news. But can you lean if you're only write about harmless entertainment like Edgar Wright [google.com]? There doesn't seem to be a slant to the right if you're going to write about Rite-Aid [google.com]. I mean, if I was going t
Re:What's bias? (Score:2)
So where did those Nigerian uranium documents come from? Oh, wait, those faked documents were only used to hype a case for invading and occupying a country. No big deal, I guess .... in some people's "world view".
Re:games people play (Score:2)
I beg to differ. You certainly have a right to start making up your own definitions to words if you want. Whether anyone will listen is a totally different matter.
A popular and adequate definition of "conservative" is: "Favoring traditional views and values; tending to oppose change."
Nowhere in that definition is any mention of money, profit, or gaming a system.