Nielsen Adapting To Modern TV-Watching 112
Ant wrote to mention a C|Net story discussing fundamental changes in how the Nielsen company tracks viewership. From the article: "CNET says that the Nielsen company is finally taking one of several steps aimed at adapting to the new television/TV audience (those who use TiVo or another service to record prime time shows for viewing later) on December 26th, 2005. Ratings will be broken out by how shows are watched--live, later in the day or within a seven-day period. Over time, Nielsen will also move to measure viewing that takes place via iPods, cellular/cell phones, laptops, and other digital devices that are gaining TV privileges. The company also will track audiences for on-demand fare. The steps are a radical change for Nielsen, reflecting an overall paradigm shift that's shaking up the television world. The audience is taking control. And TV companies are scrambling to catch up."
Very interesting (Score:5, Interesting)
I remember at one point, between the top two torrents of LOST, there were 5,000-10,000 seeders, 10-15k completes, and 20-30k people leeching within the first 12-24 hours.
One other thing I thought of (Score:5, Interesting)
Unfortunately, we may not ever see IP multicast in its present form on the backbone. It requires too much additional memory in routers, and I have yet to see ANY information on how to find a free multicast address and reserve it for use. It's simply too hard for the average programmer/user to use.
I saw a couple of links to a Japanese multicast project known as Xcast, which would simply put multiple destination IP addresses in a packet, while it isn't as scalable as IP multicast, it's a hell of a lot easier to use. Unfortunately, since it isn't quite standardized yet, it's basically only supported on a handful of test networks, and I wouldn't be surprised if it stays that way.
In this day and age of mass media distribution, some form of multicast, even a limited one that only allows 8-16 destinations per packet, is desperately needed - so why the hell is there still no viable solution?
Re: (Score:2)
Re:One other thing I thought of (Score:1)
Re:One other thing I thought of (Score:2)
That's a problem for a higher-layer protocol. I previously worked for a company that received live stock-market data via multicast. Each message included a sequence count, and if you did not receive some messags then you would ask the exchange to re-transmit a range of sequence counts. These re-transmissions would be mixed in with the regular data stream, with a flag to indicate that they were retransmissions.
I haven't worked with multicast
Re:One other thing I thought of (Score:2)
Clients can request individual packets are resent to them alone (works well if packet loss is very low).
Server continuously re-broadcasts data for a few days, so if you miss it the first time, you can get it the second/third/fourth/whateverth time (generally referred to as carousel).
Forward Error Codes: http://rfc3453.x42.com/ [x42.com]
Re:One other thing I thought of (Score:1)
But it works badly when lots of clients observe packet loss. The worst case is if you have many many clients listening to a multicast source, and there is loss on the line between the source and its ISP. The source might be drowned in retransmit requests, much like in a DDOS attack.
Carousels are fine and dandy, but if you have missed just one chunk of a large file, you may have a long wait, and lots of
Re:One other thing I thought of (Score:3, Interesting)
You're correct in that dropped packets would cause a problem for BT, since everyone needs the entire file. That said, if a client even received only 50% of a file via multicast, that would be 50% less that would eventually need to be handled via unicast, or via another multicast transmission. In reality, probably most clients would get 80% o
Re:One other thing I thought of (Score:1)
Re:One other thing I thought of (Score:2)
Initially a full multicast transmission of the file would be done, and after that, the tracker could look and see which parts of the file were missing at the greatest number of clients. The tracker would then have the clients which DO have that file retransmit the parts that most clients need with another round of multicast broadcast. Once less than a certain percentage of
Re:One other thing I thought of (Score:1)
Re:One other thing I thought of (Score:1)
If there are large numbers of clients, this operation could be very expensive for the tracker.
The other consideration with this approach, unfortunately, is that there is a serious mismatch between the rate at which the fastest-connected and slowest-connected clients can absorb the multicast traffic. If the source transmits
Re:One other thing I thought of (Score:2)
The issue of slow downloaders is a good one, but even if only 20-30 of the initial clients could download at the full broadcast rate of the initial seed, there would be a HUGE performance improvement, because there would be 20-30 seeders in a very short time.
Note that the problem you mention is where
Re:One other thing I thought of (Score:1)
I believe Forward Error Correction [wikipedia.org] can account for missing and dropped packets. From Wikipedia: "FEC is accomplished by adding redundancy to the transmitted information using a predetermined algorithm." I remember someone presenting this solution at the IETF many years ago.
Re:One other thing I thought of (Score:1)
I'm not sure Multicast would improve things much... It would only work if a large number of people on neighboring networks want to download the SAME file at roughly the SAME time...
It would probably be good for streaming TV over the internet and such. But for bit-torrent as it is, I don't see how it would help....
NOW, what could be interesting is to make a "batch" version of BitTorrent. Users would queue up the files they wanted to down
Re:One other thing I thought of (Score:2)
Re:One other thing I thought of (Score:1)
Some do. Ask yours. There are two principal availability models for native multicast that I know of. Both require asking your ISP to talk sparse-mode PIM and to exchange multicast NLRI with you via BGP. At least one large scale provider charges a nominal fee for doing this at all, at and least one large scale provider does this for free but caps the amount of multicast traffic you can send without making an extra arrangement.
The principa
Re:Very interesting (Score:2)
Re:Very interesting (Score:2)
One of the main reasons Nielsen backed off the idea of changing their measurement methods a while ago, is that it scared the hell out of TV execs. The TV people were desperately afraid that any change in Nielsen's methods would change the viewer #s & would have a major effect on advertising $$$.
(TFA should be modde
Re:Very interesting (Score:4, Insightful)
What I've been wondering though is why we have neilson anymore at all. With the advent of digital cable, it would seem to me that it's now possible to monitor directly the viewing habits of millions of people. That's a large sample. If made optional, i would even opt-in to just such monitoring, since it would mean that every time i watched my favorite shows i'd be casting a vote to keep it on the air.
Re:Very interesting (Score:2)
WIth so many digital cable boxes out there, monitoring what exactly what people watch should be so much easier now. Neilsen has such a small sample that I'm sure it's very inaccurate. They're going more for an accurate demo-mix than raw numbers. If the cable company got into the tracking business, they'd make a lot of money, and I'm convinced it would help good shows thrive. People are watching Arrested Development, we just don't know about.
And... end of rant.
Re:Very interesting (Score:3, Insightful)
Re:Very interesting (Score:2)
But seriously I do, he described how this new system worked a year ago (when they were debating rolling it out) basically as they can't get inside the DVR to track your info. The new system uses a special box that does a combination of pattern recognition and special closed caption style program information encoding. The preferable method obviously is for the program to include its own i
Re:Very interesting (Score:2)
Re:Very interesting (Score:2)
They also use some basic pattern recognition for local commerical and other small shows that are not opting to include this information.
Re:Very interesting (Score:2, Funny)
Re:Very interesting (Score:1)
Nielsen ratings are used primarily to set prices for ad segments.
I'm sure that people go out of their way to strip ads/use dvd rips for torrents. (IE they're screwed on two fronts.)
Re:Very interesting (Score:2, Informative)
Short answer: Yes, no, and maybe.
(disclosure: I am a Nielsen employee based out of their GTIC facility in Florida. Beautiful place BTW.)
In the past, Nielsen has recorded time shifting as viewing. After all, why go through the trouble of setting your VCR to record a show if you're not going to watch it? And then TiVo had to mess it all up. It constantly records things you don't even ask for. Even if you do end up watching it eventually, it could be a week or a month later.
C
Re:Very interesting (Score:1)
You hit the nail on the head. Nielsen provides products (such as Ad*Views and NPOWER) where clients can zoom in on data for just commercials or just content. However, the "currency" data that the MRC has accredited for use in determining commercial pricing doesn't distinguish between them. Before DVRs, it was rather difficult to pass the "currency" minimums without watching commercials. With DVRs it's commonplace
Re:Very interesting (Score:1)
The current system relies on moths that the broadcasting industry call, "sweeps." Most notably of these months is the May sweeps since a large number of ad agencies buy their advertisements on this books ratings. This system allows the television companies to ignore a number of months and play repeats and poorly produced programs, but still get good ratings. Basically,
Re:hey (Score:1)
Re:hey (Score:1)
Re:hey (Score:2)
Not a dime.
Oh... but they do encourage you to go out and buy video products like VCR's or DVD players, for which they will offer a small rebate.
Re:hey (Score:1)
God damn people are stupid. From this point on, I declare that if you are an uncompensated Nielson home - you must be executed.
Re:hey (Score:2)
When I was first offered the opportunity, I agreed because of what amounts to little other than unpleasant childhood memories.
Let me 'splain.
As a youth, I had noticed that it seemed to happen all too frequently that I would really get into a new TV show and it would be cancelled, often halfway through its first season. I *HATED* that this happened to me.... all the time. Like, almost every single year there'd be a new show that I'd really like and it would get canned after 10 to
Re:hey (Score:1)
It's almost completely transparent to my viewing experience; I only have to push a button on a
Re:hey (Score:2)
Perhaps we need a paradigm shift in our usage of marketspeek?
I did the Nielson ratings for five years... (Score:5, Interesting)
Re:I did the Nielson ratings for five years... (Score:1)
Re:I did the Nielson ratings for five years... (Score:2)
This could change everything... (Score:5, Interesting)
One thing I hate about Nielson is how unfair... (Score:1)
I wonder how marketing firms will use this new TiVo data? Will they discount the value of a show which was recorded and not watched
Re:One thing I hate about Nielson is how unfair... (Score:2)
What about those of us on Usenet? (Score:3, Funny)
Re:What about those of us on Usenet? (Score:1)
Re:What about those of us on Usenet? (Score:1)
Re:What about those of us on Usenet? (Score:2, Funny)
1st RULE: You do not talk about usenet.
2nd RULE: You DO NOT talk about usenet.
Re:What about those of us on Usenet? (Score:2)
It's about time! (Score:5, Interesting)
One reason advertisers loved the web (at first, at least) was because it's possible to get exact numbers of "viewers", know what viewers are doing (clicking through, clicking then ordering, etc.), and not miss any viewers simply because they didn't get lucky enough to be sampled. I can't imagine being an advertiser trying to track my television ad results... what, survey everyone who walks in my store?
Re:It's about time! (Score:1)
I had a Nielsen box in my house for a while. Later on, I actually found out it had been an accident of sorts, and it had actually been intended for a more "normal" family down the street.
I fear that I may be partially responsible for the ever smaller section of TV listings on the TV Guide Channel, as I used to leave it (it was actually the Preview Channel at the time) on for hours at a time when I was out of the room to confuse "the man".
Re:It's about time! (Score:1)
By sabotaging your input to Neilen, aren't you sabotaging your own 'vote' to the TV agencies? or maybe I'm just naieve =)
Re:It's about time! (Score:1)
By sabotaging your input to Neilen, aren't you sabotaging your own 'vote' to the TV agencies? or maybe I'm just naieve =)
No, you're not being naive. That was sort of the point of my post, though I could have put it more clearly.
Re:It's about time! (Score:2)
Re:It's about time! (Score:1)
and my All-In-Wonder? (Score:2)
-bZj
Re:and my All-In-Wonder? (Score:2)
-bZj
This won't change TV companies... (Score:2)
Re:This won't change TV companies... (Score:2)
It is possible to cut off a number of pixels around the outside when you transcode using a number of apps. Main use of it so far (or at least when I ad-strip and transcode my own digital tv recordings, anyway) is to clip off black bars around a transmitted signal, such as you get when they force a different
Re:This won't change TV companies... (Score:2)
Stop stretching shows (Score:2)
Re:Stop stretching shows (Score:3, Interesting)
Cold Case doesn't run long because the show is more than 1 hour long, Cold Case runs because of the god damn football games running long, then that pushes 60 Minutes back and then Cold Case can start anywhere from 5-45 minutes late. I wrote a letter to CBS about this idiotic schedule they have but I of course received no response.. why would I
Crap shows - Stupid idea. (Score:2)
Re:Stop stretching shows (Score:2)
Ummm, DUH, that's why I have a PVR in the first place. When I'm bored I can check out what's recorded on my PVR rather than being tied to the television schedule. I watch TV when *I* want to, not when the programmers want me to. Now, if you want to sit in your ivory tower and sip your $10 a cup lattes and debate whether television programs are worth watching, be my guest, but I find some of them t
Fantastic! (Score:5, Interesting)
Why? So they can match that with my desire to avoid StupidShit (tm). At times I'll bounce from CNN to Fox to MSNBC to Bloomberg when the same stupid commercial is played for the ninth time that hour.
Heh, " To confirm you're not a script,
please type the word in this image:"
Re:Fantastic! (Score:2, Interesting)
...what? (Score:2, Interesting)
This reflects a change in how Nielson's gathering statistics, nothing more, nothing less. What paradigm shift? What control over television companies does the audience have now that they didn't have before? It's always nice to give voice to wishful thinking, but, c'mon, at least let your excuse have some relev
Re:...what? (Score:2)
From the summary (in fact, the exact part you quote!), "The audience is taking control." Note the absence of the word "companies". They're talking about people taking control of their TV and how they watch it, not writhing throngs of couch potatoes taking over the local NBC affiliate.
Also, I hope they tak
Re:Nielsen (Score:2)
When you are pissed that your favorite show was cancelled BLAME NIELSEN!
Count not agree more. Something is very wrong with the ratings they produce.
Now my wife does not like SciFi, but she actually, much to my delight and surprize will turn "Enterprise" on and watch it with me with interest. And we have a GREAT hour!
So WTF did they get in their brain by canceling it? As I suspect it had an audience beyond the spiked hair klignon freaks.
Not everyone likes watching cheap sitcoms with zero imagination
Re: (Score:2)
Re:Too slow, too late (Score:1)
Still, I would love to figure out exactly how it works.
What the device sends to an outside party depends on the technology.
Some solutions [arbitron.com] require that broadcasters insert audio codes (invisible to human ear) to the transmission. The measurement device identifies these codes and the decoded channel is transmitted.
Other solutions [radiocontrol.ch] take a "fingerprint" of the audio and try to match that to a refence recorded elsewhere. Privacy [radiocontrol.ch] should be protected.
Nielsen? Still needed? (Score:5, Insightful)
With video watching moving towards an on-demand basis, will advertisers really need to hire a company to track viewer preferences? The best thing advertisers can do is replac Tivo/MCE/Myth/whatever with completely free tuner/PVR units. Tivo can already tell advertisers what commercials were watched or skipped, what parts of a TV show were paused or reviewed, what channels are bounced between most often, etc. As TV becomes quickly available through iTunes or direct download, IPTV, and other "right now" provisions, we'll see our information traded in exchange for free TV.
I still believe that TV show production companies will find ways to offer advertising and spyware-free shows (a la the DVD format) for those willing to pay extra. Remember, advertising only exists for shows that are being watched in real time. Video taping, downloading, PVR, whatever means ads will likely be skipped or deleted altogether. We will definitely see more product placement as well as more pop-up advertising on top of TV shows as time goes on. Technology is quickly destroying the efficacy of advertising, so advertising will either have to morph or be left in the dust.
Nielsen, IMHO, is already being put into the incinerator. Their services were nice (*pat on head*) but its time for the new kid to play.
I remember... (Score:4, Funny)
They've already been recruiting. (Score:2)
Re:They've already been recruiting. (Score:2)
Please? (Score:3, Insightful)
There's been a rash of this lately, too... The online dictionary and "finally someone realizes that language evolves" is another egregious and recent one. If you want to comment on the story, comment in the comments. Just report the story in the submission. Saves us from reading something that is often stupid and taints the whole discussion from the get-go.
Re:Please? (Score:1)
Stop announcing the measurement days (Score:5, Insightful)
Re:Stop announcing the measurement days (Score:1)
While you're at it, tell your congressman to kill off H.R.3298 and S.1372 so we can actually do it.
Re: (Score:2)
MythTV disqualified me (Score:5, Interesting)
They then asked for details about my TVs and such, down to the brands and model numbers. This is becuase they had to hook up monitoring equipment to measure the channel selected by the tuner, whether the VCR was playing or recording, etc. Everything was OK until we got to my MythTV box (with PVR-350 card). They could not monitor it properly, so we had to call the whole thing off. The technician (who was quite impressed with what MythTV could do) said that they might have ways to monitor such setups in the future, but he wasn't sure about it.
Oh well.. (Score:3, Insightful)
Out of control (Score:3, Insightful)
This isn't a paradigm shift, it's expansion of technology. Media entertainment is still media entertainment and people still watch it to be entertained. The ways people can access that media have expanded, but there has been no overall shift as a result.
Also, audiences aren't taking control. These extensions of media access are tickling media providers to death. Even Tivo, while cutting out advertising, reflects the audience demand for More! More! The problems Tivo presents to a media provider are only temporary. Media providers are recognizing the audience's unquenchable thirst for more! more! more! and they are finding ways to make even more money off of that thirst. It isn't victory of the audience, it's victory of the provider.
Re:Out of control (Score:1, Interesting)
Also, audiences aren't taking control.
EXACTLY.. there's only one way to "take control" of television: don't watch it. As soon as you plop down and stare, somebody else is in the driver's seat.
I'm not against TV but don't be fooled: finding MORE ways to squeeze MORE video, advertising, and $$$ spent into your life is not "control". In corporate america, TV-viewing controls YOU!
It reminds me of cell phone adverts that talk about "freedom" .. our new phone/new service/extended coverage gives you more "
We shall not cease from exploitation. (Score:3, Insightful)
Although I drained the ratings , which would have been higher should I have actually physically watched the television, I felt it was important since I was representing those of us who had the technology to bypass television completely. I explained this to the Neilsen folks, and they weren't interested in my alternative viewing habits. Concurrently, I also downloaded and watched the first season of the apprentice, with it's integrated product placements. That exposure, from a rating point of view, possibly should have been counted, but there is no way of them measuring that. Even with this new system, they still won't count imbedded commercial watching. Microsoft, for example, paid a pretty penny to be included in the latest episode of the apprentice.
I'm glad Neilsen is finally catching up with technology. I suspect that ratings will shift pretty dramatically when DVRs are used primarily rate the shows. Commercial watching, however, will be seen as happening much less, which I suppose is appropriate since those of that can, do watch as few commercials as possible. Sadly, prefering to watch content and even being pretty unwilling to watch commercials may in the long run prevent content geared to those kinds of individuals from being created. No watching commercials = low ratings = not enough money to produce. Yet I still do everythign I can to limit down commercial watching as much as possible. I realize that may constitute copyright infringement, but I still enjoy the entertainment so much more without having to hear 'these important messages.'
Re:We shall not cease from exploitation. (Score:5, Informative)
Every dumbass knows that Nielson is just a stupid shallow representation of the idiots of the United States.. And, you, supposedly beeing a geek, should know that. You should've had your TV timer set to automatically turn the damn thing on during Enterprise and off after Enterprise.. It doesn't matter if you were watching it or not... You represented something like 1,000,000 geeks and you decided some random measurement that Neilson doesn't yet measure was more important.. Shame on you.
Why be a Nielson kiddie if you're not even going to do your TV watching or purposeful misrepresentation through the damn Nielson system? At least make it SEEM like you were a geek.. Instead, you made it seem like geeks are unmarketable through the current system (ya.. maybe so.. but who cares) and have no money to spend.. and they watch no shows. Thus, Nielson people can readily say, "Hey.. we need more stupid reality shows because smart people don't watch TV."
Ass. I hate you.
Re:We shall not cease from exploitation. (Score:1)
Re:We shall not cease from exploitation. (Score:2)
You can expect about a dozen brawny Wonderfalls fans to show up at your door and beat the crap out of you in about ten minutes. :) It's your fault I don't get to watch Caroline Dhavernas on TV! (Good job with Enterpr
audiences taking control? (Score:3, Insightful)
If by "taking control" you mean "getting permission" then the only 'catching-up' going on here is in how quickly content-owners can implement acceptable (to them) access controls for the proliferation and fragmentation of potential TV-viewing media.
How they plan to do it (Score:1)