


Sony Develops TVs That Zoom in for True Close-ups 275
prakslash writes "Sony has unveiled version 2 of its 'Digital Reality Creation' technology that allows viewers to pan around a TV image and then zoom in. Unlike the current TVs that simply scale the image, Sony's technology does 'true' zooming by digitally enhancing the signal to communicate gloss, depth and texture.
Sometimes, you don't want to see the gloss. (Score:5, Funny)
digitally enhancing the signal to communicate gloss, depth and texture
Ya know, I was going to make the obvious joke, then I realized that what I'm thinking about, I actually *don't* want to zoom in on. Some things are best left to the imagination, lest you see the reality (and the bumps and blisters and pimples). Ewww.
So, umh, this would be cool for zooming in on puppies and stuff. Yeah.
Re:Sometimes, you don't want to see the gloss. (Score:3, Informative)
Re:Sometimes, you don't want to see the gloss. (Score:2)
We're not too far from it
Find out more about this channel (it's actually quite interesting) here [207.70.82.73] (NPR's This American Life).
Re:Sometimes, you don't want to see the gloss. (Score:3, Interesting)
I bought a $2k/pair set of infinity main speakers to go on my old JVC receiver, and compared with the rather high-end Polk bookshelf speakers I've been using for 10 years, they were an ear-opener.
The clarity and tone were outstanding, as well as the dynamic range.
But one thing bugged the hell out of me. Just because I'd changed the speakers, I could now hear all sorts of things in television programs that I could never hear before. Stuff I'm sure the sound e
About a week too late! (Score:4, Funny)
Digital Zoom is a MYTH! (Score:5, Informative)
Come on, it's trying to create data that just plain isn't coming from the original source, therefore it's nothing but guess and check logic. Sure it my smooth out what it thinks is a rough edge... but that's still only guessing and making up detail that just wasn't there.
Re:Digital Zoom is a MYTH! (Score:5, Funny)
Re:Digital Zoom is a MYTH! (Score:5, Funny)
I can see the "CSI" episode now...
Ditzy cop: "Here's that footage you wanted enhanced sir, I ran it through our SomethingAwful lab guys!"
Police Chief: "Put out an APB on this Admiral Ackbah character..."
etc...etc...etc...
Re:Digital Zoom is a MYTH! (Score:2)
Re:Digital Zoom is a MYTH! (Score:2, Funny)
Re:Digital Zoom is a MYTH! (Score:5, Funny)
Re:Digital Zoom is a MYTH! (Score:3, Informative)
This morning. Cut a couple of slices for my sandwich and one for toast. No big deal. Took me less than a minute for all three slices. (It helps if you've got a good bread knife.)
Re:Digital Zoom is a MYTH! (Score:2)
Yes. And the bread stays fresh longer for not being pre-sliced. Plus you can choose if you want a thin or fat slice. If you were making a dozen sandwiches, sliced would be a better choice though.
Re:Digital Zoom is a MYTH! (Score:3, Funny)
Sliced bread WAS the next greatest thing. (Score:2)
It's the bread slicer that allowed commercial bakers to make it into big business.
Re:Sliced bread WAS the next greatest thing. (Score:2)
Re:Digital Zoom is a MYTH! (Score:2)
"Enhance...enhance...enhance...enhance"
Re:Digital Zoom is a MYTH! (Score:5, Informative)
In fact, it may not only smooth out but actually create rough edges not in the original. Think of the case recently where the girl was kidnapped and the FBI enhanced the kidnapper's image from the crappy surveliance tape.
The article doesn't specify if it zooms a frozen screen (like a paused image) or during a sequence. Either way it could use past information from previous image frames to enhance the result.
Its one of those things that you need to actually see to believe the hype.
Re:Digital Zoom is a MYTH! (Score:3, Informative)
I think I read about it in Popular Science or Popular Mechanics (Not sure though)
Re:Digital Zoom is a MYTH! (Score:5, Insightful)
Re:Digital Zoom is a MYTH! (Score:5, Informative)
The basic idea is to use statistical methods over a series of slightly "jittered" video frames to create a high resolution or high quality still image. When an image in front of the camera is shifted by a non integer number of pixels, the images are lined up exactly with each other so that the edges of pixels overlap each other. Taking the average of these sup-pixel overlapped images at a higher resolution yields a higher quality image than the simple mosaic or blur you would get by scaling or interpolation. If the physical shape and response function of individual camera "pixels" is known, even more accuracy can be contained. The method can probably even be applied to rotating or enlarging/shrinking images of objects as well, but with more complex mathematical models for the motion and camera viewing transformation
A generic system as described in the article probably uses the frequency information about the image to construct the textures, but it wouldn't be difficult (but processor intensive) to track translational sub-pixel movement of objects and apply the above process to increase the resolution. MPEG already takes advantage of the fact that more compression for fast changes in an image are unlikely to be noticed, so it wouldn't have to improve the moving parts, just the 8x8 blocks that have B frames, since they are relatively unchanging. I bet they will even get a patent on the process, despite the fact that it's been published and I can think up most of the rest within a few minutes...
Just like insects (Score:2)
Re:Digital Zoom is a MYTH! (Score:2)
The second one looks real, and very good. They even talk about interpolating using the MPEG DCT information, rather than just decompressing the frames then applying standard algorithms. But when you look at the screen shots, it is very very unimpressive. Frankly, I can't see a pixel of difference between their super-resolution version and the original frame. There's no way a c
Re:Digital Zoom is a MYTH! (Score:5, Interesting)
Reminds me people that try to add quality to their 96kbps mp3 collection by upsampling them to 256, or recording radio then upsampling that.
Re:Digital Zoom is a MYTH! (Score:4, Insightful)
Well, it is better because in the digital domain it is possible to do a lot of operations more complex than just a magnification. A lot of these operations get lumped in to the "digital zoom" name.
Come on, it's trying to create data that just plain isn't coming from the original source, therefore
This is somewhat true but not completely. What you're forgetting is that the human visual apparatus is part of the complete system and can't be left out. Our vision system is good at detecting certain features at certain resolutions, and not so good at others. Some image processing algorithms might just "make up stuff". This too, is not necessarily bad if it can give a pleasing effect to the eye. Especially if there is a high degree of likelihood that what it is making up is an accurate representation of what actually existed before it was lost by the original signal recording.
Manytimes however, the enhancement consists of emphasizing certain things in the time or frequency domain that really do exist in the original signal but our vision does not detect because of the relationship to other nearby features. Image enhancement is not necessarily making things up. It is just using known facts about the human visual system to selectively bring out certain features that might be missed with our brain's stock detection circuitry.
What is funny about a lot of "anti digital effects" people is that they think they are automatically getting better results by having say a 48-bit scanner vs a 30-bit one because there is more information, nevermind that the lower bits are completely overwhelmed by noise and shitty A-D conversion path.
In your defense, the posting sounds very stupid and marketing influenced (redundant, I know) Calling something like this true zoom, even with the single quotes is very disingenous.
Re:Digital Zoom is a MYTH! (Score:2)
This would be true -- if we were talking about images of purely random white noise. However, most pictures of the real world aren't completely random, because real objects are relatively smooth and continuous. Just like any kind of interpolation, we can improve on chance by making reasonable assumptions about the underlying structure of what we're sampling.
If you w
Re:Digital Zoom is a MYTH! (Score:2)
No one can create information that does not exist. However, a television screen cannot display all of the information contained in the signal and even if it could, you would not perceive it all anyway.
For example, small variations in contrast can be amplified, false color can make clear what the mind would miss, sharpening (even over-sharpening) can show you detail that your (and everyone else's) pathetic visual perception can not possibly see otherwis
What about the human brain (Score:2)
Re:Digital Zoom is a MYTH! (Score:2)
Most widescreen TVs provide several options for making a 4:3 image fill up a 16:9 screen (i.e. getting rid of the black bars). You can stretch (distort) the picture, or you can zoom in and crop some of the picture. What Sony has don
OK (Score:5, Funny)
PVR (Score:3, Interesting)
Re:PVR (Score:5, Insightful)
Digital TV is MPEG to start with... (Score:3, Informative)
This argument about "lossy compression" comes up again and again. You could say that everything is "compressed" from the original reality; it's a matter of whether you do stupid compression (drop the sampling rate) or intelligent compres
Re:PVR (Score:2)
Perhaps you'd better not try it on DVDs either, 'cause they use MPEG2 as well.
Digital video broadcasts typically use quite high bit rates, and don't have many noticeable compression artifacts, at least not of the "sharp edge around a block" kind that would probably cause a problem for this system.
Comment removed (Score:5, Insightful)
Re:'True Zoom' (Score:2)
Well, except for last year's Super Bowl halftime show...
Re:'True Zoom' (Score:2, Funny)
Re:'True Zoom' (Score:2)
Grassy knoll, anyone? (Score:5, Funny)
Re:Grassy knoll, anyone? (Score:2, Funny)
digital zoom vs real zoom (Score:5, Informative)
unless tv has lower resolution than broadcast quality this is as fake as 200X DIGITAL ZOOM.
Re:200X digital zoom (Score:2, Funny)
Re:digital zoom vs real zoom (Score:3, Insightful)
At 990x you're looking at less than one pixel, but a salesman last month was toating it as "the best zoom you can get."
Re:digital zoom vs real zoom (Score:3, Informative)
All consumer TV's have lower resolution than broadcast quality. If you buy a really expensive NTSC TV, it might be able to resolve 600 lines. The NTSC signal is comprised of 720 lines.
In HD, it's even more drastic. A really expensive HD set might resolve 800 lines of a 1,920-line picture.
A broadcast monitor that can resolve 1,000 lines costs $40,000.
Re:digital zoom vs real zoom (Score:5, Informative)
Where did you ever get that idea? If that were true broadcast TVs and DVD would look exactly the same. I mean if broadcast TV is already better than a TV could support, how could DVDs possibly improve the picture? I would think anyone who has ever watched a DVD on their television has already empirically proved your statement incorrect.
In fact, broadcast TV is a far lower resolution than your TV can support (525 scanlines, of which 480 is picutre information, of which 330 is the theoretical max that will be displayed). Rather than try to explain it myself, some very good technical explanations of how it all works can be found here [aol.com] and here [doom9.org].
Re:digital zoom vs real zoom (Score:2)
Re:digital zoom vs real zoom (Score:2)
What are you smoking, DVDs don't come close to broadcast signal quality, which is still the stardard television displays are built too. DVDs were created to do away with VC
Don't use broadcast as a benchmark (Score:2)
For that matter $500 will get you a 22" computer monitor that will do 2048x1536 and will easily pull 1920x1280, even at a high refresh. It's not all that large, but it is beyond what HDTV needs by far.
yay, more hype (Score:4, Insightful)
Come on. "true zoom" requires data that simply isn't there in a TV signal.
Sure, an HD signal can be zoomed and interpolated to some extent, but call it "creation" or not, there is only so much info that can be "guessed".
Porn Jokes Aside (Score:3, Interesting)
And before it gets said, I know that has been removed. Its just an example.
marketing hype (Score:2, Informative)
Re:marketing hype (Score:2)
4 year old dvd player (Score:5, Insightful)
official press release (Score:5, Informative)
Just another algorithm..... (Score:5, Informative)
http://www.digitalanarchy.com/toolbox/toolbox_r
I'm guessing that Sony have simply come up with another one. Regardless of what they claim, you can't "zoom in" on an image with a fixed resolution, you're always going to be using some type of interpolation and this will introduce digital artefacts.
Re:Just another algorithm..... (Score:5, Interesting)
That's a hell of a processor they have if it can do that, though.
(ot) Why waste your money on that... (Score:2)
What you really need is an MPEG/JPEG deblocker, THEN you resize the image. Duurrrr.
I mean, I'd pay $180 if it took the EXIF information from the picture, derived information about the CCD layout and lens/aperature settings, and information about the artifacts introduced by the particular quanitization that occured during JPEG compression -- to create
Good existing zoom implementations (Score:5, Informative)
Re:Good existing zoom implementations (Score:5, Interesting)
It's true that digital zoom can't replace information that was lost due to scaling and sampling. It's possible to get something reasonably close, though. There are a bunch of algorithms available for photographs, but their biggest problem seems to be execution time. It's not pretty.
Here's mine [byu.edu]. Please be kind to the server...
I've gotten better-looking results since I put that together but I haven't had time to put them up yet. The slowest part of my algorithm requires solving a nonlinear system of nine equations for the least sum squared error per pixel. That's orders of magnitude slower than bicubic interpolation (which is standard).
I don't know which interpolation algorithms are used for so-called digital zoom. Is there someone in the industry here that knows?
Re:Good existing zoom implementations (Score:2)
Re:Good existing zoom implementations (Score:2)
Sure! I've considered it for the name recognition value. :) I'd want to get permission from my graduate advisor, of course. If there's a problem, it would be the possibility of patenting it and selling it. If that happened, I'd definitely fight for making it royalty-free for free software use or something...
I've still got to speed it up considerably before it'll be good for that, though. I believe I can at least get it faster than most of the other stuff that's out there.
/me goes back to slaving over hot
Re:Good existing zoom implementations (Score:3, Informative)
Re:Good existing zoom implementations (Score:2)
I imagine you can also do neat things with video (Score:2)
However even just a simple bicubic filter works pretty well, and works on all images. It looks much better than just making the pixels larger, and at up to about 200% isn't all that noticable and is even acceptable at
lemme guess (Score:3, Funny)
Uh-oh (Score:3, Funny)
I can see the ads now... (Score:5, Funny)
It's not zoom, it's digital enhancement. Which is what zoom is. But this is different. Yeah, right.
More marketing BS.
Re:I can see the ads now... (Score:3, Interesting)
The new Sony's will feature magic Hand-Wavey Technology(TM) to suck information that wasn't in the orginal signal into your TV from outer space.
Must be from the same R&D lab that brought us their new Walkman that somehow stores 13,000 songs on a 20GB drive when an iPod can only fit 5,000 on the same. Seriously, Sony is working their way into a real credibility problem when it comes to marketing their technology.
Re:I can see the ads now... (Score:2)
Must be from the same R&D lab that brought us their new Walkman that somehow stores 13,000 songs on a 20GB drive when an iPod can only fit 5,000 on the same.
Claiming that the iPod can fit 5,000 songs is 20GB is equally misleading. The 20GB iPod can store rougly 20GB of data. Depending on how much compression you use, you can get much more, or much less than 5,000 files on an iPod.
ATRAC LP4 can probably fit around 13,000 songs in that much space. Sounds like crap but it will fit. Likewise, I could
Only one use (Score:2, Insightful)
Like Blade Runner (Score:4, Funny)
It's like that?
Explanation of technology (Score:2, Insightful)
READ: Zooms image and antialiases the hell out of it. Same effect as crossing your eyes and sticking your nose to the screen, but now available from the remote control!
I've always hated... (Score:5, Insightful)
yet another invention of the (not so ?) obvious (Score:2, Insightful)
I mean zooming an image is no rocket science (and in this case is probably no good either). Recognizing public demand for such a function in the case of tv's and adding it could be good for businness. But hyping such a function this much... it's just a nobrainer.
But then again, the hype around these new functions and revolutionary enhancements
Re:yet another invention of the (not so ?) obvious (Score:5, Informative)
Yeah, its way harder. At least high quality image interpolation is. Theres been decades of research into it and dozens of different methods have been the topic of phd papers. Lots of high end math and very complex algorithms.
Ever printed a photo on an inkjet printer? You're seeing a pretty strenuous use of interpolation algorithms there. A typical resolution image coming off of a digital camera only prints at maybe 2 or 3 inches across at the resolution a typical printer operates. So if say, you want an 8x10, your printing software does some serious interpolating.
And not all printing software is equal, either. The algorithm makes all the difference. Its why you can get a so-so large image out of photoshop's print facilities (that uses bicubic) and a noticably better one from QImage (at the moment, pyramid)
LOL (Score:2)
True resolution of inkjet printers is much lower (Score:5, Informative)
Not true, because inkjet "resolutions" are really dot densities and not resolution (resolution would be how many distinct dots can you print per inch.) That's why laser printers with nominally "lower resolution" output crisper text. Also the dot density is for a single colour - complex hues such as skin tones have to be simulated by digital halftoning (essentially multiple dots forming larger colour pixels) techniques which reduce the effective resolution several fold depending on the colour being simulated and the accuracy desired. That's why continous tone printers such as dye subs with nominally "lower resolution" can give much sharper colour prints.
Software would have a major effect on the quality of colour prints from inkjets but that would mostly be from how the halftoning was done rather than the interpolation per se...
It's a bird, it's a plane... (Score:5, Informative)
There's actually a whole host of algorithms that go well beyond the junk they throw at us for "digital zoom". The two most applicable algorithms for this particular problem -- increasing the resolution of video above and beyond the source data available in a particular frame -- are temporal integration (collecting data across multiple frames) and superresolution by example (automatically associating and recalling high resolution imagery when a low resolution equivalent is shown). Some example code:
Temporal Integration: ALE [dyndns.org]
Superresolution by Example: Image Analogies [nyu.edu] -- not automated, but remains one of the cooler pieces of code ever shown at SIGGRAPH.
From the article, I'm guessing it's another ALE style stacker. They probably needed to write one for their cameras anyway.
--Dan
Re:It's a bird, it's a plane... (Score:2)
With regards to your first description, you are describing a temporal mechanism informally referred to as "drizzling". This method was pioneered by NASA for astronomical imagery. While this is one way to merge several images, it's by no means the only way. Among other things, it does require a rather cooperative camera operator -- not TV. Many webcams will stack photos and average them in an attempt to eliminate high frequency noise, which quite arguably reduces true resolution below the simple
Re:It's a bird, it's a plane... (Score:2)
Why did it take so long . . . (Score:2, Funny)
JM
True? (Score:2, Insightful)
Sure... just what Comcast needs... (Score:2)
Who needs this stuff? I have these features on a couple DVD players, and I've never used it. Pause, stop, fast forward. That's it. Tell Sony to put a fast forward (through commercials), and then I'll be interested.
Not a true zoom. (Score:2)
Totally missing the point! (Score:3, Insightful)
Useful for transition to HDTV (Score:4, Insightful)
Isn't this the sort of thing... (Score:2)
"Zoom" to a High Def resolution (Score:2)
Guns? (Score:2)
Fractal compression could do this (Score:3, Interesting)
Another demo I saw on the British show "Tomorrow's World" showed how you could zoom in on a photo that had a fence and the fractal image showed the fence details that were again not visible in the original.
There was of course talk of using this sort of tech to do video upsampling for projection. Given the performance I saw I see no reason why a standard DVD couldn't have been cranked up to twice the resolution and look substantially clearer. Of course, the downside of fractal compression was that it took huge (at the time) amounts of computing power to compress, and bugger all the uncompress. These days I expect it is trivial.
Fractal expansion (Score:3, Insightful)
"digitally enhancing the signal" (Score:4, Insightful)
However they label thier zooming, if they are introducing information into the image then you have a false image.
However, like the DivX 'warmth' plugin, randomised information can give us perceptual detail that is interpretted by our visual system to 'look right'
Otherwise all are doing is zooming with subpixel antialiasing.
In this day and age I think the signal is digital, so how is any modification of the original signal enhancing?
Now enhancing is a very broad word, but to me this article is a marketting trip to consumer land, nothing new here, move along.
Poor article text (Score:4, Interesting)
No, they've developed a new version of a chip.
They don't even know when they'll start developing "TVs that zoom in for true close-ups".
Unlike the current TVs that simply scale the image, Sony's technology does 'true' zooming by digitally enhancing the signal to communicate gloss, depth and texture.
Using which definition of "true"?
Only a few possible solutions. (Score:2)
1/ original video signal is sent using FIF (Fractal Image Format) compression, high qaulity zoom possible, by definition much of the original signal is dropped during "normal" playback.
2/ original video signal is sent using much higher resolution, high quality zoom for a couple of steps possible, by definition much of the original signal is dropped during normal playback
3/ original video signal is send using display resolution, iterpolation of several frames used to generate extra data, modest zoom possib
You can't create information out of nothing. (Score:3, Interesting)
What will happen when you know that a friend of yours is sitting in the stadium at a football game that you're watching at home and you zoom in on a couple of pinkish pixels that represent the place where you know he is sitting? Whose face will it display when you zoom in? A generic anime-like face? Your friend's face? What?
When it guesses wrong, the mistakes it makes will be dillies.
The article said it showed that a dark spot in the river was a hippopotamus. How did it know? Did it have a database that said "this film takes place in a locale where dark spots in the river are probably hippopotami?" Or when you zoom in on dark spots in other bodies of water, will it deduce and render a hippopotamus, too? Hippopotami in the Okeefenokee swamp? In the Hudson river? In Walden Pond?
As with colorized films, the effect will be exciting for about a week. Then your brain will catch on that it is being cheated, and the zoomed in images will look clear and sharp yet, subtlely, unsatisfying, because it is showing only what the brain already knows is there... or fake, stereotyped detail that will look phony once you catch on to its characteristic "look." Finally, the only fun in the system will be deliberately zooming in on things you know it will make mistakes on to see the comic effect.
Not static photo enhancement (Score:2)
They may also be able to associate a now low resolution spot in the current frame with the large high resolution image x number of frames ago.
Zoom Zoom (Score:2)
Cool tech and all that, but I found the picture on the link to be especially amusing.
Maybe it's just me, hmm.
Will Hollywood sue?! (Score:2)
http://www.usatoday.com/life/movies/news/2004-0
I can easily imagine a director complaining that allowing the user to zoom a movie would change his picture and ruin the film.
Aww, man! (Score:2)
Re:obligatory joke (Score:2, Funny)