Caching Torrent files in DNS 283
bodin writes "This is a proof of concept version of BitTorrent where the torrent files are transported over DNS. This will of course bog down BIND servers all over the planet. Everyone should be thankful that the files are not sent over DNS."
Great (Score:4, Funny)
Re:Great (Score:2, Funny)
That's not a problem, as real geeks remeber all the IPs they need.
A Friendlier Approach (Score:3, Interesting)
1. An ugly, ugly hack, and a wrong tool for the job (tm)
2. Wrong using others' resources in a way that is not intended (serving binary data)
My goal of using the DNS is however the same: solve
Speling? (Score:4, Funny)
And he's coded what is obviously the *worst idea ever!*
Do you want to shoot him or shall I?
Re:Speling? (Score:4, Insightful)
I don't think it's such a bad idea. (Score:5, Interesting)
Unless
I'm not sure that there's much point in using DNS to propagate
Given the kind of load that nameservers happily handle today when you hit a webpage with a number of entries (especially for those annoying little "badges") (and the nameserver potentially gets twenty or more lookup requests all at once), there can't be a huge processing hit.
There *might* be a storage hit...but suppose there are 10,000 torrent files out there, and each is 1K. That's just 10MB of data, and I doubt anyone is interested in storing all available torrents.
Finally, I suppose that bandwidth might be an issue, but I suspect that given the frequency of DNS lookups and the infrequency of someone needing a new
I have done plenty of fun things with DNS and run a small DNS server, but I will freely admit that I am not a DNS wizard, and leave it to the folks on NANOG to debate the merits of this.
For my money, though, this is cute and not harmful at all, though it might not be particularly useful.
Verisign Employee? (Score:4, Funny)
Does he work for Verisign?
Re:Speling? (Score:2, Troll)
Bloody hell the overly violent geek reaction is so very two years ago, it makes me want to rape you with a porcupine.
Not really that funny now is it?
BT Itself? (Score:4, Interesting)
Re:BT Itself? (Score:3, Interesting)
BT works by connecting to a tracker, which tells it about other hosts downloading the same file. Without a .torrent file, BT doesn't know what file to get or how to contact the tracker. You could distribute .torrent files over BT, but you'd need another .torrent to tell BT where to go to get the first .torrent. It'd only really be practical if you put together a massive collection
Re:BT Itself? (Score:2)
Still,
-1, Wrong (Score:5, Informative)
Re:-1, Wrong (Score:2)
but it is possible for the tracker to actively choose who it introduces to who and keep track of how much stuff somebody has transmitted, no?
well somebody should do a tracker like that if there weren't already a tracker like that out there(i know for sure that there is one that counts the 'quota' so to speak).
"It would be bad..." (Score:4, Insightful)
Seriously. I don't pretend to understand 100% of the technology involved, but it seems pretty clear even to me that:
Re:"It would be bad..." (Score:3, Interesting)
Re:"It would be bad..." (Score:5, Informative)
We have the technology! (Score:5, Interesting)
With SRV records, you say service.domain = port at host. You could do a dig for ldap.slashdot.org and findout that the ldap server is on port 389 at directory.slashdot.org.
This is a slight extension of this. I don't know the exact implementation, but you could have a zone file that looks like:
'file being served'.bt.slashdot.org SRV 0 0 PORT 'seed host'
You can have multiple SRV's per resource and load balance between them.
DNS is currently used for stuff like this all over the place. We already have the technology. IXFR means we can transfer just the changes in the zones when there are updates.
Last time I checked, DNS is not over loaded and will scale to handle this. Even it 50% of the internet uses BT over DNS, 100% of the internet uses DNS for email, web and so forth. Every time an email is delivered, there are at least 6-10 DNS queries.
DNS will not be bogged down.
Re:We have the technology! (Score:5, Insightful)
While I am not really to hot about tracking through BIND I do think that the two protocols can learn from each other. What makes DNS so great is that it is a distributed system which balances the load more or less evenly among connected nodes but the system is useless in dealing with dynamic IP, NAT, intermittent connections, etc. that effect most work stations at the fringe of the Internet. This is were P2P technologies like bittorent are starting to excel. Taken together these technologies could create a new hybridized standard that will once again allow workstations to be a presence on the Internet by creating a new Universal Resource Locator (URL) that will transend the barriors of DHCP, NAT, etc. and reinforce the advantage of distributed hierchies to peer to peer.
Re:We have the technology! (Score:3, Insightful)
He's right about DNS only distributing the very small torrent file and not the actual data the torrent points to, and since DNS is a hierarchy of caching servers the load ain't going to be very bad either, it should scale nicely so that any high-demand torrent will quickly end up cached at the users' local DNS servers.
Plus, the idea of applying lessons learned from the caching hierarchy of DNS and the dynamic join/leave handling of trackers and other p2p to come up with a better mousetrap fo
Re:We have the technology! (Score:2)
Re:We have the technology! (Score:3, Informative)
Re:"It would be bad..." (Score:3, Insightful)
Yeah, and HTTP servers are for serving HyperText only :)
Re:"It would be bad..." (Score:2)
>serving DNS information.
A TXT record with a name, associated with a given origin, *IS* a DNS record. Whether it fits your own narrowly defined idea of what constitutes a DNS record is not relevant. If your ISP does not propagate or cache TXT records, that's another matter entirely. But to say these are not DNS records is an example of the same sort of reasoning that leads people to believe "the Web" is "the Internet."
Re:Oppositely - it is an excelent idea! (Score:2)
Second, criteria is often used as a sigular form when it means compound criteria, or a logical expression with other criterions.
Either way, it's usually aceptable to say an exit criteria, as well as just exit criteria.
Re:Oppositely - it is an excelent idea! (Score:2)
Don't mess with DNS (Score:5, Funny)
Prime Directives
1. Get DSL/Cable Modem
2. Install Linux/BSD/OpenSource OS.
3. Do not mess with DNS
Re:Don't mess with DNS (Score:3)
Re:Don't mess with DNS (Score:2)
Microsoft's way ahead of ya. Although, they still won't tell anybody what directive 4 is.
This was bound to happen (Score:5, Interesting)
The load on large DNS servers can grow quickly. I wouldn't be surprised if we see a set of patches coming out for DNS servers to combat this. the question is can we find a TTL that reduces the abuse and still makes it useful.
Re:This was bound to happen (Score:2)
It's just another irresponsibility specifically designed to slink through a firewall, and subvert security. It's just like Microsoft SOAP that's nothing more than RPC via port 80, and also designed to evade firewalls. And yeah, Microsoft talk alot about security using SOAP while never actually adressing the issues.
What is unique is that they
Re:This was bound to happen (Score:3, Interesting)
Re:This was bound to happen (Score:2)
That's a fairly silly statement, given that the existing method for downloading tracker files is HTTP. I think HTTP is right up there with DNS in terms of ease of getting through firewalls. And, you know, if I was really desparate, I could just get someone to email me the tracker file, or I
Re:This was bound to happen (Score:4, Insightful)
It's amazing to me how well designed the DNS infrastructure is. Just the right balance of decentralization and authority. Unlike P2P systems it relies on root servers to provide an authoritive content but it also provides a completely decentrized administration infrastructure.
I am shocked that DNS or the ideas behind it have not been used for all kinds of things.
Re:This was bound to happen (Score:3, Insightful)
Re:This was bound to happen (Score:2, Informative)
Re:This was bound to happen (Score:2)
Re:This was bound to happen (Score:3, Informative)
If by "TIER I DNS server" you mean root name server, then the answer is that it would have little effect. The records are stored under names like 0_197_56633ab0d90f43c68ed1b47358eccfe7.domain.com . All the root and
And as for your
Re:This was bound to happen (Score:2)
cool hack.. (Score:2)
Re:cool hack.. (Score:2)
Ouch! (Score:2, Insightful)
Re:Ouch! (Score:2)
Duh! Because it makes it easier to spread information and harder for RIAA to stop them.
Re:Ouch! (Score:2)
Re:Ouch! (Score:2)
Re:Ouch! (Score:3, Informative)
Re:Ouch! (Score:3, Interesting)
The basic issue here is twofold. First, how can we get load-sharing for all aspects of BT? And second, how can we do that while keeping BT a "lightweight" program (i.e. one that doesn't require special server programs)? DNS may not be
What can we do next? (Score:5, Funny)
Freenet over DHCP;
Gnutella over BOOTP;
And last, but not least, KaZaa over WINS!!! :)
Re:What can we do next? (Score:3, Funny)
Re:What can we do next? (Score:3, Funny)
You owe me a keyboard and a couple of meals you lousy bastard - I just barfed at the very thought of your despicable suggestion!
Shame on you!
Re:What can we do next? (Score:2)
Re:What can we do next? (Score:2)
1. Create broadcast address for entire internet. (0.0.0.0 maybe?)
2. Entire files sent via above address, UDP, with said address as source.
3. Impossible to trace, because the internet has crashed.
4. Return to sneakernet!
Crap, I better patent this!
Re:What can we do next? (Score:2)
RTFA before flaming the concept! (Score:5, Insightful)
The Torrent files are indexes that tell your BitTorrent program where and how to get its data.
This sounds very useful, since what was missing from the BitTorrent network was a way of distributing cached Torrent files, and this is exactly what DNS provides.
Remains to be seen whether it actually works, but it's a neat concept.
Not THAT small. (Score:2, Insightful)
Re:Not THAT small. (Score:2)
> meant to handle a few BYTES is likely to cause all sorts of problems
The DNS spec states that the TXT record string can be up to 255 bytes.
255 > few, and the spec in RFC is what it was meant to handle.
Re:Not THAT small. (Score:3, Informative)
Er. (Score:2)
Re:Not THAT small. (Score:2)
Let's just use metatorrents then: .torrent, distributed via DNS TXT records, which points to the real .torrent (which could be over a megabyte - ever seen a DVD ISO's torrent?), which is served by bittorrent itself, with its bandwidth efficiency!
A tiny
I've actually seen this happen on bittorrent sites - and it would work perfectly in this situation. Maybe a "metatorrent" format for lower overhead could be designed, specifically targeted
Re:Not THAT small. (Score:5, Informative)
Plus, I don't see how this is going to put the huge strain on the DNS infrastructure that is implied, apart from the server hosting the torrent's TXT record anyway. Assuming no cached DNS information, I need to perform exactly the same number of DNS queries to resolve foo.domain.com to get a TXT record as I do get pull a tracker file from it. Judging by some of the posts here already some seem to think that the root DNS servers are going to have to handle terabytes of movies files or something, and that just isn't that case.
Re:Not THAT small. (Score:5, Informative)
For a typical name query, only two UDP segments are involved, one for the request and one for the response. If you were to request a torrent file, you would need the first three TCP handshaking segments, one to send the request, and then 1 or 2( depending on the machine setup) to send back the torrent file.
Normal DNS query: 2 segments
Torrent file DNS query: 5 or 6 segments
So that takes 2.5-3 times more processing time per request on the DNS server, and that doesnt even take into account the TCP session state.
Re:Metatorrents (Score:2)
The multitracker spec [rr.com] has already been implemented in many of the better bittorrent clients [degreez.net].
--
Re:RTFA before flaming the concept! (Score:2)
The key to understanding is that the DNS information that is supplied by the tracker (the torrent server) will be cached all around the world thus eliminating the endless amount of tracker server overload that we all see.
For the previous hundred flamers: the actual file is not
Re:RTFA before flaming the concept! (Score:2)
This will not solve the problem of a tracker going off line, getting DDoS'd, or simply being too busy.
As far as I understand, this is just to distribute the
I've got a great Idea (Score:5, Funny)
That way, a system we already have in place that seems to work ok can be scrapped, and we can bog down commuters only BLOCKS from their homes!!!!
THEN, I can get my article on Slashdot.
Re:I've got a great Idea (Score:2)
Ah, I see you live in New York too.
.torrent files are too big... (Score:2)
Standing up for fun/useless hacks! (Score:5, Interesting)
What's the Problem? (Score:5, Funny)
Re:What's the Problem? (Score:2)
Yes, first we'll use the DNS servers to get the torrent file, and then we'll use BitTorrent to get DNS information!
Re:What's the Problem? (Score:2)
Missing the point are we? (Score:5, Interesting)
But how bad is that really? How large is a
$large_isp has several users who wants to download $linux_dist. The first user gets the TXT record and is off downloading. And the rest of em uses the cached record (if it is cached) in either case $linux_dist's webserver dosn't suffer as hard and they can always add more slave dnses to handle the load. Perhaps users even starts slave servers for that zone to help the dist.
(Is there really a rule that says "you have to cache and store TXT for $TTL time".)
And whats this with spelling? I mean you totally miss the point and... complain about spelling? is that the end of the world? =)
Won't help the real bottleneck (Score:3, Informative)
I've thought about this... (Score:3, Interesting)
In the end, I decided that it would be more trouble than it's worth; but if someone else has written code I can borrow (I haven't looked in detail) then I might reconsider this.
Google cache? (Score:3, Interesting)
Often, slashdotted articles are still available thru Google. That might work.
It's BIND not DNS (Score:4, Insightful)
No, that's BIND. And a BIND zonefile is just that: a BIND zonefile. All this is about BIND, not DNS. It does not work "over" or "with" or "through" DNS.
It's not clever either. More like abusing other people's resources.
Re:It's BIND not DNS (Score:5, Insightful)
This doesn't only apply to BIND, it applies to any nameserver used for cachingpurposes. Be it djbdns, MS-dns, etc.
I can't see why people disrespect the author, it's a proof-of-concept; ie. it can be done. Nobody says it should be done at all...
(and it seems to me like half of the posters here either didnt RTFA or has misunderstood major parts of the article)
torrent files search application (Score:5, Informative)
I discovered this the other day,
http://www.torrentsearch.org/
basically its a p2p program that downloads the whole database of
You can then search for torrents through the gui. You can then download the
nick
Re:torrent files search application (Score:2)
Is that EULA for real?! "Please Jack My Computer" (Score:5, Informative)
By accepting this agreement, I certify the following:
4) I understand that by accepting these terms and conditions, this program will be installed on my computer and my web browser home and search page will be changed in order to allow me access.
5) I also acknowledge that a Desktop toolbar will be installed on this system as a stand-alone module and that the Desktop toolbar will update itself from time to time in accordance with the EULA Privacy Policy.
6) I further understand that an accessory tool bar will be added to my web browser which will remain visible as long as the software is installed and agree that I wish to use your search engine for my
web browsers auto search option and default error age.
7) To insure you always have the latest version and for your convenience this software will automatically update itself from time to
time once installed in accordance with this EULA and Privacy Policy.
8) If you decide to change your homepage or search page at a later date this information ?the url? will be sent back to our servers and a pass-through toolbar will be installed at the bottom of your web
browser. This toolbar will remain active as long as this software is installed on your system.
9) I understand that, by accepting these terms and conditions, bookmarks will be added to my system, which may be removed manually or via un-installation of the software.
10) In order for us to keep this software free, from time to time promotional offers from our sponsors will be displayed to you.
11) To prevent your browser from becoming cluttered when our toolbar is installed, any other toolbars you currently have visible will
be deactivated. They can be restored manually through the IE view menu.
12) In order for this software to function properly, If incorrect host-file entries are detected for this software's related domain
names, those entries will be removed.
13) If you wish to uninstall this software you may do so at any time by going to your start menu, Control Panel, Add / Remove Programs, and then selecting this application. Additionally a separate uninstaller may be downloaded from the website the Sponsor Software installs
in your web browser, or you mail email support@lop.com for further assistance.
14) Bookmarking to a page on this server/site whereby this warning page is by-passed shall constitute an implicit acceptance of the
foregoing terms herein set forth.
And it does go on.
Host Files (Score:4, Funny)
You should have listened to me and stuck with Host files
This is exactly what BIND was intended for (Score:2, Insightful)
Only the torrent files are being distributed (Score:3, Informative)
Proxy cache? (Score:2)
This should be patented! (Score:2)
I love the US patent system.
Re:Isn't this very easy to combat? (Score:4, Interesting)
Why would anyone want to "combat" it?
Also, if you'd bothered to read the article (all one page of it) you'd have seen:
Sounds pretty much like putting it into the required format, doesn't it?
Re:Isn't this very easy to combat? (Score:2)
And admins would want to combat it to prevent "DNSservers will use a loooot of memory" and "bog down BIND servers all over the planet" as the article says.
Re:Isn't this very easy to combat? (Score:2)
Why would anyone not?
Re:Isn't this very easy to combat? (Score:2)
Why would anyone want to "combat" it?
Remember, the RIAA/MPAA have lumped BitTorrent in with KaZaa and other P2P music services in its "war on piracy". Various people have counter-argued (correctly) that unlike those other services, BitTorrent is really just a protocol (like FTP, only peer-to-peer). The lack of any kind of built-in search functionality in BitTorrent
Re:Isn't this very easy to combat? (Score:2)
Re:Idiot (Score:5, Insightful)
If you read the article and know anything about DNS, you can see that he is splitting the file into 126 byte segments and storing the parts in TXT records of individual hosts. The host naming scheme is quite clever, I might add.
The goal is to offload the duty of serving up the files from the download servers to an existing distributed network. He even mentions that the DNS servers caching these records would consume massive amounts of memory, and then (like a spammer) blows it off as "its [memory] not that expensive today anyway."
If this is actually implemented on a wide scale, DNS administrators will simply stop caching TXT records, putting the load right back on the original download server where it belongs. Or worse, they may stop caching records altogether, which could only lead us all down the path of chaos, death and destruction.
I agree that it's clever, but like a deadly virus, not something that should leave the lab on a large scale.
Re:Idiot (Score:4, Insightful)
Re:Idiot (Score:2)
Yeah, your average .torrent file is about 15K (according to my OLDTORRENTS dir), so that's a lot of segments, a lot of bandwidth, and a lot more memory required to cache thousands [scarywater.net] upon thousands [suprnova.org] of torrents.
DNS administrators will simply stop caching TXT records
It's more likely they'd patch their DNS servers to filter out only the suspect non-text TXT records, which means the torrents would have their SHA1 hashes dropped and would be useless.
d8:announce36:htt
Re:Idiot (Score:2)
Why would administrators care? The same data is going to come down over either HTTP or DNS. There's nothing inherently more expensive about passing it through bind rather than squid. The point of ISPs is, after all, to provide internet service.
a lot more memory required to cache thousands upon thousands of torrents.
You only need to cache them if your users are actively downloading thousands upon thous
Re:Idiot (Score:5, Informative)
Re:Uhh (Score:3, Insightful)
Re:Uhh (Score:3, Informative)
Things just went from bad to worse (Score:3, Insightful)
I guess one could sarcastically say thanks for the proof of concept, real good job. But then again, its better they did it and let everyone know it could be done, rather than having to find out about it 'in the wild'. I just hope its easy to prevent.
Re:Funny thought (Score:2)
Re:oh well (Score:2)
Re:haha yeah its a laugh (Score:2)
Lighten up, man.
"I've come up with a worst case scenario, mod me up!"