New Method To Detect and Prove GPL Violations

qwerty writes "A paper to be presented at the upcoming academic conference Automated Software Engineering describes a new method to detect code theft and could be used to detect GPL violations in particular. While the co-called birthmarking method is demonstrated for Java, it is general enough to work for other languages as well. The API Benchmark observes the interaction between an application and (dynamic) libraries that are part of the runtime system. This captures the observable behavior of the program and cannot be easily foiled using code obfuscation techniques, as shown in the paper (PDF). Once such a birthmark is captured, it can be searched for in other programs. By capturing the birthmarks from popular open-source frameworks, GPL-violating applications could be identified."

new use of old trick

[toolslive]

I used to be a research assistent, and at university, we used this technique to see if students copied their assignments. They could rename variables, move pieces of text, change comments all the way they liked, but the execution profile stayed the same. We caught a lot of students, and they never figured out how we did it.

Re:new use of old trick

[mark-t]

How did you know they were cheating and didn't derive their similar approaches from a common origin (presumably material that was presented in class or else from the textbook)? My experience with marking for a computer science professor showed that about 80% of the students approached any given programming assignment almost exactly the same way in terms of their final implementation... their common origin being something the teacher described during a lecture.

Re:new use of old trick

[Just Some Guy]

How did you know they were cheating and didn't derive their similar approaches from a common origin (presumably material that was presented in class or else from the textbook)?

Amen to that. This is an old story, but I think it bears repeating. A friend of mine and I got "caught" turning in identical code for an assignment. I mean, identical. Same structures, variables, types, layout - everything. However, we wrote our programs separately and never saw each others' until our teacher asked about it.

It sounds improbable, but consider that:

1. We both directly transcribed variable names from the homework assignment. A sentence like "it is a fatal error condition for the user to specify a negative number of tasks" became "assert(numtasks >= 0);".
2. We used the same editor and the same indenting style.
3. We had done much of our homework together in previous classes because we tended to take the same approach to solving problems.
4. The assignment wasn't terribly complex to begin with, so the resulting code was only a few pages long.

We had a teacher who trusted us and we were both good students with good test grades, so it was dismissed as a humorous coincidence. I'm glad a human was willing to listen to our explanation and not just go along with the findings of an automated tester.

Re:new use of old trick

[Just Some Guy]

I take it your code was flawless?

Of course! ;-)

people who write flawless code can easily prove their innocence by answering a couple of questions about the implementation on the spot.

I think there was a bit of that, too: (pointing at me) "why did you do this?" "Because of this requirement in the last paragraph." (Pointing at friend) "and why didn't you use this approach?" "That wouldn 't have worked because of this part here."

Re:

[fmobus]

In my university, this is the method most teachers will use when they suspect something. Ask each student something about the implementation, how it should be changed to achieve something slightly different. In some cases, when they allow you to form groups to solve the assignment, they will ask each student in the group about the implementation.

Sounds to me the best way to catch copiers and leechers.

Re:

[anothy]

just to demonstrate that this sort of overlap isn't just CS undergrads doing homework assignments, take a look at Ken Thompson's Turing award lecture [bell-labs.com], particularly this section:

In the ten years that [Dennis Ritchie and I] have worked together, I can recall only one case of miscoordination of work. On that occasion, I discovered that we both had written the same 20-line assembly language program. I compared the sources and was astounded to find that they matched character-for-character.

that would clearly fai

Re:

[Azarael]

Or you could just use MOSS http://theory.stanford.edu/~aiken/moss/ [stanford.edu] (or other) like everyone else.

Re:

[SnowZero]

How do you know he was an teaching assistant after 1998? AFAICT Moss wasn't available before then, and didn't seem to become popular until the 2003 paper, and we certainly didn't know about it when I was a TA on the east coast in early 1999. Not that it would have mattered for us, but it's also not compatible with the GPL (non-commercial use only), so you couldn't link it in as part of the rest of your submission system if it used anything GPL, unless you were careful.

So, there are some quite normal reaso

Re:

[Azarael]

If it wasn't available then, that is certainly reasonable.
As far as the GPL goes, I'm pretty sure that's irrelevant as as far as I know, MOSS is a free service available for educational use.

Re:

[SnowZero]

Well, for the class I TA'ed, it was probably available, just not widely popular yet. Of course, cheaters are usually easy to catch, so even simple systems work pretty well. So, in their attempt to save time and effort, cheaters are often are bad at covering up their tracks. Anything that yields possible hits can be verified by human inspection. Why are almost all cheaters so lazy? Because if they weren't, they'd just do the assignment.

Cheaters in my classes tended to: (1) not correct misspellings or bu

Re:

[Azarael]

Exactly true, and in most cases the effort needed to cover you tracks well is equivalent to doing the assignment anyway.. thus the laziness factor.

Re:

[kasperd]

Whether that approach gives false positives depends on the size and complexity of the piece of code they had to write. As a teaching assistent I have seen assignments that looked even more like copying than what you described, but even in that case they were eventually accepted. One time the students had to add some functionality to an assembler. All groups were given the same code to start with and just had to add one clearly defined piece of functionality. There is really not many ways to do that, so havi

Re:

[Anonymous Coward]

A couple years ago, a manager outsourced some programming work to India. When I reviewed their work, I was impressed, but the code was inconsistent (quality, indent style, variable names, etc). I figured maybe parts were written by a new programmer. A couple days later, I accidentally discovered that a lot of the code (the part that impressed me) had been copied from a GPL program. I alerted my manager, but he didn't care. I alerted the outsource company, they didn't care. I alerted our legal departm

Re:

[SnowZero]

You sound like someone who got caught. Bitter?

Re:

[SnowZero]

Not really... That argument assumes that all classes teach the same subject: compromising verification systems and covering your tracks. Most classes in CS teach something else, with some examples being computer graphics, machine vision, and game programming. So, how has a computer vision professor failed to teach a student properly, if the student cheats and is caught in his class? At best, that's a computer security problem, which is normally an advanced enough class that cheaters don't make it that f

No, really

[Plunky]

lets just set the code free. lets not chase it down the street to make sure it stays free, just let it go as it will.

Re:

[Reziac]

That was akin to my first thought: If opensource code is really so superior to closed source code, and if the world would be better off if all apps had been built from those codebases, then shouldn't we *encourage* it to be "pirated", for everyone's net benefit??

Re:

[Anonymous Coward]

You can use the BSD license for your code if you unconditionally believe that "more copies of good code = better world". Heck, in many countries you can put code directly in the public domain. For those who think that authors of good (open) code need to be able to get an advantage in return for their generosity, so that they can keep being generous and produce more good code, there's the GPL, and that needs some level of enforcement.

Re:

[Ian Alexander]

That was akin to my first thought: If opensource code is really so superior to closed source code, and if the world would be better off if all apps had been built from those codebases, then shouldn't we *encourage* it to be "pirated", for everyone's net benefit??

One of the strengths of open source is that improvements are shared. If one company just makes some improvements to an open source project and then redistributes it in a way that violates the terms of the license designed to keep it open, that onl

Re:No, really

[TheRaven64]

For Open Source code, you are right. The Open Source movement believes in the superiority of the 'bazaar' development mode. If you try to create a closed fork then you are going to fall behind the open version, and have to spend a lot of time and effort merging changes from the main tree.

The Free Software movement, however, believes that code which protects the user's freedoms to use, modify and distribute it is intrinsically superior, and that people who wish to write code that does not respect these freedoms should not be aided by being able to use the work of those who do.

As such, an Open Source advocate would not mind, because the closed copy would quickly become inferior. A Free Software advocate would object, because their work would be being used for (in their view) unethical purposes (denying end users their freedoms).

Re:

[Nazlfrag]

If someone wants to invest time and effort into a closed fork, good on them. Everyone else still has access to the original branch, and the creator of the fork isn't messing with any of those rights. I don't see any imbalance, the authors are not falling victim to anything as their original works are intact. The closed branch people are worse off - they aren't benefiting from the open model anymore. It's their loss, their mistake to make if they want to. The inherit superiority of open source makes GPL rest

BSD network code

[Peaker]

Microsoft basically took the BSD network code into Windows.

You claim this has not harmed BSD in any way, because they still have that code.

But this ignores the fact that if Microsoft had to develop their own network code instead of using BSD's code, they would have had less of an advantage in the OS market. This would almost certainly mean more BSD users (perhaps by a slight margin, but there are probably many more pieces of BSD'ish code in Windows), and less Windows users. More BSD users would bring more d

Re:

[mwvdlee]

I have released code under BSD license (as well as GPL, ZLib/LibPNG/, Boost, public domain and proprietary, and probably a few others).

The LEAST of my concern in releasing ANY open source is some childish popularity contest.

The only valid reason for me has always been the hope of getting something in return. In the case of BSD, this return is usually "applications that work better". Without the BSD TCP-stack, Windows would probably be worse quality, how would that have benefitted anybody except the anti-Mic

Re:No, really

[The Bungi]

That won't do. The GPL is really more of a social instrument than a software license, so for people like Stallman a BSD-style license (which is just one step above public domain and true freedom) would be unacceptable. A lot of bandwidth and keyboard lubricant has been spent over the years to ensure that everyone thinks the GPL is the "best" software license - and the thousands of developers that buy into the FSF "freedom, with caveats" spiel by using the GPL (because well, that's what everyone uses) without really understanding what it's for are part of that problem.

As you can imagine I really don't like the GPL or the FSF or Richard Stallman or any of his friends too much. While I recognize their contributions I think that they've fallen into the trap of trying to force everyone to convert to what has become a quasi-religion where the Inquisition is more important than celebrating mass.

Re:

[Anonymous Coward]

keyboard lubricant

I've never heard it called that before.

Re:

[jez9999]

Making the code freer than the GPL lets eg. Microsoft's embrace, extend, extinguish a whole lot easier. Now they just have to copy/paste and slightly modify the code, compile it, and pass it off as theirs. Some of us don't like that.

Re:

[The Bungi]

I consider BSD to be a superior server environment to Linux, and so far it's doing quite well.

Re:

[be-fan]

MS has 70,000 employees, most of which are mediocre. In fact, that's almost the essence of their development model --- throw thousands of crappy developers at a problem and excrete a solution that is just workable enough to make some money.

Re:No, really

[Daishiman]

You know, I'm absolutely tired of the BSD trolls that claim that the BSD license is "freer", not because I have a beef with the BSD, simply because your definition of "freedom" is ludicrous.

There are no absolute freedoms. Freedom to infringe on other's rights or freedoms gives more freedom to yourself, but limits it to other members of society. So long as there are things that cannot be owned or achieved communaly without side effects to others, freedoms have a limit, that is the actions that you cannot do so that others can do them.

The GPL definition of freedom is that a sofware and derivatives must always, under all conditions, be free. Yes, it a restriction to the developer who would wish to close up his source and use a GPLed piece of code, but it is an additional freedom to all the users who now have access to this source, which would have otherwise been denied.

Analogy time: the King is free to treat his peasants as dogs if he wished and if he has sufficient power to repress any opinions the peasants would have about that. The peasants, however, are limited by the freedoms the king has. Therefore the balance of freedoms for a more equal society would be that the king's freedoms be limited in order to allow the peasants to live their life.

So as you said, the GPL is also a social instrument, but it is no less free than the BSD; it simply distributes freedoms in a different matter. If you have a problem with that, use whichever license you wish to use. But don't go around accusing the GPL is limiting freedoms when it gives others freedoms that the BSD could never guarantee.

Re:No, really

[The Bungi]

You know, I'm absolutely tired of the BSD trolls

If by that you mean "you have a different definition of what freedom is, therefore I don't like you" then sure, I'm a "BSD troll" or whatever.

your definition of "freedom" is ludicrous.

GPL -> Distribution restrictions.
BSD -> No restrictions.
No restrictions -> More freedom.
More freedom -> Possible unsavory side effects that people choose to live with

Isn't logic great?

The GPL definition of freedom is that a sofware and derivatives must always, under all conditions, be free.

BSD has a similar one, except that it doesn't place restrictions on how that happens. No one can make BSD-licensed software "non free", it will always be available to everyone. The only difference is that it might not benefit from coerced third party improvements, but that's what you sign up for.

it simply distributes freedoms in a different matter

The Kool-Aid is strong with this one.

But don't go around accusing the GPL is limiting freedoms when it gives others freedoms that the BSD could never guarantee.

BSD licenses guarantee absolutely nothing. Here's the code, do whatever the heck you want with it. The perceived benefits to using the GPL are nice, but please don't insult people's intelligence by claiming they result in more freedom. A restriction to ensure X or Y is still that - a restriction. The distribution restrictions on the GPL are designed to further Stallman's social causes (some of which I actually agree with). If you feel that's fine, then by all means use the GPL. That's your choice.

Re:No, really

[Daishiman]

GPL -> Distribution restrictions. BSD -> No restrictions. No restrictions -> More freedom. More freedom -> Possible unsavory side effects that people choose to live with

GPL -> Code will always be open and derivatives will stay that way
BSD -> Code can be closed off and new improvements to it can remain closed off forever.
Always open code -> More freedom
Sometimes open code -> Permanent loss of freedom with regards to that code.
Indeed, logic is great.

BSD has a similar one, except that it doesn't place restrictions on how that happens. No one can make BSD-licensed software "non free", it will always be available to everyone. The only difference is that it might not benefit from coerced third party improvements, but that's what you sign up for.

I never said that you can't sign up for that if so you wish, but code is always used within contexts, and when used in the context of proprietary software, any improvements on the code will be lost, any bug fixes will be lost, any added functionality will be lost.

Sure, some people will build upon it, but losing the obligation of putting the improvements back into the codebase means that it will eventually stagnate, and that the improvements that could have been used for the good of everyone who contributed can be denied at will. Look at FreeBSD with OS X: Apple got the foundation of their OS for free, and after that they simply closed up the rest at will. Perhaps the Apple folks got to improve their memory management, or add some new DRM techniques. Whatever they've done, the FreeBSD devs will never get to see it.

If they don't mind as users and developers to see their work used to create a proprietary, vendor-locked platform then it's their prerogative; as a used and dev I prefer to make sure that my code is an established base of constant improvement. With the GPL they're empowered and free to do that; with BSD new parties are empowered to do whatever and completely ignore original creators aside from the required attributions.

Notice that I'm not saying the BSD license is more free; it is equally free, but shifting freedom to new developers and vendors to be,IMO, lazy bastards and profiting for nothing, while GPL shifts it to original developers, contributors and users to get reciprocal treatment from others. You're free to think that the former is more important; I belive the latter brings greater benefits to everyone in the long term.

BSD has a similar one, except that it doesn't place restrictions on how that happens. No one can make BSD-licensed software "non free", it will always be available to everyone. The only difference is that it might not benefit from coerced third party improvements, but that's what you sign up for.

No one is coercing anyone here. If you had read and understoof the GPL, and it looks like you haven't, you'd know that the conditions apply only to those who want to redistribute software. If you want to keep your patches to yourself you can do that and it's your right, but if you're going to be using other's code to sell it or gain from it you have to abide by the creator's conditions. Going back to my point about freedom, perhaps as distributor you have less leeway regarding your changes, but your users have just gained the guarantee that they'll always be able to see and change the code. The BSD could not have done that.

BSD licenses guarantee absolutely nothing. Here's the code, do whatever the heck you want with it. The perceived benefits to using the GPL are nice, but please don't insult people's intelligence by claiming they result in more freedom. A restriction to ensure X or Y is still that - a restriction. The distribution restrictions on the GPL are designed to further Stallman's social causes (some of which I actually agree with). If you feel that's fine, then by all means use the GPL. That's your choice.

You hit the nail on the head. Th

Re:

[Raenex]

Access to source code != freedom. It is a convenience.

Copyright denies freedom, and it is debatable whether this is ultimately justified, but you don't hear people claiming that the benefits of copyright enable "freedoms" of copyright holders. Yet that's the same kind of nonsense that the FSF wants everybody else to swallow.

Re:

[Jonner]

I'm pretty sure that most of the people at the FSF would share your skepticism of the value of copyright. The whole point of copyleft is to use the existing legal system to promote the FSF's ideals. If there weren't copyright, the GPL would carry no weight and wouldn't be needed in the first place, a situation that RMS would have undoubtedly preferred.

Re:

[Raenex]

If there weren't copyright, the GPL would carry no weight and wouldn't be needed in the first place, a situation that RMS would have undoubtedly preferred.

You're ignoring the main point of contention here: FSF considers access to source code one of the fundamental "freedoms" and "rights" of users. That aspect can only be enforced with copyright and the GPL. Alternatively, if there was no copyright, the FSF would require a law mandating something like the GPL, which in my view would be decidedly anti-freedom.

I full agree with the FSF that being able to copy, use, and modify is an aspect of freedom. But being entitled to source is not.

Re:

[bky1701]

While they may claim that, I think the source code part is more about functionality. Since we lack the same development abilities as companies like Microsoft, the best way to develop is the open method; it avoids "dead ends" when a project dies, helps find errors and generate fixes to them, allows more people to help than would normally be 'allowed', allows code reuse and gives free software another selling point (you can change it easily to do whatever you want).

It's more about competition than ideals a

Re:

[Peaker]

I full agree with the FSF that being able to copy, use, and modify is an aspect of freedom. But being entitled to source is not.

How can you practice the freedom to modify a program without the source?

Re:

[Raenex]

How can you practice the freedom to modify a program without the source?

Freedom would entail being free to modify whatever you receive. It does not entail being entitled to receiving the source. That would be a matter of convenience, not freedom.

Re:

[fsmunoz]

BSD -> No restrictions.

There are restrictions, using the BSD license in the OSI page [opensource.org]:

# Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.
# Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.

So some people might feel that their liberty is diminuished by having to retain copyright notices and putting disclaimers in their stuff. If absolute "freedom" - actually the ability to use something without any kind of restrition whatsoever - is paramount why doesn't the BSD community (whose contribution to free software is important) put their code in the Public Domain?

The rest of the GPL vs BSD license discussi

Re:

[kaffiene]

You failed to answer any of the points raised by the poster you responded to. His post was well thought out, unlike your reply. How about answer the points raised than making cute quips like "The Kool-Aid is strong with this one".

There are plenty of people who ARE in the GPL camp, philosophically, so attempting to waive them off with glib comments is simply not good enough. If you can't be assed to do anything more than make glib comments, then the "BSD Troll" label is probably appropriate.

Re:

[The One and Only]

And my problem with the GPL trolls is their belief that inanimate software deserves freedom more than developers do. Look, GPL offers a fair bargain: I'll show you mine if you show me yours. BSD fulfills its purpose too: an unconditional donation of code to the world. The real freedom is that we have a choice between the two, and to make our own license if we want to.

Re:

[trifish]

it is no less free than the BSD

GPL certainly is less free than BSD.

Need an example? If I create software under the GPL I cannot take any code under other open source licenses (MPL, BSD, Apache, etc.) and integrate it as part of my GPLed program. Why? Because the GPL requires that all parts of my software are released under the GPL! See?

The other licenses allow me to combine open source code covered by different licenses in one single product. That's why they give us more freedom than the GPL.

Re:

[LordVader717]

Now you're using a different situation as an example.

The point is that there is no universally acknowledged "absolute freedom, guaranteed" and opinions are always subject to bias.
You, for example, have had a run-in with the restrictions of the GPL and so you have an impression of the GPL restricting your freedom.

Then there are other people who have been frustrated about not being able to change some piece of software, because some of the source is available and some isn't. Now they feel burnt. Maybe they ev

Re:

[trifish]

Let's try a different approach, so that everyone understands:

Simply, if we remove from the GPL the requirement that the whole program must be under the GPL, and if we add a new requirement that other licenses covering other parts of the program must require complete source code to be open, will we have more freedom? Yes, we definitely and obviously will.

The "if-you-are-not-with-us-you-are-against-us" attitude reminds me of the communists. The GPL insists that it should be the only license in the world...

Re:

[Daishiman]

Uhh, no. If you were a bit more aware of the subject, you would know that there are "GPL-compatible" licenses, where you can link code between them and the clauses of each license permit so without trouble.

I'm actually quite suprised how little most people know on the subject. If you want a license that frees your code while letting others link proprietary code to it, you have the LGPL, which allows just that, and is IMO the best license for core libraries such as GTK a libc.

Sounds to me like you people s

Re:

[trifish]

Uhh, no. If you were a bit more aware of the subject, you would know that there are "GPL-compatible" licenses

Uh, no. The GPL explicitly requires the entire program to be covered by the GPL. So there is simply no license "compatible with GPL" in this regard (apart perhaps from the LGPL, which I find almost ironical).

where you can link code between them and the clauses of each license permit so without trouble.

Yes, all open source licenses allow you to do that, except the GPL.

I'm actually quite suprised how little most people know on the subject.

You're right, and, no offence, but you are a good example of that.

If you want a license that frees your code while letting others link proprietary code to it, you have the LGPL, which allows just that, and is IMO the best license for core libraries such as GTK a libc.

Sounds to me like you people should take a look at the LGPL. The FSF and Stallman realized that some of the freedoms of the GPL might translate into unreasonable restrictions to others, and that's why they created that license.

Nobody has talked about LGPL. We (including the grand parent poster) have talked about the GPL. So please try to stay on-topic. The topic was GPL vs. BSD.

Re:

[Peaker]

Need an example? If I create software under the GPL I cannot take any code under other open source licenses (MPL, BSD, Apache, etc.) and integrate it as part of my GPLed program. Why? Because the GPL requires that all parts of my software are released under the GPL! See?

Sure you can. The GPL applies to those who don't have the right to distribute the software in the first place. You have the copyright to your own work, so the GPL limitations only apply to whoever you, as the copyright holder, want them to a

Re:

[Kjella]

Oh I think everybody understands it just fine because it's basicly "Modify it any way you want. If you distribute it, source code goes with it". Ok so it's not free as in public domain, but who really has a problem with the GPL? Only those that want to take source code and not distribute source code. Which is fine, I'd love it if someone did my work so I could download it off the Internet too. I just don't see why anyone should bother to listen to them, no matter how many strawmen are being used about "real

Re:

[WNight]

No, you aren't capable. You'd be doing it and releasing it under the BSDL if you could. You can't. Can NOT.

That's why you're pissed. GPL advocates are writing software you can't re-use without re-releasing.

If it wasn't that you wouldn't be bitching about licenses on Slashdot, you'd be using your obviously superior code. So go do it. Your problem is obviously that you can't have everything you want.

FSF and Stallman have endorsed permissive licenses

[tepples]

The GPL is really more of a social instrument than a software license, so for people like Stallman a BSD-style license (which is just one step above public domain and true freedom) would be unacceptable.

Not so fast. The GPL FAQ [gnu.org] states that there exist situations where a permissive license is appropriate, in particular short programs [gnu.org] and web site templates [gnu.org]. Mr. Stallman has also endorsed the use of a permissive license for a library designed as the reference implementation of a Free file format that replaces patented file formats [xiph.org].

Re:

[Schraegstrichpunkt]

libvorbis and libtheora are trivial? Please.

Re:

[DaleGlass]

The GPL vs BSD "freedom" argument is really boring semantics. Whether the GPL is freedom, slavery, communism or whatever else you want to call it is irrelevant to me: It does precisely what I want, which is why I use it.

Re:

[fsmunoz]

The GPL is really more of a social instrument than a software license

I agree with you here.

so for people like Stallman a BSD-style license (which is just one step above public domain and true freedom) would be unacceptable.

Here I disagree: it's not unaceptable at all, only less prefered. It's a free license, but lacks the "social instrument" provisions that you mentioned, but it *is* a free license nonetheless. From the FSF licences page [fsf.org]:

If you are contemplating writing a new license, please contact the FSF by writing to . The proliferation of different free software licenses means increased work for users in understanding the licenses; we may be able to help you find an existing free software license that meets your needs. We try to list the most commonly encountered free software license on this page, but cannot list them all; we'll try our best to answer questions about free software licenses whether or not they are listed here.

Modified BSD license

This is the original BSD license, modified by removal of the advertising clause. It is a simple, permissive non-copyleft free software license, compatible with the GNU GPL.
If you want a simple, permissive non-copyleft free software license, the modified BSD license is a reasonable choice. However, it is risky to recommend use of "the BSD license", because confusion could easily occur and lead to use of the flawed original BSD license. To avoid this risk, you can suggest the X11 license instead. The X11 license and the revised BSD license are more or less equivalent.
This license is sometimes referred to as the 3-clause BSD license.

From the What is Free Software page [gnu.org]:

In the GNU project, we use copyleft to protect these freedoms legally for everyone. But non-copylefted free software also exists. We believe there are important reasons why it is better to use copyleft, but if your program is non-copylefted free software, we can still use it.

... and from

Re:

[Blakey Rat]

What bothers me is that all of this discussion, all these constant debates on Slashdot over which license says what, all of the millions of comments on the GPLv3... that all represents time *not spent writing actual code*.

Re:

[radarsat1]

The GPL is really more of a social instrument than a software license

In what way is any license not a social instrument?

Re:

[be-fan]

If you think Stallman has made this into a religious thing, you really don't have a very good understanding of the history of the GPL.

I'm not going to claim to have a deep insight into Stallman's mind, but based on historical events in the public record, I think it's fair to say that the GPL has an extremely practical intention behind it.

Stallman is a product of the computer industry of the 1980s. This was when "open" in the commercial software industry meant nothing similar to what it does now, and when lo

Re:

[irc.goatse.cx troll]

People that complain about the GPL are almost always parties interested in taking working code from the original author, and using/improving on it, without giving anything back. Why should we care if you want to freeload on someone else's work?

Admittedly they're usually not as vocal, but theres plenty of people who prefer the BSD idea of freedom-- Otherwise there would be no BSD licensed code.

I don't dislike the GPL. but it definitely complicates things. A lot of times when working on something I just want

Re:

[WNight]

Why not use the GPLed code until you're ready to replace it? GPL code is free to use for development so you can just hack stuff together quickly.

Why not write your app as a stand-alone and not contain an FTP server at all. Regardless of what you've heard, shelling out and using another program isn't a derivative work.

If you write complex proprietary software you're reducing the freedom of users who get stuck using it. (Printer drivers, etc). Freedom for the users (other developers) overrides the freedom of

Re:

[Plunky]

There is a major pragmatic purpose to the GPL for the developer. Any new developments by any party are conveyed back to the original author. Thats why people like Linus love to use it.

This is not strictly true. If Boris forks Alices project, he is under no obligation to convey anything back to her. He is required to distribute source to the users of his fork, but that doesn't mean that Alice gets much benefit. The users are not obligated to publish the source, and even if one does, Boris might like a diff

Re:

[jb.hl.com]

What would a Windoze user like you know about freedom? Why should anyone listen to what you have to say about free software licenses?

What would a zealot like you know about "Windoze"? Why should anyone listen to what you have to say about Microsoft/Apple/your "non-free" enemy du jour?

Re:

[Macthorpe]

The Bungi just admitted to never really having used free software.

Where?

Re:

[dedazo]

HAHAHAH! Oh, the pain. Thanks for the link!

Re:

[WNight]

Ah twitter, I see your problem. You've got an AC trying to crawl up your ass. One dumb enough to think we need a link to your user page.

Seriously though AC, there's a difference between never using FOSS and using Windows for years, developing for it despite the crappy APIs, and supporting other users with it. One gives you *no* experience, the other gives you a great deal. Are you fucking daft?

Besides, the ultimate example of free software vs proprietary was Code Red. There were instructions for OSS (to blo

Re:

[marcello_dl]

The code doesn't need freedom. People need freedom. Let the bad guys incorporate GPLed stuff and they are likely to become an issue because they'll enhance it and defend it as it were all their own, against similar enhancements done to the GPLed branch.

Besides, If i were to buy software from a company I'd like to know if it's stuff they designed and know line by line or if they just rebranded things i could obtain for free elsewhere.

I say, if you can expose them, do it.

Re:

[MikeBabcock]

More power to you. I believe that's the MIT or BSD license you're looking for.

This is about GPL violations, which is as much about guaranteeing the future freedom of the code as it is the freedom to tinker with the code in the first place.

If you don't like it, that's fine, use something else.

A couple of things....

[mark-t]

What is the false positive rate for this method? What if two programs just happen to do the same thing and the authors happened to choose similar ways to do it. Would this method conclude that one originated with the other? It's not a copyright violation because neither is a derivative work of the other.

Also, it occurs to me that this method would probably not be as useful as expected for detecting GPL violations. It would think it would only be effective for checking where you have source code available, or at the very least enough symbol table information to make comparisons, which you are not likely to have if somebody is violating the GPL because that implies no source code anyways (and almost certainly no symbol table information for the binary).

Re:

[IamTheRealMike]

More to the point what is the false negative rate? There is tons of really useful code out there that doesn't make any system or library calls at all. It just takes data, processes it in some way, and hands back the results. That description could apply to something like an image decoder library like libpng to a fully blown 3D graphics engine.

Re:A couple of things....

[arth1]

My guess is that it would work much better for java and possibly C++ than more concise languages which don't have tonnes of implicit calls and inheritances. And even with OO languages like java, I'd think that simply adding a try in the middle would change the fingerprint quite a bit.
Also worth considering is what a compiler optimiser might do -- they can be quite good at rearranging code different ways depending on whether optimising for speed or code size, and what the target is. That's probably another reason why this might work better with java, which only has rather rudimentary jit optimiser.

If this tool can help identify some infringing code, that's well and good, but I wouldn't rely on it, wouldn't think it would add much if any legal weight, and neither would I think it could replace a thousand eyes.

Anyhow, the real problem, as I see it, with identifying open source code pilfered and added to a closed source project is that you generally aren't allowed to reverse engineer the code itself to see what it actually does. So even if you're Very Damn Sure that a piece of commercial software illegally uses open source and sells it as its own closed source, you're not allowed to investigate and come up with evidence. You'll have to file a suit and get a judge to order the code examined, and with only a good hunch to go on, and no way to document a financial loss, and probably not having too deep pockets yourself, that's rather unlikely to go anywhere.
Which is why I think it's important that we support institutions like FSF, which can occasionally fight the battle on behalf of the little guy.

Regards,
--
*Art

Re:

[mark-t]

Anyhow, the real problem, as I see it, with identifying open source code pilfered and added to a closed source project is that you generally aren't allowed to reverse engineer the code itself to see what it actually does.

The number of cases where this is actually enforceable is far outweighed by the number of cases where it isn't. Reverse engineering by itself isn't illegal anyways... so evidence of copyright infringement acquired by reverse engineering wouldn't be inadmissable.

Re:

[TheRaven64]

There is tons of really useful code out there that doesn't make any system or library calls at all. It just takes data, processes it in some way, and hands back the results

Are you sure? You know that read and write are system calls? And that printf, sqrt, exp, etc are all library functions? Even trivial code makes a lot of system calls. A hello world program, in C, on Linux, makes 27 system calls (number from strace).

Re:

[wizardforce]

probable cause? if two programs execute in virtually identical ways there is a reason to investigate. it doesnt catch them all but it is better than nothing.

Clean room could replicate signature.

[Ungrounded Lightning]

An identical library call signature for a nontrivial part of the execution could be produced by a clean-room analysis or even independent development of an equivalent component. Neither of these is a GPL violation.

This is not to say that the technique wouldn't be useful for hunting down GPL violations. But a positive is not difinitive by itself.

Meanwhile code obfuscation (even automatically generated obfuscation) could easily modify at least the timing, if not the order, of such calls.

Nevertheless this is a powerful tool: An hunk of GPL code that hasn't had its flow obfuscated systematically (even code that HAS been obfuscated but not systematically) will have large swaths of code that trips the detector. And it doesn't require reverse engineering until after the alarm goes off.

Good job, guys.

Re:

[Ungrounded Lightning]

Meanwhile code obfuscation (even automatically generated obfuscation) could easily modify at least the timing, if not the order, of such calls.

(Yes I know that the article says it can't. But that refers to the usual sort, which is directed at hiding the similarity from someone reading the source. I'm talking about obfuscation directed at tools reading the routine-call signature.)

Re:

[adrianmonk]

This is not to say that the technique wouldn't be useful for hunting down GPL violations. But a positive is not difinitive by itself.

Indeed. The title of this slashdot article would be pretty much dead on if the words "and Prove" were taken out of "New Method to Detect and Prove GPL Violations".

Coming soon...

[koh]

GGA! The GNU Genuine Advantage program!

Sweet Mother of All Revolutions

[fishthegeek]

Pitchfork? ... Check
Torch? ... Check
Map of Corporate Castle locations? ... Check
FSF Lawyers programmed to be speed dialed in emergencies? ... Check
Desire to burn the non-believers? ... Check

Okay, I'm ready! What IRC Channel are we meeting in?

Other languages

[Mike McTernan]

I looked through the paper, and it is cool stuff. But I couldn't see where it supposed the system would work well for other languages, and I wonder if it really would be so good.

Java has a very large standard library that is always dynamically linked, and hence can easily be instrumented as the technique requires. C allows static linking which would make such hooking much more difficult. Additionally Java executes in a very standard environment due to the Virtual Machine, where as other languages may have varying ABIs type sizes and other properties that could add significant noise to the birthmark.

That said, system calls are always hookable and reasonably standard, so maybe this technique could be applied successfully there for malware detection or similar?

Heh..

[mikkelm]

When people go to these lengths to prove misuse of commercial licenses, they're called fascists. When it's done to prove misuse of free licenses, it's OK.

I see the community is still working as it always has.

Re:

[sepluv]

It may be news to you but non-commercial licenses are AFAIK universally considered non-free (where as you see to imply the two are mutually exclusive). And when has anyone ever had any problem with people going to lengths (whatever that means) to prove license violations?

I've certainly never heard anyone complaining about people coming up with evidence of violations. In fact, what I've come across a lot of is the opposite: asking people who are making vague libelous accusations about someone "stealing"

Anticompetitive

[tepples]

How many anti-RIAA stories are posted on /. because they are trying to detect and sue people for copyright violation. But when it's your property that's being stolen, it's good to detect violators and threaten lawsuits.

That's because the major labels in the RIAA, along with their music publisher counterparts, have engaged in anticompetitive behavior. For instance, through payola classic [wikipedia.org] and new payola [wikipedia.org], the major labels have forced their works on shoppers in grocery stores and forced their works on children riding school buses. With the effect of cryptomnesia [wikipedia.org] case law such as Bright Tunes Music v. Harrisongs Music, this forced listening contaminates the public with potential liability for copyright infringement.

Does

Very Cool

[maz2331]

This is very cool and potentially useful. By itself, it wouldn't be enough to force compliance or win a violation suit, it could well be enough to meet the threshold for filing a suit and forcing source code analysis in discovery. Really, it is a great tool to have to ensure that open source license terms are respected by removing the "code anonymity" inherent in a binary.

Just great

[Master of Transhuman]

Instead of coding open source projects, now we're coding projects to detect license violations.

Next, the Open Source Business Software Alliance and raids by the Secret Service...

When is the last time we read anything about open source that wasn't about licensing?

When did it stop being about the code and the value?

Re:

[sepluv]

Instead of coding open source projects, now we're coding projects to detect license violations.

Well one person has as part of some academic research. You see, the beauty of FLOSS development is everyone can code what they enjoy coding, and that you don't have to help anyone but can instead do something you prefer.

I won't even bother addressing your incoherent comment about the Secret Service, but would be interested in what you are smoking.

When is the last time we read anything about open source that wasn't about licensing?

In around 95% of stories about it. For instance the last FLOSS story on here was about a new release of WINE and the one before that about possible moral iss

Re:

[DerekLyons]

When is the last time we read anything about open source that wasn't about licensing?

In reality, it's pretty much impossible to discuss open source without it being about licensing - because licenses are the legal expression of the open source philosophy. If your are discussing the code, you are discussing the application or the language, not open source.

Re:

[jesterzog]

Instead of coding open source projects, now we're coding projects to detect license violations.

No, we're not. Those guys [uni-sb.de] are developing a method to detect license violations, and despite Slashdot's implications, I can't personally see any reference they've made in their project to GPL, open source or free software.

It's only a net loss for open source projects if they were otherwise going to be working on something more beneficial for open source, and they probably weren't. Usually people who develop op

Re:

[petrus4]

Yep...it ought to be the new motto of the FSF.

"Enjoy the FREEDOM, and don't worry about the cognitive dissonance. It goes away if you don't think about it, eventually."

Re:

[Peaker]

Wow, its hard to believe how many people on Slashdot still think that there is a dissonance with the GPL.

Its been explained well at least 500 times in every such license discussion, but some people are dense enough to still not get it.

BSD->More freedom to software developers (few), less to users (many)
GPL->More freedom to software users (many), less to developers (few)

GPL generates more net freedom.

Its as simple as that.

Re:

[Peaker]

Yeah!

We should have a Slashdot article about the new query_database function in GenericProject 3.2!

Talk about code, baby!

Wine?

[buckhead_buddy]

How well does it work with the Wine versus Windows comparison?

It's not theft

[jesterzog]

a new method to detect code theft

I realise this is going off on a tangent, but I'm concerned about the use of the word theft. Usually I'm one of the first people to jump up and down when I hear the RIAA or MPAA accuse people of stealing, and I've noticed that quite a few other people on Slashdot do the same. I think it's mis-representative of the paper to represent copyright infringement as anything other than exactly what it is, which is copyright infringement.

Language is what it is, and it changes ov

Wake up and smell the dictionary

[Peaker]

Language is what it is, and it changes over time, but I'd be really disappointed if this one was let to slip, because rather than the language changing because it's more convenient or better, it's changing because a group of powerful corporations want to confuse the issue for their own control and commercial benefit.

I used to think the same, but you can check modern dictionaries. The word theft already includes copyright infringement.

The battle was lost. The best way to act is to simply declare that some t

Read comments and think MS patent claims on linux.

[3seas]

False positives....

The story is presented with a stage light focused on linux but then the house lights come up and show linux in jail along with most of the audience.

This is just one paper for one Automated Software Engineering (ASE) conference.

But if you really want to insure software becomes genuinely free, then the level or automated software development will have to become easy enough for the typical user to apply it. Much like most anyone knows how to use a calculator and uses it as they need.

There is

Too bad for SCO!

[microbee]

They should have known this earlies, but now it's too late.

Re:

[zeromorph]

Congratulations, in something that is going to be a GPL vs. BSD flamewar you are starting a vi vs. Emacs flamewar.

I'm really touched.

Re:

[hawk]

I, for one, welcome our new vi/bsd overlords, who will defend us from the beowolf of soviet russian gpl/high-church-of-emacs heretics . . .

hawk

Re:

[Epistax]

psssst.... you can use a mouse with vi..

Re:

[maxwell demon]

i actually figured out what the hell GPL is.

Interesting. Up to now I only knew about the GNU GPL and the Affero GPL. I guess the hell GPL differs from the GNU GPL that you have not only to give away your source, but also your soul?

Re:And who the fuck might I ask is to spend the ti

[ronadams]

Good thing no one asked you to. GPL code is open-source, so "keeping it out of their grubby little hands" is not an option or even wanted. You had probably better come to understand the purpose of the GPL and what a GPL violation is before you post.

Re:

[TheRaven64]

The use case for this is that you release a piece of code, and then find someone else releasing code that does something similar. You run this program on your code and theirs, and there are three likely outcomes:

• They didn't copy your code, and the program tells you this.
• They copied your code, and the program detects it.
• They didn't copy your code, but they did implement it in such a similar way that the program thinks they did.

In the first case, you stop checking. In the second and third, you run add

Re:

[bky1701]

This isn't exactly DRM. Nether has it been adapted by the FSF at all, nor endorsed by any FSF members or important developers that I know of. I'd hardly say that it has been decided that "the GPL needs DRM". This is really little more than someone yelling "hey look what I did!" and a sensational slashdot article toting it as a way to detect "GPL theft".

The world is not ending, what you always predicted is not true. Put down the pitchforks and return to your homes.

Re:

[jellomizer]

Close your Eyes, Plug your Ears and go LA LA LA.
Its DRM. It is just done differently then other DRMs. Because with GPL the freedoms are taken away from the developers you use DRM To insure that the developers are Its still DRM just targeted at a different group. See this as what it is Hypocrisy, work to keep this out from GPL and in the spirit of GPL not just ignore the facts like a mindless GPL Follower as a good thing, but see it as effecting our rights, possibly giving false positives for people who