• 1 Post
  • 21 Comments
Joined 9 months ago
cake
Cake day: February 4th, 2024

help-circle







  • Yeah. I’m thinking more along the lines of research and open models than anything to do with OpenAI. Fair use, above all else, generally requires that the derivative work not threaten the economic viability of the original and that’s categorically untrue of ChatGPT/Copilot which are marketed and sold as products meant to replace human workers.

    The clean room development analogy is definitely an analogy I can get behind, but raises further questions since LLMs are multi stage. Technically, only the tokenization stage will “see” the source code, which is a bit like a “clean room” from the perspective of subsequent stages. When does something stop being just a list of technical requirements and veer into infringement? I’m not sure that line is so clear.

    I don’t think the generative copyright thing is so straightforward since the model requires a human agent to generate the input even if the output is deterministic. I know, for example, Microsoft’s Image Generator says that the images fall under creative Commons, which is distinct from public domain given that some rights are withheld. Maybe that won’t hold up in court forever, but Microsoft’s lawyers seem to think it’s a bit more nuanced than “this output can’t be copyrighted”. If it’s not subject to copyright, then what product are they selling? Maybe the court agrees that LLMs and monkeys are the same, but I’m skeptical that that will happen considering how much money these tech companies have poured into it and how much the United States seems to bend over backwards to accommodate tech monopolies and their human rights violations.

    Again, I think it’s clear that commerical entities using their market position to eliminate the need for artists and writers is clearly against the spirit of copyright and intellectual property, but I also think there are genuinely interesting questions when it comes to models that are themselves open source or non-commercial.


  • For example, if I ask it to produce python code for addition, which GPL’d library is it drawing from?

    I think it’s clear that the fair use doctrine no longer applies when OpenAI turns it into a commercial code assistant, but then it gets a bit trickier when used for research or education purposes, right?

    I’m not trying to be obtuse-- I’m an AI researcher who is highly skeptical of AI. I just think the imperfect compression that neural networks use to “store” data is a bit less clear than copy/pasting code wholesale.

    would you agree that somebody reading source code and then reimplenting it (assuming no reverse engineering or proprietary source code) would not violate the GPL?

    If so, then the argument that these models infringe on right holders seems to hinge on the verbatim argument that their exact work was used without attribution/license requirements. This surely happens sometimes, but is not, in general, a thing these models are capable of since they’re using loss-y compression to “learn” the model parameters. As an additional point, it would be straightforward to then comply with DMCA requests using any number of published “forced forgetting” methods.

    Then, that raises a further question.

    If I as an academic researcher wanted to make a model that writes code using GPL’d training data, would I be in compliance if I listed the training data and licensed my resulting model under the GPL?

    I work for a university and hate big tech as much as anyone on Lemmy. I am just not entirely sure GPL makes sense here. GPL 3 was written because GPL 2 had loopholes that Microsoft exploited and I suspect their lawyers are pretty informed on the topic.


  • I hate big tech too, but I’m not really sure how the GPL or MIT licenses (for example) would apply. LLMs don’t really memorize stuff like a database would and there are certain (academic/research) domains that would almost certainly fall under fair use. LLMs aren’t really capable of storing the entire training set, though I admit there are almost certainly edge cases where stuff is taken verbatim.

    I’m not advocating for OpenAI by any means, but I’m genuinely skeptical that most copyleft licenses have any stake in this. There’s no static linking or source code distribution happening. Many basic algorithms don’t follow under copyright, and, in practice, stack overflow code is copy/pasted all the time without that being released under any special license.

    If your code is on GitHub, it really doesn’t matter what license you provide in the repository – you’ve already agreed to allowing any user to “fork” it for any reason whatsoever.






  • must be your client. the link works fine for me. If you see the timeline, locals mostly weren’t involved and lots of local anti fascists organized and fought back. This island was nominated for the Nobel prize when the crisis started, but there’s only so much people can take when the refugees kept coming, the island couldn’t support thousands of extra people, and refugees were forced to cut down centuries old olive trees for cooking fuel. Greece is not a wealthy country and they felt betrayed by places like Sweden and Germany that have robust economies and a much smaller proportion of the refugee crisis.

    Something had to give. Moria camp is essentially an open air prison without running water or showers. Most people who arrive are children, or were before they walked to Turkey from the Congo or Afghanistan or whatever and boarded boats for a chance at a better life.

    I heard stories from teenagers who had escaped slavery or been forced to work in fast fashion factories in Turkey without pay or had their passports stolen in Iran or picked up by a militia in the Syrian civil war and handed a weapon. And the EU just leaves them there. They get like €200 a month, if and when their legal case ever concludes, but that’s not enough to actually live and they’re not allowed to work. Not like Greece has extra work anyway.

    Maybe the countries that make a fortune by selling arms to conflict zones (France, Germany, Sweden, Belgium, Italy) should step up and take care of the crises they manufactured for profit. But nah, they just elect far right parties because brown people are scary.



  • Be 18. Get scholarship. Study literature. Drop out. Run away. Join a protest movement. Be homeless at MIT for a while. Find job. Get hurt at said job. Get workers injury insurance payment after 2 years of recocery. Go back to school for math. Be good at math. Found tech related non profit. Spend 6 months in Kurdistan, setting up wifi. Finish math school. Fuck it, get masters because good at math. Get hired by foreign company oversees to work on self driving cars. Doesn’t work. Won’t work. Quit. Go to Greece, teach refugee kids how to us MS office. Watch neo Nazis burn down refugee school and computer lab. Suddenly it’s March of 2020 (COVID) and nothing to do because Nazis and no more computer lab. Oh fuck. Find PhD program in “trustworthy ai” to figure out why car not work. Prove car never work. Get PhD. Get paid to critique AI and play on super computers while working from home and having zero day to day oversight. Get paid to travel the world. Get paid to shit on Google, Facebook , Openai, and Tesla.

    I went from homeless to visiting my 40th country in 10 years, while having a PhD.

    No regrets.




  • I have 4 of the 8bitdo controllers (various Bluetooth models) and games have varying levels of support for them. Sometimes all the controllers show up as 1st player, but mostly steam handles it fine. I’ve also use Microsoft branded controllers in the past with 0 issues, but then you’re locked into to that as mixing those with playstation or 3rd party ones can lead to the same player mapping weirdness. Also, the Xbox variety needs a 2.4Ghz dongle to work with the deck, but I’ve found this to be superior to Bluetooth in crowded environments.