Training the models is very resource intensive, but after that it’s basically fine. I can run Midjourney image generation on my modest gaming laptop. Takes maybe 30 seconds for a high-resolution image at a laptop’s “gaming mode” power consumption.
AI image generation is comparable in electric use to e.g. playing Valheim or Elden Ring.
It’s when it’s scaled up industrially that it becomes a huge waste of electricity. Me playing Valhelm for 5 minutes is nothing. My startup creating 20000 bots playing Valheim 24/7 is a problem for society.
In this analogy, using the diamond does use it up. In the sense that none else can use that diamond concurrently. If someone else wants a diamond, more children must die.
This is different from the trained AI model, which can concurrently be used by everyone at the same time, at very little extra cost.
Even if the diamond mine owners stop mining, it’s unethical to buy their stockpile of blood diamonds.
Also, there is a cost besides electricity - the theft of artist’s work is inherent to the use of the model, not just in the training. The artist is not being compensated whenever an AI generates art in their style, and they may in fact lose their job or have their compensation reduced due to artificial supply.
Finally, this is an analogy, it’s not perfect. Picking apart incidental parts of the analogy doesn’t really prove anything. Use an analogy to explain a problem, but don’t pick apart an analogy as though you’re picking apart the problem.
and they may in fact lose their job or have their compensation reduced due to artificial supply.
highly doubt. Any artists that do lose their job are probably mostly ok with it anyway, since it’s most likely going to be graphical drivel anyway. In fields like media theres a different argument to be made, but even then it’s iffy sometimes. Also i don’t think this would be considered artificial supply, it would be artificially insisted demand instead no? Or perhaps an inelastic demand side expectation.
Although, it would be nice to have some actual concrete data on artists and job prospects in relation to AI. Unfortunately it’s probably too early to tell right now, since we’re just out of the Luddite reactionary phase, who knows.
Any artists that do lose their job are probably mostly ok with it anyway, since it’s most likely going to be graphical drivel anyway.
Replace “artist” and “graphical”, and you just described most jobs. I don’t think most people are ok losing their jobs even if those jobs aren’t especially inherently rewarding; they’re getting paid for their area of training. They’re not just gonna be able to find a new job because in this hypothetical, the demand for it (a living human doing the work) is gone.
I consider this an increase in supply because it’s an increase in the potential supply. Productivity increases (which is what this is) mean you can make more, which drives down the price, which means that artists get paid less (or just get replaced).
Remember: if you 10x the productivity of an employee, that typically doesn’t mean you produce 10x the product, it typically means you need 1/10th the employees. That payroll saving goes right into the pockets of execs.
Also wrt luddites, they weren’t wrong. It did absolutely demolish their industry and devastate the workers. It’s just that the textile industry was only a small part of the economy, and there were other industries who could absorb the displaced workers after they got retrained.
LLMs threaten almost every industry, so there is a greater worker impact and fewer places for displaced workers to go. Also now workers are responsible for bearing the costs of their own retraining, unlike back in the day of the luddites.
Replace “artist” and “graphical”, and you just described most jobs.
yeah, it’s a generalized statement, so that makes sense. It’d be weird if my statement only applied to the artist economy, not like, the rest of the economy.
I don’t think most people are ok losing their jobs even if those jobs aren’t especially inherently rewarding; they’re getting paid for their area of training.
i think this is what most people would say, and i would generally agree, however there is always going to be some level of job market upset, which is a good thing for society, and people, even if they don’t like it. It’s a liquidity thing at the end of the day. If you have no liquidity doing anything other than what you first started doing is going to be really hard, if you have more liquidity, it becomes easier. Although there is a point of diminishing returns where it turns into a revolving door of short term labor.
They’re not just gonna be able to find a new job because in this hypothetical, the demand for it (a living human doing the work) is gone.
yeah but that’s the thing, i’m not convinced that the entire field is just, gone. Maybe a small portion of it, like 10-20% is less active overall right now. Some art communities are pretty insulated from the broader market as a whole, the furry community being one of them. I think most realistically, AI generated art is going to be used in places where you aren’t actively removing art from the art pool, but adding more art to the already busy art pool.
I mean in Hollywood for example, AI is most commonly used to do what, remove mustaches and shit? Replace existing CGI that would need to be done on top of faces? Particularly the really time intensive and tedious parts of it that aren’t cost effective to approach and manage. Otherwise you would just pay a normal artist to do it, because they’re going to be extremely competitive. It’s not like you can just delete an entire production team and smash a movie script through an AI (that was also written by AI) and get a full movie out of it.
I think a lot of it is a senseless overreaction, i’m sort of sympathetic to it, but at the end of the day, there hasn’t been an artist famine to my knowledge, so it seems like things are going fine.
I consider this an increase in supply because it’s an increase in the potential supply.
counter point. It’s not actually an increase in supply potential, it’s both supply and demand. You can’t just look at this like it’s increasing productivity exclusively, although it is in some part, AI simply can’t do certain things that humans can. And you can’t act like an increase in productivity won’t drive in increase in demand either. Because it will. That’s the entire operating principle of the global economy. a steady increase in productivity leads to a steady increase in supply, which leads to a steady increase of demand, which leads to overall growth.
You might be paid less as an artist, but unless you get a significant downturn that we would’ve already heard about, things like covid are going to effect you more heavily.
if you 10x the productivity of an employee, that typically doesn’t mean you produce 10x the product, it typically means you need 1/10th the employees. That payroll saving goes right into the pockets of execs.
but you also need to consider that in the global market, you aren’t just supplying a magical constant of demand, if you can increase demand, you can increase supply. and lower the price of the product as well, making it both more competitive, more accessible, and more productive. Since now you have an incentive to increase the production of that product to meet supply.
Of course if people don’t buy things, it doesn’t matter anymore, but i think both of us here can agree that people don’t really seem content to stop spending money on things any time soon.
Also wrt luddites, they weren’t wrong. It did absolutely demolish their industry and devastate the workers.
isn’t this primarily because they never industrialized/mechanized and then ended up being out competed in the market by people who did? Even if this is a concern, you can always shift focus, and move from making generalized textiles, to more complex, difficult to make, and more expensive textiles. Humans always have an advantage of machines and robots, we’re smarter. A lot smarter. You can look at other industries like watch making for example, expert watch craftsman could have lost their jobs to mechanized industrial production, but they never did. Hand made watches are still a big deal.
LLMs threaten almost every industry
i’m not sure how much they threaten every industry collectively, though i’m sure they pose some level of obstacle, at the end of the day i’ve only ever seen AI being used for janitorial tasks in companies, like boiler-plating reports, and categorizing documentation. And also customer support, which is not particularly something i’m a fan of, but there is definitely utility in it. Almost never fully replacing entire positions, that would be too costly.
A very large amount of those dug up diamonds end up as “industrial diamonds.” Because they are far from gemstone quality. And they definitely get used up. I have used up my share of them as cutting tools when I was a toolmaker.
I know the analogy isn’t a perfect fit for LLMs in general. Analogies never come close to describing the entire thing they’re analogs of, they don’t need to.
It doesn’t matter because this is a suitable analogy for the argument. This is how analogies work.
The argument is that because the harm has already been done, it’s fine to use LLMs.
That same argument can be made for blood diamonds, and it’s untrue for exactly the same reason:
Because buying the use of LLMs (which is mostly how they’re used, even if you pay in data instead of money) is funding the continued harmful actions of the producer.
I can’t believe I have to explain how analogies are used to a grown ass adult.
this is actually a really debatable argument. If you’re buying it first hand, from somebody trying to make money, yes it could arguably be unethical, but if you’re buying it second hand, i.e. someone who just doesn’t want it anymore, you could make the argument that it’s an ethically net positive transaction. Since they no longer want the diamond, and wish to have money instead, and you wish to have the diamond, and less money. Everybody wins in 2nd hand deals, weirdly enough.
Setting aside “there is no ethical consumption under capitalism”, which is a debatable for another time:
I don’t totally agree with your assessment of 2nd hand sales: it’s not ethical positive, at best it’s ethically neutral, because demand trickles up the market. I could go into this more, but ultimately it it’s irrelevant:
The 2nd hand LLM market doesn’t work like that because LLMs are sold as a service. The LLM producers take a cut from all LLM resellers.
You could make a case that self hosting a free open source LLM like OLlama is ok, but that’s not how most LLMs are distributed.
Setting aside “there is no ethical consumption under capitalism”, which is a debatable for another time:
the simple answer is yes and no, there is both ethical, and unethical consumption under capitalism. As there is in any society throughout human history.
I don’t totally agree with your assessment of 2nd hand sales: it’s not ethical positive, at best it’s ethically neutral, because demand trickles up the market. I could go into this more, but ultimately it it’s irrelevant:
if we start from a basis of ethical neutrality, ignoring the parties as a baseline, i included the parties because i would consider two parties who wish to do business, successfully doing business, to be an ethically positive thing, as two people have had their needs/wants more closely met by this deal. Therefore making it ethically positive.
If you’re starting from an ethically negative point, you need some sort of inherent negative value to exist within that relationship. Perhaps the guy who is selling was hitler for example, that would make it an ethically negative scenario. Maybe after he sold it, he would’ve donated the money or given it to someone who can do something more useful with it, making it even more ethically positive.
there’s an argument to be made for something with perceived value and static supply to have an upwards trajectory in the market going forward, for something like blood diamonds this is unlikely, but assuming it did happen, this should actually be an ethically positive thing assuming that the families of the original diamonds ended up getting their hands on them for example. If they weren’t given back to the family then it doesn’t really matter since you’re back to the baseline anyway. Prospective investments aren’t a real tangible asset, so we can’t forsee that.
although to be clear, i wasn’t talking about LLMs, this is a much harder thing to do with LLMs, although the argument here is that the training has already been done, the power has already been consumed, you can’t unconsume that power, so therefore whatever potential future consumption that could happen, is based off of the existing consumption already. Unless of course you did more training in the future, but that’s a different story. Just boycott AI or something at that point lol.
In both your examples, you seem to assume that the harm is already done and that there is no continued harm.
But in both cases the harm isn’t finished; the blood diamond mine owners use the continued sale of blood diamonds to fund their continued mining operations, and LLM providers use the sale of LLM use to fund the continued training of new LLM models.
Regardless of if you think that buying second hand blood diamonds increases overall demand in the market (which blood diamonds sellers benefit from); it is clearly the case that selling (and reselling) LLM services benefit the LLM providers, and we can trivially see that they’re training new models and not making amends.
says who? In my example i assumed that the blood mined diamonds had already ceased production, because obviously if they haven’t theres no point in talking about market forces at all. The more pressing concern would be the literal blood diamonds. I was talking about the second hand market for what were previously blood diamonds, and technically still are, just without the active cost associated.
And again, what funds, there are no funds, this is a purely second hand sale. The seller is not giving a percent back to the diamond mining company that no longer exists here.
and LLM providers use the sale of LLM use to fund the continued training of new LLM models.
i would agree with this, but it seems like we very quickly hit a new technical limitation as of the last few years. The pace has drastically slowed, the technical nature of the AIs have improved less, the broad suitability has improved more. And it’s also worth noting that this is an itemized cost. Not a whole static cost. Just saying “but but, ai consumes lots of energies” is meaningless, unless you can demonstrate that it’s significant, and actually matters. I think there is definitely an argument to be made here, but unfortunately, i have yet to see anyone actually argue it.
and we can trivially see that they’re training new models and not making amends.
what do you mean when you say amends? Carbon capture? Paying off artists so they can "steal their jobs? This is meaningless to me without an actual practical example.
I mean yeah: if we went and killed every person who benefits from conflict diamonds and closed all blood diamond mines why wouldn’t you be cool with using the resources? Their evil origin has little to do with their practical utility and if the original sin is expiated there’s no reason not to?
Like yeah conflict diamonds have basically no purpose because we can make diamonds cheaper and better in labs but in a situation where there are more practical uses (cobalt, LLMs) once we cleanse the land of the sinners why wouldn’t we use their ill gotten gains for good?
But we’re not “killing” every person who benefits, literally or figuratively. We’re continuing to buy their diamonds (pay them in money and data) while they continue to mine (train new models, use copyrighted material).
It’s not a perfect analogy, models ape the work of artists and take their jobs; it’s like if the diamond was bloody, and as long as it existed, the miner’s family not only didn’t get compensated for the loss but we’re also prevented from getting jobs themselves.
We’re not righting the wrong, were making the wrongs even worse. At some point you have to just burn the whole thing down.
Okay, so again, no new machine learning ever, unless you can prove it’s done without environmental impact or affecting peoples’ right to a dignified existence. That’s the wrong righted. That’s what you’re advocating. Am I misunderstanding?
Sounds like you think we should use the diamonds. I wouldn’t be cool with using those diamonds because they belong to the people who were forced to mine them, not me.
I wouldn’t be cool with using those diamonds because they belong to the people who were forced to mine them
well most of them are dead aren’t they? Are we going to put them back into their coffins? Or, how are we planning on redistributing these?
Dead people can’t own things, so that seems like an illogical conclusion, perhaps their estate or family? They didn’t do the work, but they would arguably be most entitled to it.
The people who were exploited should be the ones to benefit from those diamonds.
i mean probably, but this would be a question of what the law says. If we’re talking philosophy that’s irrelevant here, but to include it anyway, it would be something like “the most ethical source of any given item should be most preferred over any other source of said item” or if we’re operating under an ideology of anti-human exploitation idk where we would even start. You need a really concrete definition of exploitation, and how to combat it effectively, without just exploiting more people.
i mean yeah, statistically, an already mined diamond is a child already dead. you would just stop new diamond mining, or move away from child consumptory diamond mining, you aren’t going to completely demolish every child diamond in existence though, there’s no point, harms already done. Might as well leave them in the market.
only if they existed actively. And when it comes to the secondhand market, someone who no longer wants a product, and someone who wants that product, who can buy it from the person who no longer wants it, effectively means that two people get the same value from one singular product, essentially creating value from thin air.
The point i’m making, is that as long as you have diamond mining that requires killing people to produce diamonds, those diamonds are an ethically negative commodity, however if you are no longer killing people, those diamonds are already out there, those people have already been killed, there is nothing you can do to undead those people. So you might as well leave it in market circulation at that point.
You could argue that it would incentivize more illegal mining, but i would argue that bad regulations and enforcement incentivize illegal mining instead.
I think that the market (profit) incentives the mining, and that lax regulations simply fail to curb that incentive. We can see from the war on drugs that simply regulating or criminalizing something won’t stop it if there is a market, it just drives up prices.
But in any case, this aspect is a lot less ambiguous for LLMs because selling the use of an LLM is legal, and the sellers use the money to train new LLMs.
So let’s create regulations around LLMs and enforce those regulations, before it starts to really affect the job market and environment.
i definitely agree that there needs to be some rewriting of law, specifically copyright, which will inevitably be relevant to AI. But i’m still not convinced it’s a massive market black hole or anything.
Unless you want to be cucked like farmers in the US who take in massive subsidies and cry and moan everytime something moderately inconveniences them.
Is Midjourney available for use locally now? Or have you misunderstood Midjourney taking 30 seconds to generate from their server as happening locally?
That sounds a bit too much. Generating an sdxl image and then scaling it up is the common procedure, but that should not take 2 minutes on a 40xx card. For reference I can generate 3 batches of 5 images (without the upscaling step) in less than 2 minutes on my 4070ti. And that’s without using faster sdxl models like lightning or turbo or whatever.
Training the models is very resource intensive, but after that it’s basically fine. I can run Midjourney image generation on my modest gaming laptop. Takes maybe 30 seconds for a high-resolution image at a laptop’s “gaming mode” power consumption.
AI image generation is comparable in electric use to e.g. playing Valheim or Elden Ring.
It’s when it’s scaled up industrially that it becomes a huge waste of electricity. Me playing Valhelm for 5 minutes is nothing. My startup creating 20000 bots playing Valheim 24/7 is a problem for society.
It’s the mining of diamonds that kills all the children. After the diamond is mined, I can use it with almost no child deaths. Diamonds are fine.
No, using an already-trained model doesn’t “use up” the model in exactly the same way that pirating a movie doesn’t steal anything from Hollywood.
Use a diamond doesn’t “use up” that diamond.
And yet, it’s still unethical to buy already mined blood diamonds from people who continue to mine more blood diamonds. Funny thing about that, huh
In this analogy, using the diamond does use it up. In the sense that none else can use that diamond concurrently. If someone else wants a diamond, more children must die.
This is different from the trained AI model, which can concurrently be used by everyone at the same time, at very little extra cost.
Even if the diamond mine owners stop mining, it’s unethical to buy their stockpile of blood diamonds.
Also, there is a cost besides electricity - the theft of artist’s work is inherent to the use of the model, not just in the training. The artist is not being compensated whenever an AI generates art in their style, and they may in fact lose their job or have their compensation reduced due to artificial supply.
Finally, this is an analogy, it’s not perfect. Picking apart incidental parts of the analogy doesn’t really prove anything. Use an analogy to explain a problem, but don’t pick apart an analogy as though you’re picking apart the problem.
highly doubt. Any artists that do lose their job are probably mostly ok with it anyway, since it’s most likely going to be graphical drivel anyway. In fields like media theres a different argument to be made, but even then it’s iffy sometimes. Also i don’t think this would be considered artificial supply, it would be artificially insisted demand instead no? Or perhaps an inelastic demand side expectation.
Although, it would be nice to have some actual concrete data on artists and job prospects in relation to AI. Unfortunately it’s probably too early to tell right now, since we’re just out of the Luddite reactionary phase, who knows.
Replace “artist” and “graphical”, and you just described most jobs. I don’t think most people are ok losing their jobs even if those jobs aren’t especially inherently rewarding; they’re getting paid for their area of training. They’re not just gonna be able to find a new job because in this hypothetical, the demand for it (a living human doing the work) is gone.
I consider this an increase in supply because it’s an increase in the potential supply. Productivity increases (which is what this is) mean you can make more, which drives down the price, which means that artists get paid less (or just get replaced).
Remember: if you 10x the productivity of an employee, that typically doesn’t mean you produce 10x the product, it typically means you need 1/10th the employees. That payroll saving goes right into the pockets of execs.
Also wrt luddites, they weren’t wrong. It did absolutely demolish their industry and devastate the workers. It’s just that the textile industry was only a small part of the economy, and there were other industries who could absorb the displaced workers after they got retrained.
LLMs threaten almost every industry, so there is a greater worker impact and fewer places for displaced workers to go. Also now workers are responsible for bearing the costs of their own retraining, unlike back in the day of the luddites.
yeah, it’s a generalized statement, so that makes sense. It’d be weird if my statement only applied to the artist economy, not like, the rest of the economy.
i think this is what most people would say, and i would generally agree, however there is always going to be some level of job market upset, which is a good thing for society, and people, even if they don’t like it. It’s a liquidity thing at the end of the day. If you have no liquidity doing anything other than what you first started doing is going to be really hard, if you have more liquidity, it becomes easier. Although there is a point of diminishing returns where it turns into a revolving door of short term labor.
yeah but that’s the thing, i’m not convinced that the entire field is just, gone. Maybe a small portion of it, like 10-20% is less active overall right now. Some art communities are pretty insulated from the broader market as a whole, the furry community being one of them. I think most realistically, AI generated art is going to be used in places where you aren’t actively removing art from the art pool, but adding more art to the already busy art pool.
I mean in Hollywood for example, AI is most commonly used to do what, remove mustaches and shit? Replace existing CGI that would need to be done on top of faces? Particularly the really time intensive and tedious parts of it that aren’t cost effective to approach and manage. Otherwise you would just pay a normal artist to do it, because they’re going to be extremely competitive. It’s not like you can just delete an entire production team and smash a movie script through an AI (that was also written by AI) and get a full movie out of it.
I think a lot of it is a senseless overreaction, i’m sort of sympathetic to it, but at the end of the day, there hasn’t been an artist famine to my knowledge, so it seems like things are going fine.
counter point. It’s not actually an increase in supply potential, it’s both supply and demand. You can’t just look at this like it’s increasing productivity exclusively, although it is in some part, AI simply can’t do certain things that humans can. And you can’t act like an increase in productivity won’t drive in increase in demand either. Because it will. That’s the entire operating principle of the global economy. a steady increase in productivity leads to a steady increase in supply, which leads to a steady increase of demand, which leads to overall growth.
You might be paid less as an artist, but unless you get a significant downturn that we would’ve already heard about, things like covid are going to effect you more heavily.
but you also need to consider that in the global market, you aren’t just supplying a magical constant of demand, if you can increase demand, you can increase supply. and lower the price of the product as well, making it both more competitive, more accessible, and more productive. Since now you have an incentive to increase the production of that product to meet supply.
Of course if people don’t buy things, it doesn’t matter anymore, but i think both of us here can agree that people don’t really seem content to stop spending money on things any time soon.
isn’t this primarily because they never industrialized/mechanized and then ended up being out competed in the market by people who did? Even if this is a concern, you can always shift focus, and move from making generalized textiles, to more complex, difficult to make, and more expensive textiles. Humans always have an advantage of machines and robots, we’re smarter. A lot smarter. You can look at other industries like watch making for example, expert watch craftsman could have lost their jobs to mechanized industrial production, but they never did. Hand made watches are still a big deal.
i’m not sure how much they threaten every industry collectively, though i’m sure they pose some level of obstacle, at the end of the day i’ve only ever seen AI being used for janitorial tasks in companies, like boiler-plating reports, and categorizing documentation. And also customer support, which is not particularly something i’m a fan of, but there is definitely utility in it. Almost never fully replacing entire positions, that would be too costly.
A very large amount of those dug up diamonds end up as “industrial diamonds.” Because they are far from gemstone quality. And they definitely get used up. I have used up my share of them as cutting tools when I was a toolmaker.
Ok cool, but this is an analogy. Why are you defending the use of AI by megacorps by objecting to irrelevant parts of an analogy on technicality?
It’s a bad analogy and just plain wrong fact. Do better.
You’re insufferable.
I know the analogy isn’t a perfect fit for LLMs in general. Analogies never come close to describing the entire thing they’re analogs of, they don’t need to.
It doesn’t matter because this is a suitable analogy for the argument. This is how analogies work.
The argument is that because the harm has already been done, it’s fine to use LLMs.
That same argument can be made for blood diamonds, and it’s untrue for exactly the same reason:
Because buying the use of LLMs (which is mostly how they’re used, even if you pay in data instead of money) is funding the continued harmful actions of the producer.
I can’t believe I have to explain how analogies are used to a grown ass adult.
this is actually a really debatable argument. If you’re buying it first hand, from somebody trying to make money, yes it could arguably be unethical, but if you’re buying it second hand, i.e. someone who just doesn’t want it anymore, you could make the argument that it’s an ethically net positive transaction. Since they no longer want the diamond, and wish to have money instead, and you wish to have the diamond, and less money. Everybody wins in 2nd hand deals, weirdly enough.
Setting aside “there is no ethical consumption under capitalism”, which is a debatable for another time:
I don’t totally agree with your assessment of 2nd hand sales: it’s not ethical positive, at best it’s ethically neutral, because demand trickles up the market. I could go into this more, but ultimately it it’s irrelevant:
The 2nd hand LLM market doesn’t work like that because LLMs are sold as a service. The LLM producers take a cut from all LLM resellers.
You could make a case that self hosting a free open source LLM like OLlama is ok, but that’s not how most LLMs are distributed.
the simple answer is yes and no, there is both ethical, and unethical consumption under capitalism. As there is in any society throughout human history.
if we start from a basis of ethical neutrality, ignoring the parties as a baseline, i included the parties because i would consider two parties who wish to do business, successfully doing business, to be an ethically positive thing, as two people have had their needs/wants more closely met by this deal. Therefore making it ethically positive.
If you’re starting from an ethically negative point, you need some sort of inherent negative value to exist within that relationship. Perhaps the guy who is selling was hitler for example, that would make it an ethically negative scenario. Maybe after he sold it, he would’ve donated the money or given it to someone who can do something more useful with it, making it even more ethically positive.
there’s an argument to be made for something with perceived value and static supply to have an upwards trajectory in the market going forward, for something like blood diamonds this is unlikely, but assuming it did happen, this should actually be an ethically positive thing assuming that the families of the original diamonds ended up getting their hands on them for example. If they weren’t given back to the family then it doesn’t really matter since you’re back to the baseline anyway. Prospective investments aren’t a real tangible asset, so we can’t forsee that.
although to be clear, i wasn’t talking about LLMs, this is a much harder thing to do with LLMs, although the argument here is that the training has already been done, the power has already been consumed, you can’t unconsume that power, so therefore whatever potential future consumption that could happen, is based off of the existing consumption already. Unless of course you did more training in the future, but that’s a different story. Just boycott AI or something at that point lol.
In both your examples, you seem to assume that the harm is already done and that there is no continued harm.
But in both cases the harm isn’t finished; the blood diamond mine owners use the continued sale of blood diamonds to fund their continued mining operations, and LLM providers use the sale of LLM use to fund the continued training of new LLM models.
Regardless of if you think that buying second hand blood diamonds increases overall demand in the market (which blood diamonds sellers benefit from); it is clearly the case that selling (and reselling) LLM services benefit the LLM providers, and we can trivially see that they’re training new models and not making amends.
says who? In my example i assumed that the blood mined diamonds had already ceased production, because obviously if they haven’t theres no point in talking about market forces at all. The more pressing concern would be the literal blood diamonds. I was talking about the second hand market for what were previously blood diamonds, and technically still are, just without the active cost associated.
And again, what funds, there are no funds, this is a purely second hand sale. The seller is not giving a percent back to the diamond mining company that no longer exists here.
i would agree with this, but it seems like we very quickly hit a new technical limitation as of the last few years. The pace has drastically slowed, the technical nature of the AIs have improved less, the broad suitability has improved more. And it’s also worth noting that this is an itemized cost. Not a whole static cost. Just saying “but but, ai consumes lots of energies” is meaningless, unless you can demonstrate that it’s significant, and actually matters. I think there is definitely an argument to be made here, but unfortunately, i have yet to see anyone actually argue it.
what do you mean when you say amends? Carbon capture? Paying off artists so they can "steal their jobs? This is meaningless to me without an actual practical example.
I mean yeah: if we went and killed every person who benefits from conflict diamonds and closed all blood diamond mines why wouldn’t you be cool with using the resources? Their evil origin has little to do with their practical utility and if the original sin is expiated there’s no reason not to?
Like yeah conflict diamonds have basically no purpose because we can make diamonds cheaper and better in labs but in a situation where there are more practical uses (cobalt, LLMs) once we cleanse the land of the sinners why wouldn’t we use their ill gotten gains for good?
But we’re not “killing” every person who benefits, literally or figuratively. We’re continuing to buy their diamonds (pay them in money and data) while they continue to mine (train new models, use copyrighted material).
Agreed.
But the entire point I’m making is there’s nothing wrong with the diamonds, the problem is with the method and the people profiting from it.
You were saying the diamonds were not fine by dint of origin. I’m saying let’s right the wrong and then use the diamonds.
It’s not a perfect analogy, models ape the work of artists and take their jobs; it’s like if the diamond was bloody, and as long as it existed, the miner’s family not only didn’t get compensated for the loss but we’re also prevented from getting jobs themselves.
We’re not righting the wrong, were making the wrongs even worse. At some point you have to just burn the whole thing down.
Okay, so again, no new machine learning ever, unless you can prove it’s done without environmental impact or affecting peoples’ right to a dignified existence. That’s the wrong righted. That’s what you’re advocating. Am I misunderstanding?
Do the concepts “reparations” or “compensation for loss and damage” mean anything to you?
The people who were exploited should be the ones to benefit from those diamonds.
The fuck you think “using their ill gotten gains for good” means?
Sounds like you think we should use the diamonds. I wouldn’t be cool with using those diamonds because they belong to the people who were forced to mine them, not me.
well most of them are dead aren’t they? Are we going to put them back into their coffins? Or, how are we planning on redistributing these?
Dead people can’t own things, so that seems like an illogical conclusion, perhaps their estate or family? They didn’t do the work, but they would arguably be most entitled to it.
They had families, so yes, that’d be a good place to start reparations.
i mean probably, but this would be a question of what the law says. If we’re talking philosophy that’s irrelevant here, but to include it anyway, it would be something like “the most ethical source of any given item should be most preferred over any other source of said item” or if we’re operating under an ideology of anti-human exploitation idk where we would even start. You need a really concrete definition of exploitation, and how to combat it effectively, without just exploiting more people.
The law can eat my entire ass.
i mean yeah, statistically, an already mined diamond is a child already dead. you would just stop new diamond mining, or move away from child consumptory diamond mining, you aren’t going to completely demolish every child diamond in existence though, there’s no point, harms already done. Might as well leave them in the market.
But buying them funds the diamond miners to mine more. That’s the point.
By participating in the market, you’re perpetuating blood diamonds.
only if they existed actively. And when it comes to the secondhand market, someone who no longer wants a product, and someone who wants that product, who can buy it from the person who no longer wants it, effectively means that two people get the same value from one singular product, essentially creating value from thin air.
The point i’m making, is that as long as you have diamond mining that requires killing people to produce diamonds, those diamonds are an ethically negative commodity, however if you are no longer killing people, those diamonds are already out there, those people have already been killed, there is nothing you can do to undead those people. So you might as well leave it in market circulation at that point.
You could argue that it would incentivize more illegal mining, but i would argue that bad regulations and enforcement incentivize illegal mining instead.
I think that the market (profit) incentives the mining, and that lax regulations simply fail to curb that incentive. We can see from the war on drugs that simply regulating or criminalizing something won’t stop it if there is a market, it just drives up prices.
But in any case, this aspect is a lot less ambiguous for LLMs because selling the use of an LLM is legal, and the sellers use the money to train new LLMs.
So let’s create regulations around LLMs and enforce those regulations, before it starts to really affect the job market and environment.
i definitely agree that there needs to be some rewriting of law, specifically copyright, which will inevitably be relevant to AI. But i’m still not convinced it’s a massive market black hole or anything.
Unless you want to be cucked like farmers in the US who take in massive subsidies and cry and moan everytime something moderately inconveniences them.
I see your point and agree with it, but I believe you read more defense in my comment than I tried to put in.
I’m not in favor of this waste.
Yeah. My phone can generate a 512x512 image with Stable Diffusion in like 20 seconds with the right settings.
Is Midjourney available for use locally now? Or have you misunderstood Midjourney taking 30 seconds to generate from their server as happening locally?
I know a guy that uses Stable Diffusion XL locally with a few LORAs, last time I’ve heard one 2k image took 2 minutes on RTX 30 or 40 something
IDK how expensive is Midjourney in comparison, but running it locally doesn’t sound impossible
The impossible part is that it isn’t publicly available. It’s not an open model.
Oh, ok. I’m not into image generation, so I didn’t know.
That sounds a bit too much. Generating an sdxl image and then scaling it up is the common procedure, but that should not take 2 minutes on a 40xx card. For reference I can generate 3 batches of 5 images (without the upscaling step) in less than 2 minutes on my 4070ti. And that’s without using faster sdxl models like lightning or turbo or whatever.