I’d describe those products as being in the “heh, that’s neat” phase. At least, the good ones anyway. After a few hours you start the see the issues - like images with very weird fingers - and then you the illusion is broken.
For example, in work I’ve been playing around a lot with various LLMs to generate marketing copy for physical products. I’m being vague here for reasons I’m sure are obvious.
Across the first few hours it felt very impressive, it would pretty much instantly churn out descriptions in a variety of styles, even when the product information we provided was low quality.
The problem though, was that the copy it wrote was actually - if you sat down and read it - shit.
Now, the vast majority of marketing copy is also shit. The good stuff is excellent, rare as hens teeth, and incredibly expensive, but your generic boilerplate crap you see all over the Internet, that stuff, it could replicate perfectly. Even the lies.
If you want sales speak waffle, it’s 11/10 every time.
So we’re currently in a bit of a bind. Do we release a tool that creates boilerplate shit more easily, and will turn even the most inconsistent (and straight up conflicting or impossible) data in to fancy sounding text, and jump on the AI-powered bandwagon, or do we not, because what it creates isn’t actually any good?
Imo spitting out crap in a second or two isn’t a valuable improvement on where we were a few years ago, even if it is pretty neet.
I agree with what you’re saying about your line of work. I code for a living, and Copilot is genuinely useful all day long. I use it now and again to generate a script from scratch, but most of the time it functions as either an incredible autocomplete of whatever I am coding, or it converts a chunk of code from one format to another, with just a description of what I’m trying to do, instead of me having to write a complex regular expression or do it by hand. So I’d say in my line of work it’s gotten past the “neat” phase.
But it still ultimately requires you in that chair to correct issues.
I don’t doubt for a second that time is saved, especially in the boilerplate parts of writing code, but it’s not going to remove you from that chair.
From my experience, Copilot is helpful, but we’re talking a few steps above templates, Clippy 3.0, if you will. The bit that blew my mind a bit was realising just how much code I write is the essentially the same. “Automating” that has been a great help, but - like with the marketing stuff - it’s not at a point where it can do it alone.
There are lots of awesome things that help me with my job but still require me to be there. But you were saying the help it gives with the job is more limited than it seems to be at first. And I’m just saying in my line of work it’s actually a huge help.
It’s not like Clippy or templates. I have to spend time setting up templates and following a specific structure and syntax, remembering to use them. With Copilot I turned it on one day and it was instantly helping me with whatever I was working on, and continues to do so no matter what comes up.
I wasn’t making any assertion that it could do my job without me, but it seems far more useful in what I do than what you had described.
I’d describe those products as being in the “heh, that’s neat” phase. At least, the good ones anyway. After a few hours you start the see the issues - like images with very weird fingers - and then you the illusion is broken.
For example, in work I’ve been playing around a lot with various LLMs to generate marketing copy for physical products. I’m being vague here for reasons I’m sure are obvious.
Across the first few hours it felt very impressive, it would pretty much instantly churn out descriptions in a variety of styles, even when the product information we provided was low quality.
The problem though, was that the copy it wrote was actually - if you sat down and read it - shit.
Now, the vast majority of marketing copy is also shit. The good stuff is excellent, rare as hens teeth, and incredibly expensive, but your generic boilerplate crap you see all over the Internet, that stuff, it could replicate perfectly. Even the lies.
If you want sales speak waffle, it’s 11/10 every time.
So we’re currently in a bit of a bind. Do we release a tool that creates boilerplate shit more easily, and will turn even the most inconsistent (and straight up conflicting or impossible) data in to fancy sounding text, and jump on the AI-powered bandwagon, or do we not, because what it creates isn’t actually any good?
Imo spitting out crap in a second or two isn’t a valuable improvement on where we were a few years ago, even if it is pretty neet.
I agree with what you’re saying about your line of work. I code for a living, and Copilot is genuinely useful all day long. I use it now and again to generate a script from scratch, but most of the time it functions as either an incredible autocomplete of whatever I am coding, or it converts a chunk of code from one format to another, with just a description of what I’m trying to do, instead of me having to write a complex regular expression or do it by hand. So I’d say in my line of work it’s gotten past the “neat” phase.
But it still ultimately requires you in that chair to correct issues.
I don’t doubt for a second that time is saved, especially in the boilerplate parts of writing code, but it’s not going to remove you from that chair.
From my experience, Copilot is helpful, but we’re talking a few steps above templates, Clippy 3.0, if you will. The bit that blew my mind a bit was realising just how much code I write is the essentially the same. “Automating” that has been a great help, but - like with the marketing stuff - it’s not at a point where it can do it alone.
It’s the same with driving, etc.
There are lots of awesome things that help me with my job but still require me to be there. But you were saying the help it gives with the job is more limited than it seems to be at first. And I’m just saying in my line of work it’s actually a huge help.
It’s not like Clippy or templates. I have to spend time setting up templates and following a specific structure and syntax, remembering to use them. With Copilot I turned it on one day and it was instantly helping me with whatever I was working on, and continues to do so no matter what comes up.
I wasn’t making any assertion that it could do my job without me, but it seems far more useful in what I do than what you had described.