To be honest, I’ve wasted entire evenings on regex. Fuck regex. We need a replacement that isn’t an llm but fixes that archaic shit. Make it human language
Yeah, that’s fair. If you have one problem and solve it with regex, now you have two problems.
Though in this case the monthly inference budget ran out causing a system outage. I was on call, so, getting a page off hours makes me dislike the llm approach even more haha
On the contrary. If you architect to not fail when missing context critical to customer experience your architecture is irrelevant because you’re losing customers. The issue was the Layer8 decision to use inference when regex it’s a better fit.
But lol imagine making deep assumptions when you don’t even know what the product is.
To be honest, I’ve wasted entire evenings on regex. Fuck regex. We need a replacement that isn’t an llm but fixes that archaic shit. Make it human language
Machine learning classification is a good way to do this cheaply:
https://youtu.be/sOw40hTAowI
Yeah, that’s fair. If you have one problem and solve it with regex, now you have two problems.
Though in this case the monthly inference budget ran out causing a system outage. I was on call, so, getting a page off hours makes me dislike the llm approach even more haha
If being out of tokens causes an outage, you have architectural problems
On the contrary. If you architect to not fail when missing context critical to customer experience your architecture is irrelevant because you’re losing customers. The issue was the Layer8 decision to use inference when regex it’s a better fit.
But lol imagine making deep assumptions when you don’t even know what the product is.
Fail fast. Fail loud.