Seems like a reasonable thing to bet a whole economy on. /s

I mean, back when it was a huge, poorly understood leap past previous technology it maybe was, but we know now that this is pretty much as good as it can do, just by scaling.

It's maaagic. So much so that sometimes we don't know wtf it's doing.

Well, there's multiple months in a year, but only one day per day, so that makes total sense somehow.

Wednesmillisecond, Wednesmicrosecond, ...

Wrapping a blackbox/legacy system would be a good reason.

Declare the old API in your new language, warts'n'all.

A lot of developers are not passionate, or not curious, or don't know that libraries exist, or all at once (aka stupid). I've seen this everywhere.

Maybe the more copilot is used, the more code on github is ai garbage, ths more copilot trains on github, the worse it gets.

Probably quite a lot of other things too, but I haven't used it so I don't know if it has got worse.

There is a reason there is sometimes a notable decrease in quality of the same AI model a while after it's released.

Hosters of the models (like OpenAI or Microsoft) may have switched to a quantized version of their model. Quantization is a common practice to increase power efficiency and make the model easier to run, by essentially rounding the weights of the model to a lower precision. This decreases VRAM and storage usage significantly, at the cost of a bit of quality, where higher quantization results in worse quality.

For example, the base model will likely be in FP16, full floating point precision. They may switch to a Q8 version, which nearly halves the size of the model, with about a 3-7% decrease in quality.

Novelty weared off

It's been reported the latest model has been optimized for reduced power use, and abilities got reduced somewhat in the streamlining.

Dont knows for these two but the enterprise version of copilot for office workers is so damn awefull its embarrassing.

It literally suggests to do stuff that it is incapable of doing.

I tried to get some doc as a flowchart using mermaid script, i know for a fact other llms have no problems with that:

After 3 attempts of it trying to code but resulting in an actual error it gives me,

Do you want me to provide this flowchart in visio format instead.

yes, if you can do that, it would be useful.

Generates a powerpoint about the topic.

that is a powerpoint, not a flowchart.

Tries to generate an image of a flowchart with not a single word spelled correctly and arrows going nowhere.

i didn’t ask to generate an image i need a flowchart

Sorry, if you want i can provide a flowchart in viso file format instead.

sure, give it another go

Generates a brand new bad PowerPoint.

I copy pasted the entire conversation to claude and it instantly gave me what i asked.

We'll fix it next Wednesminute