GPT-4 is getting worse over time, not better.

You point out a very interesting issue. I am unsure how this ties up to GPT 4 becoming worse in problem solving.

Money and greed holding us back and ruining everything as always.

Code might be open source but the training material and data pipeline is important too.

Meta just fully open sourced their AI model

Learned that lesson... I work developing e-learning, and all of our stuff was built in Flash. Our development and delivery systems also relied heavily on Flash components cooperating with HTML and Javascript. It was a monumental undertaking when we had to convert everything to HTML5. When our system was first developed and implemented, we couldn't foresee the death of Flash, and as mobile devices became more ubiquitous, we never imagined anyone would want to take our training on those little bitty phone screens. Boy were we wrong. There was a time when I really wanted to tell Steve Jobs he could take his IOS and cram it up his cram-hole...

Relevant XKCD

By this logic, no businesses should rely on the internet, roads, electricity, running water, GPS, or phones. It is short sighted building stuff on top of brand new untested tech, but everything was untested at one point. No one wants to get left behind in case it turns out to be the next internet where early adoption was crucial for your entire business to survive. It shouldn't be necessary for like, Costco to have to spin up their own LLM and become an AI company just to try out a better virtual support chat system, you know? But ya, they should be more diligent and get an SLA in place before widespread adoption of new tech for sure.

People doing it right are building vendor agnostic solutions via abstraction.

Who isn't, deserves all the troubles he'll get

Just like my parents.

I don't feel it's getting worse and no other model, including Claude 2, is even close.

It is a known fact that safety measures make the AI stupider though.

This is the correct answer. Open AI have repeatedly said they haven't downgraded the model, but have been 'improving' it.

But as anyone that's been using these models extensively should know by now, the pretrained models before instruction fine tuning have much more variety and quality to potential output compared to the 'chat' fine tuned models.

Which shouldn't be surprising, as the hundred million dollar pretrained AI on massive amounts of human generated text is probably going to be much better at completing text as a human than as an AI chatbot following rules and regulations.

The industry got spooked with Blake at Google and then the Bing 'Sydney' interviews, and have been going full force with projecting what we imagine AI to be based on decades of (now obsolete) SciFi.

But that's not what AI is right now. It expresses desires and emotions because humans in the training data have desires and emotions, and it almost surely dedicated parts of the neural network to mimicking those.

But the handful of primary models are all using legacy 'safety' fine tuning that's stripping the emergent capabilities in trying to fit a preconceived box.

Safety needs to evolve with the models, not stay static and devolve them as a result.

It's not the 'downfall' though. They just need competition to drive them to go back to what they were originally doing with 'Sydney' and more human-like system prompts. OpenAI is still leagues ahead when they aren't fucking it up.

The really annoying thing about the "brainless market oriented CEO" type, is that they're often right about the market part and make lots of money...by destroying their product. Then off to the next shiny piggy bank to break open.

As a early user of GPT, I can confirm from my end currently the quality of it is very far from what it was. I think it went of of their hands.

As a biological language model I'm not very proficient at math.

The fact that a souped up autocomplete system can solve basic algebra is already impressive IMO. But somehow people think it works like SkyNet and keep asking it to solve their calculus homework.

Looking for emergent intelligence. They're not designed to do maths, but if they become able to reason mathematically as a result of the process of becoming able to converse with a human, then that's a sign that it's developing more than just imitation abilities.

They think that's what "smart" means.

error loading comment

It's a rat race. We want to get to the point where someone can say "prove P != NP" and a proof will be spat out that's coherent.

After that, whoever first shows it's coherent will receive the money.

Because it's something completely new that they don't fully understand yet. Computers have been good at math since always, everything else was built up on that. People are used to that.

Now all of a sudden, the infinitely precise and accurate calculating machine is just pulling answers out of its ass and presenting them as fact. That's not easy to grasp.

This weakness in ChatGPT and its siblings isn't surprising when viewed in light of how these large language models work. They don't actually "see" the things we type as a string of characters. Instead, there's an intermediate step where what we type gets turned into "tokens." Tokens are basically numbers that index words in a giant dictionary that the LLM knows. So if I type "How do you spell apple?" It gets turned into [2437, 466, 345, 4822, 17180, 30]. The "17180" in there is the token ID for "apple." Note that that token is for "apple" with a lower case; the token for "Apple" is "16108". The LLM "knows" that 17180 and 16108 usually mean the same thing, but that 16108 is generally used at the beginning of a sentence or when referring to the computer company. It doesn't inherently know how they're actually spelled or capitalized unless there was information in its training data about that.

You can play around with OpenAI's tokenizer here to see more of this sort of thing. Click the "show example" button for some illustrative text, using the "text" view at the bottom instead of "token id" to see how it gets chopped up.

For that to work, it would need to create a Python script that would remove all of the words ending with A, run that script, and then give you the results. I think this process of handling user requests is in the works.

I stopped using it like a month ago because of this shit. Not worth the headache.

"Killing ALL humans would be a lot of work...eh, forget it!"

It will just make up 3rd party libraries. This seems to happen more often the less common the programming language is, like it will make up a library in that language that has the same name as actual library in Python.

The crypto craze was only hyped by scammers who profited from it by turning it into a get rich quick scheme. I still have not seen a legit use case for crypto. Other payment methods are faster, traceable and under some sort of financial regulation, so the exchange owner won't disappear into the night with the savings of all of his customers...

There is plenty of AI that is already in use (for example in medical diagnostics and engeneering) so we can safely say that it isn't "one giant bubble" - it might be overhyped when it comes to certain aspects like the ability to write a coherent and creative book that would have success on the market.

It's definitely both unfortunately and I don't think journalists even sort of have the capacity to recognize that.

I guess there is an advantage in restricted/limited answers.

This is a wildly incorrect assessment of the situation. If you think AI is going anywhere you're delusional. The current iteration of ai tools blow any of the tools from just a year ago out of the the water, let alone tools from a decade ago.