Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lie

From Re-evaluating GPT-4’s bar exam performance (linked in the article):

First, although GPT-4’s UBE score nears the 90th percentile when examining approximate conversions from February administrations of the Illinois Bar Exam, these estimates are heavily skewed towards repeat test-takers who failed the July administration and score significantly lower than the general test-taking population.

Ohhh, that is sneaky!

AI being pushed by scam artists...Gee. Who could have guessed?

Though making an unreliable intern is amazing and was impossible 5 years ago...

the perils of hitting /all

AI = Actually Indians

I asked AI to summarize the article since it's paywalled. It didn't say anything about lying, should I trust it?

It sounds like ChatGPT is eligible for a degree in business!

It's almost like we can't make a machine conscious until we know what makes a human conscious, and it's obvious Emergentism is bullshit because making machines smarter doesn't make them conscious

Time to start listening to Roger Penrose's Orch-OR theory as the evidence piles up - https://pubs.acs.org/doi/10.1021/acs.jpcb.3c07936

sort by controversial did not disappoint :)

this is sooo silicon valley

this thread enters the pantheon of things I'll occasionally return to when I need a laugh, joining the likes of bash.org (rip) and other qdbs

I never had any doubt

I just assumed that train on an answer sheet could probably get you past most tests.

Thanks for archive! :::

This is the best summary I could come up with:

Consider this week’s announcement from OpenAI’s chief executive, Sam Altman, who promised he would unveil “new stuff” that “feels like magic to me.” But it was just a rather routine update that makes ChatGPT cheaper and faster.

That realization has real implications for the way we, our employers and our government should deal with Silicon Valley’s latest dazzling new, new thing.

has conquered many tasks that were previously unimaginable, such as successfully identifying images, writing complete coherent sentences and transcribing audio.

A re-examination by experimental materials chemists at the University of California, Santa Barbara, found “scant evidence for compounds that fulfill the trifecta of novelty, credibility and utility.”

I don’t think we’re in cryptocurrency territory, where the hype turned out to be a cover story for a number of illegal schemes that landed a few big names in prison.

Should we as a society be investing tens of billions of dollars, our precious electricity that could be used toward moving away from fossil fuels, and a generation of the brightest math and science minds on incremental improvements in mediocre email writing?

The original article contains 1,141 words, the summary contains 181 words. Saved 84%. I'm a bot and I'm open source!