The Obtain: sycophantic LLMs, and the AI Hype Index

The Obtain: sycophantic LLMs, and the AI Hype Index


That is as we speak’s version of The Obtain, our weekday e-newsletter that gives a each day dose of what’s happening on the earth of know-how.

This benchmark used Reddit’s AITA to check how a lot AI fashions suck as much as us

Again in April, OpenAI introduced it was rolling again an replace to its GPT-4o mannequin that made ChatGPT’s responses to consumer queries too sycophantic.

An AI mannequin that acts in a very agreeable and flattering approach is extra than simply annoying. It may reinforce customers’ incorrect beliefs, mislead folks, and unfold misinformation that may be harmful—a specific threat when rising numbers of younger individuals are utilizing ChatGPT as a life advisor. And since sycophancy is troublesome to detect, it may well go unnoticed till a mannequin or replace has already been deployed.

A brand new benchmark known as Elephant that measures the sycophantic tendencies of main AI fashions may assist corporations keep away from these points sooner or later. However simply understanding when fashions are sycophantic isn’t sufficient; you want to have the ability to do one thing about it. And that’s trickier. Learn the complete story.

—Rhiannon Williams

The AI Hype Index

Separating AI actuality from hyped-up fiction isn’t at all times simple. That’s why we’ve created the AI Hype Index—a easy, at-a-glance abstract of all the pieces that you must know concerning the state of the business. Check out this month’s version of the index right here.

The must-reads

I’ve combed the web to search out you as we speak’s most enjoyable/essential/scary/fascinating tales about know-how.

1 Anduril is partnering with Meta to construct a sophisticated weapons system
EagleEye’s VR headsets will improve troopers’ listening to and imaginative and prescient. (WSJ $)
+ Palmer Luckey needs to show “warfighters into technomancers.” (TechCrunch)
+ Luckey and Mark Zuckerberg have buried the hatchet, then. (Insider $)
+ Palmer Luckey on the Pentagon’s way forward for combined actuality. (MIT Expertise Assessment)

2 A brand new Texas regulation requires app shops to confirm customers’ ages
It’s following in Utah’s footsteps, which handed an analogous invoice in March. (NYT $)
+ Apple has pushed again on the regulation. (CNN)

3 What occurs to DOGE now?
It has misplaced its chief and a high lieutenant inside the house of per week. (WSJ $)
+ Musk’s departure raises questions over how a lot energy it would wield with out him. (The Guardian)
+ DOGE’s tech takeover threatens the protection and stability of our vital knowledge. (MIT Expertise Assessment)

4 NASA’s ambitions of a 2027 moon touchdown are trying much less seemingly
It wants SpaceX’s Starship, which retains blowing up. (WP $)
+ Is there a viable different? (New Scientist $)

5 College students are utilizing AI to generate nude pictures of one another
It’s a grave and rising downside that nobody has an answer for. (404 Media)

6 Google AI Overviews doesn’t know what 12 months it’s
A 12 months after its introduction, the characteristic remains to be making apparent errors. (Wired $)
+ Google’s new AI-powered search isn’t match to deal with even primary queries. (NYT $)
+ The corporate is pushing AI into all the pieces. Will it repay? (Vox)
+ Why Google’s AI Overviews will get issues mistaken. (MIT Expertise Assessment)

7 Hugging Face has created two humanoid robots 🤖
The machines are open supply, that means anybody can construct software program for them. (TechCrunch)

8 A well-liked vibe coding app has a serious safety flaw
Regardless of being notified about it months in the past. (Semafor)
+ Any AI coding program catering to amateurs faces the identical problem. (The Data $)
+ What’s vibe coding, precisely? (MIT Expertise Assessment)

9 AI-generated movies have gotten far more reasonable
However not in terms of depicting gymnastics. (Ars Technica)

10 This digital tattoo measures your stress ranges
Contemplate it a temper ring on your face. (IEEE Spectrum)

Quote of the day

“I feel lastly we’re seeing Apple being dragged into the kid security enviornment kicking and screaming.”

—Sarah Gardner, CEO of kid security collective Warmth Initiative, tells the Washington Publish why Texas’ new app retailer regulation may sign a turning level for Apple.

Yet another factor

Home-flipping algorithms are coming to your neighborhood

When Michael Maxson discovered his dream house in Nevada, it was not owned by an individual however by a tech firm, Zillow. When he went to check out the property, nevertheless, he found it broken by an enormous water leak. Regardless of providing to deal with the pricey repairs himself, Maxson found that the home had already been offered to a different household, on the similar value he had supplied.

Throughout this time, Zillow misplaced greater than $420 million in three months of erratic home shopping for and unprofitable gross sales, main analysts to query whether or not the whole tech-driven mannequin is actually viable. For the remainder of us, a much bigger query stays: Does the arrival of Silicon Valley tech level to a greater future for housing or an business disruption to worry? Learn the complete story.

—Matthew Ponsford

We will nonetheless have good issues

A spot for consolation, enjoyable and distraction to brighten up your day. (Acquired any concepts? Drop me a line or skeet ’em at me.)

+ A 100-mile real-time ultramarathon online game that lasts wherever as much as 27 hours is about as enjoyable because it sounds.
+ Right here’s how edible glitter may assist save the standard water vole from extinction.
+ Cleansing large statues shouldn’t be for the faint-hearted ($)
+ When is a flute trainer not a flautist? When he’s a whistleblower.



Leave a Reply

Your email address will not be published. Required fields are marked *