This transcript was created using speech recognition software. While it has been reviewed by human transcribers, it may contain errors. Please review the episode audio before quoting from this transcript and email transcripts@nytimes.com with any questions.

kevin roose

Casey, how’s your week?

casey newton

Oh, Kevin, this week has been humming along. I have a big drawer in my kitchen, and I closed it such that a muffin tin went vertical. And now I cannot open the drawer. And it is deep enough that I cannot access the muffin tin with a ruler. And so I may need to hire a handyman —

kevin roose

Wow.

casey newton

— to open a drawer at my house.

kevin roose

Wow.

casey newton

Yeah.

kevin roose

This always happens to me with the drawer under the oven where you keep the sheet pans.

casey newton

Ah, yes.

kevin roose

And the sheet pan sometimes gets stuck and lodged in a way that makes it impossible to open the drawer to fix the sheet pan.

casey newton

Exactly.

kevin roose

This happens to me like, every six months. It’s infuriating.

casey newton

I’m glad we’re talking about this because people don’t talk about this. But there are so many drawers in this country that just don’t open anymore.

kevin roose

It’s true.

casey newton

And what is the construction industry doing about it? I haven’t heard one thing.

kevin roose

Yeah. What is President Biden doing about this?

casey newton

Where is President Biden on this?

kevin roose

Come on.

casey newton

Come on. [THEME MUSIC]

kevin roose

I’m Kevin Roose, a tech columnist for “The New York Times.”

casey newton

I’m Casey Newton from Platformer.

kevin roose

And this is “Hard Fork.”

casey newton

This week on the show, indie AI companies are falling apart. We’ll tell you what’s happening. Then, listeners respond to last week’s segment about teens and social media. You’ll hear from actual young people on the subject. And finally, what’s the deal with Shrimp Jesus?

[THEME MUSIC]

kevin roose

Casey, it has been a messy, dramatic week in the world of AI.

casey newton

And that’s my favorite kind of week to have in AI, Kevin.

kevin roose

[LAUGHS]: Yes, we love a mess on this show. And we should talk about the mess because I think there’s some pretty interesting things going on. For the last basically year and a half, the story of the AI industry has just kind of been a bunch of graphs that are all going up and to the right. Everyone’s raising money. Everyone’s making money. All the models are getting better. And now I think we’re starting to see some cracks in the AI industry emerge.

casey newton

Yeah. The tide is going out, Kevin, and it’s scooping up some companies that we’ve talked about on this very podcast.

kevin roose

Yes. So this week, one AI company, Stability AI — this is the company that makes the Stable Diffusion image generator — announced that its CEO, Emad Mostaque — former “Hard Fork” guest — was resigning from the company. Mostaque said that his departure was because he wanted to spend more time pursuing decentralized AI. And this news caught a bunch of people by surprise. What did you make of it?

casey newton

Well, first of all, spending more time with decentralized AI is the new spending more time with your family. So families are out and decentralized AI is in. But look, this was a surprise, Kevin. Emad Mostaque was actually a guest on the third episode of “Hard Fork,” and he made a really strong impression on us. I think until Kara Swisher came on this show a few weeks ago, he was the single most confident person who’d ever been in the studio with us.

kevin roose

It’s true. He had all these stories about how he was going to use AI, and some of that sounds pretty silly in retrospect. But you have to remember, he was a very important figure in the world of generative AI. I went to this party back in late 2022 where Stability AI was announcing that they had just raised $101 million, a very large first major funding round.

And they were this buzzy, hot startup. And he was this buzzy, hot CEO. And they threw this huge party in the Exploratorium, and all these bigwigs from tech showed up. And it was just kind of — it felt like an arrival of sorts. And so now, less than two years later, he’s out and this company Stability AI appears to actually be quite unstable, which leads me to my first point about this, which is if you are going to name your company something that is going to look extremely funny in hindsight if it blows up, don’t do that.

Do not name your company Stability AI if every time the company has problems people are going to say something like, oh, they should have called it Instability AI. Do not do that. Don’t name your company Extremely Profitable or Totally Solvent or Definitely Not a Scam. Just go with some other name.

casey newton

That’s right, Kevin. It’d be like if you wanted to start an AI company devoted to doing all of its research in the open and call it OpenAI, and then move to a more closed model where you shared nothing. But who would do that?

kevin roose

That would never happen.

casey newton

That would never happen.

kevin roose

Be real.

casey newton

It would never happen.

kevin roose

So I’ve talked to some people sort of in and around this situation. People say, on some level what happened at Stability AI, what is happening at Stability AI, is a pretty standard story. This is a company that raised a bunch of money. But ever since then it seems to have been a pretty rocky road for the company, and maybe we should talk about some of the things that have happened to them.

casey newton

Yeah so I think the main thing that was happening at Stability AI that was public was that executives kept leaving the company. And I would shout out Bloomberg who, over the past year, has done a lot of great reporting on this subject. But at least five vice presidents left the company within the last year, including their head of audio, Ed Newton-Rex, who is no relation but has a great last name.

He resigned in protest of how AI companies, including Stability, have been treating copyrighted data. Stability was sued by Getty Images for copyright infringement in both the United States and the United Kingdom. And so that’s a lot of turmoil to have at a company in a single year.

kevin roose

Yeah. This company, I would say, has been on the Hot Mess Express for more than a year now. They’ve had lawsuits. One of the co-founders of the company sued Emad Mostaque, alleging that Emad basically cheated him out of his stake in the company. There have been all these departures that you talked about.

And investors in the company have not been happy with Emad Mostaque for months now, in part because the company was just losing a lot of money, and didn’t really seem to have a business model. Emad Mostaque also was accused of maybe fabricating or embellishing some of his credentials, claiming that he had degrees that he didn’t have and whatnot. And so it has just been a very messy last year for Stability AI. Now, I did also talk to Emad Mostaque last night.

casey newton

Oh, very good.

kevin roose

I’ll just read you some of the texts he sent me.

casey newton

Yeah.

kevin roose

Because I asked him why did why did you leave. And he said, “Being a CEO sucks. Elon was right. It is like looking into the abyss and chewing glass.”

He also said, quote, “I am not a normal person. It is impossible for me to do distributed instability. And I don’t like being a CEO.”

casey newton

Well, I mean, points for honesty, man.

kevin roose

Points for honesty. He also said — I asked him what his plans were in the future. He says, “I’m going to do Indonesian, and cancer models, and the Web3 protocol to tie it all together.”

casey newton

Yeah. That makes sense. And I don’t think we need any further explanation of what that means. But you know, Kevin, it strikes me that some people might be listening to this and thinking, look, this seems like a fun story but I never used Stable Diffusion. Was it really even that big of a deal? So, Kevin, tell us a little bit about what they were making and why, at the time, this seemed like a company that we would be mentioning in the same breath as an OpenAI or an Anthropic.

kevin roose

Yeah. Stable Diffusion was one of the first big image generation models, when DALL-E and Midjourney were first coming out. It was quite a big deal. And Stability AI had this vision that was different than some of the leading AI labs. They were going to create these tools, language models, image models, video models, and they were going to release them freely. And people would be able to build their own versions.

They were pioneers in the open-source AI community. And they have built some models that are quite widely used, and that have fans, and people seem to them. But they’ve also really struggled to build a business around that. Because if you’re giving your software away for free and you’re not charging people to use it, that really eats away at a potential revenue stream. And so I wonder if they ever had a plan to make money. Obviously, they had some revenue. It’s not like this company has never made money. But they were not making enough to satisfy their investors, and ultimately Emad Mostaque ends up leaving the company. They’ve replaced him with two co-CEOs.

And Emad, when I talked to him last night, seemed to think that the future of this company lies in the media models, that they were not going to compete with GPT-4 and Gemini and all the text-based models, but that there was actually a lot that you could do to make money when it comes to image generating models and movie generating models. What do you make of that?

casey newton

Well, so the case that I would make for Stability mattering is that, in 2022, I was able to get a Stable Diffusion model running on my M1 laptop and generating images just via text. Now, if you’ve done that using something like DALL-E on the web, that might not sound very impressive. And, in fact, the images I was getting then do not compare to the images you can get today.

But the fact that I could run the entire model on my laptop was one of those “whoa” moments. And a mod came on our podcast to talk about this a month before ChatGPT was even released. So sort of even before that sort of big bang moment for generative AI, they were working on this stuff. They were doing really cool things. So that’s why I was sort of invested in what was going to happen in this company.

And you’ve certainly shared enough reasons for why it didn’t work out for them. But I would say it raises even more than that. And I think number one, Kevin, is just cannot overstate how expensive it is to compete at the highest levels when you are competing against literally the richest companies in the world — in Google, and Meta, and Microsoft. And two, you can’t overestimate how hard it is just to get your hands on the infrastructure that you need to do this stuff, what often gets called “compute”— do you have access to the GPUs that are necessary to train these next models.

So I think just on those two axes alone, it’s super hard to run a company. And then you throw in the challenge of building a consumer business and a good product, and going out to market and — yeah, you can see why a company might not realize all of its ambitions.

kevin roose

Yeah. So I think, on some level, this is sort of a standard business story. Startups fail all the time, even ones that raise lots of money. And there are management and leadership changes. But I think it doesn’t help that they were early in a market that has since become very, very competitive with many of the largest companies in the world throwing billions of dollars into trying to train their own models. And it’s just very hard to compete with that, even if you do have a ton of venture capitalists in your corner.

casey newton

Yeah. All right. Well, so enough about Stability. Is there another big, interesting company out there that’s also going through it, Kevin?

kevin roose

Yeah. So last week Microsoft announced that it was hiring away two co-founders and a whole bunch of employees from Inflection. Inflection is an AI company that we’ve talked about a little bit on this show. They are best known for their chatbot which is called Pi, which was sort of marketed as a more personal chatbot. Some compared it to an almost an AI therapist. And they had raised a ton of money from venture capitalists to build out future versions of their AI models.

And they were run by these very experienced AI leaders, including Mustafa Suleyman, who was one of the co-founders of DeepMind. He is joining Microsoft as a bigwig in their AI division along with many of Inflection’s employees. This was a bombshell when it came out. Everyone I know who follows AI closely was talking about this, gossiping about this, trying to make sense of it. Because this was one of the highest flying AI startups just a year ago, and now they’re basically being dissolved and reconstituted within Microsoft.

And we should say, this is a bizarre deal, because this is not Microsoft acquiring Inflection. They are not buying the company outright. Instead, they are basically hiring the majority of the staff and striking a licensing deal. Microsoft, according to the information, is going to be paying Inflection $650 million for the rights to make Inflection’s models available through Microsoft’s Azure Cloud Service. And Inflection reportedly has also agreed to use that money to pay back its investors maybe the value of their original investment plus a little bit more. But this is a strange structure for one of these deals.

casey newton

Yeah, because not only are they getting paid out, but they also get to keep their equity in the company. So what is happening here? Well, essentially, Microsoft and Inflection are finding a way to pay off all of the investors in Inflection so nobody stamps their feet about all of this. Microsoft gets access to all of the top talent at Inflection, or probably most of it. Inflection gets to continue on as a kind of husk of itself, so no one can say that Microsoft actually acquired the company. But Microsoft gets all the upside anyway. And I have never seen a deal like this in Silicon Valley.

kevin roose

Yeah. And some people I’ve talked to have described this as a non-acquisition acquisition. Basically, it’s not easy to acquire a startup if you are one of the biggest tech companies. Regulators in the US and Europe have placed a lot of scrutiny on tech acquisitions, especially by the biggest tech companies. And so I think there is an assumption, if you are a big tech company looking to buy a smaller tech company, that you’re not going to be allowed to do that. Or at least it’s going to be challenging and regulators are going to challenge your right to do that.

And so by structuring the deal this way where it’s like, we’re not acquiring the company we’re just hiring away the leadership and many of the top talent and licensing their models, Microsoft gets to kind of dodge the regulatory scrutiny that it might be under if it tried to buy the company outright, which is very clever and something that I expect if you’re a regulator you’re looking at that and going like, ah, we didn’t think of that one.

casey newton

Yeah. It definitely feels like one of these “curses, foiled again” moments. Right? Because think about all of the really canny investments that Microsoft has been able to make in AI over the past few years. Most famously, they are hugely invested in OpenAI. When OpenAI started to fall apart last year, they basically swooped to the rescue and helped to ensure that Sam Altman returned to power and protect a very large investment in that company.

And, Kevin, as I know you remember, one of the ideas at the time was that if they couldn’t restore Sam Altman as CEO of OpenAI, they would basically put him in charge of AI at Microsoft. Well, fast forward to today, and now they still have that investment in OpenAI. And they just went to hire one of the biggest players in the space, one of the co-founders of DeepMind who founded Inflection. And now he’s going to run AI and Microsoft. So they have really hedged that bet.

And as if that weren’t enough, they’re also invested in Mistral, which is a very hot French AI startup that has just a huge pedigree of people that worked at all the big companies before it. So essentially, whoever wins in AI, Microsoft is just poised to reap a huge amount of the upside.

kevin roose

Yeah. Somebody I talked to this week described it as sort of Microsoft’s attempt to do a land grab, basically to spend a bunch of money to get all of the best AI people, and companies, and models under their roof, or if not officially under their roof, then at least to take stakes in them or to be their cloud provider or something, and that they’re using this moment when there is some weakness in the industry, when a lot of these companies are not making money yet, to just Hoover up all of the talent and all the resources that they can.

casey newton

Yeah. And so how do we feel about what Microsoft is up to here, Kevin?

kevin roose

I mean, I think it’s smart strategically for them. Obviously, they now know — after what happened at OpenAI last year — that there are downsides to being a minority investor in an AI company. You don’t control it. Microsoft now does have an observer seat on the OpenAI nonprofit board, but they are not really in control of that company. And that’s by design. They structured that deal in a way where they wouldn’t get majority control, presumably for some of these same antitrust and regulatory reasons.

But, yeah, if you’re them you do have to be looking at what happened at OpenAI last year and saying, well, we better have a plan B and a plan C if something happens to that investment. And so I think this move, hiring away Inflection, is a good way to create an insurance policy for themselves if something does happen at OpenAI.

But you wrote a newsletter this week that I thought was interesting that I want to talk about, which basically said that these two stories — the Stability AI leadership transition basically unraveling, and the Inflection quasi-aqui hire by Microsoft are part of a trend, that we’re seeing a sort of faltering of what you might call the middle class of AI — these companies that are not the Googles, the Microsofts, the Metas, that are one tier below that, that they’re really struggling. So explain what you wrote and what you meant by it.

casey newton

Yeah. Well, look, when generative AI first hit the scene there was a lot of optimism that this was going to be a moment in the tech industry akin to when the App Store first landed on the iPhone. And all of a sudden, you had a platform that could support all these new kinds of businesses, whether it was Uber, or Dropbox, or mobile gaming. All of a sudden, entrepreneurs just had access to this giant new global market, and could invent a bunch of new stuff.

And I think there was some optimism at the start of the generative AI moment that this was going to be similar. And so you had all kinds of investors pouring billions of dollars into startups, and lots of little teams leaving Google, and Meta, and other companies to start up their own businesses. And what I think we’ve started to see this month, Kevin, is the tide is starting to go out there.

It is starting to dawn on some of these companies that the giants in some cases really are too big to fight against. The giants are the ones who have the money. They have the computing power. They have all of the resources necessary to train those large frontier models. And they have the product shops and the distribution strategy to actually turn those into real businesses.

And I think you’ve seen companies like Stability and Inflection take a swing at doing all of that themselves, of trying to advance the state of the art on the tech side while also building a business, maybe building a big consumer business. And they are just not succeeding. So that, I think, is really notable and it makes me a little sad.

kevin roose

Why does it make you sad?

casey newton

Because I am somebody who wants there to be more smaller companies. I don’t think that the ideal state of the world is one where there are four or five tech giants. I think it’s one where there’s lots of medium-sized companies who are all competing, who are giving a lot of choice to consumers, who are not dominating the landscape. And whenever I see Microsoft wind up in a situation like this, or maybe Meta wind up in a situation like this, I just think, oh, well, so much for the chance that we had to unsettle the landscape. It looks like the new bosses are going to be the same as the old bosses.

kevin roose

Yeah, I think that’s right. And this moment in AI really does remind me a little bit of the moment maybe a decade ago where you had Uber, which was raising all this money and building this huge business. And then you had all of the kind of Uber wannabes, the Uber for X, Uber for laundry, Uber for dog walking, all these different sort of flavors of the same fundamental business model as Uber pioneered with the gig worker.

And you just had investors lining up to just shower these startups with cash, thinking maybe this will be the next Uber. Maybe this will be the thing that makes me 100 times my original investment. And most of those companies failed. And it wasn’t for lack of trying.

Just the sort of nature of the venture capital business is that you kind of spray and pray. You shower a bunch of different startups with money. Most of them fail. But the ones that succeed make enough for you that it pays back for all of the losers. So I think that’s really what’s happening here in AI. Investors are just kind of throwing money at anything that looks like it might have a pulse, that it might have a chance of getting that product market fit and making money. And I don’t think they’re going to be too dissuaded by some failures along the way. Because they pretty much expect it.

casey newton

I think that’s right. Now, I talked to somebody at one of these companies after my column this week. And they said to me, look, what you’re seeing actually could be a temporary phenomenon. Right now, the key limiting factor in the ability to start a great AI company is access to computing resources. And that is a temporary phenomenon.

Within, I don’t know, a year, a couple of years, if you want to start your AI company you’re going to be able to get your hands on more of the chips and the computing power that you need. And that is when you’re going to go and be able to build your great business. And so it may look like the giants are winning handily for the next year or so, but eventually you’re going to see the challengers rise up again.

Now, this argument may be a little self-serving. We’re going to have to check back on this in a couple of years to see if it’s true. But if you’re looking for some sliver of optimism among the great washing out of the indie AI companies, I leave that for you.

kevin roose

Yeah. I think there’s a little bit of optimism for smaller and medium-sized AI startups here in that the big money trucks have not really started to arrive yet. We’ve seen a ton of funding come into AI startups over the past year or two. Amazon, just this week, announced that it was investing another $2.75 billion into Anthropic. That’s on top of a bunch of money they had already invested. They’ve invested about $4 billion so far.

And my colleagues also reported at “The Times” this week that the Saudi Arabian sovereign wealth fund, the PIF, is considering raising a fund of $40 billion with the help of Andreessen Horowitz to invest in AI startups. $40 billion is a lot of money even in the world of AI. And so I think we are going to see another wave of institutional investors who are desperate to get in on the AI boom, just funding tons and tons of startups. That money is not all going to go to Microsoft, and Google, and Amazon.

casey newton

Well, I’m disappointed to hear that Saudi Arabia is investing in that and not journalism. It would be great to see $40 billion go to critical reporting of that regime, but maybe next time.

kevin roose

Maybe next time.

casey newton

Yeah.

kevin roose

All right. Well, we’ll keep tabs on the messes in AI. But I would say what you’re seeing — at least sort of the vibe that I’m picking up, is that people don’t think the party is over. They don’t think the party is ending. But they do think that there is sort of going to be a little bit of a washout, as some of these companies that raised a ton of money without very clear paths to profitability start getting tough questions from their investors about, well, what’s your plan to actually make back our money.

casey newton

That’s right. And in the meantime, if your AI company is falling apart we’d love to hear from you. Email hardfork@nytimes.com.

kevin roose

[LAUGHS]:

All right.

When we come back, we’ll hear from some of our listeners about our segment from last week with Jonathan Haidt about young people and smartphones.

[MUSIC PLAYING]

So, Casey, last week we talked with Jonathan Haidt, the social psychologist and author, about how smartphones and social media are affecting young people. And I think it’s safe to say it was one of our most polarizing segments we’ve ever aired on the show.

casey newton

Yeah. This is just one of those where everyone has a really deeply felt personal opinion. Some folks are convinced that social media really is the primary cause of the mental health crisis in young people. Others think it is a moral panic. And we really heard from all corners of that debate over the past week.

kevin roose

Yeah. We always love to hear from our listeners. And I just thought some of these responses were so thoughtful that we should actually just call up the people who wrote to us and bring you their perspectives. And we should also just say, part of why we are talking about this subject is not just because it’s something that people have strong feelings about, or that we’re getting older and we feel like the kids these days are using their phones too much. This is a really active debate right now, and a real inflection point in the history of the internet.

Just this week, Ron DeSantis, the governor of Florida, signed a new bill into law that would prohibit kids under 14 from creating social media accounts. There are other laws around the country that are making their way through state legislatures with similar things in them. This is a really, really important debate right now and an ongoing policy discussion. So I really want to hear from our listeners, from young people especially, about how they’re thinking about this question.

casey newton

So first up, we’re going to talk with Jordan Lucero. Jordan is a high school junior who sent us an email pushing back against some of the arguments he heard here last week. In his own words, he is addicted to his phone. But as a gay student, he is skeptical that taking away his smartphone in school would improve his own experience. So let’s bring Jordan in here.

[MUSIC PLAYING]

Jordan!

jordan lucero

Hi.

kevin roose

Jordan.

casey newton

How are you?

jordan lucero

It’s an honor to be here.

kevin roose

Hello.

casey newton

What’s going on?

jordan lucero

I just got out of class.

casey newton

And how was class today?

jordan lucero

It was good. We watched a movie, so we didn’t do anything.

casey newton

That’s what I like to hear about the American education system is why read a book or write anything when you could just enjoy the finest of what Hollywood has to offer. Well, hey, thanks for hopping on with us. Last week we interviewed Jonathan Haidt about his new book and we got some really great emails. And yours struck me.

Something I have talked about on the show is being worried that if we take social media away from kids it could make life harder for LGBT kids, in particular. Talk to us a little bit about that. Why don’t you like this idea of taking away phones in schools?

jordan lucero

The clearest thing — I tried to make it clear in the email that I was writing at 1:00 AM. I just reread it again and was like, oh, wow. I was pissed. If our teachers don’t trust us as people to manage our time, it completely changes the dynamic of the class, I think.

If we need to look up something that we didn’t get, like we missed a note or something, it helps us learn better. And if a teacher just takes that away, it just kind of rubs us the wrong way. And if I don’t have friends in the class, it’s just kind of miserable. It’s just the basic thing about around respect.

casey newton

Right. Well, so explain this a little bit. Because when I was in high school, if I didn’t have a friend in the class I would just sort of have to talk to whoever was around me to entertain myself. But you have a smartphone. So you told us that you actually just sort of text people who are not in your class during class. Tell us how that works.

jordan lucero

So I have so many group chats and I’m very dependent on them. Because a few weeks ago, when AT&T was out, I couldn’t text anyone for two hours and it was honestly — I had no idea I was that dependent on having constant access of just saying whatever I want. So it helps me just put my thoughts into words, and it just helps me feel better about what I do every day.

casey newton

Now, some people might hear that and say, I don’t know, Jordan. That sounds like that must be pretty distracting during class. And in some of your classes you just have to watch a movie, so it’s probably fine. But presumably there are ones where there are lectures, and homework, and stuff. So don’t you feel distracted by your smartphone all the time in class?

jordan lucero

Definitely. And I should be a lot better at managing it. But, mostly in my classes, most people are focused. And they’re using their phones to either reply to a quick text or they might be scrolling through. But they’re not doing it during class. They’re doing it in off time, so it’s not hurting anything. I wouldn’t say they’re missing anything at all.

And sometimes my phone helps me if. I have to look up something, I’m able to do that. And if we’re doing downtime and I see another teacher post an assignment, I’m going to get a start on that. I’m doing emails. I’m managing the other clubs that I’m in. I’m doing all this stuff. I’m not just scrolling through brain rotting. Just like how you guys use your phones to do things, we’re also using them as a tool to get things done.

casey newton

Well, Kevin mostly uses his phone to rot his brain. But I think it’s actually really inspiring how you use it. And I’m hoping he takes a couple notes from you.

kevin roose

Yes, teach me your ways. Jordan, do you — this is a little off topic. But do your group texts have names? Because one thing I have heard is that teenagers’ group chat names are totally unhinged.

jordan lucero

I never thought about it. I guess they’re all kind of insane. So we have Lisy Bees, because one time I misspelled Busy Bees, peach emoji, just that, Be Who You Are and WDSY Buzz.

kevin roose

Wait. What was the last one?

jordan lucero

WDSY Buzz.

casey newton

WDSY Buzz, Kevin. What, you don’t have that group chat yourself?

kevin roose

Wow. We have so much to learn.

casey newton

OK. Just a couple more questions. Jordan, one thing you have me wondering is I can understand why the internet is useful to you. Look up facts. All of that makes a lot of sense to me. When we were talking to Haidt, he tried to make a distinction between the internet and social media and said, look, internet access is fine. You want to get on your laptop and look stuff up, that’s fine. That’s not hurting anybody.

But it’s the social media of it all, where you’re expected to take pictures of yourself and there are counts underneath. And maybe it makes you feel self-conscious about your appearance. That is the really harmful thing. Do you have thoughts about kind of social media in particular and what it might be doing to your school?

jordan lucero

I think it’s really a net positive, but that’s the thing. He tried to distinct between the internet and social media, and they’re so now intertwined that you can’t really make that distinction anymore. If I want to get the news, I’m doing that on something like Threads or Twitter. That’s just one example of what’s so intertwined.

kevin roose

I’m curious. Again, there’s this big push to take away social media from kids, especially kids younger than 16. And I just wonder, as a gay student, how you think that would affect LGBT students.

jordan lucero

It would really harm the self-discovery process, I think, and finding a healthy community. Because I was on Twitter at age nine, which is absolutely insane. And it’s for the better. I’ve been lucky enough to have that experience where it’s a healthy experience.

casey newton

What were you doing on Twitter age nine, Jordan? Were you dunking on people?

jordan lucero

No. My Minecraft YouTubers, they’d follow me on Twitter. And I was just do anything.

casey newton

So you were tweeting at Minecraft YouTubers.

jordan lucero

Yeah.

casey newton

OK.

jordan lucero

But it helped me see a large variety of viewpoints about a lot of social topics that would just be on trending topics every day. And it taught me a lot more about the world and has made me a better person for it.

kevin roose

Yeah. So am I hearing you say that you feel like social media helped you come to a very positive self-understanding?

jordan lucero

Yeah, definitely.

kevin roose

And then my last question was just whether you’re doing anything at your high school to get the word out about “Hard Fork.”

jordan lucero

I’m going to post this on my Instagram story if you put it in the show.

kevin roose

Yes!

casey newton

Well, this is fantastic. Your email meant a lot to me. I really appreciated you taking the time not just to listen to the show, but to write in. And thank you for indulging our questions.

kevin roose

Thank you, Jordan. You’re inspiring me to come up with funnier and more unhinged names for my group chats. So for that alone —

casey newton

WDSY Buzz, baby.

kevin roose

— I’m grateful.

jordan lucero

Thank you, guys. [MUSIC PLAYING]

kevin roose

Next up, we’re going to talk to Maya Rael. Maya is not a teen, she’s 24, but she wrote in to talk to us about this issue. And she pointed out that the things that our conversation with Jonathan Haidt might have overlooked is how valuable social media can actually be for students, and in particular for student athletes.

She’s an athlete. She runs track and field. And in her experience, social media has been an important way for female athletes especially to get opportunities related to their athletic accomplishments.

[MUSIC PLAYING]

Hello.

casey newton

Maya. Where are you joining us from today?

maya rael

So I’m actually in California. I’m on the Wisconsin track team, and we’ve got a race in the Bay Area this week.

casey newton

So you’re in our neck of the woods.

maya rael

I am, yeah.

casey newton

Well, welcome to town. We hope you’re having a good time here. So Maya, what has been the value of social media in your life as a student athlete?

maya rael

I think it’s a really nice way for me to figure out what different accomplishments people are having, and just get news about who ran a fast time, what athletes I should be following, learn a lot about what’s going on in different people’s lives.

casey newton

And tell us what kind of athlete you are. What’s your sport?

maya rael

So I’m a runner. I run the mile 1,500 meter 5K.

casey newton

Awesome, so further than Kevin runs in a typical day is what it sounds like.

kevin roose

Hey, you don’t know that. Probably faster but maybe not further.

casey newton

[LAUGHS]:

I also think that part of what you’re bringing up here is that if you’re a really serious young athlete and you want to compete at the highest level, Division 1, want to go pro, you might actually be at a disadvantage if you’re not posting on social media even from the time that you may be a freshman in high school. Does that sound right to you?

maya rael

I think that’s absolutely correct. I don’t know how much the listeners know about NIL, but that’s name, image, and likeness. And it’s this alternative way that student athletes can harness the power of social media in order to get paid by businesses. It can be really important. There’s a lot of inequality in it. But this is an opportunity for a lot of female athletes, and male athletes as well, to just have more of a platform than they otherwise would have, get monetary gains from it, which they can’t get directly through their schools. And so this can be a pretty important financial aspect for certain athletes.

kevin roose

Yeah.

casey newton

Now, my guess is you would agree that for all of the benefits that you just raised, which I think are very real, social media can be a double-edged sword. And I wonder if you have seen the flip side of it in your life. Are there people in your life who you feel like social media has contributed to anxiety, or depression, or has just made people really upset over the years?

maya rael

Oh, absolutely. I think the body image side of it can be super damaging to people. I think that there’s also just these echo chambers and rabbit holes, where as soon as you pay attention to one thing it just feeds you more and more of that. And you can see the different ways that these algorithms definitely can influence you.

kevin roose

So, Maya, if you don’t think that we should heed Jonathan Haidt’s recommendations and keep smartphones away from kids until they’re in high school, and social media away from kids until they’re 16 or older — if you don’t think those are the solutions, what do you think should be done, if anything? Or do you think this is all basically just sort of a scary narrative that adults are telling about kids these days and we should just let the kids do their own thing?

maya rael

Oh, it’s tricky. I feel like I don’t have the answers to it. I think it’s really complicated. I guess I think about it a little bit like drinking, where the types of parents that restrict their kids, like, you can’t have a sip of alcohol, you have to stay in, you can’t do any of that — as soon as they graduate, as soon as they leave, like 18, what happens when they get to college is that they just go way overboard.

And I saw that so many times, that the people with the strict parents that didn’t give them any freedom, it just didn’t go well. And so I think that parents should be able to trust their kids. Maybe a 12-year-old shouldn’t be on social media. But a 15-year-old, I mean, that’s mostly a real human being at that point who can make their own decisions.

kevin roose

Yeah. Somebody else who wrote to us this week pointed out that we don’t let kids younger than 16 drive in most states. But you can get your temporary permit. There’s a sort of ramp for you to gradually learn how to drive and be given more and more responsibility. And then, when you’re 16, you get the whole thing. So maybe that’s what we need, is some kind of training wheels for people who are — they’re 14 or 15. Maybe they’re not ready for the full social media, but they can get their learner’s permit.

maya rael

Yeah, I like that idea lot. I think that totally makes sense.

casey newton

Maya, when did you create your Instagram account? How old were you?

maya rael

I was probably 11 or 12.

casey newton

OK. [LAUGHS]

And the reason I’m laughing. Is that know you’re not supposed to create an account till your 13. Would you say that Instagram threw up any roadblocks to be like, hey, sure seems like you’re 11?

maya rael

I knew that I had to be — what is it, 13 or something?

casey newton

Yeah.

maya rael

I just lied about my birthday. Literally everyone in my class did that.

casey newton

So your whole class is 11 and they’re on Instagram. And they’re posting photos and collecting likes in — I guess this would be what, the sixth grade?

maya rael

Yeah.

casey newton

Yeah, OK. I have to go lie down now.

I mean, Maya, here’s what I appreciate about this discussion. You’ve hit on this tension that is unresolvable for me, whereas I think it’s very clear that social media is hugely beneficial to some young people. And I think that it has very positive effects for them. And I also think that social media has really negative effects for some group of people. And I don’t know exactly how large the different groups of people are. But the area where I struggle is how do we design a policy or a set of policies or systems to ensure that we get the most good out of this for the most number of people while minimizing the harms. And I truly don’t know how to do that.

maya rael

I don’t have the answers to that either. I don’t know.

casey newton

Maya, that’s why we brought you on the show!

kevin roose

You’re supposed to give us all the answers.

maya rael

I mean, I set time limits for myself. And sometimes that works, but sometimes I just ignore them.

kevin roose

Right.

brendan kelley

But, yeah, I don’t know. It’s definitely tricky. But I think it’s like part of the world that we’re in right now, is that you can waste so much time on your phone or on your screen. And learning those skills of being able to not do that, whether you’re 15, or 18, or 40, I think is — it’s difficult no matter what.

casey newton

Well, it’s great to talk with you. If you do come up with a solution to this problem, we hope you’ll call back. But in the meantime, we hope that you have a great meet this week.

kevin roose

Yeah, have a good meet.

maya rael

Thank you so much. [MUSIC PLAYING]

casey newton

Next up, we’re going to talk to Jack Campbell. Jack is 20 years old. He’s in college. And he wrote to us with a really unsettling account of how frequently in his life he has learned that a friend or acquaintance had attempted suicide. He wrote to us quote, “I’ve not experienced childhood in any other decade. But from what I’m told, this was not the situation of 20 or even 30 years ago.”

Now, we should note, if you are in crisis, please call the Suicide and Crisis Lifeline at 988. Or you can contact the Crisis Text Line by texting TALK to 741741. To learn more about Jack’s experience we gave him a call.

Jack.

jack campbell

Hey, how you doing?

casey newton

Good. How are you?

jack campbell

Good. Sorry about my kind of barren dorm wall here.

casey newton

That’s OK. I actually find it more attractive than our studio, which was designed by professionals. Where do you go to school?

jack campbell

William and Mary —

casey newton

Oh, very cool.

jack campbell

— in Virginia.

casey newton

And this is your dorm room that we’re catching you in?

jack campbell

Yeah. Yeah. I’m a resident assistant, so this is my little office area. And then I’ve got the sleeping area here.

casey newton

What is being an RA — when I was in college, RAs mostly would give out condoms and tell people not to be so obvious about smoking weed in the dorms. What are your main duties?

jack campbell

Yeah. It has not changed. And sometimes I have to do a little pizza party occasionally.

casey newton

Well, first of all, thank you for writing into us. You sent us a really touching email. Maybe we could just start by having you talk about your reaction to when we talked to Jonathan Haidt last week. And what has your own experience been here?

jack campbell

Social media has been obviously a huge part of my life. And I’ve been on social media since I was 11, 12, and I’ve had an iPhone for forever. And it’s worked out great for me. I’m in college. And I’d like to think that I’m doing relatively well and all that. But the data that Jonathan Haidt kind of brings up about rates of depression, and rates of suicide and all that, those data points are my friends.

And it’s one of those things where his proposed solution of preventing people from creating accounts specifically, I don’t think that it’s going to be harmful if you’re just allowed to see — look but don’t touch until you’re 16. And I think it’s something that we really do have to do something about, clearly. It’s clearly a crisis.

kevin roose

Have you had friends or people who you’re close to who have had serious mental health struggles that you or they would attribute to use of social media?

jack campbell

Definitely. 100 percent, multiple. And I don’t think that can get away from the fact that so many of our interactions these days are mediated by these online platforms and these social media and stuff like that.

casey newton

Can you say a little bit more specifically about what aspects of social media do you think are contributing the most to depression and the desire to self-harm?

jack campbell

I think when you have timed photos, and Snap Map — you really want to know are kids having a party without you, you can see them on a map. They’re all hanging out together and I’m at home. And all you can do is just like, watch them drive around. And it’s very much the case that you get on Instagram and everyone else is at events. Even if you’re at some of these events, just the fact that there are events that you’re not at, you get into that kind of self-comparison mode, I think.

kevin roose

Jack, you mentioned that you’ve had social media basically your whole childhood or your whole adolescence, and that you feel like it’s worked out pretty well for you, even though you do know lots of people for whom it has not worked out well. Do you think there’s something different about the way that you use social media versus some of your friends or is it just kind of luck?

jack campbell

I think a lot of it is luck. I can’t deny the fact that I’m male and the statistics don’t look nearly as bad for us. But I don’t necessarily think that anything was really different about the way that I used social media in comparison to my friends.

kevin roose

Do you think the idea of not letting kids have social media accounts until they’re 16 would be popular among your friend group or do you think you’re more of an outlier?

jack campbell

I don’t think I’m that much of an outlier. I think Jonathan really hits the nail on the head, where if it’s kind of a collective action problem I think that that’s going to be a reasonably popular thing among people of my generation.

kevin roose

Jonathan Haidt said that he asked students how many of you wish TikTok were never invented, and most of the hands in the room go up. Would you be one of those hands?

jack campbell

Yeah. I go through periods where I’ll just delete TikTok because I need to do homework occasionally. Actually, my girlfriend, she really kind of struggles with this, is she tries to delete Instagram. She’s cut it down to Instagram Saturdays. And then every so often she’ll redownload it on a Tuesday, and it really sucks for her. She gets really distraught about it.

casey newton

I will say, I think this is such an important point. Because I talk to the folks over at Meta and Instagram a lot. And they push back really hard on me when we talk about this stuff. And they say, Casey, you’re falling prey to this moral panic. And this is just sort of comic books, and heavy metal, and video games all over again.

But when you talk to the kids who are reading the comic books, and listening to the heavy, metal and playing the video games, none of them were saying, take this away from me it’s too dangerous, or I have to set aside five days a week where I can’t even look at this thing. And I’m going to feel distraught in the days in between. There is some emotional level that this stuff really scares a lot of people. And it causes them a lot of grief. And that is something that I just think that the platforms are really refusing to reckon with.

jack campbell

I completely agree. I completely agree.

casey newton

Well, thank you so much for joining us. Really appreciate your perspective on all of this.

jack campbell

Thank you guys so much. Thank you, really. I really appreciate it.

kevin roose

Jack, thank you so much. And your mustache is so cool. It’s so cool.

jack campbell

It’s so funny. I called my dad this morning. I was like, should I shave it?

[MUSIC PLAYING]

kevin roose

We also got a lot of emails and social media posts from teachers, people who work in schools and see up close the effects that technology is having on young people every day. So we’re going to hop on a chat with Brendan Kelley. Brendan is a teacher. He’s been a teacher for more than 20 years. He currently works at a high school in Richardson, Texas, as a digital coach. And he wrote in with some observations about how he sees smartphones and social media affecting his students.

[MUSIC PLAYING]

Brendan, how are you?

brendan kelley

Hey. How’s it going?

casey newton

Good. Where are we catching you today?

brendan kelley

All right, so I am at school. I’m at JJ Pearce high school here in Richardson, Texas.

casey newton

And what do you teach?

brendan kelley

So I am a digital coach. And what I do is I actually have a small group of elite students who we will meet with teachers, and we’ll just help them with lesson plans, help them integrate technology into their lessons.

casey newton

Sounds very relevant to the subject we’re going to be discussing today. Brendan, after our episode last week you sent in this story over email that really unsettled me. You said that when you give a state test you have to keep the classroom quiet after the last student turns in their test. And before iPhones, you hated that because it was impossible to keep kids from talking to each other, even if they weren’t friends. But now that iPhones exist, there is apparently just an eerie silence that fills the room. So talk to us about classrooms before and after smartphones.

brendan kelley

Yeah, for sure. So that, specifically, that is absolutely right. And the deal is, is that before iPhones and before social media I would hate when that last test would come in. Because then that means that I would have to really, really struggle to keep these whispers down. And these are kids, like 30 kids who kind of know each other, kind of not. But it would be a real struggle to keep it just from erupting into just a whole bunch of talking.

However, now it’s super easy. And that’s not because they have their phones and they’re just absorbed in their phones. They still have their phones away in their backpacks. But the problem is, is that they — I don’t know if it’s a lack of motivation or it’s a lack of skills or what it is. But a lot of the times, they’ll just kind of sit there and wait for those phones. And so it’s really easy to keep them from talking to each other, because there’s not a lot of motivation for them to talk to each other in the first place.

kevin roose

So your school is not a school that bans students from carrying their phones on them during the day. Does your school have any rules about how students can use smart phones?

brendan kelley

It does, yeah. So the deal is, is that theoretically they are supposed to not have their phones out of their backpacks until lunch. And then they can use their phones during lunch, and then they have to put them away. Now, we do have some pilot schools who are doing a pouch program like your guest talked about before.

And at first I thought, well, that’s ridiculous. Because what they do is they’ll take a broken old phone, their brother’s phone, and then they’ll put that in the pouch. And then they’ll say, all right, let’s go ahead and seal it up. And then that’s fine, and then they’re still looking under the table.

casey newton

Yeah. Take my BlackBerry. You can lock that up.

kevin roose

Yeah.

brendan kelley

Yeah, right, exactly. What is this flip phone? So I did not believe in it at first. But I will say, I talked to a teacher who is in a school where they’re using that. And she says that the kids are not only doing it, but they’re kind of happy about doing it. And I think like your guest had talked about this before, as well, is that it leveled the playing field. Like, OK, everybody is doing it. Everybody is off of social media in my school. I guess I’ll do it too.

She actually gives them bonuses when she sees that the phones are in the pouches, the pouches are sealed and everything is great. And she says she gives a lot of bonuses.

kevin roose

Like, extra points for tests and stuff like that or cash?

brendan kelley

Oh, we’re teachers. Yeah, extra points.

kevin roose

I don’t know. Candy? I don’t know. There are lots of ways you can give a bonus.

casey newton

Do you think teachers are just passing out $100 bills over here?

brendan kelley

They’re giving us cash. We’re like, hey, can I borrow a — no.

casey newton

But, Brendan, this is really interesting. Because what you’re saying is that it seems, at least for some of the students in your district, they really are looking for an excuse to not have their phones around. And as long as no one else in their line of sight has their phone out, it makes it OK for them to focus on whatever they’re supposed to be paying attention to in class.

brendan kelley

Yeah, for sure. And I’ve been asking around like, kids, tell me your opinions on phones, social media. And it’s pretty much 100 percent that we understand that it’s — we understand that it’s bad. And we also use it for — I talked to one kiddo today who was saying that she uses it for anxiety, to calm her anxiety.

She floods her feed with — she follows all sorts of positive folks. And when she gets a little anxious, she takes out that phone, reads about it’s all going to be OK. This is a moment and this will pass. And then she puts it down and she’s good to go. It’s a little bit of self-medicating.

But that’s I think that that’s the key, is that we — anytime you’re fighting against human nature, you’re going to lose. You’re fighting an uphill battle. And so instead of just saying, all right, that’s it, we’re pretending that phones don’t exist, I think we need to teach intentionality behind it.

casey newton

Right.

kevin roose

I totally agree.

casey newton

I agree, as well. But I think what Jonathan Haidt would say is that it kind of doesn’t matter if you teach kids to use these phones intentionally just because social media, in particular, is just structured in a way to make you think about it constantly, to drag you into rabbit holes, to make you feel self-conscious about your appearance. And so even if you want to use it in a positive way, you might struggle to do that.

So, Brendan, I just wonder what your view has been overall of how students in your district are using social media. If you have a view, does it feel like a net positive, a net negative, more mixed? What is your sense of how it’s playing out?

brendan kelley

I feel like it’s really the old story. I mean, I feel like I’ve been talking to a lot of kids and I’ve heard the same thing now that I’ve heard five years ago, is that I know that I shouldn’t be on this phone for this long. I have talked with kids who over the summer had 18 hours of TikTok daily.

kevin roose

Oh, god.

brendan kelley

That’s too much. And she was like, but that’s OK. Now it’s just down to 10. And so that’s the thing, is that we understand that there’s — that it’s addictive. And it is, for sure. I mean, Dr. Haidt said that if you ask students do you wish it never was created they say yes. And I’m definitely in that camp, as well. But it is. It is created. And I think, yeah, it would be great if we could do things to rein it in, for sure. But we also need to teach the ability to — the ability to put it down. I think that’s the big thing, is the ability to disengage.

kevin roose

Yeah.

casey newton

Absolutely.

kevin roose

Well, that’s all I have, Mr. Kelley. Thank you so much for your time.

casey newton

Yeah.

kevin roose

Yeah. If you wouldn’t mind being my digital coach —

brendan kelley

Any time.

kevin roose

— there there are moments where I would need one.

brendan kelley

Hey, I have reached peak digital coach talking to you guys. I can’t even believe it. Thank you guys so much.

kevin roose

I’m having this problem with my printer. Maybe you could —

brendan kelley

Oh, don’t even talk — don’t even start, please. We’ve had too many problems today. You don’t even know. You’ve just triggered me and I need to go take a nap.

casey newton

Brendan, I’m going to email you privately to tell you what you should charge Kevin for digital coaching. Because I know what he can afford.

kevin roose

[LAUGHS]:

[MUSIC PLAYING]

casey newton

When we come back, the powerful new religious figure who is dominating the Facebook feed.

kevin roose

All right, Casey, today I really wanted to finish the episode by talking about Shrimp Jesus.

casey newton

Oh, finally we’re talking about it.

kevin roose

[LAUGHS]:: So for those of you who are not brain poisoned like us, Shrimp Jesus refers to an image that went viral on Facebook recently that has kind of become a stand in for lots of people’s concerns about what AI-generated content is going to do to our online media ecosystem. Shrimp Jesus, just to describe the picture a little bit, it is an image or maybe a series of images. There’s sort of a theme of Shrimp Jesus’s.

casey newton

The plural is actually Shrimps Jesus.

kevin roose

Shrimps Jesus. [LAUGHS]

casey newton

Facebook is flooded with Shrimps Jesus.

kevin roose

Yes. And it is pretty much what it sounds like. It is a figure of Jesus Christ, who appears to be floating in water and is made out of lots of shrimp.

casey newton

Yeah. I mean, Kevin, we all remember where we were when we first saw Pope in a puffer coat. Right?

kevin roose

Yes. Oh, of course.

casey newton

This was one of the first AI-generated images to really make the world stand still, a picture of Pope Francis sort of in what appeared to be this very cool, very fashiony white puffy winter coat. But we’re now in a moment where it seems like every day, when people are opening up Facebook, they’re seeing some new uncanny thing, some new eerie thing. And it all really crystallized with Shrimp Jesus.

kevin roose

Yeah. So this was first reported on back in December by 404 Media. They highlighted the fact that a bunch of AI-generated images had gone viral on Facebook — lots of men kneeling next to very realistic wood carvings of dogs, for some reason.

casey newton

Beautiful.

kevin roose

These images were being shared alongside captions like, “I made this with my own hands.” And basically, people would just leave comments saying like, wow, that looks great.

casey newton

Yeah.

kevin roose

In fact, a post with an AI-generated image was one of the 20 most viewed pieces of content on all of Facebook in the third quarter of last year. It got 40 million views. So this month two researchers, Renee DiResta and Josh Goldstein, from Stanford and Georgetown respectively, put out a report that used Shrimp Jesus as its lead image. But the report is really interesting, and I thought we should talk about it. It’s called “How Spammers, Scammers, and Creators Leverage AI-Generated Images on Facebook for Audience Growth.” This is a preprint that they put out, and basically they are exploring the ecosystem of AI-generated images on Facebook and why some of these pages are posting these, to my eye, very obviously fake images.

casey newton

Well, and what did they find?

kevin roose

So according to them, they looked at 120 Facebook pages that posted at least 50 AI-generated images each. The pages had an average follower count of about 129,000. The pages are called things like “Interesting Planet” or “Love Baby.” And a lot of them are of like kids standing next to very impressive creations, like a huge decorative cake or a sandcastle that’s more realistic than any sandcastle that has ever been created. And I guess one question that I had about this is do the people who are sharing these things actually understand that they are not real.

casey newton

And what do you think the answer to that is?

kevin roose

I think there’s probably a lot of gullible people out there who just see these things and think, oh, this is real. How impressive is that? I also think there are people who probably don’t care. I’ve had this experience recently that Facebook has decided that I’m really into cabin core — these beautiful images of cabins in the mountains, very cozy and beautiful. And a ton of these are just AI-generated, very obviously if you look even a little bit closely at them.

And so now, whenever I see an image of a cabin or something beautiful on Facebook, my first thought is always like, is that real? Does that beautiful cabin actually exist? And a lot of the times, the answer is no. It doesn’t. It’s just being created for the purpose of getting attention and engagement.

casey newton

You’re telling me that they’re not just posting these images to try to grow awareness of the teachings of Shrimp Jesus?

kevin roose

Maybe some of them are, but some of them are also linking to e-commerce stores and pretty low quality news sites. These are basically just sort of the thing that they will dangle in front of people to get them to or subscribe to a page so that they can feed them stuff that’s going to make them money or benefit them in some way.

casey newton

So in other words, Kevin, it sounds like this is the latest iteration of a very old technique, which is try to come up with the most universally appealing images imaginable. Baby animals has often been a very popular one. And you grow the following, and then once you get it to a certain size you sell the page. And then people just start raining spam on these poor, unsuspecting baby animal lovers.

kevin roose

Right. So Meta does have policies that are pretty new about AI-generated media. But Facebook does not appear to be enforcing these rules very consistently. And they’re basically saying, well, look. We’re working on tools that can automatically detect AI-generated content. But this research project at least suggests that they’re not having total success.

casey newton

Yes. I think that is what the study suggests. I think there’s sort of two avenues to pursue here. One is like, yes, it is obviously bad for scammers to come along and grow these pages and flip them. And I’m sure that Meta will try to fight back against that as best as it can, although at the end of the day, there’s never going to be anything that stops somebody from creating a page that gets popular. That’s kind of what the whole site is set up to do. Right?

The trickier question, I think, is how do we feel about these images in general. How do we think about them as items in the feed? What are they doing to our general sense of reality? So do you have an emotional reaction to the flood of these images disconnected from the kind of scam of it all?

kevin roose

I do. And, in part, that’s because we now have seen reports that a lot of the people who are being served these images are older people, are seniors, are people who maybe aren’t the most sophisticated and discerning consumers of online media, and who may actually be thinking that these things are real.

And, look, the stakes are not existential here. We’re not talking about political misinformation. But I think this is a good proof of concept for how something like political misinformation could take off. I saw on Facebook recently someone posted this AI-generated image of basically this underground city underneath the Capitol. Have you seen this one?

casey newton

Yes.

kevin roose

So this is clearly fake. There is no underground city beneath the Capitol. But this is the kind of thing that conspiracy theorists have been talking about for years. There are these secret tunnels that allow members of Congress to traffic children, and they’re located under the National Mall, things like that.

And, look, you could look at something like Shrimp Jesus and say, wow. This is really funny and kind of harmless that these pages are duping people with these AI-generated images. But it’s a very short hop from where we are now with Shrimp Jesus to something that actually does catch fire, and does mislead a lot of people about something important that is maybe related to the election.

casey newton

That’s kind of where I come down on it, is that bit by bit people are learning not to trust their eyes anymore. And this is really kind of the place where it starts. You were just browsing your Facebook feed. You thought you saw a cool dude who whittled a hyperrealistic version of his dog. And you thought, that’s the coolest thing I’ve ever seen, and you shared it. And then, eventually, someone pops up in your comments and says, hey, dummy, that’s a fake.

And that’s only going to have to happen to you a few times before it doesn’t matter what you see in your feed. You are going to stop believing your own eyes. And so while I don’t want to overdramatize this, because this is mostly just a funny story, there is a double edge to this. And it is going to bite us, I think.

kevin roose

Yeah. I also think this is just a pretty predictable result of two things that have happened. One is the just absolute proliferation of these tools for generating fake images, and the fact that it’s very hard to use technology to detect these images. It’s not impossible in some cases. And Facebook and Meta have said that they’re building tools that will allow them to automatically detect this stuff. But it’s never going to be perfect. They’re never going to be able to catch everything. And at least so far, it doesn’t seem like they’re trying all that hard.

But I also think this is what happens when you deprioritize news on a platform. We know we’ve talked about on this show that Facebook for years now has been saying we’re going to show people less news in their Facebook feeds. Because they don’t want the blowback. They don’t feel like they can responsibly serve that content to people. They don’t think that their users want as much news in their feeds.

But when you actually deprioritize news, in my opinion what happens is that you don’t actually get less news. You just get more Shrimp Jesus’s. You get more people who are sharing dubious things that maybe look like news. Maybe they have a link to some site that maybe looks like a news site. People are still interested in what’s going on in the world. But if you deprioritize news from trusted publishers, you will just get a lot more of this schlocky AI-generated garbage.

casey newton

I think that’s right, Kevin. And that’s why I’m actually excited to announce my new venture, which I think is going to get around this problem and kill two birds with one stone.

kevin roose

What’s your new venture?

casey newton

Starting later next month, I will be debuting on Facebook the “Shrimp Jesus Gazette,” a sort of newsy diary of all things Shrimp Jesus. And my hope is that that will entertain Boomers for days to come, while also feeding them a little bit of their vegetables and we’ll give them the top headlines from around the world. So wish me luck as I launch the “Shrimp Jesus Gazette” on Facebook.

kevin roose

I love it. Do you think this is actually a risk for Meta at all? Their whole reason for existence for years has been to tell you what is actually happening with your friends, with your neighbors, with people in your community, and with the world at large. If it just starts being sort of a dumping ground for all of these AI-generated images and these sort of scammy and spammy attempts to use engagement bait to get people’s attention and redirect them somewhere else, do you think, ultimately, people will be turned off their products as a whole?

casey newton

I mean, it doesn’t have to be. Right? Because, as you note, they have policies that are designed to flag this stuff. And I think as long as people know that what they’re looking at is AI-generated it’s fine. In fact, I follow an account on Instagram that just makes these wonderful creations out of AI. And I love looking at it.

It’s really weird stuff. It’s, I would say, a bit more sophisticated than Shrimp Jesus. But there’s nothing wrong with just being creative online. I think where you get into trouble is when you don’t enforce the policies you have and it starts to kind of erode that sense of reality. But, look, if you’re asking me do I think that there should be actual high quality news in news feeds on Facebook and elsewhere, yes, I always have.

kevin roose

Yeah. So we’ll keep tabs on Shrimp Jesus and other AI-generated images.

casey newton

By the way, do you know what you call Shrimp Jesus and his followers?

kevin roose

What’s that?

casey newton

A Shrimp Cocktail.

kevin roose

[LAUGHS]: Come on.

[MUSIC PLAYING]

casey newton

Before we go, a quick update to an interview we did here a few weeks ago with the great “New York Times” reporter Kashmir Hill, about the car companies who are gathering all sorts of information about how you were driving your car, your breaking, your mileage, the dates and time, and selling that to data brokers who then sold something called a risk profile of individual drivers to insurance companies. And then, of course, their insurance rates went up. Well, following that story, General Motors says it is no longer doing that, so no more GM snitch mobiles on the road. Well done, Kash.

“Hard Fork” is produced by Rachel Cohen and Davis Land. We’re edited by Jen Poyant. We’re fact checked by Caitlin Love. Today’s show was engineered by Chris Wood. Original music by Marion Lozano, Rowan Niemisto, and Dan Powell. Our audience editor is Nell Gallogly. Video production by Ryan Manning and Dylan Bergeson.

You can check out the whole show and little extras that are fun on youtube.com/HardFork. Special thanks to Paula Szuchman, Pui Wing Tam, Kate LoPresti, and Jeffrey Miranda. You can email us at hardfork@nytimes.com. What’s your favorite version of Shrimp Jesus?

[MUSIC PLAYING]

Share.
Leave A Reply

© 2024 Daily News Hype. Designed by The Contentify.
Exit mobile version