ReportWire

Tag: Deepfakes

  • Brits were exposed to 95 billion scam adverts last year – Tech Digest

    [ad_1]

    Share


    Social media platforms are hosting a record wave of fraudulent activity, with new research revealing that British users were exposed to 95 billion scam adverts last year.

    The UK has emerged as one of the most profitable targets for digital criminals globally, with the average social media user now seeing nearly 200 scam ads every month.

    This saturation has led to significant financial damage, as victims lose an average of £1,258 per successful scam – the second-highest figure in Europe, trailling only Ireland’s average of £1,292.

    The volume of scams is not just a burden for consumers but a massive revenue stream for the platforms themselves. It is estimated that social media giants generated £430 million in revenue during 2025 specifically from ads targeting British consumers with scams.

    Experts now calculate that approximately one in every ten adverts shown to UK users is a fraudulent attempt to extract money or data.

    The methods used by scammers are becoming increasingly sophisticated and difficult to detect too. Beyond traditional fake retail ads, there has been a sharp rise in the use of high-quality artificial intelligence to create deepfakes.

    These involve impersonating celebrities or business leaders to endorse fake investment schemes that appear legitimate to the untrained eye. There is also a growing trend of official impersonation, with a rising number of scams purporting to be from government departments, which makes them significantly harder for the public to identify.

    High-demand events have also become a primary target for fraudsters. Recent research from Lloyds Bank showed that 90% of ticket scams for major events, such as the Oasis tour and Glastonbury, originated on Meta-owned platforms like Facebook and Instagram.

    While some tech firms claim to be tackling the issue – Meta recently stated it had removed 134 million scam ads – leaked documents suggest some companies may be using keywords to hide these ads from regulators rather than removing them entirely.

    Financial experts warn that the problem is set to worsen in the coming years. Projections suggest scam ad impressions could reach 137 billion per year in the UK by 2030 as AI technology makes it easier to automate and scale fraud.

    For latest tech stories go to TechDigest.tv


    Discover more from Tech Digest

    Subscribe to get the latest posts sent to your email.

    [ad_2]

    Chris Price

    Source link

  • Over 4 in 5 AI fraud cases in 2025 involved deepfakes, research claims – Tech Digest

    [ad_1]

    Share

    Image: Cybernews

    Deepfakes have emerged as the primary weapon for artificial intelligence-driven crime, accounting for over four in five AI fraud cases recorded last year.

    According to a new report from Cybernews, which analyzed data from the AI Incident Database, 81% of all AI-related fraud incidents in 2025 involved some form of synthetic impersonation.

    The research highlights a significant shift in the cybercrime landscape. Of the 346 total AI incidents documented in 2025, 179 involved deepfakes – ranging from voice cloning to hyper-realistic video manipulation.

    Within the specific category of fraud, 107 out of 132 recorded cases were driven by deepfake technology. These scams have proven exceptionally effective due to their ability to exploit human trust through highly targeted and realistic impersonations of family members, executives, and celebrities.

    Exploit of Trust

    The human cost of these digital deceptions is staggering. The Cybernews analysis pointed to several high-profile cases that illustrate the reach of the technology:

    • Romance Scams: A British widow lost £500,000 after falling victim to a scammer using a deepfake of actor Jason Momoa.

    • Family Emergencies: In Florida, a woman was defrauded of $15,000 after hearing an AI-generated clone of her daughter’s voice pleading for financial help.

    • Investment Fraud: High-net-worth individuals and private citizens alike have been targeted by fabricated “live” videos of CEOs such as Elon Musk, leading to individual losses as high as $45,000.


    The Growing Threat of Unsafe Content

    While financial fraud dominated the statistics, the report also warned of “violent and unsafe content” generated by popular AI tools. Though accounting for only 37 cases, these incidents often had more severe, non-financial consequences.

    The research found that some Large Language Models (LLMs) could still be manipulated into providing dangerous self-harm advice or detailed instructions for committing violent crimes when specific guardrails were bypassed.

    Specific AI tools were named in some reports, with ChatGPT appearing most frequently (35 cases), followed by Grok, Claude, and Gemini. However, the Cybernews team noted that the actual figures are likely higher, as many incidents do not specify the exact software used.

    The findings serve as a stark warning for 2026. As AI tools become more accessible, the barrier to entry for sophisticated fraud has collapsed, making verification and scepticism the most vital defences for the public.

    For more information, here’s the full research: https://cybernews.com/ai-news/346-ai-incidents-in-2025-from-deepfakes-and-fraud-to-dangerous-advice/


    For latest tech stories go to TechDigest.tv


    Discover more from Tech Digest

    Subscribe to get the latest posts sent to your email.

    [ad_2]

    Chris Price

    Source link

  • Grok still allowing deepfakes of women in bikinis, Starlink now cheaper than BT broadband – Tech Digest

    [ad_1]

    Share


    X has continued to allow users to post highly sexualised videos of women in bikinis generated by its AI tool Grok, despite the company’s claim to have cracked down on misuse. The Guardian was able to create short videos of people stripping to bikinis from photographs of fully clothed, real women. It was also possible to post this adult content on to X’s public platform without any sign of it being moderated, meaning the clip could be viewed within seconds by anyone with an account. It appeared to offer a straightforward workaround to restrictions announced by Elon Musk’s social network this week. The Guardian 

    Elon Musk’s Starlink is now offering cheaper broadband than BT after rolling out price cuts in the UK. The billionaire’s satellite broadband company has launched a high-speed internet service for just £35 per month in some areas, down from its previous entry-level price of £55.  That compares to £40 for BT’s equivalent package, while Virgin Media O2 (VMO2) is priced at £36. Even when the £94 installation fees are included, Starlink’s new discounted package is still less expensive than BT’s over a 24-month contract. Telegraph 

    Amid continued trade and geopolitical volatility between Europe and the US, Amazon Web Services is making its European Sovereign Cloud generally available today and plans to expand so-called Local Zones. Amazon says the cloud is “entirely located within the EU, and physically and logically separate from other AWS Regions.” It will initially offer 90 services from compute to database, networking, security, storage, and AI. The Register

    A new report on Apple’s partnership with Google to have Gemini power the new Siri appears to confirm speculation that the iPhone maker is paying around a billion dollars a year for the deal. It also claims that ChatGPT provider OpenAI made a conscious decision to decline the opportunity to provide the intelligence behind Siri … A Financial Times report says that the deal will be ‘structured in the form of a cloud computing contract, which could lead to Apple paying several billion dollars to Google over time, a person familiar with the agreement told the FT.’ 9to5Mac


    Launched officially in January 2026 in Verbier, the wonderfully-named E-Skimo system represents a significant shift in alpine mobility. Just as the e-bike expanded the reach of casual cyclists, these motorised skis are designed to assist the normal rhythm and motion of ski touring, allowing users to ascend faster and with significantly less physical strain. On a technical level, E-Skimo consists of a pair of high-performance free-ride skis, each equipped with a front-mounted lithium battery and a rear-mounted motor delivering up to 850W of power. ShinyShiny

    The BBC has struck a landmark deal to make shows for YouTube as it grapples with an exodus of viewers to the streaming service. The public service broadcaster will begin making programmes specifically for YouTube under the terms of a deal that could be announced as early as next week, the Financial Times reported. These programmes, which would primarily be aimed at younger viewers, would subsequently be shown on the corporation’s own streaming platforms iPlayer and Sounds. Telegraph 


    For latest tech stories go to TechDigest.tv


    Discover more from Tech Digest

    Subscribe to get the latest posts sent to your email.

    [ad_2]

    Chris Price

    Source link

  • A GOP Account Posted a Chuck Schumer Deepfake With a Real Schumer Quote

    [ad_1]

    Is an AI-generated video of a politician technically a deepfake if the words they’re saying are their own?

    By any reasonable definition, yes, and the National Republican Senatorial Committee published just such a deepfake of Democratic Minority Leader Chuck Schumer on its X account on Friday:

    The ad, which is labeled as AI-generated, depicts Schumer saying six words he did actually say: “Every day gets better for us,” but the quote originally comes from a text interview with Schumer published in Punchbowl News. After saying these words in the video, Schumer’s digital mouth peels into a nightmare grin like Jim Carrey in The Grinch.

    “These are Chuck Schumer’s own words,” NRSC communications director Joanna Rodriguez told The Associated Press, adding that “video is a way for voters to see and hear it themselves.” Reading the quote aloud in a scary voice and putting it onscreen in red text is a more traditional way of doing this in political ads.

    The video is vaguely cinematic, with heavy bokeh. Savvy internet content consumers probably would not mistake this for an off-the-cuff-remark taken from a TV news clip, or a smartphone video taken by a congressional reporter. It looks more like a stock photo of Schumer hastily animated with a quick-and-dirty online tool like Google’s Veo 3.

    That’s not to say there’s nothing to worry about. According to a famous genre of viral video, Facebook users in their 60s and older fall for much less plausible AI trickery all the time.

    The X rules state “You may not deceptively share synthetic or manipulated media that are likely to cause harm.” The “likely to cause harm” phrasing leaves room for interpretation, particularly since the video has only received 364 reposts and 414 likes on X at the time this was published.

    In the original interview, Schumer is essentially saying his party’s messaging around the government shutdown—an attempt to focus the public’s attention on healthcare—is going well. He even reiterates this in slightly longer form: “But every day we’re getting better and better as the message sinks in more and more deeply.”

    We reached out to Senator Schumer for comment, and will update if we hear back.

    [ad_2]

    Mike Pearl

    Source link

  • Senate Republicans deepfaked Chuck Schumer, and X hasn’t taken it down  | TechCrunch

    [ad_1]

    Senate Republicans shared a deepfake video of Chuck Schumer, the Senate minority leader, designed to make it seem like Democrats are celebrating the ongoing government shutdown, which has lasted 16 days.  

    In the deepfake, an AI-generated Schumer repeats the phrase “every day gets better for us,” an actual quote taken out of context from a Punchbowl News article. In the original story, Schumer discussed the Democrats’ healthcare-focused shutdown strategy, and said they were not going to back away from Republicans’ playbook of threats and “bambooz[ling].” 

    The shutdown is happening because Democrats and Republicans cannot agree to pass a bill funding government through October and beyond. Democrats are trying to hold on to tax credits that would make health insurance cheaper for millions of Americans, secure a reversal to Trump’s Medicaid cuts, and block cuts to government health agencies.

    The video was posted Friday on the Senate Republicans’ X account. According to X’s policies, the platform prohibits “deceptively shar[ing] synthetic or manipulated media that are likely to cause harm.” Harmful content includes media that could “mislead people” or “cause significant confusion on public issues.” 

    Enforcement actions include removing content, labeling warnings, or reducing visibility. X has not, as of the time of this writing, removed the deepfake or added a warning label — though the video does include a watermark denoting its AI origins. 

    The Schumer video is not the first time X has allowed deepfakes of politicians to remain on the platform. In late 2024, X owner Elon Musk shared a manipulated video of former vice president Kamala Harris in the lead-up to the election, sparking debate about misleading voters.  

    TechCrunch has reached out to X for comment.

    Techcrunch event

    San Francisco
    |
    October 27-29, 2025

    Up to 28 states have enacted laws prohibiting deepfakes of political figures, specifically around campaigns and elections, though most don’t outright ban them if they have clear disclosures. California, Minnesota, and Texas have banned deepfakes intended to influence elections, deceive voters, or harm candidates.

    The latest post comes weeks after President Donald Trump posted deepfakes on Truth Social depicting Schumer and Hakeem Jeffries, the House minority leader, making false statements about immigration and voter fraud. 

    Responding to criticism of the lack of honesty and ethics, Joanna Rodriguez, the National Republican Senatorial Committee communications director, said: “AI is here and not going anywhere. Adapt & win or pearl clutch & lose.” 

    [ad_2]

    Rebecca Bellan

    Source link

  • You can’t libel the dead. But that doesn’t mean you should deepfake them. | TechCrunch

    [ad_1]

    Zelda Williams, daughter of the late actor Robin Williams, has a poignant message for her father’s fans.

    “Please, just stop sending me AI videos of Dad. Stop believing I wanna see it or that I’ll understand. I don’t and I won’t,” she wrote in a post on her Instagram story on Monday. “If you’ve got any decency, just stop doing this to him and to me, to everyone even, full stop. It’s dumb, it’s a waste of time and energy, and believe me, it’s NOT what he’d want.”

    It’s probably not a coincidence that Williams was moved to post this just days after the release of OpenAI’s Sora 2 video model and Sora social app, which gives users the power to generate highly realistic deepfakes of themselves, their friends, and certain cartoon characters.

    That also includes dead people, who are seemingly fair game because it is not illegal to libel the deceased, according to the Student Press Law Center.

    Sora will not let you generate videos of living people — unless it is of yourself, or a friend who has given you permission to use their likeness (or “cameo,” as OpenAI calls it). But these limits don’t apply to the dead, who can mostly be generated without roadblocks. The app, which is still only available via invite, has been flooded with videos of historical figures like Martin Luther King, Jr., Franklin Delano Roosevelt, and Richard Nixon, as well as deceased celebrities like Bob Ross, John Lennon, Alex Trebek, and yes, Robin Williams.

    How OpenAI draws the line on generating videos of the dead is unclear. Sora 2 won’t, for example, generate former President Jimmy Carter, who died in 2024, or Michael Jackson, who died in 2009, though it did create videos with the likeness of Robin Williams, who died in 2014, according to TechCrunch’s tests. And while OpenAI’s cameo feature allows people to set instructions for how they appear in videos others generate of them — guardrails that came in response to early criticism of Sora — the deceased have no such say. I’ll bet Richard Nixon would be rolling over in his grave if he could see the deepfake I made of him advocating for police abolition.

    Deepfakes of Richard Nixon, John Lennon, Martin Luther King, Jr., and Robin Williams
    Deepfakes of Richard Nixon, John Lennon, Martin Luther King, Jr., and Robin WilliamsImage Credits:Sora, screenshots by TechCrunch

    OpenAI did not respond to TechCrunch’s request for comment on the permissibility of deepfaking dead people. However, it’s possible that deepfaking dead celebrities like Williams is within the firm’s acceptable practices; legal precedent shows that the company likely wouldn’t be held liable for the defamation of the deceased.

    Techcrunch event

    San Francisco
    |
    October 27-29, 2025

    “To watch the legacies of real people be condensed down to ‘this vaguely looks and sounds like them so that’s enough,’ just so other people can churn out horrible TikTok slop puppeteering them is maddening,” Williams wrote.

    OpenAI’s critics accuse the company of taking a fast-and-loose approach on such issues, which is why Sora was quickly flooded with AI clips of copyrighted characters like Peter Griffin and Pikachu upon its release. CEO Sam Altman originally said that Hollywood studios and agencies would need to explicitly opt out if they didn’t want their IP to be included in Sora-generated videos. The Motion Picture Association has already called on OpenAI to take action on this issue, declaring in a statement that “well-established copyright law safeguards the rights of creators and applies here.” He has since said the company will reverse this position.

    Sora is, perhaps, the most dangerous deepfake-capable AI model accessible to people so far, given how realistic its outputs are. Other platforms like xAI lag behind, but have even fewer guardrails than Sora, making it possible to generate pornographic deepfakes of real people. As other companies catch up to OpenAI, we will set a horrifying precedent if we treat real people — living or dead — like our own personal playthings.

    [ad_2]

    Amanda Silberling

    Source link

  • OpenAI’s New Sora App Lets You Deepfake Yourself for Entertainment

    [ad_1]

    On Tuesday, OpenAI released an AI video app called Sora. The platform is powered by OpenAI’s latest video generation model, Sora 2, and revolves around a TikTok-like For You page of user-generated clips. This is the first product release from OpenAI that adds AI-generated sounds to videos. For now, it’s available only on iOS and requires an invite code to join.

    “You are about to enter a creative world of AI-generated content,” reads an advisory page displayed during the app sign-up process. “Some videos may depict people you recognize, but the actions and events shown are not real.”

    OpenAI is betting that creating and sharing AI deepfakes will become a popular form of entertainment. Whether it’s your friends, influencers, or random strangers online, Sora frames generating deepfake videos as a form of scrollable fun. The app’s main feed is an endless serving of bite-sized AI slop featuring human faces.

    During the set up process, users are given the option to create a digital likeness of themselves by saying a few numbers aloud and turning their head around as the app records. “The team worked very hard on character consistency,” wrote OpenAI CEO Sam Altman in a blog about Sora’s release.

    People have the ability to choose who can use their digital likeness in Sora videos. It can be set to everyone, or limited to just yourself, those you approve, or mutual connections on the app. Whenever someone generates a video using your likeness, even if it’s just sitting in their drafts, you can see the full clip from your account’s page.

    First Impressions

    Many of the most-liked videos on my “For You” feed on Tuesday afternoon featured Altman’s likeness. One AI-generated clip depicted the OpenAI CEO stealing a graphics processing unit from Target. When the character gets caught, a voice that sounds like Altman pleads with a security guard to let him keep the GPU so that he can build AI tools.

    Many of the videos generated during WIRED’s testing included rough edges and other errors. But Sora makes it incredibly seamless to create personalized deepfakes that often look and sound convincingly real.

    To incorporate the likenessnesses of different people in your videos, just tap on their faces on Sora’s generation page and add them as “cameos.” Then, enter a simple prompt, like “fight in the office over a WIRED story.”

    [ad_2]

    Reece Rogers

    Source link

  • How to Protect Your Company From Deepfake Fraud | Entrepreneur

    [ad_1]

    Opinions expressed by Entrepreneur contributors are their own.

    In 2024, a scammer used deepfake audio and video to impersonate Ferrari CEO Benedetto Vigna and attempted to authorize a wire transfer, reportedly tied to an acquisition. Ferrari never confirmed the amount, which rumors placed in the millions of euros.

    The scheme failed when an executive assistant stopped it by asking a security question only the real CEO could answer.

    This isn’t sci-fi. Deepfakes have jumped from political misinformation to corporate fraud. Ferrari foiled this one — but other companies haven’t been so lucky.

    Executive deepfake attacks are no longer rare outliers. They’re strategic, scalable and surging. If your company hasn’t faced one yet, odds are it’s only a matter of time.

    Related: Hackers Targeted a $12 Billion Cybersecurity Company With a Deepfake of Its CEO. Here’s Why Small Details Made It Unsuccessful.

    How AI empowers imposters

    You need less than three minutes of a CEO’s public video — and under $15 worth of software — to make a convincing deepfake.

    With just a short YouTube clip, AI software can recreate a person’s face and voice in real time. No studio. No Hollywood budget. Just a laptop and someone ready to use it.

    In Q1  2025, deepfake fraud cost an estimated $200 million globally, according to Resemble AI’s Q1 2025 Deepfake Incident Report. These are not pranks — they’re targeted heists hitting C‑suite wallets.

    The biggest liability isn’t technical infrastructure; it’s trust.

    Why the C‑suite is a prime target

    Executives make easy targets because:

    • They share earnings calls, webinars and LinkedIn videos that feed training data

    • Their words carry weight — teams obey with little pushback

    • They approve big payments fast, often without red flags

    In a Deloitte poll from May 2024, 26% of execs said someone had tried a deepfake scam on their financial data in the past year.

    Behind the scenes, these attacks often begin with stolen credentials harvested from malware infections. One criminal group develops the malware, another scours leaks for promising targets — company names, exec titles and email patterns.

    Multivector engagement follows: text, email, social media chats — building familiarity and trust before a live video or voice deepfake seals the deal. The final stage? A faked order from the top and a wire transfer to nowhere.

    Common attack tactics

    Voice cloning:

    In 2024, the U.S. saw over 845,000 imposter scams, according to data from the Federal Trade Commission. This shows that seconds of audio can make a convincing clone.

    Attackers hide by using encrypted chats — WhatsApp or personal phones — to skirt IT controls.

    One notable case: In 2021, a UAE bank manager got a call mimicking the regional director’s voice. He wired $35 million to a fraudster.

    Live video deepfakes:

    AI now enables real-time video impersonation, as nearly happened in the Ferrari case. The attacker created a synthetic video call of CEO Benedetto Vigna that nearly fooled staff.

    Staged, multi-channel social engineering:

    Attackers often build pretexts over time — fake recruiter emails, LinkedIn chats, calendar invites — before a call.

    These tactics echo other scams like counterfeit ads: Criminals duplicate legitimate brand campaigns, then trick users onto fake landing pages to steal data or sell knockoffs. Users blame the real brand, compounding reputational damage.

    Multivector trust-building works the same way in executive impersonation: Familiarity opens the door, and AI walks right through it.

    Related: The Deepfake Threat is Real. Here Are 3 Ways to Protect Your Business

    What if someone deepfakes the C‑suite

    Ferrari came close to wiring funds after a live deepfake of their CEO. Only an assistant’s quick challenge about a personal security question stopped it. While no money was lost in this case, the incident raised concerns about how AI-enabled fraud might exploit executive workflows.

    Other companies weren’t so lucky. In the UAE case above, a deepfaked phone call and forged documents led to a $35 million loss. Only $400,000 was later traced to U.S. accounts — the rest vanished. Law enforcement never identified the perpetrators.

    A 2023 case involved a Beazley-insured company, where a finance director received a deepfaked WhatsApp video of the CEO. Over two weeks, they transferred $6 million to a bogus account in Hong Kong. While insurance helped recover the financial loss, the incident still disrupted operations and exposed critical vulnerabilities.

    The shift from passive misinformation to active manipulation changes the game entirely. Deepfake attacks aren’t just threats to reputation or financial survival anymore — they directly undermine trust and operational integrity.

    How to protect the C‑suite

    • Audit public executive content.

    • Limit unnecessary executive exposure in video/audio formats.

    • Ask: Does the CFO need to be in every public webinar?

    • Enforce multi-factor verification.

    • Always verify high-risk requests through secondary channels — not just email or video. Avoid putting full trust in any one medium.

    • Adopt AI-powered detection tools.

    • Use tools that fight fire with fire by leveraging AI features for AI-generated fake content detection:

      • Photo analysis: Detects AI-generated images by spotting facial irregularities, lighting issues or visual inconsistencies

      • Video analysis: Flags deepfakes by examining unnatural movements, frame glitches and facial syncing errors

      • Voice analysis: Identifies synthetic speech by analyzing tone, cadence and voice pattern mismatches

      • Ad monitoring: Detects deepfake ads featuring AI-generated executive likenesses, fake endorsements or manipulated video/audio clips

      • Impersonation detection: Spots deepfakes by identifying mismatched voice, face or behavior patterns used to mimic real people

      • Fake support line detection: Identifies fraudulent customer service channels — including cloned phone numbers, spoofed websites or AI-run chatbots designed to impersonate real brands

    But beware: Criminals use AI too and often move faster. At the moment, criminals are using more advanced AI in their attacks than we are using in our defense systems.

    Strategies that are all about preventative technology are likely to fail — attackers will always find ways in. Thorough personnel training is just as crucial as technology is to catch deepfakes and social engineering and to thwart attacks.

    Train with realistic simulations:

    Use simulated phishing and deepfake drills to test your team. For example, some security platforms now simulate deepfake-based attacks to train employees and flag vulnerabilities to AI-generated content.

    Just as we train AI using the best data, the same applies to humans: Gather realistic samples, simulate real deepfake attacks and measure responses.

    Develop an incident response playbook:

    Create an incident response plan with clear roles and escalation steps. Test it regularly — don’t wait until you need it. Data leaks and AI-powered attacks can’t be fully prevented. But with the right tools and training, you can stop impersonation before it becomes infiltration.

    Related: Jack Dorsey Says It Will Soon Be ‘Impossible to Tell’ if Deepfakes Are Real: ‘Like You’re in a Simulation’

    Trust is the new attack vector

    Deepfake fraud isn’t just clever code; it hits where it hurts — your trust.

    When an attacker mimics the CEO’s face or voice, they don’t just wear a mask. They seize the very authority that keeps your company running. In an age where voice and video can be forged in seconds, trust must be earned — and verified — every time.

    Don’t just upgrade your firewalls and test your systems. Train your people. Review your public-facing content. A trusted voice can still be a threat — pause and confirm.

    [ad_2]

    Ivan Shkvarun

    Source link

  • Welcome to the Era of ‘Deep Doubt’

    Welcome to the Era of ‘Deep Doubt’

    [ad_1]

    AI has scrambled our ability to tell what’s real and what’s synthetic. But there are tools and techniques to help stay grounded in truth.

    [ad_2]

    Benj Edwards, Ars Technica

    Source link

  • Trump Falsely Claims Harris Used AI to Create Massive Crowd | Entrepreneur

    Trump Falsely Claims Harris Used AI to Create Massive Crowd | Entrepreneur

    [ad_1]

    Despite what former President Donald Trump claimed on Truth Social on Sunday, Vice President Kamala Harris’s 15,000-person crowd in Michigan was not fake or created with AI.

    Trump claimed on Sunday that Harris “cheated” and “A.I.’d” the crowd of supporters who greeted her when she arrived at the airport in Detroit on Wednesday.

    “There was nobody at the plane,” Trump wrote, later calling for Harris to be disqualified from the election because “the creation of a fake image is ELECTION INTERFERENCE.”

    Related: Facebook Issues Apology After Photo of Donald Trump Was Erroneously Labeled ‘Altered’

    But the image was not made with AI. It was taken at an event covered by Fox News, Reuters, the Detroit News, and other media outlets. Fox Detriot wrote on Wednesday that “thousands” attended the Detroit rally, and confirmed today that an estimated 15,000 people showed up.

    Harris’s campaign responded to Trump’s accusation by stating that the image was real. Videos from the event, as well as Getty Images photos captured at the time, confirm that the image was real too.

    Tech giants including Google, Meta, and Microsoft have pledged to keep an eye on their platforms for AI-altered or created content ahead of the November election. But this may not be able to stop an influx of AI-generated content — and claims of fake photos.

    As of last month, Google requires advertisers to disclose when they use deepfakes, or realistic AI versions of people’s voices and likenesses, in election ads.

    Despite these efforts, AI has already made multiple appearances this election season. In February, an AI robocall in President Joe Biden’s voice told 20,000 New Hampshire Democrats not to vote in the state’s presidential primary.

    In late July, Elon Musk shared a parody video of Harris with his 193.8 million followers on X. In the video, Harris’s voice and likeness are manipulated to say statements like “I was selected because I am the ultimate diversity hire.”

    Musk did not disclose that the video was a parody when he shared it. He endorsed Trump in early July.

    After the attempt on Trump’s life at a rally in Pennsylvania in July, a Meta spokesperson apologized after the company incorrectly labeled a photo of Trump as “altered.”

    Trump is scheduled to appear in an interview with Musk on X Monday evening.

    Related: JPMorgan CEO Jamie Dimon Offers Policy Advice to Donald Trump, Kamala Harris in New Op-Ed — Is an Endorsement Next?

    [ad_2]

    Sherin Shibu

    Source link

  • Why the EU’s Vice President Isn’t Worried About Moon-Landing Conspiracies on YouTube

    Why the EU’s Vice President Isn’t Worried About Moon-Landing Conspiracies on YouTube

    [ad_1]

    When European Union vice president Věra Jourová met with YouTube CEO Neal Mohan in California last week, they fell to talking about the long-running conspiracy theory that the moon landings were fake. YouTube has faced calls from some users and advocacy groups to remove videos that question the historic missions. Like other videos denying accepted science, they have been booted from recommendations and have a Wikipedia link added to direct viewers to debunking context.

    But as Mohan spoke about those measures, Jourová made something clear: Fighting lunar lunatics or flat-earthers shouldn’t be a priority. “If the people want to believe it, let them do,” she said. As the official charged with protecting Europe’s democratic values, she thinks it’s more important to make sure YouTube and other big platforms don’t spare a euro that could be invested in fact-checking or product changes to curb false or misleading content that threatens the EU’s security.

    “We are focusing on the narratives which have the potential to mislead voters, which could create big harm to society,” Jourová tells WIRED in an interview. Unless conspiracy theories could lead to deaths, violence, or pogroms, she says, don’t expect the EU to be demanding action against them. Content like the recent fake news report announcing that Poland is mobilizing its troops in the middle of an election? That better not catch on as truth online.

    In Jourová’s view, her conversation with Mohan and similar discussions she held last week with the CEOs of TikTok, X, and Meta show how the EU is helping companies understand what it takes to counter disinformation, as is now required under the bloc’s tough new Digital Services Act. Its requirements include that starting this year the internet’s biggest platforms, including YouTube, have to take steps to combat disinformation or risk fines up to 6 percent of their global sales.

    Civil liberties activists have been concerned that the DSA ultimately could enable censorship by the bloc’s more authoritarian regimes. A strong showing by far-right candidates in the EU’s parliamentary elections taking place later this week also could lead to its uneven enforcement.

    YouTube spokesperson Nicole Bell says the company is aligned with Jourová on preventing egregious real-world harm and also removing content that misleads voters on how to vote or encourages interference in the democratic processes. “Our teams will continue to work around the clock,” Bell says of monitoring problematic videos about this week’s EU elections.

    Jourová, who expects her five year term to end later this year, in part because her Czech political party, ANO, is no longer in power at home in Czechia to renominate her, contends that the DSA is not meant to enable anything more than appropriate moderation of the most egregious content. She doesn’t expect Mohan or any other tech executive to go a centimeter beyond what the law prescribes. “Overusage, overshooting on the basis of the EU legislation would be a big failure and a big danger,” she says.

    On the other hand, she acknowledges that if the companies aren’t seen to be stepping up to mitigate disinformation, then some influential politicians have threatened to seek stiffer rules that could border on outright censorship. “I hate this idea,” she says. “We don’t want this to happen.”

    But with the DSA offering guidelines more than bright lines, how are platforms to know when to act? Jourova’s “democracy tour” in Silicon Valley, as she calls it, is part of facilitating a dialog on policy. And she expects social media researchers, experts, and the press to all contribute to figuring out the fuzzy borders between free expression and destructive disinformation. She jokes that she doesn’t want to be seen as the “European Minister of the Truth,” as tempting as that title may be. Leaving it to politicians alone to define what’s acceptable online “would pave the way to hell,” she says.

    [ad_2]

    Paresh Dave

    Source link

  • This year’s Met Gala theme is AI deepfakes | TechCrunch

    This year’s Met Gala theme is AI deepfakes | TechCrunch

    [ad_1]

    Whether you love or hate celebrity culture, the Met Gala is an event. Those less jaded among us get to see all of the biggest stars take their boldest fashion risks of the year; unlike an award show, it’s an event that encourages avant-garde extravagance. And if you find the whole thing vapid, then you can laugh along at how Ed Sheeran’s outfit looks like something Troy Bolton wore in High School Musical 3.

    But this year, the Met Gala was a test.

    “Katy Perry. That’s it,” one X post read. In the photo, Katy Perry appears to be wearing a massive gown decorated with three-dimensional floral appliques. As the pearlescent gown drapes down to the ground, its long train fades into realistic-looking moss, which cascades across the beige and red Met Gala carpet.

    If you look at the image for longer than a passing glance, you could feasibly believe that the “Teenage Dream” singer arrived at fashion’s biggest night wearing this whimsical, woodland-like gown. But in all of the other photos of the Met Gala, the carpet was white and green as part of the “Garden of Time” theme; in this photo, it’s beige and red. Why does Katy appear to be walking a different carpet?

    That’s the tell-tale sign that this viral image of Perry is fake. And yet it already has more than 10 million views on X and over 300,000 likes.

    Minutes later, another user on X posted another image of Perry. Her lips are slightly parted like she’s surprised by the paparazzi, and she’s wearing a bronze corset that looks like a key to a garden. Unlike the first image, this one actually has the correct color palette and scenery for this year’s gala, but something still feels off. Her floral skirt seems like it was cut and paste onto her body, and the light is hitting her corset in an unnatural way.

    So, how do you know it’s fake, as opposed to a strange photo? No fashion magazine has reported on Katy Perry’s look tonight — it doesn’t look like she’s actually attending this year. Meanwhile, Perry cryptically liked both viral tweets, but did not comment on the deceptive posts.

    Every year at the Met Gala, Rihanna is among the best dressed. In the days leading up to the event, she promised fans that she would actually get to the event in time for dinner — usually, she’s very fashionably late. She even dyed her hair pink for the occasion.

    On the earlier end of the red carpet, an image surfaced of Rihanna wearing a dramatically regal, garden-themed dress. The shoulders balloon into a sculptural halo, embroidered with birds, vines and flowers. But again, despite getting 2.6 million views, the image is not real. Rihanna dyed her hair pink, remember? Like Perry, Rihanna is nowhere in sight. People Magazine reported that Rihanna had to skip Monday evening’s festivities after coming down with the flu.

    The consequences of a fake Rihanna dress are pretty minor. But based on Rihanna’s history of nailing the Met Gala theme, would she really take the easy way out and wear a floral gown to the “Garden of Time” celebration? Like an AI deepfake Drake song, these synthetic looks were a bit too on the nose, lacking the creativity that makes the Met Gala unique. Could an AI come up with Cynthia Erivo’s brilliant suit or Lana Del Rey’s creepy-cool woodsy look?

    Zendaya, an early front-runner for best dressed, showed up relatively in a blue-green outfit that makes her look like a super chic fairytale villain. Hours later, when an image cropped up of Zendaya wearing a black leather gown and floral headpiece on the carpet, I was braced to believe that it was yet another fake photo. But the truth is stranger: After five years absent from the gala, Zendaya actually walked the carpet twice in two different outfits. Go figure.

    Still, each new image of a celebrity served as a call to check the patterns on the carpet, the flowers along the stair railings, and whether or not the paparazzi in the background look a little funky. Usually, the Met Gala is an opportunity to gab about famous people’s outlandish outfits as a brief distraction from our unglamorous Monday nights. But in the age of widespread generative AI tools, celebrity culture serves as a constant reminder that we can’t believe everything we see online.

    [ad_2]

    Amanda Silberling

    Source link

  • The Deodorant AI Spokesmodel Is a Real Person, Sort Of

    The Deodorant AI Spokesmodel Is a Real Person, Sort Of

    [ad_1]

    Photo-Illustration: Intelligencer

    In December of last year, Ariel, a 24-year-old content creator in New Jersey, received a message from a French digital-marketing company called Arcads. Ariel makes her living doing marketing videos for brands, who hire her through platforms like Fiverr and Upwork. Arcads had a slightly different request. “They asked if I’d be willing to take part in their AI technology campaign,” Ariel said. “They gave me a couple of prompts and said, ‘Talk as long as you can.’”

    She sent them the material. Later, the company reps came back with feedback and specific requests for clips filmed in different environments. They wanted walk-and-talk video. They wanted different settings. They wanted her sitting in a car. It wasn’t that much work — nine videos in total — she was paid for it, and it felt like something new and interesting.

    On Tuesday, months later, Ariel got a message from a friend with a link to a video posted on X. It had millions of views and thousands of responses and had become the subject of an intense and very strange debate between AI boosters, AI skeptics, and thousands of other assorted strangers with theories of their own. The preview contained her face. “Is this real?” her friend asked.

    “When I watched the video, I genuinely thought it was one of my UGC (user-generated content) videos,” she said. The style, delivery, and location were all familiar. “I’ve done so many, I lose track,” she said, and companies post her influencer-style videos on their social-media channels all the time.

    Then she listened to the text: an awkward, trollish rant about body odor and deodorant pitching a brand of cleaning wipes. She knew she’d never worked with this company and watched the video more closely. It was her, but not quite. She’d encountered her AI clone in the wild. “It honestly just threw me off a little,” she said. It had been a while since she thought about the AI company, and she hadn’t seen any of its work before this week. Now, through Arcads, clients were hiring an automated Ariel to do brand videos, and one of them had gone viral. Arcads had been honest about its plans, and Ariel felt she was fairly compensated and hadn’t been misled. Still, she said, “It just caught me off guard.” How couldn’t it?

    What turned the video into the social-media controversy du jour wasn’t so much the video’s content as a couple of imprecise captions, which launched it into the center of the churning online discourse about the future of AI. First, there was the original, from the founder of the client company: “It’s terrible but I still think it’s wild that this can all be done with AI. Imagine in 6 months …” A classic social marketing post, honestly — vague and teasing, with an unclear subject-poster relationship and a strong connection to an unrelated trend. From there, it got picked up by a bunch of AI influencers, whose breathless posts (“It’s so over …”) really took off:

    Linus Ekenstam’s post started drawing skeptical responses from his audience of AI optimists and doomers. This clearly wasn’t AI, some said, in the sense that it wasn’t generated by AI from scratch — even the most advanced unreleased video-generation software from OpenAI can’t do something quite like this. Others decided that the post was fake, by which they meant the video it contained was not fake. They found Ariel’s Fiverr page, shared similar videos that she’d made, and concluded that the clip was a commission masquerading as a digital avatar. “I’ve gotten so many people messaging me on Fiverr and on Instagram asking if I’m real,” Ariel said. “People I’ve worked with in the past!”

    In comments and community notes, people, including Ekenstam, sorted things out: The video wasn’t entirely AI-generated, in the sense that the base imagery is real video of a real person, but the facial movements and voice were synthesized. Users started commissioning weirder, glitchier videos from cyber-Ariel (the caption here is misleading — the actual cost of the video was €10):

    Still, lots of viewers remained unconvinced, or rather, quite convinced of whichever theory of the video they’d settled on before the video scrolled off their phones forever.

    To AI enthusiasts, this sort of thing is old news. Arcads isn’t a big player in AI — this week’s attention crashed the service, and its main proposition seems to be collecting and digitizing UGC professionals into a stable of licensed talent — but its product is based almost entirely on technology from HeyGen, which has been available to the public since last year and which just raised a round of funding at a $440 million valuation.

    HeyGen offers characters of its own that users can use to make corporate videos, ads, or anything else that needs a talking head. Crucially, it also has the ability to create puppet avatars from short clips, a feature I tested out a few months ago. From 30 seconds of grainy, poorly lit webcam footage, it synthesized a slightly robotic avatar with my upper body and face, something like my voice, and an unrecognizable but semi-plausible set of facial movements. Nobody I know would confuse it for me, but in the right context, they might confuse it for a person. This week, in The Atlantic, Louise Matsakis described the bracing experience of seeing her own HeyGen avatar speaking in perfectly translated Chinese. “By merely uploading a selfie taken on my iPhone, I was able to glimpse a level of Mandarin fluency that may elude me for the rest of my life,” she wrote.

    HeyGen is a real company with customers who see some opportunity in creating what are basically sanctioned corporate deep fakes: individualized videos from executives to clients, customized video and email ads, internal communications, and seminars. (If you want a picture of the future, imagine an uncanny AI avatar leading a workplace harassment-training module about reading subtle social cues, forever.) What HeyGen does, and what Arcads is doing with HeyGen, also represents a safe-for-work, aboveboard take on a technology that lots of people find distressing, or worse, for a variety of reasons. Nonconsensual explicit deep fakes are now so easy to make that they’re a problem not just for public figures but at middle schools. Phone scammers are recording short conversations and then using voice synthesis to target family members. The ease with which record companies and movie studios can capture and reproduce digital likenesses — voices, faces, bodies — has artists rightfully worried and was a major issue driving last year’s Hollywood strikes. The existence of HeyGen demonstrates how accessible this sort of thing has become. Anyone who posts videos to TikTok, Instagram, or YouTube is providing more than enough training material for someone to make a pretty good clone.

    Having the subject onboard, as Ariel was here, doesn’t resolve the essential strangeness of what’s going on or account for how people actually consume and encounter media. A simple ad turned into a disorienting and frequently nasty argument between thousands of people, for an audience of millions, not just about whether or not the video was real, but about what it even means to be real, eventually scattering participants across a range of conclusions from approximately “everyone has lost their minds about this” to “we’re all going to die.”

    The video’s short trajectory tells a slightly different story than the one you commonly hear from politicians, experts, and pundits about deep fakes and disinformation: While people will certainly be manipulated by AI-generated political content, the more significant consequence of this technology will be that it sows doubt about everything else, establishing a conspiratorial default around videos of people in general.

    There are clear limits to HeyGen’s technology as it exists today, and while it will certainly improve, it’s unclear by how much and at what. It’s good enough to create plausible marketing videos, so long as their audiences aren’t too familiar with the actor. Ariel isn’t primarily an influencer, in that she isn’t selling clients access to an audience. Instead, they post her videos themselves, for audiences that understand her as something between a spokesperson, a reviewer, and an influencer that they don’t know, but assume others do. The baseline artificiality of this arrangement would seem to make it a better target for automation, which companies like Arcads clearly think it is. Ariel, surprised as she was by the video, isn’t concerned. “It will definitely automate some things,” she said. “But I’m not worried about competing with myself — I’m a completely different being than that AI version of me,” she said. “It can’t do the same hand gestures or the various different things that make me me.” 

    So far, Ariel’s first encounter with self-automation has gone the other way — the video’s meta-virality has resulted in more business. “It’s weird, but I am grateful for it because so many more people have reached out asking if I can make videos for them. It’s boosted my profile,” she said. She’s still working with Arcads. “I have a very animated personality, and people saw that, and they were interested.” She’s booking a lot of fresh work on Fiverr and is now talking with the founder of the wipes company, whom she hadn’t been in contact with before, and who wants to keep riding this wave. Ariel is now “the new face” of the brand, she said, and they’ll be making videos together, this time with a camera.

    [ad_2]

    By John Herrman

    Source link

  • A Deepfake Nude Generator Reveals a Chilling Look at Its Victims

    A Deepfake Nude Generator Reveals a Chilling Look at Its Victims

    [ad_1]

    Another image on the site showed a group of young teens who appear to be in middle school: a boy taking a selfie in what appears to be a school gymnasium with two girls, who smile and pose for the picture. The boy’s features were obscured by a Snapchat lens that enlarged his eyes so much that they covered his face.

    Captions on the apparently uploaded images indicated they include images of friends, classmates, and romantic partners. “My gf” one caption says, showing a young woman taking a selfie in a mirror.

    Many of the photos showed influencers who are popular on TikTok, Instagram, and other social media platforms. Other photos appeared to be Instagram screenshots of people sharing images from their everyday lives. One image showed a young woman smiling with a dessert topped with a celebratory candle.

    Several images appeared to show people who were complete strangers to the person who took the photo. One image taken from behind depicted a woman or girl who is not posing for a photo, but simply standing near what appears to be a tourist attraction.

    Some of the images in the feeds reviewed by WIRED were cropped to remove the faces of women and girls, showing only their chest or crotch.

    Huge Audience

    Over an eight-day period of monitoring the site, WIRED saw five new images of women appear on the Home feed, and three on the Explore page. Stats listed on the site showed that most of these images accumulated hundreds of “views.” It’s unclear if all images submitted to the site make it to the Home or Explore feed, or how views are tabulated. Every post on the Home feed has at least a few dozen views.

    Photos of celebrities and people with large Instagram followings top the list of “Most Viewed” images listed on the site. The most-viewed people of all time on the site are actor Jenna Ortega with more than 66,000 views, singer-songwriter Taylor Swift with more than 27,000 views, and an influencer and DJ from Malaysia with more than 26,000 views.

    Swift and Ortega have been targeted with deepfake nudes before. The circulation of fake nude images of Swift on X in January triggered a moment of renewed discussion about the impacts of deepfakes and the need for greater legal protections for victims. This month, NBC reported that, for seven months, Meta had hosted ads for a deepnude app. The app boasted about its ability to “undress” people, using a picture of Jenna Ortega from when she was 16 years old.

    In the US, no federal law targets the distribution of fake, nonconsensual nude images. A handful of states have enacted their own laws. But AI-generated nude images of minors come under the same category as other child sexual abuse material, or CSAM, says Jennifer Newman, executive director of the NCMEC’s Exploited Children’s Division.

    “If it is indistinguishable from an image of a live victim, of a real child, then that is child sexual abuse material to us,” Newman says. “And we will treat it as such as we’re processing our reports, as we’re getting these reports out to law enforcement.”

    [ad_2]

    Caroline Haskins

    Source link

  • Kids’ Cartoons Get a Free Pass From YouTube’s Deepfake Disclosure Rules

    Kids’ Cartoons Get a Free Pass From YouTube’s Deepfake Disclosure Rules

    [ad_1]

    YouTube has updated its rulebook for the era of deepfakes. Starting today, anyone uploading video to the platform must disclose certain uses of synthetic media, including generative AI, so viewers know what they’re seeing isn’t real. YouTube says it applies to “realistic” altered media such as “making it appear as if a real building caught fire” or swapping “the face of one individual with another’s.”

    The new policy shows YouTube taking steps that could help curb the spread of AI-generated misinformation as the US presidential election approaches. It is also striking for what it permits: AI-generated animations aimed at kids are not subject to the new synthetic content disclosure rules.

    YouTube’s new policies exclude animated content altogether from the disclosure requirement. This means that the emerging scene of get-rich-quick, AI-generated content hustlers can keep churning out videos aimed at children without having to disclose their methods. Parents concerned about the quality of hastily made nursery-rhyme videos will be left to identify AI-generated cartoons by themselves.

    YouTube’s new policy also says creators don’t need to flag use of AI for “minor” edits that are “primarily aesthetic” such as beauty filters or cleaning up video and audio. Use of AI to “generate or improve” a script or captions is also permitted without disclosure.

    There’s no shortage of low-quality content on YouTube made without AI, but generative AI tools lower the bar to producing video in a way that accelerates its production. YouTube’s parent company Google recently said it was tweaking its search algorithms to demote the recent flood of AI-generated clickbait, made possible by tools such as ChatGPT. Video generation technology is less mature but is improving fast.

    Established Problem

    YouTube is a children’s entertainment juggernaut, dwarfing competitors like Netflix and Disney. The platform has struggled in the past to moderate the vast quantity of content aimed at kids. It has come under fire for hosting content that looks superficially suitable or alluring to children but on closer viewing contains unsavory themes.

    WIRED recently reported on the rise of YouTube channels targeting children that appear to use AI video-generation tools to produce shoddy videos featuring generic 3D animations and off-kilter iterations of popular nursery rhymes.

    The exemption for animation in YouTube’s new policy could mean that parents cannot easily filter such videos out of search results or keep YouTube’s recommendation algorithm from autoplaying AI-generated cartoons after setting up their child to watch popular and thoroughly vetted channels like PBS Kids or Ms. Rachel.

    Some problematic AI-generated content aimed at kids does require flagging under the new rules. In 2023, the BBC investigated a wave of videos targeting older children that used AI tools to push pseudoscience and conspiracy theories, including climate change denialism. These videos imitated conventional live-action educational videos—showing, for example, the real pyramids of Giza—so unsuspecting viewers might mistake them for factually accurate educational content. (The pyramid videos then went on the suggest that the structures can generate electricity.) This new policy would crack down on that type of video.

    “We require kids content creators to disclose content that is meaningfully altered or synthetically generated when it seems realistic,” says YouTube spokesperson Elena Hernandez. “We don’t require disclosure of content that is clearly unrealistic and isn’t misleading the viewer into thinking it’s real.”

    The dedicated kids app YouTube Kids is curated using a combination of automated filters, human review, and user feedback to find well-made children’s content. But many parents simply use the main YouTube app to cue up content for their kids, relying on eyeballing video titles, listings, and thumbnail images to judge what is suitable.

    So far, most of the apparently AI-generated children’s content WIRED found on YouTube has been poorly made in similar ways to more conventional low-effort kids animations. They have ugly visuals, incoherent plots, and zero educational value—but are not uniquely ugly, incoherent, or pedagogically worthless.

    AI tools make it easier to produce such content, and in greater volume. Some of the channels WIRED found upload lengthy videos, some well over an hour long. Requiring labels on AI-generated kids content could help parents filter out cartoons that may have been published with minimal—or entirely without—human vetting.

    [ad_2]

    Kate Knibbs

    Source link

  • Google Is Getting Thousands of Deepfake Porn Complaints

    Google Is Getting Thousands of Deepfake Porn Complaints

    [ad_1]

    Each method is weaponized—almost always against women—to degrade, harass, or cause shame, among other harms. Julie Inman Grant, Australia’s e-safety commissioner, says her office is starting to see more deepfakes reported to its image-based abuse complaints scheme, alongside other AI-generated content, such as “synthetic” child sexual abuse and children using apps to create sexualized videos of their classmates. “We know it’s a really underreported form of abuse,” Grant says.

    As the number of videos on deepfake websites has grown, content creators—such as streamers and adult models—have used DMCA requests. The DMCA allows people who own the intellectual property of certain content to request it be removed from the websites directly or from search results. More than 8 billion takedown requests, covering everything from gaming to music, have been made to Google.

    “The DMCA historically has been an important way for victims of image-based sexual abuse to get their content removed from the internet,” says Carrie Goldberg, a victims’ rights attorney. Goldberg says newer criminal laws and civil law procedures make it easier to get some image-based sexual abuse removed, but deepfakes complicate the situation. “While platforms tend to have no empathy for victims of privacy violations, they do respect copyright laws,” Goldberg says.

    WIRED’s analysis of deepfake websites, which covered 14 sites, shows that Google has received DMCA takedown requests about all of them in the past few years. Many of the websites host only deepfake content and often focus on celebrities. The websites themselves include DMCA contact forms where people can directly request to have content removed, although they do not publish any statistics, and it is unclear how effective they are at responding to complaints. One website says it contains videos of “actresses, YouTubers, streamers, TV personas, and other types of public figures and celebrities.” It hosts hundreds of videos with “Taylor Swift” in the video title.

    The vast majority of DMCA takedown requests linked to deepfake websites listed in Google’s data relate to two of the biggest sites. Neither responded to written questions sent by WIRED. The majority of the 14 websites had over 80 percent of the complaints leading to content being removed by Google. Some copyright takedown requests sent by individuals indicate the distress the videos can have. “It is done to demean and bully me,” one request says. “I take this very seriously and I will do anything and everything to get it taken down,” another says.

    “It has such a huge impact on someone’s life,” says Yvette van Bekkum, the CEO of Orange Warriors, a firm that helps people remove leaked, stolen, or nonconsensually shared images online, including through DMCA requests. Van Bekkum says the organization is seeing an increase in deepfake content online, and victims face hurdles to come forward and ask that their content is removed. “Imagine going through a hiring process and people Google your name, and they find that kind of explicit content,” van Bekkum says.

    Google spokesperson Ned Adriance says its DMCA process allows “rights holders” to protect their work online and the company has separate tools for dealing with deepfakes—including a separate form and removal process. “We have policies for nonconsensual deepfake pornography, so people can have this type of content that includes their likeness removed from search results,” Adriance says. “And we’re actively developing additional safeguards to help people who are affected.” Google says when it receives a high volume of valid copyright removals about a website, it uses those as a signal the site may not be providing high-quality content. The company also says it has created a system to remove duplicates of nonconsensual deepfake porn once it has removed one copy of it, and that it has recently updated its search results to limit the visibility for deepfakes when people aren’t searching for them.

    [ad_2]

    Matt Burgess

    Source link

  • Florida Middle Schoolers Arrested for Allegedly Creating Deepfake Nudes of Classmates

    Florida Middle Schoolers Arrested for Allegedly Creating Deepfake Nudes of Classmates

    [ad_1]

    Two teenage boys from Miami, Florida, were arrested in December for allegedly creating and sharing AI-generated nude images of male and female classmates without consent, according to police reports obtained by WIRED via public record request.

    The arrest reports say the boys, aged 13 and 14, created the images of the students who were “between the ages of 12 and 13.”

    The Florida case appears to be the first arrests and criminal charges as a result of alleged sharing of AI-generated nude images to come to light. The boys were charged with third-degree felonies—the same level of crimes as grand theft auto or false imprisonment—under a state law passed in 2022 which makes it a felony to share “any altered sexual depiction” of a person without their consent.

    The parent of one of the boys arrested did not respond to a request for comment in time for publication. The parent of the other boy said that he had “no comment.” The detective assigned to the case, and the state attorney handling the case, did not respond for comment in time for publication.

    As AI image-making tools have become more widely available, there have been several high-profile incidents in which minors allegedly created AI-generated nude images of classmates and shared them without consent. No arrests have been disclosed in the publicly reported cases—at Issaquah High School in Washington, Westfield High School in New Jersey, and Beverly Vista Middle School in California—even though police reports were filed. At Issaquah High School, police opted not to press charges.

    The first media reports of the Florida case appeared in December, saying that the two boys were suspended from Pinecrest Cove Academy in Miami for 10 days after school administrators learned of allegations that they created and shared fake nude images without consent. After parents of the victims learned about the incident, several began publicly urging the school to expel the boys.

    Nadia Khan-Roberts, the mother of one of the victims, told NBC Miami in December that for all of the families whose children were victimized the incident was traumatizing. “Our daughters do not feel comfortable walking the same hallways with these boys,” she said. “It makes me feel violated, I feel taken advantage [of] and I feel used,” one victim, who asked to remain anonymous, told the TV station.

    WIRED obtained arrest records this week that say the incident was reported to police on December 6, 2023, and that the two boys were arrested on December 22. The records accuse the pair of using “an artificial intelligence application” to make the fake explicit images. The name of the app was not specified, and the reports claim the boys shared the pictures between each other.

    “The incident was reported to a school administrator,” the reports say, without specifying who reported it or how that person found out about the images. After the school administrator “obtained copies of the altered images,” the administrator interviewed the victims depicted in them, the reports say, who said that they did not consent to the images being created.

    [ad_2]

    Caroline Haskins

    Source link

  • How AI Is Being Used to Influence and Disrupt the 2024 Election

    How AI Is Being Used to Influence and Disrupt the 2024 Election

    [ad_1]

    Two days before the New Hampshire primary in January, a robocall featuring an AI-generated imitation of President Biden’s voice was sent out to thousands of people in the state urging them not to vote. The call was also spoofed to appear as if it had come from the telephone of a former state Democratic Party official. Independent analysis later confirmed that the fake Biden voice had been created with ElevenLabs’ AI text-to-speech voice generator.

    The New Hampshire attorney general’s office launched an investigation into the robocall and subsequently determined it had been sent to as many as 25,000 phone numbers by a Texas-based company called Life Corporation, which sells robocalling and other services to political organizations.

    On February 23, NBC News reported that a New Orleans magician named Paul Carpenter had admitted using ElevenLabs to create the fake Biden audio. Carpenter said he did it after being paid by Steve Kramer, a longtime political operative then working for Democratic presidential candidate (and AI proponent) Dean Phillips. The campaign has denied having any knowledge of the effort.

    “I was in a situation where someone offered me some money to do something, and I did it,” Carpenter said. “There was no malicious intent. I didn’t know how it was going to be distributed.” He told NBC he was admitting his role in part to call attention to how easy it was to create the audio:

    Carpenter — who holds world records in fork-bending and straitjacket escapes, but has no fixed address — showed NBC News how he created the fake Biden audio and said he came forward because he regrets his involvement in the ordeal and wants to warn people about how easy it is to use AI to mislead. Creating the fake audio took less than 20 minutes and cost only $1, he said, for which he was paid $150, according to Venmo payments from Kramer and his father, Bruce Kramer, that he shared.

    “It’s so scary that it’s this easy to do,” Carpenter said. “People aren’t ready for it.”

    Kramer, who also previously worked on the failed 2020 presidential campaign of Kanye West, was paid nearly $260,000 by the Phillips campaign across December and January for ballot-access work in Pennsylvania and New York. A Phillips campaign spokesperson told NBC News that it played no part in the AI robocall:

    “If it is true that Mr. Kramer had any involvement in the creation of deepfake robocalls, he did so of his own volition which had nothing to do with our campaign,” Phillips’ press secretary Katie Dolan said. “The fundamental notion of our campaign is the importance of competition, choice, and democracy. We are disgusted to learn that Mr. Kramer is allegedly behind this call, and if the allegations are true, we absolutely denounce his actions.”

    In a statement to NBC News, Kramer eventually admitted he was behind the robocall, which he said he sent to 5,000 likely Democratic voters. He claimed he did it to prevent future AI deepfaked robocalls:

    “With a mere $500 investment, anyone could replicate my intentional call,” Kramer said. “Immediate action is needed across all regulatory bodies and platforms.”

    [ad_2]

    Chas Danner

    Source link

  • AI-generated nude images of teen girls spur families to push for protections: ‘We’re fighting for our children’

    AI-generated nude images of teen girls spur families to push for protections: ‘We’re fighting for our children’

    [ad_1]

    A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

    Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls – that attend a high school in suburban Seattle, Washington.

    The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

    Desperate for solutions, affected families are pushing lawmakers to implement robust safeguards for victims whose images are manipulated using new AI models, or the plethora of apps and websites that openly advertise their services. Advocates and some legal experts are also calling for federal regulation that can provide uniform protections across the country and send a strong message to current and would-be perpetrators.

    “We’re fighting for our children,” said Dorota Mani, whose daughter was one of the victims in Westfield, a New Jersey suburb outside of New York City. “They are not Republicans, and they are not Democrats. They don’t care. They just want to be loved, and they want to be safe.”

    The problem with deepfakes isn’t new, but experts say it’s getting worse as the technology to produce it becomes more available and easier to use. Researchers have been sounding the alarm this year on the explosion of AI-generated child sexual abuse material using depictions of real victims or virtual characters. In June, the FBI warned it was continuing to receive reports from victims, both minors and adults, whose photos or videos were used to create explicit content that was shared online.

    Several states have passed their own laws over the years to try to combat the problem, but they vary in scope. Texas, Minnesota and New York passed legislation this year criminalizing nonconsensual deepfake porn, joining Virginia, Georgia and Hawaii who already had laws on the books. Some states, like California and Illinois, have only given victims the ability to sue perpetrators for damages in civil court, which New York and Minnesota also allow.

    A few other states are considering their own legislation, including New Jersey, where a bill is currently in the works to ban deepfake porn and impose penalties — either jail time, a fine or both — on those who spread it.

    State Sen. Kristin Corrado, a Republican who introduced the legislation earlier this year, said she decided to get involved after reading an article about people trying to evade revenge porn laws by using their former partner’s image to generate deepfake porn.

    “We just had a feeling that an incident was going to happen,” Corrado said.

    The bill has languished for a few months, but there’s a good chance it might pass, she said, especially with the spotlight that’s been put on the issue because of Westfield.

    The Westfield event took place this summer and was brought to the attention of the high school on Oct. 20, Westfield High School spokesperson Mary Ann McGann said in a statement. McGann did not provide details on how the AI-generated images were spread, but Mani, the mother of one of the girls, said she received a call from the school informing her nude pictures were created using the faces of some female students and then circulated among a group of friends on the social media app Snapchat.

    The school hasn’t confirmed any disciplinary actions, citing confidentiality on matters involving students. Westfield police and the Union County Prosecutor’s office, who were both notified, did not reply to requests for comment.

    Details haven’t emerged about the incident in Washington state, which happened in October and is under investigation by police. Paula Schwan, the chief of the Issaquah Police Department, said they have obtained multiple search warrants and noted the information they have might be “subject to change” as the probe continues. When reached for comment, the Issaquah School District said it could not discuss the specifics because of the investigation, but said any form of bullying, harassment, or mistreatment among students is “entirely unacceptable.”

    If officials move to prosecute the incident in New Jersey, current state law prohibiting the sexual exploitation of minors might already apply, said Mary Anne Franks, a law professor at George Washington University who leads Cyber Civil Rights Initiative, an organization aiming to combat online abuses. But those protections don’t extend to adults who might find themselves in a similar scenario, she said.

    The best fix, Franks said, would come from a federal law that can provide consistent protections nationwide and penalize dubious organizations profiting from products and apps that easily allow anyone to make deepfakes. She said that might also send a strong signal to minors who might create images of other kids impulsively.

    President Joe Biden signed an executive order in October that, among other things, called for barring the use of generative AI to produce child sexual abuse material or non-consensual “intimate imagery of real individuals.” The order also directs the federal government to issue guidance to label and watermark AI-generated content to help differentiate between authentic and material made by software.

    Citing the Westfield incident, U.S. Rep. Tom Kean, Jr., a Republican who represents the town, introduced a bill on Monday that would require developers to put disclosures on AI-generated content. Among other efforts, another federal bill introduced by U.S. Rep. Joe Morelle, a New York Democrat, would make it illegal to share deepfake porn images online. But it hasn’t advanced for months due to congressional gridlock.

    Some argue for caution — including the American Civil Liberties Union, the Electronic Frontier Foundation and The Media Coalition, an organization that works for trade groups representing publishers, movie studios and others — saying that careful consideration is needed to avoid proposals that may run afoul of the First Amendment.

    “Some concerns about abusive deepfakes can be addressed under existing cyber harassment” laws, said Joe Johnson, an attorney for ACLU of New Jersey. “Whether federal or state, there must be substantial conversation and stakeholder input to ensure any bill is not overbroad and addresses the stated problem.”

    Mani said her daughter has created a website and set up a charity aiming to help AI victims. The two have also been in talks with state lawmakers pushing the New Jersey bill and are planning a trip to Washington to advocate for more protections.

    “Not every child, boy or girl, will have the support system to deal with this issue,” Mani said. “And they might not see the light at the end of the tunnel.”

    __

    AP reporters Geoff Mulvihill and Matt O’Brien contributed from Cherry Hill, New Jersey and Providence, Rhode Island.

    [ad_2]

    Haleluya Hadero, The Associated Press

    Source link

  • Sevdaliza and Grimes Enlist Madonna, Julia Fox and A$AP Ferg to Remind Us That “Nothing Lasts Forever”

    Sevdaliza and Grimes Enlist Madonna, Julia Fox and A$AP Ferg to Remind Us That “Nothing Lasts Forever”

    [ad_1]

    There is perhaps no better person to incorporate into a song called “Nothing Lasts Forever” than Madonna. Not just because she has made a career out of proving that trends come and go, and that reinvention is the only way to survive the fallout of a certain “fad’s” death (even if fads always end up swinging back around—like voguing), but because to stay stagnant is its own form death. Of course, there’s also the more obvious way the song applies to Madonna in that she happened to have a near-death experience over the summer that reminded her (as if she needed to be) of just how fleeting existence can be. 

    With the concept for the video written and directed by Willem Kantine, the visuals for it accentuate just how much the music video art form has evolved since Madonna’s “heyday,” when far more fanfare and linear conceptualization was put into such endeavors. Now, all an artist needs is a “concept” without much else behind it (save for trippy special effects), least of all a narrative on par with the video for “Express Yourself” or “Bad Girl” (both of which were directed by David Fincher). Even so, the video is actually inspired by 90s-era gabber music, which often featured such displays of underground machismo. So naturally, Madonna is game to contribute her visage (#givegoodface) to the project intended to subvert ideas of what “masculinity” is. And, in her own way, maybe it’s a troll on all the blowback she got a couple years ago for putting her face on another woman’s body. Although the altered image Madonna had posted was from 2015, it took six years for the culture to become outraged about it in our newly evolved state of perceiving everything as a violation (which, truth be told, it kind of is). Madonna’s social media choice brought up a larger conversation about “reality” in the internet age, well before the AI panic of 2023. Not to mention the issue of stripping female bodily autonomy when it comes to AI, deepfakes, Photoshopping, etc. Thus, for a feminist like Madonna, such behavior was a big dichotomy. 

    In any case, it wouldn’t be unlike M to display a sardonic sense of humor toward that moment by, once again, having her head placed atop another person’s body. This time, a bodybuilder type. Indeed, everyone in the video—Sevdaliza, Grimes, Madonna, Julia Fox and A$AP Ferg—is down to have their physical person warped by this odd “cut and paste” of their head. Better known as: deepfaking. For the most part, it’s Sevdaliza and Grimes who seem to be loosely training for a competition (if all that slow walking side-by-side on a treadmill is any indication). After all, it’s their song. One that combines their shared love of AI in particular and technological manipulation in general. For example, Sevdaliza offered herself up to become the first femenoid robot (named Dahlia) and Grimes has been very open about inviting fans to deepfake her voice via the website she launched to do just that, Elf.Tech. In both instances, each artist has taken a contrasting approach to the new world order compared to other musicians, who view AI and deepfaking as massive threats to art. Rather than fighting it, however, Sevdaliza and Grimes have gone whole hog on embracing it, perhaps adhering to the old adage, “If you can’t beat them, join them.” Mind you, that seemed to be the adage that many a Nazi employed as well. 

    Madonna, too, has employed this method with technological advances throughout her career, embracing every shift as it comes—from the dawning of the internet (see: her concert at the Brixton Academy being among the first of its kind to get livestreamed) to her creation of a TikTok account. Whatever it might be, Madonna never shies away from the new tech that bombards us because she, like Sevdaliza and Grimes, prefers to use it as a tool rather than view it as a threat. 

    Granted, it was Grimes herself who ominously foretold that “we’re in the end of art, human art.” And she’s been the first to practice what she preaches by surrendering herself over fully to the matrix (as she basically did when she started dating Elon Musk and then had his children). Madonna, too, has made that surrender, in case you forgot about the NFT she made of herself (in conjunction with Beeple) that shocked the nation. For Madonna, that kind of immortality is precisely what she’s always yearned for. With technological manipulation a person can not only live forever, but they can look young forever, to boot (see also: Madonna’s face as Andy Warhol’s philosophy). Which brings us to a key lyric from “Nothing Lasts Forever”: “I don’t wanna waste my youth (nothing lasts forever)/Love me then let me go.” If that hasn’t been the credo that Madonna has lived by, then nothing is. 

    To be sure, the themes of “Nothing Lasts Forever” apply not just to Madonna’s own approach to life and the pursuit of fame (which took a toll on many of her personal relationships during her climb to the top), but to humanity itself as we start to reconcile with the notion that maybe our jig is about to be up. Just like it was for the dinosaurs. Whether that refers to our extinction by way of AI or climate change (or both) remains to be seen. But when Sevdaliza sings, “We are machines made for dreamin’/Dreams are done, are dreams dead?/Something inside still believes it,” it only further proves that we’ll die living in the delusion that there’s still a shred of hope left. 

    Unfortunately, there’s no such hope for music videos as we once knew them in their postmodern prime. Going back to how the medium of the music video has devolved irrevocably since the decades when Madonna was going all in on film-like efforts such as “Like A Prayer” and  “Bedtime Story” (and no, Taylor Swift’s “All Too Well” isn’t that), Kantine had this to say of “Nothing Lasts Forever”: “With the rise of TikTok and other trends, the actual time consumers watch videos like ours has been steadily declining. Our project is a response to this phenomenon and challenges the notion that art needs to cater to a specific audience to be successful.”

    In other words, we’re living in the era of Just Toss Something Out and See What Sticks/Goes Viral. Madonna, ever the ready adapter, is only too prepared to absorb and wield that trend. One that, hopefully, won’t last forever… then again, maybe it’s better if attention spans, short as they already are, stay the same for as long as possible. Because it can only go further downhill from here. 

    [ad_2]

    Genna Rivieccio

    Source link