ReportWire

Tag: Deepfakes

  • Deepfakes Are on the Rise — Will They Change How Businesses Verify Their Users? | Entrepreneur

    Deepfakes Are on the Rise — Will They Change How Businesses Verify Their Users? | Entrepreneur

    [ad_1]

    Opinions expressed by Entrepreneur contributors are their own.

    You know how you can’t do anything these days without proving who you are? Whether opening a bank account or just hopping onto a car-sharing service. With online identity verification becoming more integrated into daily life, fraudsters have become more interested in outsmarting the system.

    Criminals are investing more money and effort to overcome security solutions. Their ultimate weapon is deepfakes — impersonating real people using artificial intelligence (AI) techniques. Now, the multi-million question is: Can organizations effectively employ AI to combat fraudsters with their tools?

    According to a Regula identity verification report, a whopping one-third of global businesses have already fallen victim to deepfake fraud, with fraudulent activities involving deepfake voice and video posing significant threats to the Banking sector.

    For instance, fraudsters can easily pretend to be you to get access to your bank account. Stateside, almost half of the companies surveyed confessed to being targeted with the voice deepfakes last year, beating the global average of 29%. It’s like a blockbuster heist but in the digital realm.

    And as AI technology for creating deepfakes becomes more accessible, the risk of businesses being affected only increases. That poses a question: Should the identity verification process be adjusted?

    Related: Deepfake Scams Are Becoming So Sophisticated, They Could Start Impersonating Your Boss And Coworkers

    Endless race

    Luckily, we’re not at the “Terminator” stage yet. Right now, most deepfakes are still detectable — either by eagle-eyed humans or AI technologies that have already been integrated into ID verification solutions for quite some time. But don’t let your guard down. Deepfake threats are evolving quickly — we are already on the edge of witnessing persuasive samples that can scarcely arouse any suspicion, even upon deliberate scrutiny.

    The good news is that the AI, the superhero we’ve enlisted to fight against good old “handmade” identity fraud, is now being trained to spot fake stuff created by its fellow AI buddies. How does it manage this magic? First of all, AI models don’t work in a vacuum; human-fed data and clever algorithms shape them. Researchers can develop AI-powered tools to remove the bad guys of synthetic fraud and deepfakes.

    The core idea of this protective technology is to be on the lookout for anything fishy or inconsistent while doing those ID liveness checks and “selfie” sessions (where you snap a live pic or video with your ID). An AI-powered identity verification solution becomes the digital Sherlock Holmes. It can detect both changes that occur over time, like shifts in lighting or movement, and sneaky changes within the image itself – like tricky copy-pasting or image stitching.

    Fortunately, AI-generated fraud still has some blind spots, and organizations should leverage those weak points. Deepfakes, for instance, often fail to capture shadows correctly and have odd backgrounds. Fake documents typically lack optically variable security elements and would fail to project-specific images at certain angles.

    Another key challenge criminals face is that many AI models are primarily trained using static face images, mainly because those are more readily available online. These models struggle to deliver realism in liveness “3D” video sessions, where individuals must turn their heads.

    One more vulnerability organizations can use is the difficulty in manipulating documents for authentication compared to attempting to use a fake face (or to “swap a face”) during a liveness session. This is because criminals typically have access only to one-dimensional ID scans. Moreover, modern IDs often incorporate dynamic security features that are visible only when the documents are in motion. The industry is constantly innovating in this area, making it nearly impossible to create convincing fake documents that can pass a capture session with liveness validation, where the documents must be rotated at different angles. Hence, requiring physical IDs for a liveness check can significantly boost an organization’s security.

    While the AI training for ID verification solutions keeps evolving, it’s essentially a constant cat-and-mouse game with fraudsters, and the results are often unpredictable. It is even more intriguing that criminals are also training AI to outsmart enhanced AI detection, creating a continuous cycle of detection and evasion.

    Take age verification, for example. Fraudsters can employ masks and filters that make people appear older during a liveness test. In response to such tactics, researchers are pushed to identify fresh cues or signs of manipulated media and train their systems to spot them. It’s a back-and-forth battle that keeps going, with each side trying to outsmart the other.

    Related: The Deepfake Threat is Real. Here Are 3 Ways to Protect Your Business

    Maximum level of security

    In light of all we’ve explored thus far, the question looms: What steps should we take?

    First, to achieve the highest level of security in ID verification, toss out the old playbook and embrace a liveness-centric approach for identity checks. What’s the essence of it?

    While most AI-generated forgeries still lack the naturalness needed for convincing liveness sessions, organizations seeking maximum security should work exclusively with physical objects — no scans, no photos — just real documents and real people.

    In the ID verification process, the solution must validate both the liveness and authenticity of the document and the individual presenting it.

    This should also be supported by an AI verification model trained to detect even the most subtle video or image manipulations, which might be invisible to the human eye. It can also help detect other parameters that could flag abnormal user behavior. This involves checking the device used to access a service, its location, interaction history, image stability and other factors that can help verify the authenticity of the identity in question. It’s like piecing together a puzzle to determine if everything adds up.

    And one final tip – requesting that customers use their mobile phones during liveness sessions instead of a computer’s webcam would be helpful. This is because it is generally much more difficult for fraudsters to swap images or videos when using a mobile phone’s camera.

    To wrap it up, AI is the ultimate sidekick for the good guys, ensuring the bad guys can’t sneak past those defenses. Still, AI models need guidance from us humans to stay on the right track. But when together, we are superb at spotting fraud.

    [ad_2]

    Ihar Kliashchou

    Source link

  • Beware: Deepfake Scams Could Target Your Next Zoom Meeting | Entrepreneur

    Beware: Deepfake Scams Could Target Your Next Zoom Meeting | Entrepreneur

    [ad_1]

    Cybercriminals are leveraging AI-driven voice simulation and deepfake video technology to deceive individuals and organizations, Bloomberg reported. In a recent incident, a CEO transferred $249,000 in funds after receiving a call that sounded like it came from a trusted source, only to discover it was generated by AI.

    Udi Mokady, chairman of the cybersecurity firm CyberArk Software, had a surprising encounter with such an attack. In a Microsoft Teams video message in July, Mokady was taken aback when he came face-to-face with an eerily convincing deepfake version of himself, a move that was later revealed to be a prank by one of his coworkers.

    “I was shocked,” Mokady told Bloomberg. “There I was, crouched over in a hoodie with my office in the background.”

    While smaller companies may have tech-savvy employees who can spot deepfakes, larger organizations are more vulnerable to such attacks, as there may not be as intimate work relationships or technological understanding to spot whether someone is, well, real.

    “If we were the size of an IBM or a Walmart or almost any Fortune 500 company there’d be legitimate cause for concern,” Gal Zror, research manager at CyberArk who carried out the stunt on Mokady, told Bloomberg. “Maybe Employee No. 30,005 could be tricked.”

    Cybersecurity experts have warned of the consequences of a human-like AI copy of an executive who unearths vital company data and information such as passwords.

    Related: A Deepfake Phone Call Dupes An Employee Into Giving Away $35 Million

    In August, Mandiant, a Google-owned cybersecurity company, disclosed the first instances of deepfake video technology explicitly designed and sold for phishing scams, per Bloomberg. The offerings, advertised on hacker forums and Telegram channels in English and Russian, promise to replicate individuals’ appearances, boosting the effectiveness of extortion, fraud, or social engineering schemes with a personalized touch.

    Deepfakes impersonating well-known public figures have also increasingly surfaced. Last week, NBC reviewed over 50 videos across social media platforms wherein deepfakes of celebrities touted sham services. The videos featured altered appearances of prominent figures like Elon Musk, but also media figures such as CBS News anchor Gayle King and former Fox News host Tucker Carlson, all falsely endorsing a non-existent investment platform.

    Deepfakes, along with other rapidly expanding technology, have contributed to an uptick in cybercrime. In 2022, $10.2 billion in losses due to cyber scams were reported to the FBI — up from $6.9 billion the year prior. As AI capabilities continue improve and scams are becoming more sophisticated, experts are particularly worried about the lack of attention given to deepfakes amid other cyber threats.

    Related: ‘Biggest Risk of Artificial Intelligence’: Microsoft’s President Says Deepfakes Are AI’s Biggest Problem

    “I talk to security leaders every day,” Jeff Pollard, an analyst at Forrester Research, told Bloomberg in April. “They are concerned about generative AI. But when it comes to something like deepfake detection, that’s not something they spend budget on. They’ve got so many other problems.”

    [ad_2]

    Madeline Garfinkle

    Source link

  • Pope Francis’ (Fake) Puffer Coat Was Generated By AI | Entrepreneur

    Pope Francis’ (Fake) Puffer Coat Was Generated By AI | Entrepreneur

    [ad_1]

    A photo of Pope Francis went viral over the weekend when an image of him stepping out in public in a stylish, puffer-coat version of white papal wear made its way around the internet, inspiring jokes for some and complete shock for others.

    The image was fake.

    According to Insider, the image was created with the “generative AI” program Midjourney, a platform where you can enter text and receive often highly detailed, sometimes uber-realistic images in return.

    In a Reddit thread, r/midjourney, people submit images that were created using the program, from a Rembrandt with cellphones to Severus Snape from the Harry Potter universe playing at the 1969 music festival Woodstock.

    On Friday, a user posted a series of photos of Pope Francis in a white jacket, one of which went viral on Twitter. The image even fooled Chrissy Teigen.

    “It went so viral, not just because it was funny to some people, but because most people couldn’t tell it was fake,” Sinéad Bovell, founder of media and technology company WAYE told CNN.

    She suggested that social media platforms might have features in the future that would mark these types of images as AI-generated.

    One way to tell that the image is AI-generated, at least in this case, is that the hands look misshapen, as the program struggles to create hands, per BuzzFeed News.

    Related: Getty Images Has Started Legal Proceedings Against an AI Generative Art Company For Copyright Infringement

    It is possible these photos are only going to get more popular as other generative AI programs that work similarly, such as DALL-E, from the same company behind ChatGPT, OpenAI, hit the mainstream.

    Lensa AI was another program that used generative AI to iterate on inputted images that found itself in the headlines in late 2022. Users were seemingly wowed by the realistic, digital portraits that depicted users as woodland fairies or in space.

    Related: What is Lensa AI? And Does it Pose Privacy and Ethical Concerns?

    Still, there could be implications beyond what the Pope’s lifestyle brand would be called. We’re hovering on the edge of a world where “we can’t distinguish what’s real and what’s not,” Bovell told CNN.

    [ad_2]

    Gabrielle Bienasz

    Source link

  • South Park Creators Raise $20 Million For Deepfake Company

    South Park Creators Raise $20 Million For Deepfake Company

    [ad_1]

    The creators behind the animated satire show South Park have raised $20 million for their deepfake and artificial intelligence studio, Deep Voodoo, per Variety.


    Chris Hopkins / Stringer I Getty Images

    Matt Stone and Trey Parker at

    It represents the group’s first outside funding, the outlet noted — the company was previously funneling capital from the entertainment company Park County, owned by the animated show’s creators, Trey Parker and Matt Stone.

    South Park, the adult animated comedy series, has been running since 1997 and just finished its 25th season. The show has been renewed for projects that take it through to 2027. The creators said in 1998 they were in the business of making people go, “‘What the f[—] is this?’”

    In 2020, Stone and Parker began work on what they hoped would be a full-length film related to deepfakes. But once the pandemic hit, the project turned into the much shorter — but very viral — satire video called “Sassy Justice with Fred Sassy,” which joked about figures including Mark Zuckerberg and then-President Donald Trump.

    But it’s an expensive business. The 15-minute video cost the pair “millions” (including the initial investment that didn’t pan out because of the pandemic) and was “probably the single most expensive YouTube video ever made,” Parker told the outlet.

    Still, the duo decided to continue their deepfake work after the YouTube video. Now, the company has raised a $20 million round, led by Connect Ventures, a collaboration between talent and media agency CAA and a venture capital firm, New Enterprise Associates (NEA).

    “Connect Ventures is thrilled to lead the investment in Deep Voodoo, providing unique access to CAA and NEA’s resources and relationships,” said Michael Blank, leader of consumer investments at CAA, in a statement Tuesday.

    Deepfakes are videos that imitate the appearance or face of another, and the technology has alarmed misinformation experts. The term appears to have been coined on Reddit.

    Related: The Elon Musk Deepfake Was a Joke. But More Celebrity Face Fakes Could Be Coming

    “Deepfakes still might be poised to corrupt the basic ways we process reality—or what’s left of it,” The Atlantic wrote Tuesday.

    Stone, meanwhile, said he hopes the technology will support artists.

    “We stumbled upon this amazing technology and ended up recruiting the best deepfake artists in the world,” Stone said. “We are psyched to share their brilliance with the Hollywood creative community.”

    [ad_2]

    Gabrielle Bienasz

    Source link

  • Report: Deepfakes Are on the Rise and Stopping Them Will Be Tough

    Report: Deepfakes Are on the Rise and Stopping Them Will Be Tough

    [ad_1]

    Deepfakes have become several things — vehicles of misinformation, jokes, an underappreciated art form — but there’s one thing that could make them very attractive to marketers: It’s probably cheaper than hiring a celebrity for your video.


    Edward Webb I Wikimedia Commons

    This is why, according to the Wall Street Journal, they are becoming more common, harder to spot, and the outlet reports, tough to litigate.

    And there might not be anything anyone can do about it.

    There isn’t a crystal-clear avenue for someone who’s looking to initiate legal action against a person who’s using a deepfake of their likeness — and in the age of social media, a video might be too widespread to tame, anyway, the outlet reported.

    What is a deepfake?

    Deepfakes are videos where a face has been digitally manipulated to look like another person’s face. The term was actually created by a Reddit user, whose username was also deepfake, to describe digital face-switching in pornography, according to MIT.

    They’re also tough to spot. One expert told the WSJ that deepfakes could make scouting misinformation even more difficult.

    “We’re having a hard enough time with fake information. Now we have deepfakes, which look ever more convincing,” Ari Lightman a professor of digital media at Carnegie Mellon told the outlet.

    What was the deepfake of Elon Musk?

    Last Wednesday, real estate tech startup reAlpha — the same one that posted a deepfake video of Musk in a bathtub — posted another faux Musk.

    In this one, he’s being held hostage in a warehouse. The video explains reAlpha’s business model with a few jokes about Musk, such as that the company should have properties on Mars.

    It doesn’t quite look like Musk, and the bottom of the video says “This is NOT actually Elon Musk. But we wouldn’t be mad if fake Elon can get Real Elon’s Attention.”

    Why are deepfakes becoming more popular?

    Deepcake, digital media deepfake company, which is involved in a controversy over whether or not it had the right to make a deepfake of Bruce Willis, told the WSJ that the practice is cost-efficient.

    “In six months, we made 10 completely different creatives and concepts with digital Bruce Willis working with different directors,” a Deepcake told WSJ. “It is difficult to imagine such a production with a real actor.”

    What celebrities have been deepfaked?

    Deepfakes are also used for jokes and memes. One TikToker, Jesse Richards, has made an online career of creating funny videos with convincing deepfakes of videos of people from Millie Bobby Brown to Zac Efron.

    @iamjesserichards Replying to @valeriiaaa.24__ you asked #strangerthings #milliebobbybrown ♬ original sound – IAmJesseRichards

    Last spring, a deepfake went viral for its uber-realistic portrayal of Tom Cruise.

    https://www.youtube.com/watch?v=wq-kmFCrF5Q

    However, that video points out an important limitation of the technology. The video’s creator, Chris Ume told Vice post-production alone took him 24 hours. His spokesperson also noted the work because of the Cruise imitator he used to film the content.

    “Even after all that work, you can still see a few glitches,” Ume told the outlet.

    As for the less-realistic Musk deepfake, Christie Currie chief marketing officer of reAlpha, told the Journal they worked to make it clear the video was a parody or joke. (Satire is protected free speech.)

    One expert told WSJ celebrities can (and have, such as Woody Allen nabbing a settlement in 2009 over an American Apparel commercial) sue under the “Right of Publicity” laws.

    This means people have a right to own their own images, per a federal law related to unfair competition, which also grants the “right to protection against false endorsement, association, or affiliation.”

    Still, only a few states have passed laws related specifically to deepfake videos — California, Texas, and Virginia.

    [ad_2]

    Gabrielle Bienasz

    Source link