AI

AI's real risks for business owners: deepfakes, made-up facts and new rules

The AI concerns that matter to brands and marketers: deepfakes of founders, AI that invents facts, India's 2026 AI labelling rules and the DPDP data rules. What happened, and what to do.

Most worries about AI are about the far future. The ones that cost businesses money are already here, and they are surprisingly ordinary: a convincing fake of your founder, a confident wrong answer, a rule nobody read. Here are the risks we see owners underestimate, with the real events behind them.

Deepfakes of your founder and your brand

In January 2024, a finance employee at the Hong Kong office of engineering firm Arup joined a video call with what appeared to be the company's UK-based CFO and several colleagues. Every other person on the call was an AI-generated deepfake. After the call he made 15 transfers totalling about HK$200 million, roughly US$25 million. Arup confirmed the fraud publicly in May 2024.

For founder-led brands, coaches and experts, this cuts both ways. The more your face and voice appear in reels, podcasts and ads, the more material there is to copy. A cloned voice note can ask your team to approve a payment, and a fake video can sell a "course" or "offer" in your name to your own followers.

What to do: agree that no payment or bank change is approved on a call, voice note or video alone. Tell your audience, in your bio and on your website, which accounts and numbers are officially yours, and act quickly on any fake page or ad using your name.

AI that makes things up

In October 2025, Deloitte agreed to partially refund the Australian government for a roughly A$440,000 report after an academic found fabricated references and a made-up quote from a court judgment. The revised report disclosed that a generative AI tool had been used.

If it can happen in a large firm's government report, it can happen in your proposal, your product claims or your blog. AI tools write fluently, and fluency is not accuracy.

What to do: treat AI output as a first draft from a confident intern. Check every number, name, quote and source before it goes to a client or onto your website.

The rules have arrived

India notified amendments to its IT Rules on 10 February 2026, in force from 20 February 2026. They define "synthetically generated information", require platforms to label AI-generated content prominently, ask large platforms to collect a declaration from users on whether content is synthetic, and sharply shorten takedown timelines.

For a business, the practical rule is simple. If an ad, reel or testimonial uses an AI-generated person, voice or scene, disclose it. Never create a "customer" who does not exist. Beyond the legal risk, it is the fastest way to lose trust when someone notices.

Your customers' data

India's Digital Personal Data Protection Rules were notified on 14 November 2025 with an 18-month phased timeline. Most obligations on businesses that collect personal data come into full force by May 2027. That includes the phone numbers in your WhatsApp lists, the emails on your website forms and the customer details in your spreadsheets.

Pasting that data into a free AI tool to "clean up the list" or "write personalised messages" is exactly the kind of habit to stop now.

What to do: know what personal data you collect and why, get clear consent on your forms, use business AI plans with data controls, and keep a simple record of who can access customer lists.

The quieter risk: sounding like everyone

The least dramatic risk may be the most expensive over time. When every competitor uses the same tools with the same prompts, websites, posts and ads start to sound identical. Customers stop noticing any of them. AI cannot give you a point of view, real proof or the reasons customers choose you. Those still come from understanding your business.

A one-page safety checklist

  • Payment and bank changes need a second confirmation, never just a call or voice note. Your official accounts and numbers are listed publicly.
  • Every AI-written claim, number and quote is checked by a person before it is published.
  • AI-generated people, voices and scenes in marketing are labelled. No fake testimonials, ever.
  • Customer data stays out of free AI tools, and your forms ask for consent.
  • One person in the business owns these rules and reviews them every quarter.
The biggest AI risk for most businesses is not the technology. It is trusting it without checking.

Want a second pair of eyes on how your business uses AI in marketing and sales? It is part of our business audit, and our automation work is built with these checks in place.

Sources

  1. Arup deepfake scam: how US$25M was stolen via video call (Adaptive Security)
  2. Deloitte refunds Australian government over AI in report (The Register)
  3. India's IT Rules 2026 deepfake regulation (Legal 500)
  4. DPDP Rules, 2025 notified (Press Information Bureau)
Your next step

Book a free discovery call.

Thirty to forty minutes. You leave knowing the two most critical issues holding back your sales, whatever you decide next.

Nothing is recommended before we understand your business.

No work starts before the price is agreed in writing.

If we are not the right fit, we will tell you, and who is.

Email us WhatsApp us