Why do people decide if you’re smart before you even finish your first sentence?
If you’ve ever watched a TED Talk and started nodding along before you really understood the speaker, it probably wasn’t the ideas that got you. It was their hands.
Researchers at the University of British Columbia recently fed 2,184 TED Talks into an AI video system. They chopped them into more than 200,000 small clips and asked a simple question: what are the speakers’ hands doing when audiences find them most competent and convincing?
The answer was clear. Speakers who used “illustrator” gestures stood out. These are the movements where your hands show what you’re saying. You might trace a rising line when you say “the numbers shot up,” hold your hands apart to show “this big,” or outline a box when you mention “your comfort zone.”
These speakers came across as more confident, clear, and convincing, even though they used the same words as others.
Other gestures didn’t help much. Pointing at slides, waving to make a point, or random hand flapping are common but don’t add much. Sometimes, they just create distraction without adding meaning.
Researchers think illustrator gestures work because they send the same message twice—once with words and once with pictures. Your brain likes this and finds it easier to follow, so you assume the speaker knows what they’re talking about. We often mistake clarity for competence.
Last week, my sister and I watched a reality show. As soon as one contestant appeared, I said, “She gives me the same ickI get from [an agreed psychopath, who would sue if I named them!].” My sister didn’t even look up from her phone. “Yep,” she said. “Her body language is identical.” We both picked up on the same silent message and felt the same unease.
Welcome to the Sound-Off Channel
As a psychiatrist, I’m not surprised by any of this. We all live in the silent channel of human behaviour.
In psychiatry training, we often watch live interviews through a one-way mirror. Sometimes the sound is off or turned down to help us focus on body language. You might think this would make it harder, but it doesn’t. You can still see if a patient slumps in their chair, sits up straight, looks away quickly, holds their arms tightly, or lets their shoulders drop when a topic comes up.
If you give trainees a silent ten-minute video and ask them to guess if the patient is anxious, angry, flat, agitated, paranoid, hiding something, or just exhausted, they won’t all agree. But they’re not guessing in the dark. A lot of emotion still comes through, even without sound.
You probably notice this in daily life. You know when your partner says they’re “fine” but clearly isn’t. You can tell when a friend feels down before they say anything. The official conversation is in the words, but the real conversation is in everything around them.
Psychologists often say that “60 to 90 percent of emotional meaning is nonverbal.” The exact number changes depending on the situation, but the main idea is true. Words work well for facts and details. For almost everything else, like “How do I feel about you” or “Do I believe you,” your brain decides based on tone, posture, timing, and movement.
Party Tricks From the Lab
There are some interesting, and a bit unsettling, studies about this.
In one famous series, viewers watched a few seconds of silent video of teachers at work, then judged them. Those quick judgments matched the students’ end-of-semester evaluations. Brief snippets of behaviour, no sound, yet people could still sense warmth, confidence and chaos.
In another study, researchers took 20 seconds of surgeons talking, stripped out the content so only tone remained, then asked listeners to judge how dominant, cold, or concerned they sounded. Those ratings predicted which surgeons had been sued for malpractice. Not their technical skill. Their voice tone.
It seems that patients don’t sue doctors they trust.
How To Use Your Ridiculous Hands
So what role do your hands play in all of this?
Think of them as your personal subtitles. When you use illustrator gestures, your hands sketch a small diagram of your thoughts in real time. You’re helping the other person build a mental picture. When your hands stay still, the other person has to work harder to piece together the scene. When your hands just flap or fidget, you’re adding static to the signal.
Most of us aren’t giving TED Talks. We’re just getting through team meetings, job interviews, awkward first dates, or tough talks with teenagers. The research still applies.
Here are a few easy things you can try:
- Draw what you’re saying. When you talk about a change, a path, or a difference, use your hands to show it—up, down, bigger, smaller, closer, or further. If it has a shape, sketch it out.
- Match the mood. If you’re giving bad news, let your face, shoulders, and voice show that it’s serious. If you’re apologising, don’t just stand still.
- Cut the static. You don’t have to stand perfectly still, but try to avoid pen-twirling or picking at your sleeves during important conversations. Use your hands for clear signals, not for fidgeting.
- On Zoom, make sure your hands are visible. If your camera is too close and you look like a floating head, adjust it so your hands show, especially when you’re explaining something tricky. Also, remove virtual backgrounds because the technology often cuts out your hands.
None of this is about being slick or fake. In fact, people usually dislike that. It’s about making sure your body matches what you really mean.
The Conversation You Cannot Turn Off.
Like it or not, you’re always communicating. There’s the conversation in your words, which could be written down, and there’s the other conversation in how you sit, look, pause, and move.
Next time you talk in a meeting or tell a story at dinner, imagine half the room has muted you and can only see your hands.
What story are they picking up?