'I Was Just Joking!': What to Say When a Friend Downplays a Hurtful Comment

The project slides are up, and you’re walking your team through the Q3 projections. You click to the next slide, the one with the slightly ambitious timeline. From across the table, a colleague laughs. “Wow, looks like someone’s aiming for a promotion. Either that or you forgot how calendars work.” A few people shift in their seats. Your face gets hot. You want to snap back, but the words catch in your throat. You’re already thinking about how to respond to a backhanded compliment without looking defensive. Before you can say anything, he leans back with a grin and says, “Relax, I was just joking!”

This is a conversational trap, and it’s designed to be inescapable. It’s an act of aggression packaged as entertainment. The “joke” is the punch, and the “just joking” is the shield. If you object to the punch, you’re accused of not being able to take a joke. You’re humorless, too sensitive, a poor sport. If you let it go, you’ve quietly agreed to be a punching bag. The speaker has successfully established that they can say what they want at your expense, and you are not allowed to object. You’re caught in a bind where any direct response makes you the problem.

What’s Actually Going On Here

The “I was just joking” defense isn’t about humor; it’s about plausible deniability. It allows someone to launch a small missile of criticism, judgment, or outright contempt, and then immediately disown it if it doesn’t land well. It’s a test. The speaker is testing the boundaries of the relationship and the room. They are checking to see what they can get away with. It’s a low-risk way to assert dominance or express resentment.

This pattern is incredibly stable because the group often reinforces it. When your colleague makes the “joke,” everyone else in the meeting looks down at their notes or offers a tight, uncomfortable smile. Their silence is a form of consent. It signals that rocking the boat is more disruptive than allowing one person to be casually undermined. By not intervening, the team implicitly agrees that your discomfort is a smaller problem than the speaker’s potential embarrassment. The system protects the aggressor because calling them out would create a moment of genuine, undeniable conflict that most people are desperate to avoid.

The comment itself is often vague, cloaked in a generalisation like “someone’s aiming for a promotion.” This isn’t a specific, debatable critique of your timeline; it’s an attack on your motives. Because it’s abstract, it’s hard to refute. You can’t prove you aren’t ambitious or brown-nosing. The vagueness is a feature, not a bug. It makes any defense sound like an overreaction to a harmless observation.

What People Usually Try (and Why It Backfires)

When you’re under pressure, your brain reaches for the most familiar tools. The problem is, the familiar tools for this situation are broken.

• Fighting back directly. → “That was completely out of line.” → This makes you look emotional and humorless, confirming their frame that you “can’t take a joke.” You’ve taken the bait, and now you’re the one escalating things.

• Explaining your feelings. → “When you say that, it makes me feel undermined.” → You are offering vulnerability to someone who has just demonstrated they are not a safe recipient for it. Their likely response will be to double down: “It was a joke! You’re being way too sensitive.”

• Laughing it off. → You force a laugh and say, “Yeah, well, you know me!” → You’ve just taught them that this is an acceptable way to treat you. The digs will continue, and they will likely get worse over time because you’ve signaled your approval.

• Returning fire with another “joke.” → “Well, at least I know how a calendar works, unlike some people’s budget reports.” → While it might feel satisfying for a second, you’ve just entered their game. You’ve accepted the premise that passive-aggressive jabs are a valid form of communication on this team.

A Better Way to Think About It

Your goal is not to win the argument, prove them wrong, or get an apology. An apology extracted under pressure is worthless. Your goal is to break the frame of the conversation. The speaker has created a frame that says, “This is a joke, and we are in a fun, lighthearted moment.” Your job is to calmly and neutrally reject that frame without creating a new one called “We are now in a big, serious fight.”

The move is to treat the “joke” as a serious comment that you don’t understand. You are not the butt of a joke; you are a professional colleague who has just heard a confusing statement and requires clarification.

This shift does two things. First, it removes their shield. A joke is only a joke if everyone agrees it’s a joke. By refusing to treat it as one, you strip away the plausible deniability. Second, it puts the social pressure back on them. They made an awkward comment. You are now calmly, and very reasonably, asking them to explain their own awkwardness. The spotlight is back on them. You are not attacking; you are asking. You are not emotional; you are curious.

A Few Lines That Fit This Move

These are not scripts to be memorized, but illustrations of the underlying move: calmly refusing the “joke” frame and asking for clarification.

• “I don’t get it.” → This line is powerful because it’s neutral. You’re not accusing them of being mean; you are stating that you lack the information to find their comment funny, and you’re inviting them to explain it.
• “Can you explain what you mean by that?” → This calmly re-frames their “joke” as a piece of content that has meaning, and you are simply asking them to be clear about that meaning.
• Hold eye contact, wait a beat, and say nothing. → Your silence is a refusal to accept the comment or rescue them from the awkwardness they just created. This puts the onus on them to either double down or, more likely, backtrack.
• “Let’s go back to the timeline on slide 14.” → This move refuses to engage with the comment at all. It re-establishes the professional boundary and communicates that their comment was an irrelevant distraction from the work at hand.

From Insight to Practice

Knowing the right move and being able to execute it under pressure are two different things. The reason you fall back on old habits is because they are deeply rehearsed. When your heart rate is up and you feel the eyes of the room on you, your brain won’t have the space to calmly search for a new theory. It will grab whatever is closest.

To make these moves available in the moment, you have to practise them. This means moving beyond just reading. It involves rehearsing a scenario out loud, hearing how the words sound in your own voice, and feeling how your body responds. With tools like Rapport7, you can capture the details of a past conversation, practise different responses, and review the recording to see if your tone and body language matched your intent. This is how you build the muscle memory to handle the situation calmly and effectively the next time it happens, without having to think about it.