Eagle AI Agency

Notes

What should your automation do when a lead replies?

By Matthew Eagle

Founder, Eagle AI Agency. Eight years as a staffing account executive.

Published . Updated .

This week our automated follow-ups answered four kinds of reply the wrong way. Here is what each one got wrong, and the rules that now decide when a person takes over.

When a lead replies, your automation should stop following up with them, and anything other than a plain yes should go to a person. Stop requests and angry replies go on a permanent do not contact list before the next send. A reply that carries a phone number, a link or a question your rules never planned for gets a human answer, and your booking link goes to the same person once, never twice.

What went wrong when our follow-ups answered replies on their own?

We run automated follow-ups that answer some replies without waiting for us. A plain yes gets a booking link, and a few clear cases, like a candidate outside the area we hire in, get a standard answer. This week four kinds of reply slipped past those rules.

  • A prospect said yes and sent a link to book time on their own calendar. Our system sent our booking link straight back. Their link turned out to be a paid session on their side, which a person would have spotted in a second.
  • A prospect replied with a phone number and a window when they were free. The system sent the booking link anyway, and it was the second time that person had received it.
  • On a recruiting campaign, a candidate wrote that they were from another country, already working here on a visa, and asked whether they could contract through their home country. The system saw the other country and sent our standard out of area decline.
  • Candidates who wrote "stop messaging me" kept getting the next follow-up. The system sending those emails could send from the mailbox but could not read it, so a reply never stopped anything.

Why do automated replies get these wrong?

Automated replies get these wrong because each rule is written for the common reply, and real replies mix two things at once. "Yes, call me at this number" is a yes and a request. The system matched the yes and ignored the request.

The visa reply matched the location rule for the same reason. The rule fired on one word and never weighed the rest of the sentence.

The stop requests failed for a plainer reason. Nothing was reading the inbox at all, so every reply looked the same as silence.

Which replies should go to a person?

A reply should go to a person whenever it asks for something your automation cannot do or was not built to judge. This is how we sort them now.

How we sort replies now

What the lead wroteWhat the automation doesWho answers
A plain yesSends the booking link, onceAutomation
A link to their own calendar or booking pageSends nothing, flags itA person books on their side or replies
A phone number or "call me"Sends no link, passes on the number and their wordsA person calls
Visa, work permit, sponsorship or where they are basedNever declines on its ownA person decides
Stop, remove me, unsubscribeStops every follow-up and adds them to do not contact, permanentlyNobody replies
Angry, "how did you get my email", "this is spam"Same as a stop requestNobody replies
Out of office, "no longer works here", help desk ticketSends no answerNobody
A yes from someone who already has the linkHolds itA person follows up

What rules did we put in place?

  1. 1Any reply stops the follow-ups to that person.
  2. 2The reply check runs before every send, so a reply that lands between sends still counts.
  3. 3Stop and hostile wording goes on the do not contact list straight away, and it stays there for good.
  4. 4A reply with a link in it, or talk of their own calendar, goes to a person.
  5. 5A reply with a phone number or "call me" gets no link. The person who owns the lead gets the number and the lead's own words in one message.
  6. 6Visa, permit, sponsorship and location questions never trigger an automatic decline.
  7. 7The booking link goes to anyone once. A second yes from the same person goes to a human.
  8. 8Every misfire becomes a test first. We save the lead's real words as a test case, and the fix does not ship until the system handles that reply correctly.

The last rule matters most. Each of these replies will come back in a slightly different form, and a test built from the real words catches the next one.

What has to be true before a stop request can work?

A stop request only works if the system that sends your follow-ups can read the replies to the same mailbox. Sending and reading are separate permissions, and many setups only ask for sending.

When we built the reply check on one campaign, it sat waiting on that read access. Until it has it, it sees nothing, so we treat that state as broken.

To test yours, reply "stop" to one of your own follow-ups from a second address. If the next follow-up still arrives, your opt-outs are not working. We hold the outreach we run in our sales work to the same test. For the outbound side of the same problem, see what stops AI outreach from sending the wrong message.

Questions people ask

Should every reply stop an automated sequence?

Yes. Once someone answers, they are in a conversation, and a scheduled follow-up on top of their reply reads as if nobody listened.

Is it safe to send a booking link automatically when someone says yes?

Yes, for a plain yes and only once. Anything with a condition attached, like a phone number, a time or their own link, should go to a person.

How fast should an unsubscribe take effect?

Before the next send. Check replies at the start of every send run, so a stop request can never sit behind a follow-up already in the queue.

What should you do when your automation already answered a reply wrong?

Have a person follow up the way the lead asked: call the number, book through their link or answer the question. Keep it short and skip the pitch.

If you want follow-ups that know when to hand a lead to a person, book a call.

More notes

Want the version of this for your business?

Twenty minutes, your actual situation, a straight answer about what we would do first.

Book a 20 minute call

20 minutes. You leave with a straight answer.