How Do You Stop the Same Message Arriving Twice?

Aggregate three channels that follow the same market and you will receive the same news three times within a minute. The problem is not the rules โ€” each one is doing its job โ€” it is that the sources overlap. Duplicate detection recognises content it has just relayed and lets only the first copy through.

How a duplicate is recognised

Each relayed message leaves a fingerprint built from what it contains: its text, and for an attachment its kind and size. When a new message produces the same fingerprint inside the time window, it is dropped instead of relayed.

You choose what goes into the fingerprint. Text alone is right when the same news is posted with different images; including the attachment is right when the picture is the thing being repeated.

The time window

The window is how far back the comparison looks, five minutes by default. It should match how your sources behave rather than being set as high as possible: a window of an hour will also drop a legitimate repeat โ€” a price update that genuinely says the same thing twice โ€” and you will not be told which.

For overlapping news channels, a few minutes is usually enough. For a source that reposts its pinned message every day, no window will help, and a keyword rule is the better tool.

Near-identical is not identical

The comparison is exact. Two channels publishing the same story with a different opening line produce two different fingerprints, and both are relayed. That is a deliberate limit rather than an oversight: a fuzzy comparison that decides two messages are "close enough" would eventually drop something you wanted, silently, and there is no way to notice what never arrived.

If the duplicates differ only by a fixed prefix or a signature line, a find-and-replace rule that removes it will make the fingerprints match, and the duplicate filter will then do its job.

The protection that is always on

Separately from this setting, there is a safety net that cannot be switched off: the same content sent to the same destination within a few seconds is not sent twice. It exists to stop a loop โ€” two rules pointing at each other, or a destination that is also a source โ€” from multiplying messages endlessly, which is the kind of accident that gets a Telegram account limited.

One consequence worth knowing: if two of your rules deliberately relay the same message to the same destination, only one copy arrives.

Which plans include it

Duplicate detection is part of the paid plans, from Smart upwards. The safety net against loops applies to everyone, on every plan. The plan comparison is on the pricing page.

Common questions

How do I stop the same message being forwarded twice?

Switch on duplicate detection for the rule. Each relayed message leaves a fingerprint, and a new message with the same fingerprint inside the time window is dropped rather than relayed.

What time window should I use?

Five minutes covers most overlapping sources and is the default. A very long window will also drop legitimate repeats, and you will not be told which, so raise it only if you see duplicates arriving outside the window.

Does it catch messages that are almost identical?

No, the comparison is exact. Two versions of the same news with a different opening line are both relayed. If they differ only by a fixed line, remove it with find and replace and the fingerprints will match.

Two of my rules send to the same destination and only one copy arrives. Why?

A built-in protection stops the same content reaching the same destination twice within a few seconds. It exists to prevent loops from multiplying messages, and it cannot be switched off.

Try Phantom Forwarder free

7-day trial, unlimited rules. Cloud-based, anonymous, nothing to install.

Related

More guides