Run a Receivables Tone Experiment

This guide runs a controlled A/B comparison between two tone profiles. The experiment assigns eligible customers to one profile. It keeps each customer's assignment stable. It reports recorded payment conversions by variant.

Prerequisites

• At least two reviewed tone profiles exist.
• A workflow with tone turned on sends payment communications from a template.
• The workflow has customer context and real eligible traffic.
• You set up the workspace's AI and communication providers.
• Invoice payment and recovery records are reliable.
• The team defined the hypothesis, observation window, minimum sample, and decision owner.

An Auto-chase policy that you create only through Settings → Receivables Controls is not enough evidence that the messages use a tone profile. That form does not attach a template or a tone profile.

1. Define One Testable Hypothesis

Choose one deliberate difference, for example:

• empathetic versus neutral words
• neutral versus firm words
• lower versus higher urgency
• standard versus simplified reading level

Write down:

• expected direction of change
• target customer population
• start and end dates
• minimum assignment count per variant
• primary metric
• conditions that must stop the test

The page reports assignment and conversion rates. It does not calculate statistical significance. It does not find a safe sample size.

2. Prepare Variant A and B

1. Open Receivables → Tone Profiles.
2. Create or edit the two profiles.
3. Give each a clear experiment-safe name.
4. Examine preset, formality, empathy, urgency, reading level, and brand voice.
5. Examine blocked phrases, necessary disclaimers, and maximum length.
6. Save both profiles.

Do not make the variants differ in many unrelated ways when you must understand why one variant did better.

3. Confirm the Eligible Communication Path

Before you create the experiment, send an approved communication to a controlled test recipient through the same workflow.

Confirm:

• the workflow uses a communication template
• a template-specific or team-default tone profile is available
• customer context is present
• the AI provider transforms content when expected
• the provider sends the message
• the original template is safe if transformation fails

A tone failure falls back to the original content and does not stop the send. Content rules help you check the transformation. They do not replace your examination of the base template.

4. Create the Experiment

1. Open Receivables → Tone Experiments.
2. Select New Experiment.
3. Enter a name.
4. Add an optional description with the hypothesis and the planned window.
5. Choose the profile for Variant A.
6. Choose a different profile for Variant B.
7. Set the percentage that goes to A. Eigenn gives the remainder to B.
8. Select Create experiment.
9. Confirm that the status is Draft.

Use a two-sided split such as 50/50 when both variants need comparable volume. Eigenn lets you set a 0/100 or 100/0 split. That split cannot give a useful two-variant comparison.

5. Start the Experiment

1. Select View details.
2. Recheck the variant names and traffic split.
3. Select Start experiment.
4. Confirm that the status is Running.
5. Confirm that the started time appears.

Only one experiment can run for the team. If the page names another active experiment, pause or complete that experiment first.

6. Let Assignments Accumulate

While the experiment is active, an eligible communication can assign its customer to A or B. The first assignment for that experiment is sticky. Later eligible messages to the same customer use the same variant.

This means:

• the traffic split controls assignment probability, not exact counts
• repeat messages do not create a new assignment for the same customer
• the denominator represents assigned customers, not messages
• small samples can show an unbalanced result

Open View details to examine the A and B counts and the customer IDs. If no assignments appear, do not assume that the experiment works.

7. Preserve the Payment Observation Window

Keep the experiment Running while assigned customers have a reasonable opportunity to pay. The supported automatic outcome path looks for active experiments when it records a recovery payment conversion.

If you pause or complete the experiment too early, later payments can stay unattributed. Manual invoice status changes and some alternative payment paths can also fail to populate an experiment outcome.

Before you end the test:

1. Confirm that the assigned customers got the intended eligible communication.
2. Let the planned payment window pass.
3. Reconcile recorded payments and invoice status.
4. Confirm that the experiment summary shows updated outcomes.

8. Read the Results

The details view shows total and per-variant:

• assignments
• conversions
• conversion rate

Interpret conversion rate as:

assigned customers with a recorded true paid/converted outcome ÷ assigned customers

It is not:

• delivered messages divided by sent messages
• amount recovered divided by amount due
• time to payment
• proof that tone caused the difference

Compare sample sizes and source records before you compare percentages. One conversion in a very small group can produce a large but unstable rate.

9. Pause or Complete Deliberately

Use Pause when the test must stop the intake of eligible traffic for a time. Automatic payment attribution can also stop during the pause.

Use Mark completed only after the observation window closes.

1. Select Mark completed.
2. Confirm the completed time.
3. Examine both variant rates again.
4. Select Variant A wins or Variant B wins only when the decision owner approves.

The winner selection is a label on the experiment. It does not change live communication behavior by itself.

10. Roll Out the Winner

1. Open Receivables → Tone Profiles.
2. Select Set Default on the profile that won, when it must become the fallback.
3. Update each template-specific profile that must use the winner.
4. Send a controlled message through each affected workflow.
5. Check the transformed content, the necessary language, the provider delivery, and the analytics attribution.

Keep the profile that lost until you examine all dependent templates, segment rules, and experiment records.

11. Preserve or Delete the Experiment

Keep the completed experiment when its assignment and conversion record is useful for audit or future comparison.

Use Delete only when you want permanent removal. Delete removes the experiment and its assignments. You cannot reverse it. The experiment list does not show a separate confirmation dialog for this action.

Acceptance Checklist

The experiment is complete when:

• you defined the hypothesis and the observation window before launch
• A and B are different, reviewed profiles
• you checked the eligible workflow and the base template
• the experiment was the team's only active experiment
• both variants accumulated a useful assignment count
• you reconciled the payments and the invoice records
• you thought about the limits of the result
• you selected the winner manually
• you updated the default and the template configuration separately
• you checked the messages after rollout

Troubleshoot

New Experiment is unavailable

Create tone profiles first. A meaningful experiment needs at least two different profiles.

Start experiment fails

Another experiment is already active. Open it. Then pause it or complete it before you start the new one.

No assignments appear

Confirm that the status is Running. Confirm that the workflow prepares template-based communications with a tone profile and customer context. A saved experiment or a basic recovery policy does not generate traffic.

One variant has far fewer assignments

Assignment is random and sticky for each customer. Wait for more unique eligible customers. Confirm that the split you set is not near 0% or 100%.

Payments happened but conversions remain zero

Check whether Eigenn assigned the customers. Check whether the experiment was still active when Eigenn recorded the supported recovery outcome. Check whether the payment path writes an experiment outcome. A manual paid status can leave the summary unchanged.

Tone Profiles delivery counts disagree with experiment assignments

The two views use different attribution. Tone analytics group tracked communications by the profile that links to the template. The experiment view counts customer assignments and recorded outcomes.

The winner selection changed nothing

Open Tone Profiles. Set the intended default. Update the template-specific configuration. Winner selection does not deploy the profile.

Related Pages

• Tone Profiles and Experiments
• Receivables Controls
• Configure Receivables Controls
• Invoice Collection Workflow
• Receivables