Troubleshooting

Model accuracy issues

Why your models might have lower accuracy than expected and how to improve them.

Churn model accuracy is below 80%

Accuracy below 80% is usually explained by one or more of these:

  • Insufficient data — The model needs at least 500 customers and 90 days of history. With less, scores are provisional.
  • Very low purchase frequency — Stores where customers buy once a year or less have inherently noisy churn signals. Consider the Home & Furniture workspace template which adjusts thresholds for infrequent-purchase stores.
  • Missing first_order_date — Without this, the model can't understand customer tenure, which is a strong churn predictor.
  • Heavy promotional activity — Stores with frequent large promotions have erratic purchase patterns that are harder to model. Accuracy typically improves over 3–6 months as the model learns your promotional calendar.

Model says a customer is "safe" but they've clearly churned

Check if this customer has an unusual purchase cadence (e.g., they buy every 6 months and the model's average is monthly). The model scores relative to each customer's personal rhythm — a 6-month gap for an annual buyer isn't a churn signal.

If the model is wrong, you can manually override the score from the customer profile. Consistent overrides for similar customer types can be flagged to support — they may indicate a model configuration opportunity in Model Studio.

Was this article helpful?