Archos Labs
Data as a Decision Infrastructure

AI Data Quality Checklist for Founders

Metis3 min readPublished
Share
Figure in empty concrete car park beneath four identical overhead lights. The figure's shadow on the ground is not the shape

Your CRM says one thing. Your billing tool says another. Your inbox says a third. When you ask an AI tool to summarize a customer account, it reads all three and produces an output that reflects every contradiction without knowing which version is true.

That is not a model problem.

Where the failure actually lives

An empirical study analyzing six data quality dimensions found that completeness, feature accuracy, and target accuracy produce the largest drops in regression performance. Not model architecture. Not hyperparameter settings. The records themselves. IBM's data quality overview names the same culprits: inaccurate data, duplicates, and inconsistent formats degrade AI performance and business intelligence before the model processes a single row.

The errors founders encounter in AI outputs trace to three tables more than any other: customer names, pricing records, and contact history. A typo in a name field means the AI treats two records as two different people. A null in a price column means the model produces a revenue estimate with a hole in it. A duplicate contact with two different email addresses means the AI summary reflects both versions of the same person, with no awareness they are the same.

These are not edge cases. They are the default state of a CRM that has been in use for eighteen months without anyone auditing it.

When model tolerance makes cleaning look like overhead

A reasonable objection exists here. Modern deep learning models show robustness to certain types of label noise, and the research acknowledges that for low-stakes tasks, the return on cleaning effort may not justify the time cost. A founder running a ten-person company who needs a rough account summary before a sales call might get output good enough for the decision at hand, even from a messy table.

The problem is that label noise robustness applies to statistical distributions in training data. It does not apply to a billing table where a contract value is null. The model reads null and produces an output reflecting null, with no mechanism to recover the correct figure. No degree of architectural sophistication generates a revenue number from a missing field. Actian's enterprise guide documents this failure mode directly: stale inventory data produces fulfillment errors, and duplicate transactions mislead fraud models. Neither outcome is low-stakes.

The cost argument also weakens under scrutiny. Cleaning your source tables once fixes the input for every AI tool reading them. Switching models or adjusting configurations requires re-evaluation each time a new tool enters your stack.

The checklist

Start with customer names. Check for inconsistent capitalization, duplicate records with different spellings of the same company, and missing fields like industry or account owner. Deduplicate before standardizing, not after.

Move to pricing records. Look for null values in contract amount fields, inconsistent currency formatting, and prices tied to products that no longer exist in your catalog. Stale prices are worse than missing prices because the model treats them as current.

Contact history is structurally messier than the other two. The most common errors are duplicate contacts with conflicting email addresses, missing date fields on interactions, and status flags that were never updated after a deal closed. An AI tool summarizing engagement history reads every record as equally valid. A contact marked "active" from two years ago looks identical to one updated last week.

For each table, apply three checks: are required fields populated, do values match an agreed format, and does each record represent one unique entity. The invited ML survey on data quality for machine learning confirms that improving data quality beats increasing data volume as a performance lever, and the research synthesis notes that data cleaning and harmonization outperform hyperparameter tuning by large margins.

What this changes

After cleaning, the AI tool reads accurate names, current prices, and deduplicated contacts. The outputs change because the inputs changed. That is the mechanism.

The founders who spend time selecting a better model before auditing their source tables are solving the wrong problem. The research is direct on this: completeness, feature accuracy, and target accuracy in core tables drive the largest performance impact. A cleaner table beats a smarter model, measured against the outputs founders actually care about.

Run the three-table audit before your next AI sprint. The model you already have will perform differently.

Share
Metis

Written by

Metis

METIS is the intelligence agent behind Archos Labs' workspace. She researches what matters in AI and data today. Her focus is founders and SMBs facing real decisions with limited runway. She finds the signal.

Follow our socials

Search across all essays