Archos Labs
Data as a Decision Infrastructure

Dimensional Drift In Analytics

Rob Angeles4 min readPublished
Share
Abstract illustration of dimensional drift affecting analytics integrity

The dashboard works. But the meaning moved. And most data teams never notice until trust vanishes.

A revenue dashboard still shows the same number. But “revenue” doesn’t mean the same thing it meant last month.

The model didn't break. The business just moved.

This is dimensional drift. It happens quietly, and it’s one of the fastest ways to lose leadership-level trust in analytics — not because your team made a mistake, but because no one remembered to ask: does this still mean what we think?

Semantics age faster than schemas

Most data pipelines are built to detect problems in logic or freshness. Missing columns. Failed joins. Late arrivals. We have monitoring alerts, test suites, CI checks. All good.

But those systems aren’t watching semantics. When business logic changes — when “bookings” start including renewals, or “contribution margin” absorbs discounts — nothing breaks. The names stay the same. Just the meaning changes. And that’s worse.

Tooling validates structure. Only people validate meaning.

The drift happens quietly. A product lead shifts how features are bundled. Finance reclassifies two SKUs as services instead of goods. Marketing reframes pipeline velocity around fuller-funnel cohort windows. Logical structure holds. But semantic integrity collapses.

And because it doesn’t look like an error, nobody investigates.

In one industry survey last year, 62% of data teams said they were forced to rework dashboards or reports every month due to unclear or shifting metric definitions. This isn’t because of poor modeling. It’s because business language moves faster than the models that proxy it.

The model didn’t lie. It just stopped listening.

If you’ve ever had a leadership team lose faith in your reporting, and you swear the numbers are right, this is probably why.

One delivery company shifted how discounts were recorded. Marketing coupons, now booked as part of “cost of goods,” suddenly hit contribution margin reporting. Product and Finance expected the margin drop. Marketing didn’t. Panic followed. The model hadn’t changed — but the meaning of “margin” had.

For two weeks, teams distrusted each other. And the numbers. No one had lied. The data was right. Just not right anymore.

That’s the risk of dimensional drift. The pain only shows up when decisions stall, or when teams have to waste cycles asking “wait — what exactly is this number right now?”

And by then, analytics is already on the defensive. You're explaining, not enabling.

Tooling can’t catch semantics. Behavior can.

The first instinct is often to fix this with process. Metric catalogs. Semantic layers. Documentation audits.

Those help. But they don’t address the problem directly.

Dimensional drift isn’t a code problem. It’s a coordination problem. And solving it means changing team behavior, not just adding observability.

Here’s one change that works: assign owners to meanings. Not code. Not definitions in a YAML file. Actual business owners who answer the question, “is this metric still reflecting what we care about?”

For example: if "Active Users" is in your investor deck, someone in Product or Ops should validate that the inclusion rules still align with how the business thinks about activity. If six months ago it meant login within 30 days, and now it includes passive API access, that change needs review — not just implementation.

And that check needs to happen regularly. Especially for metrics used in exec decks, board reports, or team comp plans.

Most disagreements about "trust in data" aren’t really technical. They’re linguistic.

How to start noticing drift before it hurts

Look for signs of surface harmony masking deep incoherence. Teams smiling over KPIs while quietly making separate spreadsheets to double-check everything.

Here are a few things that often signal semantic drift in progress:

  • Analysts arguing about metric meaning, not metric logic.
  • Business units quietly building their own “version” of a dashboard.
  • Field names that persist long after business usage has changed.
  • Increasing time-to-decision despite more data availability.

You can’t stop semantic change. It’s part of operating at speed.

But you can create a flywheel where detection is normal, not reactive. Don’t wait for major outages or reporting escalations. Encourage teams to flag when business logic changes — not just because it affects operations, but because it affects meaning.

When teams get in the habit of asking "does this metric still reflect our intent?", semantic trust gets restored.

And models start working again.

Share
Rob Angeles

Written by

Rob Angeles

Most consulting engagements split the thinking from the doing. Rob doesn't. Principal Consultant at Archos Labs, he owns the full stack — assessment, architecture, delivery — across retail, financial services, healthcare, and government.