What Working With Your Data Involves
Not every project needs all of these parts:
- collection: automatically pulling data from the systems where it lives;
- cleaning: fixing errors, duplicates, empty fields and inconsistent formats;
- integration: linking records across systems, such as ad source, lead in the CRM and payment in accounting;
- reporting: dashboards that update automatically and show consistent numbers;
- analysis: finding patterns and answering specific business questions.
Sometimes the task is narrow, like one report on sales by channel. Sometimes you need a full reporting system for leadership, sales and marketing.
Who Needs This
- Marketing and sales see different numbers and argue over whose are right.
- The leadership report takes several hours to compile from five different systems every time.
- An online store wants to understand which customers come back and which buy only once.
- The company is planning forecasting or ML models and needs to prepare historical data first.
If the business is young and there isn't much data yet, a complex system would be overkill. A few well-built reports will do, and you can come back to a data warehouse later.
Spreadsheets, Dashboards or a Data Warehouse
We recommend the simplest option that works for you. Spreadsheets are enough for a few sources and small volumes. Dashboards in Looker Studio or another BI tool connected directly to your sources update automatically and don't need developers, but get slow and confusing when many sources must be linked. A warehouse in BigQuery, PostgreSQL or ClickHouse with automated loading gives one database for all reports, speed and any calculation, and needs development up front and maintenance whenever source systems change.
Data Preparation: What We Document With You
Most of the effort goes into what happens before the charts. Typical problems we meet: the same customer recorded in the CRM three times, products with different names and SKUs in accounting and on the website, canceled or returned orders that show up in one system and not in another, and dates and currencies stored in different formats. We document these problems and agree with you on how to handle them, so your dashboard doesn't show wrong numbers. We also agree on shared definitions of a lead, a sale and margin, so marketing and sales stop arguing over the report.
What to Prepare to Get Started
- A list of the systems your company uses and the people responsible for each.
- Read access or data exports for the available period.
- Examples of reports you use now, even if they're spreadsheets compiled by hand.
- The questions the reports should answer first.
What Affects the Cost
- Number and type of sources: services with a ready-made API are easier to connect than legacy systems without one.
- Data quality: the more duplicates and discrepancies, the more cleanup work.
- Volume and update frequency: daily reports on millions of records need a different architecture than a weekly summary.
- Number of reports and users with different access permissions.
- Analysis: a one-off question or ongoing analysis with recommendations.
Frequently asked questions
Can you connect our accounting system? In most cases, yes: via API, a direct database connection or scheduled file exports. We choose the method after getting familiar with the system. If you also need data exchange between the systems themselves, that's a job for integrations and process automation.
Who has access to our data? Only the people you grant it to. We create the warehouse in your account and assign access by role.
Do we need a dedicated in-house analyst? Not necessarily. We build reports so that managers can use them. But if you have a lot of questions, someone in-house who owns the data helps a lot.
How is this different from web analytics? Web analytics focuses on website visitor behavior. Here we work with all of your company's data: sales, customers, inventory, finance.
Who keeps the pipelines running after launch? That is agreed in advance: we can maintain the system as your source systems change, or hand it over to your team with documentation.
Why Promodex
Our 750+ projects since 2015 include websites, web services and internal systems that exchange data with CRM and accounting software. The team has developers who can set up data collection and marketers who understand what you actually need to see in reports. We explain where every number comes from, and we're upfront about where there isn't enough data to support a conclusion.