Have you ever experienced the frustration of needing data to make informed decisions, only to find it incomplete or unavailable? As a decision maker, you understand the critical importance of having accurate data and insights to support your business decisions. It's not just about having data, but about having the correct data at the right time.
It's an everyday struggle in the business world. Even the most seemingly well-organized companies face data issues behind closed doors. New businesses often over-rely on tools and AI, hoping to bypass the need for a solid data foundation. Meanwhile, established companies are frequently hindered by legacy technologies and outdated processes.
Businesses that cannot leverage clean, accurate data for insights are at risk of making decisions based on assumptions, inaccurate data, or even a “gut feeling.” The potential consequences of such choices are significant, making it a risk not worth taking.
In 2012-2013, JCPenney's CEO, Ron Johnson¹, made decisions based on his successful experience at Apple retail stores and industry assumptions rather than JCPenney's customer data. He eliminated coupons and sales, implemented "everyday low pricing", and redesigned stores to be more minimalist – all without testing these changes with JCPenney's specific customer base.
He relied on:
This approach resulted in a $985 million² loss in 2012. Sales dropped 25%, and Johnson was fired after 17 months. The company nearly went bankrupt because their core customers actually loved the "hunt" for deals and coupons – something data would have revealed.
In contrast to JCPenney's disastrous business transformation, Target's analytics team analyzed purchasing patterns and found that pregnant women buy specific product combinations (unscented lotions, supplements, cotton balls) at predictable times during pregnancy. They used this insight to create targeted marketing campaigns.
This data-driven approach involved:
This intelligent approach enabled Target to send relevant coupons to expectant mothers at precisely the right time, significantly increasing customer lifetime value and market share in baby products, without customers even realizing how Target knew they were pregnant³.
The key difference: JCPenney’s leadership ignored their customers’ actual preferences, whereas Target’s team let customer data guide their strategy, resulting in one of retail’s most successful predictive analytics programs.
When analyzing many established businesses and their processes, it becomes clear that there is a significant potential for improvement in data integration. Many software systems fail to integrate well, communicate poorly, or fail to communicate at all. Data is typically siloed in a single database or spread across multiple directories and files on shared drives, such as Google Drive or OneDrive — often referred to as “junkyards” — with poor version control and exponential backups that nobody will ever use. Add multiple file formats with no conventions or standards to follow, and you have chaos: poorly structured data that needs extensive manipulation to extract any valuable insights.
It is very common to see business intelligence tools added to legacy systems to make sense of the data. However, these tools require an ETL (extract, transform, load) process to prepare the data before it can be used for visualization or to gain valuable insights. More often than not, this process becomes a data destruction pipeline due to incorrect usage or simply because we’re trying to force-fit existing data sources. It’s crucial to focus on fixing the underlying problems rather than settling for what we have.
Our team recently had the opportunity to fully engage in a complex project. We’ve been deeply involved in conducting comprehensive data analysis for a significant healthcare organization. Our involvement has been crucial in helping a team of consultants interpret the data and enhance the monitoring of business-critical KPIs. Unfortunately, we are bound by an NDA, preventing us from disclosing the organization’s name or the consulting company we’ve been collaborating with on this intricate project.
With nearly a decade of operation under their belt, the organization had been diligently tracking data through various KPIs for several years. While the business appeared successful on the surface, it was grappling with profitability issues.
Despite the software's inherent limitations, the primary issue was that the staff were not using it as intended. This misuse, coupled with unstandardized business processes, resulted in poorly structured data scattered across multiple drives, files, and databases.
Most people working there or joining the organization later inherited the system as it was. It initially had loose business processes, and over time, it inherited additional issues through business acquisitions and the adoption of acquired business practices or software solutions, so everyone continued to follow bad practices. Change is needed. They didn’t know how to change it, so they were “hacking” the system.
Our team deployed our full analytics capabilities, running multiple initiatives simultaneously to gather valuable insights and understand the current state of the business. We conducted a comprehensive audit to analyze their core business processes, workflows, and software systems. Our approach included an in-depth data quality assessment to identify issues, statistical analysis to uncover hidden patterns, and process evaluation to map how work actually gets done versus how it should.
After evaluation and GAP analysis, our focus shifted towards data governance and data integrity. We performed extensive validation, evaluating the correctness and accuracy of the data in their software systems and comparing them with the reports and insights in their business intelligence tools. Our team conducted detailed analyses, identified discrepancies in data matching between systems, and performed cross-system reconciliations. The result was not surprising: a significant data mismatch, quantified through our data quality assessment.
Due to the urgency and short timeline, we focused on providing actionable insights rather than correcting or improving the existing system. Our team swiftly built a semi-automated process that combines existing data sheets from their drives with reports we generated and exported from their primary software. We applied data cleansing techniques, dynamic filtering, and generation, and extracted and manipulated crucial data points to build dynamic reports that integrated different data sources. This multi-source approach enabled our team to quickly visualize the business's current state and identify critical trends, providing real-time visibility into their operations.
As part of our change management approach, we tracked initiative performance, built predictive models to forecast profitability, and estimated when the business would become stable and profitable. We implemented robust data governance, trained their personnel, and established new KPI-tracking methods, providing stakeholders with a clear view of progress. We also developed a semi-automated reporting system, which ultimately began showing measurable progress.
Recall the frustration your team felt the last time they spent hours hunting for a single document, hoping it contained the needed data, only to come up empty-handed. Beyond the lost hours, there's a deeper cost to consider.
Imagine if that missing data were business-critical and vital decisions hinged on it. Without that crucial piece of information, you're left to make assumptions or rely on gut feelings. Even if your decision turns out well, you've missed an opportunity for growth or potentially made a choice that could harm your business.
When your team lacks proper training, especially in data management, and your onboarding process is poor or non-existent, untrained personnel create cascading problems. Data generated by incorrect software usage, regardless of the system's limitations, will be poorly formatted and unreliable. This prevents you from gathering accurate insights that could impact critical business decisions.
Consider basics such as folder structure, file naming conventions, and standardized formats. These simple practices can dramatically reduce the time spent searching for information.
Why do so many companies dread audit season? Because nobody can find anything promptly when it matters most. However, by implementing a robust data management system and providing comprehensive training, you can avoid this situation and ensure that your team is always prepared for audits and other critical tasks.
Every process step is crucial. The way business processes are executed, tracked, and monitored directly impacts your bottom line. By addressing these foundational issues, you can turn lost time into productivity. More importantly, you can transform gut-feeling decisions into data-driven strategies that could revolutionize your business. Audit periods become routine, and your team operates with confidence, which naturally reduces turnover.
A small upfront investment and intelligent planning from the start will keep your business competitive, adaptable, and profitable, providing a sense of reassurance and security amid uncertainty.
