Three things I know: taking over the family business
How many times did I secretly wish for my father to leave the business and leave me the sole “Queen” on board? Ten years later, I cannot imagine working without him by...
Brain Circuits
Are you in touch with your dark side?
Generative AI offers organizations the opportunity to create economic value out of their data but a significant volume of that data – so-called “dark data” – goes unused, constituting a massive environmental problem. Take this short quiz to test your understanding of the dark data dilemma and read on for three tips on managing your data in more profitable and sustainable ways.
What exactly is dark data?
a. The information you hold on individuals that is subject to data protection rules.
b. Documents, emails, images, and videos the organization has amassed over time.
c. Information you have acquired but which has no formal record regarding its source.
Answer: (b). It sounds sinister but dark data, as defined by Gartner, simply refers to “the information assets organizations collect, process and store during regular business activities, but generally fail to use for other purposes, such as analytics, business relationships and direct monetizing.”
What volume of data is unused and becomes dark?
a. 10%
b. 30%
c. 95%
Answer: (c). Staggeringly, less than 5% of the huge data reservoirs that organizations collect are used, while the rest sit untapped in vast lakes. Given that data centers now account for 2-3% of global greenhouse gas emissions, this presents a huge challenge to meeting carbon-reduction goals.
Why does data “go dark”?
a. Because someone decided it would be a good idea to store all the information that passed through the organization in a vast data warehouse but didn’t label it appropriately.
b. Because people who could exploit its potential don’t know it’s there or don’t understand its value.
c. Because it’s stored in different departments, leading to data silos, fragmentation, isolation, and a general lack of visibility.
Answer: All of the above – and much more. Many factors contribute to the build-up of dark data. Other significant causes include a lack of robust data governance, failure to integrate legacy systems, changing business priorities, organizational data illiteracy, and the accumulation of ROT (data that is redundant, obsolete, or trivial).
Managing your dark data: three recommendations for business leaders
- Evaluate your AI use cases not just for their potential business value, but also for their environmental impact. Consider the carbon footprint of your AI applications and opt for alternatives that use less data (data minimalism) and less energy.
- Adopt a structured approach to categorize your data and implement stringent policies for its lifecycle management, including archival and deletion protocols.
- Rethink how you store the data and, most importantly, how you design and maintain your data pipelines (the process whereby raw data is captured from various data sources and then ported to data storage, such as a data lake or data warehouse, for analysis).
Further reading
AI and the hidden climate cost of ‘dark data’
Monetizing data in the AI era: increasing profits while preserving privacy
Data collectives are the next frontier of labor relations
Authors
Related
Why leaders should learn to value the boundary spanners
Entrepreneurial talent who work with other teams often run into trouble with their managers. Here are ways to get the most out of your ‘boundary spanners’...
Audio available
Cracking the culture code: how to ensure maximum team performance
Culture shapes how people work together, make decisions, handle conflict, and support each other. Ask yourself the following questions to check where your teams might be going wrong, and read on for tips on maximizing...
How to prevent employee burnout through a growth mindshift
When we feel stressed, we’re more likely to operate from a place of fear and fall back on a mindset that is fixed, judgmental, and focused on polarities – behaviour that soon...