What data do we have?
What data do we have?
Such a simple question and one any senior executive or manager might ask. In most organizations, an executive asking this question to an average data geek would receive an answer so complex that their eyes would gloss over in about twenty seconds.
I've been pondering this type of question for a very long time and yet I still don't know a very good way to answer it.
In the past I've built data dictionaries in MSExcel and socialized this with folks who might have asked me the question. The response is usually a "thanks" but deep down I know they are like "huh?". These .xls files typically contain a list of tables and fields with associated metadata such as short descriptions of the tables/fields and data types and sizes of the fields. Much too granular.
I've built a "Information Catalog" in PHP which works for me at the very granular (table/field) when I'm doing database development work. Most folks outside someone who is developing on that database probably wouldn't "get" this tool though. The tool took the .xls version of the data dictionary to a whole new level as it allowed for easy loading, quick entry of descriptions and flickr-like tagging capabilities at the table level. Again, very useful for me but "gobbledygook" for an executive as it's really just a step up from the .xls solution.
I've never worked with a formal metadata repository but I've seen enough of the dog-and-pony shows by those vendors to know that they aren't going to really answer the executives simple question.
I wish I could find some examples of cases where folks have illustrated or inventoried their "data assets" in a fashion most senior executives would understand. I'm talking "way" beyond (or is it way "above"?) a simple list of databases and their tables and their fields. Something that a CEO can go and show their other CEO friends and say, "Hey fellow golf buddies, look what I got from my data geeks, my data geeks are better then your data geeks!".
We really need to figure out a way to inventory and illustrate our data assets so that we could understand our data. Such an inventory could answer fundamental questions like:
- Where do these data assets physically reside (servers, database names/types, etc.)
- Where does this data come from?
- Where is this data used and where does it go?
- How good is this data? Are their data quality issues and if so are they chronic?
- Who are the resident experts for this data?
- What did/does it cost to obtain and manage this data?
- Can we sell our data?
- ...insert a slew of additional questions here...
& last but not least...
- What data do we have?
If anyone out there has had success beyond simple data dictionaries I'd love to hear about them.
Until next time...Rich
Such a simple question and one any senior executive or manager might ask. In most organizations, an executive asking this question to an average data geek would receive an answer so complex that their eyes would gloss over in about twenty seconds.
I've been pondering this type of question for a very long time and yet I still don't know a very good way to answer it.
In the past I've built data dictionaries in MSExcel and socialized this with folks who might have asked me the question. The response is usually a "thanks" but deep down I know they are like "huh?". These .xls files typically contain a list of tables and fields with associated metadata such as short descriptions of the tables/fields and data types and sizes of the fields. Much too granular.
I've built a "Information Catalog" in PHP which works for me at the very granular (table/field) when I'm doing database development work. Most folks outside someone who is developing on that database probably wouldn't "get" this tool though. The tool took the .xls version of the data dictionary to a whole new level as it allowed for easy loading, quick entry of descriptions and flickr-like tagging capabilities at the table level. Again, very useful for me but "gobbledygook" for an executive as it's really just a step up from the .xls solution.
I've never worked with a formal metadata repository but I've seen enough of the dog-and-pony shows by those vendors to know that they aren't going to really answer the executives simple question.
I wish I could find some examples of cases where folks have illustrated or inventoried their "data assets" in a fashion most senior executives would understand. I'm talking "way" beyond (or is it way "above"?) a simple list of databases and their tables and their fields. Something that a CEO can go and show their other CEO friends and say, "Hey fellow golf buddies, look what I got from my data geeks, my data geeks are better then your data geeks!".
We really need to figure out a way to inventory and illustrate our data assets so that we could understand our data. Such an inventory could answer fundamental questions like:
- Where do these data assets physically reside (servers, database names/types, etc.)
- Where does this data come from?
- Where is this data used and where does it go?
- How good is this data? Are their data quality issues and if so are they chronic?
- Who are the resident experts for this data?
- What did/does it cost to obtain and manage this data?
- Can we sell our data?
- ...insert a slew of additional questions here...
& last but not least...
- What data do we have?
If anyone out there has had success beyond simple data dictionaries I'd love to hear about them.
Until next time...Rich
Comments
I'll see if I can add to your data dictionary model and come up with some good ideas.
We've tried something we called a "Data Map", basically a very highlevel ER schema with all the company's data that fits on a single PowerPoint slide. It's part of something I want to discuss on my blog in the future, but I could send out a sample or do a rough post if anyone's interested.
I think part of the solution is presenting the information in very visual ways. A picture really is worth a thousand data models.
I think you've put your finger on one of the key issues facing data people today.
Abstraction is for hiding the details, not lying about them.
I wonder if there are any good ways to take the detailed metadata that we collect in ER models and generate a higher level picture. Maybe some kind of mind map or a word cloud that would help a savvy-but-not-technical executive understand more easily. Interesting experiment... watch for a blog post from me in the next few days...
The best way I have found to handle this question is to turn it around.
Respond with "It's not about the data we have, it's about the Information we have"
Talk about your data in the context of information and the business will understand it. If they don't, they probably never will...
Execs don't ask how many widgets they have for production of XYZ product, they ask what the production capacity is to produce XYZ product. Treat discussions about data in the same way and you will get their attention.
Cheers
Charles
1/ the information that is important (such as definitions, rules, stakeholders, issues) is easily accessed and searchable
2/ it allows for both business and IT to collaborate on potential changes to the rules etc,
3/ it can easily be maintained and therefore the information is kept up-to-date.
4/ We can track the usage (or hits) each term receives which tells us which information the users are most in need of.
We know this provides value to our users because in 1 year the hits to this information has increased by 200%.
This strategy doesn't meet all the needs you identified but it has helped us communicate, engage and raise awareness of data quality.
Thanks very much