Skip to main content

What is Data profiling?

As Wikepdia says :
Data profiling is the process of examining the data available in an existing data source (e.g. a database or a file) and collecting statistics and information about that data. The purpose of these statistics may be to:
  1. find out whether existing data can easily be used for other purposes
  2. Give metrics on data quality including whether the data conforms to company standards
  3. Assess the risk involved in integrating data for new applications, including the challenges of joins
  4. Track data quality
  5. Assess whether metadata accurately describes the actual values in the source database
  6. Understanding data challenges early in any data intensive project, so that late project surprises are avoided. Finding data problems late in the project can incur time delays and project cost overruns.
  7. Have an enterprise view of all data, for uses such as Master Data Management where key data is needed, or Data governance for improving data quality

Now this is all we know. The real question though is - How to get the profiling done correctly? What kind of companies or consultants available in the market? What kind of services they provide? Are they in my budget ? What is my ROI for doing this?

So We really need answer on :

Why - should I do it?

Who - will provide me this services

What - are my options, cost and ROI of doing this?

How - this needs to be done and how much is the time.

Once this is done what will be the next thing? What will I get ?

Watch this space next monday to have all your questions answered here.

Comments

Post a Comment

Popular posts from this blog

Master Data Management – Product or Process ?

I have 2 SAP systems and I want to fix my material master, Services Master. I want all that data to be clean, standardized, classified, enriched and load it back to my SAP in next 6 months. What do you suggest ? Chris - one of my key client was explaining during a “solution understanding” call. My sales manager Tom, enthusiastically started talking about new version of the MDM platform by ERP company, tools, technologies, product landscape, licenses etc. After 30 minutes of sales pitch, I could see confusion on Chris’s face clearly. He said - but I don’t want to add any new product in my infrastructure for all this. Can you just implement MDM for me without I adding any new software ?   Both are using MDM implementation as a keyword, but in a completely different context. Chris wants to implement MDM as a process while Tom was trying to sell MDM as a new software. Whats the difference ? Lot I will say. MDM as a product – when you sell a   software license to a...
4 comments
Read more

Data Management - Terminologies & Definitions

As a third step in my Data Management article series – lets look at commonly used terminology in the domain. Now these are very standard definitions I am quoting from a standard available glossary. The next step – next article would be to explain the relevance and usage of these terminology in business world. E.g. How to look at data standardization in supplier data context or material data context – when it comes to optimizing your procurement processes. That’s next. In my first article in this data management series –I compared data management with the story of elephant and seven blind men. http://manageyourdata.blogspot.in/2012/09/data-management-elephant-seven-blind-men.html The second post is more about – why its important to speak same language when you are running any data management initiative.   http://manageyourdata.blogspot.in/2012/09/data-management-are-we-all-speaking.html Data analysis : Analysis of data is a process of inspecting, cleaning, transfo...
1 comment
Read more

Journey of procurement transformation begins with..….. Part II

 Original Blog post - https://www.linkedin.com/pulse/journey-procurement-transformation-begins-part-ii-prashant-mendki Procurement transformation journey is complex, cross functional, time consuming and even frustrating at times. The very basic but a strategic step to start this journey is “Spend Analysis”. Again – this has to be done in a right way to get the potential benefits. We talked about that in first part of this article https://www.linkedin.com/pulse/journey-procurement-transformation-begins-part-i-prashant-mendki By definition – Spend Analysis is an analysis of your spend (invoice paid), what items you are spending on (product), who you are paying to (supplier). It looks really simple – no? When I worked with one of the large Media Entertainment company few years back, they had thousands of suppliers, millions of transactions, good amount of Maverick spend. It’s a global business with more than $2Bn in Spend, 12 different global systems. Thousands of trans...
Post a Comment
Read more