Skip to main content

What is Data profiling?

As Wikepdia says :
Data profiling is the process of examining the data available in an existing data source (e.g. a database or a file) and collecting statistics and information about that data. The purpose of these statistics may be to:
  1. find out whether existing data can easily be used for other purposes
  2. Give metrics on data quality including whether the data conforms to company standards
  3. Assess the risk involved in integrating data for new applications, including the challenges of joins
  4. Track data quality
  5. Assess whether metadata accurately describes the actual values in the source database
  6. Understanding data challenges early in any data intensive project, so that late project surprises are avoided. Finding data problems late in the project can incur time delays and project cost overruns.
  7. Have an enterprise view of all data, for uses such as Master Data Management where key data is needed, or Data governance for improving data quality

Now this is all we know. The real question though is - How to get the profiling done correctly? What kind of companies or consultants available in the market? What kind of services they provide? Are they in my budget ? What is my ROI for doing this?

So We really need answer on :

Why - should I do it?

Who - will provide me this services

What - are my options, cost and ROI of doing this?

How - this needs to be done and how much is the time.

Once this is done what will be the next thing? What will I get ?

Watch this space next monday to have all your questions answered here.

Comments

Post a Comment

Popular posts from this blog

Master Data Management – Product or Process ?

I have 2 SAP systems and I want to fix my material master, Services Master. I want all that data to be clean, standardized, classified, enriched and load it back to my SAP in next 6 months. What do you suggest ? Chris - one of my key client was explaining during a “solution understanding” call. My sales manager Tom, enthusiastically started talking about new version of the MDM platform by ERP company, tools, technologies, product landscape, licenses etc. After 30 minutes of sales pitch, I could see confusion on Chris’s face clearly. He said - but I don’t want to add any new product in my infrastructure for all this. Can you just implement MDM for me without I adding any new software ?   Both are using MDM implementation as a keyword, but in a completely different context. Chris wants to implement MDM as a process while Tom was trying to sell MDM as a new software. Whats the difference ? Lot I will say. MDM as a product – when you sell a   software license to a customer
4 comments
Read more

Journey of procurement transformation begins with..….. Part II

 Original Blog post - https://www.linkedin.com/pulse/journey-procurement-transformation-begins-part-ii-prashant-mendki Procurement transformation journey is complex, cross functional, time consuming and even frustrating at times. The very basic but a strategic step to start this journey is “Spend Analysis”. Again – this has to be done in a right way to get the potential benefits. We talked about that in first part of this article https://www.linkedin.com/pulse/journey-procurement-transformation-begins-part-i-prashant-mendki By definition – Spend Analysis is an analysis of your spend (invoice paid), what items you are spending on (product), who you are paying to (supplier). It looks really simple – no? When I worked with one of the large Media Entertainment company few years back, they had thousands of suppliers, millions of transactions, good amount of Maverick spend. It’s a global business with more than $2Bn in Spend, 12 different global systems. Thousands of transacti
Post a Comment
Read more

Who in Supplier diversity program - An interesting Aspect

Last week after I posted third part of my Supplier diversity series of - What Why and How, I got an question from my esteemed senior colleague Ashok Pai, Who works in Supply chain industry worldwide for decades and a Client Partner with Bristlecone, asking "When are you writing about WHO aspect of this?" I replied saying I never thought of that angle, as my basic assumption was that supplier onboarding process is part of strategic sourcing and procurement department chain so those are the people who will be implementing it. And then he mentioned to me that "Look at it from supplier onboarding angle, which is a major pain area for US industry". As I started thinking and researching from that angle, I realized that as a part of diversity implementation its easy to say that run the diversity program in industry, capture supplier attendtion, get the diverse suppliers registered and start doing business with them - its hard to implement. Its really hard to get a new su
1 comment
Read more