XAI – A Data Scientist’s Mouthpiece

If it does creep in, how does one find out and nip the problem in the bud without waiting for the algorithm to start actively discriminating or giving unintended results?  The folks over at FAT-ML (Fairness and Transparency in Learning) have taken up this noble cause.

While my reason of “increasing data science-product sales” may not be as noble, the use of XAI to explain algorithmic results to the ‘humans-in-the loop’ is completely in alignment with the aforementioned group .

Where does the eXplainability come from ?The explainability in  XAI comes from a set of techniques that add contextual adaptability and interpretability to machine learning models.

I would combine the two terms and call it “contextual reasoning”.

There is no formal mathematical definition for this term, but one may say that it is the ability to come to a conclusion from  concepts (like a human) rather than by just using probability.

For example, if one were asked to assign a reason why two fingers ( like in the picture alongside) have been raised – A human may assign a reason looking at the burger joint in the background or the black and white photos of soldiers grinning on the battlefield .

An algorithm on the other hand would calculate the probability distribution of what the two raised fingers mean from a large collection of training photographs  of people holding up the “v”-sign from the internet and then associate a reason based on this distribution.

So over a large number of cases , the algorithm may prove correct, but there would come a case of a soldier holding up the same sign at a burger joint that could cause problems because the algorithm would get confused because it associates soldiers holding up signs to victory.

If a human were to understand that the algorithm was biased by the large number of world war II photographs on which the model was trained, then he would make effort to circumvent such conclusions .

In fact, this would  also help  the data-scientist who trained the model, pointing him towards the need to de-bias the training photographs.

The story does not end here however.

Hoping that my readers have understood contextual reasoning, I bifurcate context into two subtypes – local context and global context .

Here is another example that illustrates the difference between the two.

The highest temperatures ever recorded may not be worry some in the middle of the Sahara desert ( local context) but is definitely concerning if its so across the globe ( global context ….

yes i did that ) .

The set of techniques under XAI can be grouped by the kind of contextual information they provide.

By no means are these techniques new.

Some of them like “global feature importance have been around for quite a while, but it is certainly new that data scientists  can combine these techniques to enable an algorithm explain itself in their absence .

In the next part of this blog series, I will delve into the kind of techniques covered under XAIReferences:https://www.




pdfExplainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models Wojciech Samek, Thomas Wiegand, Klaus-Robert Müllerhttps://www.


com/news/252457364/Explainable-AI-How-and-why-did-the-AI-say-trueThe author has a decade of experience leading data science teams in startups and larger organizations.

His educational background is in Robotics, Physics and Finance.

  He is currently working as the Director of Data Science at Digite Inc.

implementing an XAI pipeline for their product RISHI – XAI for Enterprise Project Intelligence.

He is a regular blogger and has spoken at various conferences.

Bio: Adurthi Ashwin Swarup is the Director of Data Science at Digité Inc.

He brings with him a decade of experience in leading data science teams.

He has worked with both startups and larger organizations to solve data science use-cases across industry verticals.

His educational background revolves around physics, robotics, and finance.

He blogs, speaks at conferences and often works on distributed algorithms for GPUs.

Resources:Related: var disqus_shortname = kdnuggets; (function() { var dsq = document.

createElement(script); dsq.

type = text/javascript; dsq.

async = true; dsq.

src = https://kdnuggets.



js; (document.

getElementsByTagName(head)[0] || document.


appendChild(dsq); })();.. More details

Leave a Reply