Logo-amall

Hello all. Do you plan including in the pipelines a component for the analysis of the AI models with explainable AI toolkits (like for example: or )?

Last active 15 days ago

15 replies

2 views

  • LU

    Hello all. Do you plan including in the pipelines a component for the analysis of the AI models with explainable AI toolkits (like for example: or )?

  • SA

    Hey @lunzueta, Thank you for reaching out, at this time, we do not currently have a short-term plan for a component that can perform inspection and interpretation of AI models. However, we would greatly appreciate if you could submit a proposal for this component to our Roadmap . Additionally, if you have a specific use-case in mind where such a component would be particularly beneficial, we would be happy to discuss it further with you.

  • HA

    I believe @noble.ackerson was also looking into the same thing maybe he has some thoughts?

  • LU

    In principle, we'd be interested in being able to analyze the performance of trained models (especially black-box models, like deep neural networks for computer vision tasks) with metrics beyond accuracy, processing time, etc. before we decide to replace the model in production. Recent model-agnostic XAI methods look very appropriate for that. But, yes, we'll try to be more specific in the feature request. We'll think in a more specific use-case and we'll put a proposal in the roadmap. Thanks

  • SA

    Thank you so much for the feedback! We appreciate the interest in utilizing ZenML in this regard. Looking forward to learn more about the use-case.

  • NO

    @lunzueta, I brought ZenML up in the AIF360 slack as well as I'm unclear about which integration points could make sense to validate this need or which stage makes more sense i.e. pre-proc, training, or post-processing.
    Let's talk about the approach if your time permits so that we can detail the ask when we submit the idea for roadmap.
    I'm available throughout the day.

  • LU

    Well, maybe I asked for this too quickly haha. I have to review more in detail what you say, because maybe it's not only in one integration point but in more than one. I don't think I'll do it soon. I'll need some timeā€¦

  • LU

    Related with this question too, there's another thing that I'm not sure if you are considering in ZenML: the model cards:

  • LU

    (sorry I didn't check yet in detail all the things you have in ZenML)

  • HA

    How would you use model cards with ZenML?

  • LU

    In a similar way to how they are integrated in TFX

  • HA

    So a step that would produce a model card automatically?

  • LU

    Ideally yes

  • HA

    I suppose we dont need a special integration for that :slightlysmilingface: You can just create a step that does what you need with the model card library

  • LU

    Okay

Last active 15 days ago

15 replies

2 views