Exam AIGP Topic 7 Question 14 Discussion

Actual exam question for IAPP's AIGP exam
Question #: 14
Topic #: 7
You are part of your organization's ML engineering team and notice that the accuracy of a model that was recently deployed into production is deteriorating.
What is the best first step address this?

Suggested Answer: B Vote an answer

When the accuracy of a model deteriorates, the best first step is to conduct champion/challenger testing. This involves deploying a new model (challenger) alongside the current model (champion) to compare their performance. This method helps identify if the new model can perform better under current conditions without immediately discarding the existing model. It provides a controlled environment to test improvements and understand the reasons behind the deterioration. This approach is preferable to directly replacing the model, performing audits, or running red-teaming exercises, which may be subsequent steps based on the findings from the champion/challenger testing.
Reference: AIGP BODY OF KNOWLEDGE, sections on model performance management and testing strategies.

by Kim at Dec 02, 2024, 05:25 AM

Limited Time Offer

15%

Off

Get Premium AIGP Questions as Interactive Self Test Engine or PDF

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Nick name: Submit Cancel
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
0
0
0
10