Home / News / Microsoft open-sources Counterfit, an AI security risk assessment tool

Microsoft open-sources Counterfit, an AI security risk assessment tool

Sign up for Turn into 2021 this July 12-16. Check in for the AI tournament of the yr.

Microsoft these days open-sourced Counterfit, a device designed to lend a hand builders take a look at the safety of AI and device studying programs. The corporate says that Counterfit can permit organizations to behavior checks to make sure that the algorithms used of their companies are powerful, dependable, and devoted.

AI is being an increasing number of deployed in regulated industries like healthcare, finance, and protection. However organizations are lagging in the back of of their adoption of chance mitigation methods. A Microsoft survey discovered that 25 out of 28 companies indicated they don’t have the fitting sources in position to protected their AI programs, and that safety pros are in search of particular steering on this house.

Microsoft says that Counterfit was once born out the corporate’s wish to assess AI programs for vulnerabilities with the purpose of proactively securing AI services and products. The instrument began as a corpus of assault scripts written in particular to focus on AI fashions after which morphed into an automation product to benchmark a couple of programs at scale.

Beneath the hood, Counterfit is a command-line software that gives a layer for antagonistic frameworks, preloaded with algorithms that can be utilized to evade and thieve fashions. Counterfit seeks to make revealed assaults obtainable to the safety neighborhood whilst providing an interface from which to construct, organize, and release the ones assaults on fashions.

When carrying out penetration trying out on an AI device with Counterfit, safety groups can go for the default settings, set random parameters, or customise every for wide vulnerability protection. Organizations with a couple of fashions can use Counterfit’s integrated automation to scan — optionally a couple of occasions as a way to create operational baselines.

Counterfit additionally supplies logging to document the assaults in opposition to a goal fashion. As Microsoft notes, telemetry may pressure engineering groups to reinforce their working out of a failure mode in a device.

The industry worth of accountable AI

Internally, Microsoft says that it makes use of Counterfit as part of its AI pink group operations and within the AI construction section to catch vulnerabilities ahead of they hit manufacturing. And the corporate says it’s examined Counterfit with a number of buyer together with aerospace large Airbus, which is creating an AI platform on Azure AI services and products.  “AI is an increasing number of utilized in trade; it will be significant to stay up for securing this era in particular to grasp the place characteristic house assaults may also be learned in the issue house,” Matilda Rhode, a senior cybersecurity researcher at Airbus, mentioned in a remark.

The price of equipment like Counterfit is readily changing into obvious. A find out about by way of Capgemini discovered that buyers and workers will praise organizations that observe moral AI with better loyalty, extra industry, or even a willingness to suggest for them — and in flip, punish those who don’t. The find out about means that there’s each reputational chance and an instantaneous have an effect on on the base line for corporations that don’t method the problem thoughtfully.

Principally, customers need self assurance that AI is protected from manipulation. Some of the suggestions from Gartner’s Best five Priorities for Managing AI Possibility framework, revealed in January, is that organizations “[a]dopt particular AI security features in opposition to antagonistic assaults to make sure resistance and resilience.” The analysis company estimates that by way of 2024, organizations which put in force devoted AI chance control controls will steer clear of adverse AI results two times as steadily as those who don’t.”

In line with a Gartner file, via 2022, 30% of all AI cyberattacks will leverage training-data poisoning, fashion robbery, or antagonistic samples to assault device learning-powered programs.

Counterfit is part of Microsoft’s broader push towards explainable, protected, and “truthful” AI programs. The corporate’s makes an attempt at answers to these and different demanding situations come with AI bias-detecting equipment, an open antagonistic AI framework, interior efforts to cut back prejudicial mistakes, AI ethics checklists, and a committee (Aether) that advises on AI interests. Just lately, Microsoft debuted WhiteNoise, toolkit for differential privateness, in addition to Fairlearn, which goals to evaluate AI programs’ equity and mitigate any seen unfairness problems with algorithms.


VentureBeat’s project is to be a virtual the city sq. for technical decision-makers to achieve wisdom about transformative era and transact.

Our web page delivers crucial data on information applied sciences and methods to lead you as you lead your organizations. We invite you to turn into a member of our neighborhood, to get entry to:

  • up-to-date data at the topics of passion to you
  • our newsletters
  • gated thought-leader content material and discounted get entry to to our prized occasions, corresponding to Turn into 2021: Be told Extra
  • networking options, and extra

Develop into a member


Check Also

google details new ai accelerator chips 310x165 - Google details new AI accelerator chips

Google details new AI accelerator chips

Raise your business information era and technique at Turn out to be 2021. At Google …

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.