Selloff or Market Correction? Either Way, Here's What to Do NextSee Overvalued Stocks

Amazon to warn customers on limitations of its AI

Published 11/30/2022, 12:07 PM
Updated 11/30/2022, 04:46 PM
© Reuters. FILE PHOTO: The logo of Amazon is seen at the company logistics center in Lauwin-Planque, northern France, November 15, 2022.  REUTERS/Pascal Rossignol
GOOGL
-
AMZN
-
IBM
-
GOOG
-

By Jeffrey Dastin and Paresh Dave

LAS VEGAS (Reuters) - Amazon.com Inc (NASDAQ:AMZN) is planning to roll out warning cards for software sold by its cloud-computing division, in light of ongoing concern that artificially intelligent systems can discriminate against different groups, the company told Reuters.

Akin to lengthy nutrition labels, Amazon's so-called AI Service Cards will be public so its business customers can see the limitations of certain cloud services, such as facial recognition and audio transcription. The goal would be to prevent mistaken use of its technology, explain how its systems work and manage privacy, Amazon said.

The company is not the first to publish such warnings. International Business Machines (NYSE:IBM) Corp, a smaller player in the cloud, did so years ago. The No. 3 cloud provider, Alphabet (NASDAQ:GOOGL) Inc's Google, has also published still more details on the datasets it has used to train some of its AI.

Yet Amazon's decision to release its first three service cards on Wednesday reflects the industry leader's attempt to change its image after a public spat with civil liberties critics years ago left an impression that it cared less about AI ethics than its peers did. The move will coincide with the company's annual cloud conference in Las Vegas.

Michael Kearns, a University of Pennsylvania professor and since 2020 a scholar at Amazon, said the decision to issue the cards followed privacy and fairness audits of the company's software. The cards would address AI ethics concerns publicly at a time when tech regulation was on the horizon, said Kearns.

"The biggest thing about this launch is the commitment to do this on an ongoing basis and an expanded basis," he said.

Amazon chose software touching on sensitive demographic issues as a start for its service cards, which Kearns expects to grow in detail over time.

SKIN TONES

One such service is called "Rekognition." In 2019, Amazon contested a study saying the technology struggled to identify the gender of individuals with darker skin tones. But after the 2020 murder of George Floyd, an unarmed Black man, during an arrest, the company issued a moratorium on police use of its facial recognition software.

Now, Amazon says in a service card seen by Reuters that Rekognition does not support matching "images that are too blurry and grainy for the face to be recognized by a human, or that have large portions of the face occluded by hair, hands, and other objects." It also warns against matching faces in cartoons and other "nonhuman entities."

In another warning card seen by Reuters, on audio transcription, Amazon states, "Inconsistently modifying audio inputs could result in unfair outcomes for different demographic groups." Kearns said accurately transcribing the wide range of regional accents and dialects in North America alone was a challenge Amazon had worked to address.

Jessica Newman, director of the AI Security Initiative at the University of California at Berkeley, said technology companies were increasingly publishing such disclosures as a signal of responsible AI practices, though they had a way to go.

© Reuters. FILE PHOTO: The logo of Amazon is seen at the company logistics center in Lauwin-Planque, northern France, November 15, 2022.  REUTERS/Pascal Rossignol

"We shouldn't be dependent upon the goodwill of companies to provide basic details of systems that can have enormous influence on people's lives," she said, calling for more industry standards.

Tech giants have wrestled with making such documents short enough that people will read them yet sufficiently detailed and up to date to reflect frequent software tweaks, a person who worked on nutrition labels at two major enterprises said.

Latest comments

Risk Disclosure: Trading in financial instruments and/or cryptocurrencies involves high risks including the risk of losing some, or all, of your investment amount, and may not be suitable for all investors. Prices of cryptocurrencies are extremely volatile and may be affected by external factors such as financial, regulatory or political events. Trading on margin increases the financial risks.
Before deciding to trade in financial instrument or cryptocurrencies you should be fully informed of the risks and costs associated with trading the financial markets, carefully consider your investment objectives, level of experience, and risk appetite, and seek professional advice where needed.
Fusion Media would like to remind you that the data contained in this website is not necessarily real-time nor accurate. The data and prices on the website are not necessarily provided by any market or exchange, but may be provided by market makers, and so prices may not be accurate and may differ from the actual price at any given market, meaning prices are indicative and not appropriate for trading purposes. Fusion Media and any provider of the data contained in this website will not accept liability for any loss or damage as a result of your trading, or your reliance on the information contained within this website.
It is prohibited to use, store, reproduce, display, modify, transmit or distribute the data contained in this website without the explicit prior written permission of Fusion Media and/or the data provider. All intellectual property rights are reserved by the providers and/or the exchange providing the data contained in this website.
Fusion Media may be compensated by the advertisers that appear on the website, based on your interaction with the advertisements or advertisers.
© 2007-2024 - Fusion Media Limited. All Rights Reserved.