Now Tec BlogNow Tec Blog

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Managed Security Service Provider (MSSP) Market News: May 31, 2023

    May 31, 2023

    Cloud Native Computing Foundation Welcomes EY as New Gold Member

    May 31, 2023

    Rose Marie Bravo Honored by Bronx High School Science Department – ​​WWD

    May 31, 2023
    Facebook Twitter Instagram
    • Home
    • Business

      National Eating Disorder Association’s AI Chatbot Goes Offline

      May 31, 2023

      Hinge Users Can Enjoy More Dating Success With This One Trick

      May 31, 2023

      Chase Freedom Unlimited® Review: A Comprehensive Loyalty Card with No Annual Fees

      May 31, 2023

      Philip Scofield’s Boyfriend Scandal: Why Bosses Are Never Allowed To Date Juniors

      May 31, 2023

      Food stamp deal between Biden and Republicans will cost more

      May 31, 2023
    • Gadgets

      Up To 33% Off 2022 The Frame Smart TVs From Samsung

      May 31, 2023

      The best budget robot vacuums for 2023

      May 31, 2023

      The best Father’s Day tech gift ideas

      May 31, 2023

      The Morning After: Industry Leaders Say AI Is as ‘Risk of Extinction’ as Nuclear War

      May 31, 2023

      Garmin unveils high-end smartwatch for well-funded explorers

      May 31, 2023
    • Tech

      Amazon Echo Pop Review (2023): Fun to Watch

      May 31, 2023

      Millions of Gigabyte Motherboards Sold with Firmware Backdoors

      May 31, 2023

      Introducing Longevity Mania and China’s AI Regulations

      May 31, 2023

      Expand drug testing programs to combat the overdose crisis

      May 31, 2023

      China is not waiting to make rules on generative AI

      May 31, 2023
    • World

      Protesters clash with soldiers in Ghana gold mining town | Mine News

      May 31, 2023

      Zimbabwe president and parliamentary polls set for August 23 | Election News

      May 31, 2023

      Milosevic allies sentence extended in ‘groundbreaking’ ruling | Genocide News

      May 31, 2023

      Elon Musk talks about ‘intelligent networked vehicles’ in China | Automotive industry news

      May 31, 2023

      NATO peacekeepers in Kosovo set up barriers amid violent clashes | NATO News

      May 31, 2023
    • AI

      AF Leverages AI for Data Analysis > Air Force > Article Display

      May 31, 2023

      Danish Prime Minister Gives Speech Partially Written by AI – EURACTIV.com

      May 31, 2023

      AI boom triples valuation of US startup Lightmatter, which uses light for computing

      May 31, 2023

      AI’s ‘godfather’ Joshua Bengio feels ‘lost’ to his life’s work

      May 31, 2023

      AI is too important to leave to tech companies

      May 31, 2023
    • Apple

      19 Anniversary Deals Available This Week – Up To 70% Off

      May 31, 2023

      Apple’s VR headset will be the ‘iPhone moment’, says industry expert | Pocket Gamer.biz

      May 31, 2023

      Best deals from Apple: Up to 43% off AirPods, MacBooks, Apple Watch and more at Amazon

      May 31, 2023

      How to activate and use eSIM on Android

      May 30, 2023

      Want another iMac?

      May 30, 2023
    • ChatGPT

      How to build a Google Ads Search campaign with ChatGPT

      May 31, 2023

      Can ChatGPT fact-check? We tested.

      May 31, 2023

      How Google’s search generation experience compares to ChatGPT, Bard, and Bing Chat

      May 31, 2023

      How to Access ChatGPT from Anywhere with ChatGPT Everywhere

      May 31, 2023

      European Commission Issues Internal Guidelines on ChatGPT, Generative AI – EURACTIV.com

      May 31, 2023
    • Cyber Security

      Managed Security Service Provider (MSSP) Market News: May 31, 2023

      May 31, 2023

      Barracuda Zero-Day Vulnerability Exploited for 7 Months Before Detected

      May 31, 2023

      How Should CISOs Approach Supply Chain Cybersecurity?

      May 31, 2023

      ConnectWise Wins Four Fortress Cybersecurity Awards for 2023

      May 31, 2023

      Cyber ​​Security Officials Criticize Nation’s Developments – Public Enterprises Minister

      May 31, 2023
    • Computing

      Cloud Native Computing Foundation Welcomes EY as New Gold Member

      May 31, 2023

      IBM and Google commit $150 million to quantum computing

      May 31, 2023

      Who are the key innovators in secure multi-party computing in the technology industry?

      May 31, 2023

      AI boom triples valuation of US startup Lightmatter, which uses light for computing

      May 31, 2023

      What it means for your business

      May 31, 2023
    • Science

      Rose Marie Bravo Honored by Bronx High School Science Department – ​​WWD

      May 31, 2023

      CSU Mobile Science Lab Conducts Research with Navajo Nation – The Rocky Mountain Collegian

      May 31, 2023

      Marsupials 3 million years ago were good at walking

      May 31, 2023

      Most South Board Students Take Science in Class 11: Government Survey Says

      May 31, 2023

      17 Global Companies Set World’s First Science-Based Goals for Nature This Year

      May 31, 2023
    Facebook Twitter Instagram
    Now Tec BlogNow Tec Blog
    • Home
    • Business

      National Eating Disorder Association’s AI Chatbot Goes Offline

      May 31, 2023

      Hinge Users Can Enjoy More Dating Success With This One Trick

      May 31, 2023

      Chase Freedom Unlimited® Review: A Comprehensive Loyalty Card with No Annual Fees

      May 31, 2023

      Philip Scofield’s Boyfriend Scandal: Why Bosses Are Never Allowed To Date Juniors

      May 31, 2023

      Food stamp deal between Biden and Republicans will cost more

      May 31, 2023
    • Gadgets

      Up To 33% Off 2022 The Frame Smart TVs From Samsung

      May 31, 2023

      The best budget robot vacuums for 2023

      May 31, 2023

      The best Father’s Day tech gift ideas

      May 31, 2023

      The Morning After: Industry Leaders Say AI Is as ‘Risk of Extinction’ as Nuclear War

      May 31, 2023

      Garmin unveils high-end smartwatch for well-funded explorers

      May 31, 2023
    • Tech

      Amazon Echo Pop Review (2023): Fun to Watch

      May 31, 2023

      Millions of Gigabyte Motherboards Sold with Firmware Backdoors

      May 31, 2023

      Introducing Longevity Mania and China’s AI Regulations

      May 31, 2023

      Expand drug testing programs to combat the overdose crisis

      May 31, 2023

      China is not waiting to make rules on generative AI

      May 31, 2023
    • World

      Protesters clash with soldiers in Ghana gold mining town | Mine News

      May 31, 2023

      Zimbabwe president and parliamentary polls set for August 23 | Election News

      May 31, 2023

      Milosevic allies sentence extended in ‘groundbreaking’ ruling | Genocide News

      May 31, 2023

      Elon Musk talks about ‘intelligent networked vehicles’ in China | Automotive industry news

      May 31, 2023

      NATO peacekeepers in Kosovo set up barriers amid violent clashes | NATO News

      May 31, 2023
    • AI

      AF Leverages AI for Data Analysis > Air Force > Article Display

      May 31, 2023

      Danish Prime Minister Gives Speech Partially Written by AI – EURACTIV.com

      May 31, 2023

      AI boom triples valuation of US startup Lightmatter, which uses light for computing

      May 31, 2023

      AI’s ‘godfather’ Joshua Bengio feels ‘lost’ to his life’s work

      May 31, 2023

      AI is too important to leave to tech companies

      May 31, 2023
    • Apple

      19 Anniversary Deals Available This Week – Up To 70% Off

      May 31, 2023

      Apple’s VR headset will be the ‘iPhone moment’, says industry expert | Pocket Gamer.biz

      May 31, 2023

      Best deals from Apple: Up to 43% off AirPods, MacBooks, Apple Watch and more at Amazon

      May 31, 2023

      How to activate and use eSIM on Android

      May 30, 2023

      Want another iMac?

      May 30, 2023
    • ChatGPT

      How to build a Google Ads Search campaign with ChatGPT

      May 31, 2023

      Can ChatGPT fact-check? We tested.

      May 31, 2023

      How Google’s search generation experience compares to ChatGPT, Bard, and Bing Chat

      May 31, 2023

      How to Access ChatGPT from Anywhere with ChatGPT Everywhere

      May 31, 2023

      European Commission Issues Internal Guidelines on ChatGPT, Generative AI – EURACTIV.com

      May 31, 2023
    • Cyber Security

      Managed Security Service Provider (MSSP) Market News: May 31, 2023

      May 31, 2023

      Barracuda Zero-Day Vulnerability Exploited for 7 Months Before Detected

      May 31, 2023

      How Should CISOs Approach Supply Chain Cybersecurity?

      May 31, 2023

      ConnectWise Wins Four Fortress Cybersecurity Awards for 2023

      May 31, 2023

      Cyber ​​Security Officials Criticize Nation’s Developments – Public Enterprises Minister

      May 31, 2023
    • Computing

      Cloud Native Computing Foundation Welcomes EY as New Gold Member

      May 31, 2023

      IBM and Google commit $150 million to quantum computing

      May 31, 2023

      Who are the key innovators in secure multi-party computing in the technology industry?

      May 31, 2023

      AI boom triples valuation of US startup Lightmatter, which uses light for computing

      May 31, 2023

      What it means for your business

      May 31, 2023
    • Science

      Rose Marie Bravo Honored by Bronx High School Science Department – ​​WWD

      May 31, 2023

      CSU Mobile Science Lab Conducts Research with Navajo Nation – The Rocky Mountain Collegian

      May 31, 2023

      Marsupials 3 million years ago were good at walking

      May 31, 2023

      Most South Board Students Take Science in Class 11: Government Survey Says

      May 31, 2023

      17 Global Companies Set World’s First Science-Based Goals for Nature This Year

      May 31, 2023
    Now Tec BlogNow Tec Blog
    Home»Tech News»AI datasets are full of errors. It distorts what we know about AI
    Tech News

    AI datasets are full of errors. It distorts what we know about AI

    eduardo_alves38By eduardo_alves38April 1, 2021Updated:April 1, 2021No Comments3 Mins Read
    Facebook Twitter Pinterest LinkedIn Tumblr Email
    Share
    Facebook Twitter LinkedIn Pinterest Email


    Yes, but: In recent years, studies have shown that these datasets may contain serious gaps. ImageNet, for example, contains racist and sexist labels as well as photos of people’s faces obtained without consent. The latest study now looks at another problem: many labels are just plain fake. A mushroom is labeled a spoon, a frog is labeled a cat, and an Ariana Grande high score is labeled a whistle. The ImageNet test set has an estimated label error rate of 5.8%. Meanwhile, the test set for QuickDraw, a compilation of hand drawn drawings, has an estimated error rate of 10.1%.

    How was it measured? Each of the 10 datasets used to evaluate the models has a corresponding dataset used to train them. MIT graduate students, Curtis G. Northcutt and Anish Athalye and alum Jonas Mueller, used the training data sets to develop a machine learning model, and then used it to predict labels in the data from test. If the model did not agree with the original label, the data point was flagged for manual review. Five human Amazon Mechanical Turk reviewers were asked to vote on which label – the model’s or the original – they thought was correct. If the majority of human reviewers agreed with the model, the original tag was counted as an error and then corrected.

    Is it important? Yes. The researchers looked at 34 models that had previously been measured against the ImageNet test set. Then, they re-evaluated each model against the 1,500 or so examples where the data labels turned out to be wrong. They found that the models that did not perform so well on the original Incorrect the labels were among the best performers after the label correction. In particular, the simpler models seemed to take better advantage of the corrected data than the more complicated models used by tech giants like Google for image recognition and assumed to be the best in the business. In other words, we may get an exaggerated idea of ​​how great these complicated models are due to faulty test data.

    Now what? Northcutt encourages the AI ​​field to create cleaner datasets to evaluate models and track the progress of the field. He also recommends that researchers improve the hygiene of their data when working with their own data. Otherwise, he says, “if you have a noisy dataset and a bunch of models you’re trying out, and you’re going to deploy them in the real world,” you might end up selecting the wrong model. To this end, he opened the code he used in his study to correct label errors, which he says are already being used in a few large tech companies.



    Source link

    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
    eduardo_alves38
    • Website

    Related Posts

    Amazon Echo Pop Review (2023): Fun to Watch

    May 31, 2023

    Millions of Gigabyte Motherboards Sold with Firmware Backdoors

    May 31, 2023

    Introducing Longevity Mania and China’s AI Regulations

    May 31, 2023
    Add A Comment

    Leave A Reply Cancel Reply

    Editors Picks

    How to build a Google Ads Search campaign with ChatGPT

    May 31, 2023

    Can ChatGPT fact-check? We tested.

    May 31, 2023

    How Google’s search generation experience compares to ChatGPT, Bard, and Bing Chat

    May 31, 2023

    How to Access ChatGPT from Anywhere with ChatGPT Everywhere

    May 31, 2023
    Top Reviews
    Advertisement
    Demo
    Now Tec Blog
    Facebook Twitter Instagram Pinterest Vimeo YouTube
    • Home
    • About us
    • DMCA
    • Privacy Policy
    © 2023 nowtecblog. Designed by nowtecblog.

    Type above and press Enter to search. Press Esc to cancel.