Wir benötigen Ihre Einwilligung zur Verwendung der einzelnen Daten, damit Sie unter anderem Informationen zu Ihren Interessen einsehen können. Klicken Sie auf "OK", um Ihre Zustimmung zu erteilen.
IEEE Approved Draft Standard for Robustness Evaluation Test Methods for a Natural Language Processing Service that uses Machine Learning
Name übersetzen
NORM herausgegeben am 19.6.2024
Bezeichnung normen: IEEE P3168
Ausgabedatum normen: 19.6.2024
SKU: NS-1170284
Gewicht ca.: 300 g (0.66 Pfund)
Land: Internationale technische Norm
Kategorie: Technische Normen IEEE
New IEEE Standard - Active - Draft.
The Natural Language Processing (NLP) services using machine learning have rich applications in solving various tasks, and have been widely deployed and used, usually accessible by API calls. The robustness of the NLP services is challenged by various well-known general corruptions and adversarial attacks. Examples of general corruptions include inadvertent or random deletion, addition, or repetition of characters or words. Adversarial attacks generate adversarial characters, words or sentence samples causing the models underpinning the NLP services to produce incorrect results. This standard proposes a method for quantitatively evaluating the robustness the NLP services. Under the method, different cases the evaluation needs to perform against are specified. Robustness metrics and their calculation are defined. With the standard, the service stakeholders including the service developer, service providers, and service users can develop understanding of the robustness of the services. The evaluation can be performed during various phases in the life cycle of the NLP services, the testing phase, in the validation phase, after deployment, etc.
ISBN: 979-8-8557-0478-5, 979-8-8557-0478-5
Number of Pages: 27
Product Code: STDUD26745, STDAPE26745
Keywords: robustness evaluation, artificial intelligence, natural language processing service, evaluation metrics
Category: 309
Draft Number: P3168/D3, Aug 2023 - UNAPPROVED DRAFT, P3168/D3, Aug 2023 - APPROVED DRAFT
Bereitstellung von aktuellen Informationen über legislative Vorschriften in der Sammlung der Gesetze bis zum Jahr 1945.
Aktualisierung 2x pro Monat!
Brauchen Sie mehr Informationen? Sehen Sie sich diese Seite an.
Letzte Aktualisierung: 2024-05-15 (Zahl der Positionen: 2 900 316)
© Copyright 2024 NORMSERVIS s.r.o.