Medscape Medical NewsAll articles

AI Metrics

AI Metrics, LLC • Radiology • 12/22/2020

510(k)IEC 62304 Class B
FDA Summary PDF

Device Purpose

AI Metrics is a software-based Picture Archiving and Communications System designed to enhance clinical workflows by enabling trained medical professionals to view, analyze, and compare medical images (CT, MR) over time, specifically for assessing disease extent and therapeutic response. Utilizing DICOM data, it offers tools for manual and semi-automatic image annotation, lesion segmentation, standardized measurements (e.g., RECIST 1.1), and automated structured reporting, without providing direct diagnoses.

Summary

AI Metrics is a software-only medical device designed as a Picture Archiving and Communication System (PACS) for use by trained medical professionals in environments like radiology and oncology. Its primary purpose is to facilitate the viewing, manipulation, communication, storage, annotation, analysis, and comparison of medical images, such as CT and MR scans, from multiple modalities and/or different time points. The methodology involves deploying the software via internet download onto a Linux platform (native or virtualized), where it functions as an interactive workflow automation tool. It enables users to assess and document the extent of a disease or tumor response to therapy according to user-selected standards, like RECIST 1.1, and track changes in imaging findings over time, thereby aiding in the interpretation and evaluation of examinations. The underlying science involves processing DICOM compliant image data, enabling features such as image navigation, manual and semi-automatic lesion segmentation suggestions, automatic measurement of lesion axes, tabulation and summation of measurements, semi-automatic anatomical lesion labeling suggestions, and the calculation of quantitative and qualitative metrics based on annotation data. AI Metrics automatically generates structured reports that include this data, presented in graphs, tables, key images, and structured text. While it does not directly generate diagnoses, it provides crucial information to support clinicians, who retain ultimate diagnostic responsibility. The software has undergone extensive verification and validation testing according to ISO standards (62304, 14971, 13485), with all identified risks deemed acceptable and the software passing all critical tests, ensuring it meets design specifications and demonstrates acceptable performance. AI Metrics is not intended for use in mammography.

AI Regulatory Concerns

Powered byJev by TypeSafe AI

Jev reads the full FDA letter and returns calibrated concern probabilities per regulatory category. These are AI estimates, not regulatory advice.

Keywords

Medical Imaging SoftwarePACSWorkflow AutomationLesion SegmentationImage AnalysisDICOMTumor Response AssessmentRECIST 1.1Structured ReportingMedical Image Annotation

Device Metadata

Submission Number
K202229
Company
AI Metrics, LLC
Panel
Radiology
Product Code
N/A
Data Type
Images
Clinical Function
Assessment
AI Function
Analysis
AI Subclass
quantification/feature localization

Relevant Clinical Questions

  • Q1. How does the semi-automatic lesion segmentation algorithm perform across different tumor types and image qualities, and what is the typical level of user adjustment required?; What specific quantitative and qualitative metrics, beyond RECIST 1.1, can be calculated or customized within the AI Metrics platform for advanced oncological research or specific clinical trial protocols?; Considering the workflow automation aspect, what is the measured impact of AI Metrics on radiologist/oncologist reporting time and inter-observer variability when compared to traditional disjointed image comparison methods?; How does AI Metrics handle and integrate images from various scanner manufacturers and DICOM versions, and what are the specific limitations regarding CT and MR dataset compatibility?; What are the security protocols and data management strategies employed by AI Metrics, particularly for deployment via internet software download and handling of sensitive patient DICOM data on Linux platforms?

Risk Classification

ESL Analysis
FDA Device ClassII

FDA Class II via 510(k) pathway; IEC 62304 Class B (software safety classification); Authorized before §524B enforcement

Learn how Parasoft automates IEC 62304 compliance testing →

Cybersecurity Evidence

Powered by SBOMator™

Based on AI-generated device summaries, not the full FDA submission. Items not detected here may still be present in the complete submission package.

Cyber Score35/100
SBOM Evidence⚠ Not mentioned in summary
Cyber Risk Assessment✓ Detected in Summary
Postmarket Plan⚠ Not mentioned in summary
§524B ApplicableNo

Supply Chain BOM Evidence

Based on the CycloneDX / OWASP ECMA-424 xBOM ecosystem. Detection is from the AI-generated summary.

SBOMSoftware Bill of Materials
- Not detected
ML-BOMMachine Learning Bill of Materials(algorithm, dataset, annotation, labeling)
✓ Detected
SaaSBOMSoftware-as-a-Service Bill of Materials(server, internet, platform)
✓ Detected
HBOMHardware Bill of Materials
- Not detected
CBOMCryptography Bill of Materials
- Not detected
VDR/VEXVulnerability Disclosure Report / Vulnerability Exploitability eXchange
- Not detected
OBOMOperations Bill of Materials(deployment, environment)
✓ Detected

Analysis:

• Analysis is based on the AI-generated device summary, not the full FDA submission package. Click "Analyze Full FDA PDF" below to scan the actual submission document.

• Evidence of ML-BOM, SaaSBOM, OBOM detected in AI-generated device summary.

• This device was authorized before §524B took effect. Cybersecurity evidence requirements were less prescriptive at the time.

• Postmarket cybersecurity monitoring plan not clearly documented in AI-generated device summary.

• Not detected in AI-generated device summary: SBOM, HBOM, CBOM, VDR/VEX. These may be present in the full FDA submission.

Preparing a similar submission?

ESL takes complete ownership of your software evidence work - SBOM & CVE remediation with SBOMator™, static analysis & unit testing with Parasoft, traceability, and full IEC 62304 lifecycle support.

Assess Your Readiness →Or contact ESL directly
AI Metrics - AI Metrics, LLC | ESL FDA AI Device Intelligence