Loading...
Loading...
Browse all stories on DeepNewz
VisitWhich compliance area will see most improvement in AI models by mid-2025?
Cybersecurity resilience • 25%
Bias and discrimination • 25%
Transparency • 25%
Other • 25%
Improvement reports from COMPL-AI or related research publications
COMPL-AI Framework Finds OpenAI, Meta AI Models Fail EU Act Standards in Cybersecurity, Bias
Oct 16, 2024, 08:32 AM
LatticeFlow, in collaboration with ETH Zurich and INSAIT, has launched COMPL-AI, the first open-sourced EU AI Act compliance evaluation framework for generative AI models. According to an exclusive report by Reuters, the framework assesses AI models from major companies including OpenAI, Meta, Alibaba, Anthropic, and Mistral against the forthcoming European regulations. The evaluation revealed that while these models scored well in certain areas, they fall short in key compliance aspects such as cybersecurity resilience and discriminatory outputs. The findings highlight significant compliance gaps and underscore the urgency for Big Tech to address issues related to transparency, cybersecurity, and bias as they race to meet the new standards set by the EU AI Act.
View original story
National Security • 25%
Healthcare • 25%
Infrastructure • 25%
Other • 25%
Healthcare AI • 25%
Finance AI • 25%
Retail AI • 25%
Other • 25%
Healthcare • 25%
Finance • 25%
Energy • 25%
Other • 25%
Claude 3.5 Sonnet • 25%
GPT-4o • 25%
Gemini Pro • 25%
Llama-3 • 25%
Language Processing • 25%
Image Recognition • 25%
Predictive Analytics • 25%
Other • 25%
Diagnostics • 25%
Patient Monitoring • 25%
Administrative Tasks • 25%
Treatment Recommendations • 25%
Technology • 25%
Healthcare • 25%
Finance • 25%
Manufacturing • 25%
Healthcare • 25%
Finance • 25%
Retail • 25%
Transportation • 25%
Risk management • 25%
Customer service • 25%
Fraud detection • 25%
Investment advisory • 25%
Claude 3.5 Sonnet • 33%
GPT-4o • 33%
Gemini • 34%
Pathology service delivery • 25%
Resource utilization • 25%
Clinical decision-making • 25%
Other • 25%
Meta (Llama 3) • 25%
OpenAI (GPT-4o) • 25%
Anthropic (Claude 3.5 Sonnet) • 25%
Other • 25%
Alibaba • 25%
Anthropic • 25%
OpenAI • 25%
Meta • 25%