#EnterpriseAI

ConfusedPilot Attack Can Manipulate RAG-Based AI Systems

by

October 14, 2024 at 12:56PM Researchers from the University of Texas discovered the “ConfusedPilot” attack, which targets retrieval augmented generation (RAG)-based AI systems by introducing malicious documents. This manipulation can confuse AI responses, leading to misinformation. Current mitigation strategies include strict data access controls, integrity audits, and data segmentation to protect organizational information. **Meeting Takeaways: … Read more

Relyance AI Raises $32M Series B Funding to Safeguard AI Innovation in the Enterprise

by

October 11, 2024 at 05:01PM Relyance AI announced a $32.1 million Series B funding round, led by Thomvest Ventures, to enhance its AI-powered data governance platform. This funding aims to address rising regulatory demands and data privacy concerns as AI use surges, enabling businesses to innovate while ensuring compliance and customer trust. ### Meeting Takeaways … Read more

AI in the Enterprise: Cutting Through the Hype and Assessing Real Risks

by

August 5, 2024 at 09:42AM The text discusses the hype and challenges around implementing AI in organizations. It emphasizes the importance of applying AI to specific problems, understanding its implications, developing appropriate policies, choosing specific challenges, understanding exposure and additional risks, and continuously measuring and improving its use. It also highlights the need to follow … Read more

Meta’s AI safety system defeated by the space bar

by

July 29, 2024 at 05:09PM Meta’s machine-learning model designed to detect prompt injection attacks, known as Prompt-Guard-86M, has ironically been found vulnerable to such attacks. This model, introduced by Meta in conjunction with its Llama 3.1 generative model, aims to catch problematic inputs for AI models. However, a recent discovery by bug hunter Aman Priyanshu … Read more

Knostic Brings Access Control to LLMs

by

April 12, 2024 at 08:41AM Security startup Knostic emerged from stealth with $3.3 million pre-seed funding to address AI adoption challenges. Co-founder Gadi Evron emphasizes the need for personalized “need to know” access controls for large language models. Knostic’s approach enables tailored information access based on the user’s role, enhancing data privacy and AI adoption. … Read more

Knostic Emerges From Stealth With Enterprise Gen-AI Access Controls

by

April 11, 2024 at 10:48AM Knostic, a startup founded in late 2023 by cybersecurity veterans Gadi Evron and Sounil Yu, has emerged from stealth mode with $3.3 million in pre-seed funding. They have developed an access control solution for enterprises using generative AI to provide personalized need-to-know access control for large language models, preventing sensitive … Read more

Enterprise AI Security Firm TrojAI Raises $5.75M in Seed Funding

by

April 6, 2024 at 10:06PM TrojAI, a Canadian-based AI security firm, has secured $5.75 million in additional seed capital, led by Flying Fish and with support from Build Ventures, Techstars, Alteryx Ventures, and Flybridge Capital Partners. The investment will help the company develop its AI security platform, expand to the U.S., and appoint Lee Weiner, … Read more

Move Fast and Break the Enterprise With AI

by

January 23, 2024 at 09:44AM Large enterprises often feel resistant to change due to their deep-rooted culture. Security professionals question the progress made in enhancing organizational security over the years. However, the implementation of AI in enterprise operations is disrupting traditional paradigms, leading to changes in data management, permission systems, and user activity monitoring, despite … Read more