Assessment Program Manager (APM) - Generative AI
Location: Remote
Job Type: Full-time
Salary: Starting from €130,000 per year
Introduction:With the new frontier of Generative AI rapidly advancing, it is critical that we ensure the deployment of AI systems is reliable, predictable, and safe. As an Assessment Program Manager (APM), you will play a key role in working alongside engineering teams to assess the development and deployment of AI systems, ensuring they adhere to rigorous safety standards. You will be instrumental in guiding teams through the process of hardening their Large Language Model (LLM)-based systems to meet these high standards, directly impacting the next generation of AI products and responsible AI requirements.
In this role, you will work closely with product teams to understand their progress, identify potential risks, and help them implement best practices for responsible AI deployment. Your expertise will shape the future of AI products, ensuring that they not only meet product innovation goals but also comply with safety and ethical guidelines.
Key Responsibilities:
Collaborate with AI system product teams to assess their development progress and provide guidance on AI safety practices from the earliest stages of development.
Identify risks and gaps in current mitigation techniques, and assist teams in measuring and addressing these risks to ensure safe deployment.
Lead discussions and meetings with various teams to tailor the best approach for each project, preparing them for final review.
Stay updated on emerging trends and challenges in the AI landscape, engaging with the broader AI technical program management team to refine mitigation techniques and responses to new threats.
Directly influence the development of state-of-the-art techniques for risk mitigation and testing functionality across AI products.
Shape and support responsible AI commitments, balancing safety with continued product innovation.
Required Qualifications:
Bachelor’s Degree AND 10+ years of experience in product/service/project/program management or software development
OR equivalent experience
Preferred Qualifications:
Experience in Responsible AI, Digital Safety, or Security
Experience working with Generative AI
Experience with Natural Language Understanding (NLU), Natural Language Processing (NLP), Natural Language Generation (NLG), and language models
Skills & Attributes:
Strong understanding of generative AI use cases and responsible AI practices
A keen ability to balance innovation with the implementation of safe, ethical practices
Technical proficiency to understand and apply responsible AI measurement and mitigation techniques
Exceptional communication and collaboration skills, with the ability to influence and guide teams toward best practices
Proactive problem-solving mindset, with a focus on continuous improvement and staying ahead of emerging AI risks
About Casaba:Casaba is a highly specialized cybersecurity company deeply committed to achieving superior levels of security for our clients. With over two decades of experience, our team has played a critical role in securing the most sophisticated products in the world, including many of the AI/LLM, cloud, software, mobile, and IoT products you use today. We are not a scanner company. We are the team hired to thoroughly vet security mitigations and find vulnerabilities well after all other design reviews, code reviews, and testing measures have been exhausted. Trusted by the world’s largest organizations, we are known for raising the bar on security through our one-of-a-kind high quality, deep, and thorough testing approach.