Principal Researcher: AI Trust & Safety

Share job

Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world.

Do you want to find responsible AI failures in Microsoft’s largest AI systems impacting millions of users? Join Microsoft’s AI Red Team where you'll emulate work alongside security experts to cause trust and safety failures in Microsoft’s big AI systems. We are looking for a Principal Researcher: AI Trust & Safety focused with tactical experience in trust, safety, or responsible AI for our team to help make AI security better and help our customers expand with our AI systems. Our team is an interdisciplinary group of red teamers, adversarial Machine Learning (ML) researchers, Safety & Responsible AI experts and software developers with the mission of proactively finding failures in Microsoft’s big bet AI systems. In this role, you will be an individual contributor, red teaming AI models and applications across Microsoft’s AI portfolio including Bing Copilot, Security Copilot, Github Copilot, Office Copilot and Windows Copilot. This work is sprint based, working with AI Safety and Product Development teams, to run operations that aim to find safety and security risks that inform internal key business decisions. As a Principal Researcher: AI Trust & Safety, you will have the latitude to define emerging threat areas for the company, responsible for operations delivery, communicating impact of findings to diverse internal stakeholders, and pushing cross-team efforts to improve operational effectiveness. This Principal Researcher: AI Trust & Safety role is also expected to bring insight into the AI Safety space and collaborate closely with our tooling and research teams to orchestrate innovation with the operations testing team. We are open to remote work. More about our approach to AI Red Teaming: https://www.microsoft.com/en-us/security/blog/2023/08/07/microsoft-ai-red-team-building-future-of-safer-ai/.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Required/Minimum Qualifications

• Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
  • OR equivalent experience.

Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

• Experience in Trust and Safety area or policy area, especially working with human-generated or AI-generated harmful materials across multiple media types and creating objective recommendations, grounded and supported by research and data.
• Experience in national security, specifically CBRN
• Preferred multilingual proficiency, especially in languages used in Microsoft userbase in Europe, EMEA and APAC region
• Prior experience in red teaming events such as GRT at Defcon AI Village or other LLM CTFs
• While extensive coding experience is not necessary, candidate should be comfortable with basic/intermediate Python programming
• 1+ years' experience in a field related to Responsible AI including but not limited to ethics, chemistry, biology, linguistics, sociology, psychology, medicine, socio-technical safety space, online safety, privacy

Applied Sciences IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until January 10, 2025.

#MSFTSecurity #airedteam #MSECAIR #AEGIS

• Discover and exploit GenAI vulnerabilities with respect to end-to-end capabilities in order to assess the safety of systems and lead communication of impact of vulnerabilities to partner stakeholders
• Develop novel methodologies and techniques to scale and accelerate AI Red Teaming in collaboration with our research team, our tooling team, and leaders in the Microsoft AI Safety & Security ecosystem
• Collaborate with teams to influence measurement and mitigations of these vulnerabilities in AI systems
• Research new and emerging threats to inform the organization and craft solutions to operationalize testing within the AI Red Team function
• Work alongside traditional offensive security engineers, adversarial ML experts, developers to land responsible AI operations -Model and coach other red teamers on functional strategies for effective delivery, communication, and prioritization in fast moving environments.
• Embody our Culture and Values