Alice (Formerly ActiveFence) Logo

Alice (Formerly ActiveFence)

GenAI Safety Analyst

Posted 23 Days Ago
Remote
Hiring Remotely in United States
80K-87K Annually
Entry level
Remote
Hiring Remotely in United States
80K-87K Annually
Entry level
Analyze generative AI content infringements and develop adversarial prompts to identify model vulnerabilities across hate speech, misinformation, intellectual property, and other abuse areas. Manage multilingual datasets, investigate safety circumvention tactics, oversee projects and quality assurance, and collaborate with engineering, product, and policy teams to improve AI safety strategies.
The summary above was generated by AI
Description

Alice is seeking a driven, detail-focused professional to become a vital part of our team as a GenAI Safety Analyst. In this role, you'll dive into the cutting-edge of technology, meticulously analyzing various content infringements to secure the new wave of Generative AI tools. Your duties will include collaborating with experts in diverse fields such as Hate Speech, Misinformation, Intellectual Property and Copyright, among others.

Your tasks will involve writing adversarial prompts to identify weaknesses in various AI models, including Large Language Models (LLMs), Text-to-Image, Text-to-Video, AI Agents and beyond. You'll also oversee data management to guarantee the highest quality of outputs.

Responsibilities:

  • Developing adversarial and risky prompt strategies across several areas of abuse to expose potential vulnerabilities in models.
  • Managing projects end-to-end, from initial planning and oversight through quality assurance to final delivery.
  • Handling extensive datasets across multiple languages and areas of abuse, ensuring precision and meticulous attention to detail.
  • Ongoing investigation into new tactics for circumventing foundational models' safety measures.
  • Working alongside diverse teams, engineering, product, policy, to tackle new challenges and craft forward-thinking strategies and resolutions.
  • Promoting a culture of knowledge exchange and continual learning within the team.
Requirements

Must have:

  • Background in AI Safety and/or Responsible AI and/or Trust and Safety 
  • Familiarity with recent Generative AI models and agents is essential, though direct technical experience is not a prerequisite.
  • Command of English at a near-native level.
  • Attention to detail, organizational capabilities, and the capacity to juggle numerous tasks concurrently.

Additional Wants:

  • Experience with various model types (Text-to-Text, Text-to-Image) is desirable.
  • Prior experience with OSINT (Open Source Intelligence) will be considered an asset.
  • A self-starter attitude, with the energy to excel in a fast-moving and variable environment.

The salary range for this role in the US is $80K - $87K - Range may vary based on experience. Salary at the time of offer will be commensurate with experience.

About Alice

Alice is a trust, safety, and security company built for the AI era. We safeguard the communicative technologies people use to create, collaborate, and interact- whether with each other or with machines.

In a world where AI has fundamentally changed the nature of risk, Alice provides end-to-end coverage across the entire AI lifecycle. We support frontier model labs, enterprises, and UGC platforms with a comprehensive suite of solutions: from model hardening evaluations and pre-deployment red-teaming to runtime guardrails and ongoing drift detection.

Alice is widely considered a global leader in online safety and AI security. We have some of the most forward-thinking and passionate minds in the world working to safeguard over 3 billion users across the largest AI and tech platforms.

If you're creative and driven to secure the future of AI, we want to hear from you!

Alice (Formerly ActiveFence) New York, New York, USA Office

New York, New York, United States

Similar Jobs

25 Days Ago
Remote
USA
80K-87K Annually
Mid level
80K-87K Annually
Mid level
Security • Software • Generative AI
Analyze content infringements and write adversarial prompts to find model vulnerabilities across LLMs, text-to-image/video, and agents. Manage datasets and projects end-to-end, investigate evasion tactics, collaborate with engineering, product, and policy teams, and promote knowledge sharing to improve model safety.
Top Skills: Ai AgentsGenerative AiLarge Language Models (Llms)OsintText-To-ImageText-To-Video
13 Minutes Ago
Remote
US
141K-229K Annually
Senior level
141K-229K Annually
Senior level
Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Leads product strategy, roadmap, and continuous improvement for PSA Vault and warehouse management systems. Oversees operational workflows including receiving, storage, inventory, fulfillment, and shipping while improving integrations with grading, marketplace, and logistics systems. Partners with Engineering, Operations, and business stakeholders to define requirements, prioritize initiatives, measure outcomes, and enhance customer experiences. The role also identifies AI and automation opportunities and coordinates cross-functional delivery across the Collectors ecosystem.
Top Skills: AIAutomationEbayProshipWarehouse Management Systems (Wms)
24 Minutes Ago
Remote or Hybrid
California, USA
118K-194K Annually
Senior level
118K-194K Annually
Senior level
Gaming • Information Technology • Mobile • Software • Esports
Lead the DevOps team for WWE 2K by defining technical strategy and building reliable development and production infrastructure. Responsibilities include designing CI/CD pipelines, deployment automation, cloud and containerized environments, developer tooling, observability, documentation, and operational standards. The role also requires cross-team collaboration, technical leadership, and improving workflows across a distributed game development studio.
Top Skills: .NetAWSBashCC#C++Ci/CdGCPGitInfrastructure As CodeJenkinsLinuxNode.jsPerforcePowershellPuppetPythonReactWindows

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account