Alice (Formerly ActiveFence) Logo

Alice (Formerly ActiveFence)

GenAI Safety Analyst

Posted 23 Days Ago
Remote
Hiring Remotely in United States
80K-87K Annually
Entry level
Remote
Hiring Remotely in United States
80K-87K Annually
Entry level
Analyze generative AI content infringements and develop adversarial prompts to identify model vulnerabilities across hate speech, misinformation, intellectual property, and other abuse areas. Manage multilingual datasets, investigate safety circumvention tactics, oversee projects and quality assurance, and collaborate with engineering, product, and policy teams to improve AI safety strategies.
The summary above was generated by AI
Description

Alice is seeking a driven, detail-focused professional to become a vital part of our team as a GenAI Safety Analyst. In this role, you'll dive into the cutting-edge of technology, meticulously analyzing various content infringements to secure the new wave of Generative AI tools. Your duties will include collaborating with experts in diverse fields such as Hate Speech, Misinformation, Intellectual Property and Copyright, among others.

Your tasks will involve writing adversarial prompts to identify weaknesses in various AI models, including Large Language Models (LLMs), Text-to-Image, Text-to-Video, AI Agents and beyond. You'll also oversee data management to guarantee the highest quality of outputs.

Responsibilities:

  • Developing adversarial and risky prompt strategies across several areas of abuse to expose potential vulnerabilities in models.
  • Managing projects end-to-end, from initial planning and oversight through quality assurance to final delivery.
  • Handling extensive datasets across multiple languages and areas of abuse, ensuring precision and meticulous attention to detail.
  • Ongoing investigation into new tactics for circumventing foundational models' safety measures.
  • Working alongside diverse teams, engineering, product, policy, to tackle new challenges and craft forward-thinking strategies and resolutions.
  • Promoting a culture of knowledge exchange and continual learning within the team.
Requirements

Must have:

  • Background in AI Safety and/or Responsible AI and/or Trust and Safety 
  • Familiarity with recent Generative AI models and agents is essential, though direct technical experience is not a prerequisite.
  • Command of English at a near-native level.
  • Attention to detail, organizational capabilities, and the capacity to juggle numerous tasks concurrently.

Additional Wants:

  • Experience with various model types (Text-to-Text, Text-to-Image) is desirable.
  • Prior experience with OSINT (Open Source Intelligence) will be considered an asset.
  • A self-starter attitude, with the energy to excel in a fast-moving and variable environment.

The salary range for this role in the US is $80K - $87K - Range may vary based on experience. Salary at the time of offer will be commensurate with experience.

About Alice

Alice is a trust, safety, and security company built for the AI era. We safeguard the communicative technologies people use to create, collaborate, and interact- whether with each other or with machines.

In a world where AI has fundamentally changed the nature of risk, Alice provides end-to-end coverage across the entire AI lifecycle. We support frontier model labs, enterprises, and UGC platforms with a comprehensive suite of solutions: from model hardening evaluations and pre-deployment red-teaming to runtime guardrails and ongoing drift detection.

Alice is widely considered a global leader in online safety and AI security. We have some of the most forward-thinking and passionate minds in the world working to safeguard over 3 billion users across the largest AI and tech platforms.

If you're creative and driven to secure the future of AI, we want to hear from you!

Alice (Formerly ActiveFence) New York, New York, USA Office

New York, New York, United States

Similar Jobs

25 Days Ago
Remote
USA
80K-87K Annually
Mid level
80K-87K Annually
Mid level
Security • Software • Generative AI
Analyze content infringements and write adversarial prompts to find model vulnerabilities across LLMs, text-to-image/video, and agents. Manage datasets and projects end-to-end, investigate evasion tactics, collaborate with engineering, product, and policy teams, and promote knowledge sharing to improve model safety.
Top Skills: Ai AgentsGenerative AiLarge Language Models (Llms)OsintText-To-ImageText-To-Video
10 Minutes Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
98K-193K Annually
Senior level
98K-193K Annually
Senior level
Big Data • Cloud • Software • Database
Serve as the strategic compensation partner for Sales, advising senior leaders on offers, equity, leveling, promotions, retention, benchmarking, and compensation cycles. Analyze market and internal data, support incentive-plan governance and modeling, lead competitive intelligence, improve compensation programs, manage strategic projects, and develop manager enablement materials. Partner closely with Finance, Sales Operations, Recruiting, Legal, and HR while presenting recommendations to executive stakeholders.
Top Skills: RadfordWtw
11 Minutes Ago
Remote or Hybrid
42K-88K Annually
Mid level
42K-88K Annually
Mid level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Manages and grows revenue from an assigned dealer-client portfolio through consultative, solutions-based sales. Travels approximately 80% to client businesses across Kentucky and Indiana, develops relationships, sells Cox Automotive inventory and wholesale solutions, identifies cross-selling opportunities, and collaborates with marketing and sales teams. Uses Salesforce for sales activities and account insights while meeting monthly quotas and supporting digital and in-lane transactions.
Top Skills: Salesforce

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account