Character.ai logo

Research Engineer, AI Safety & Alignment

Character.ai

Redwood City, CAHybridFull-time$225–400K/yrPosted 11mo agoChecked 1w ago

Most applications go out cold — see where you stand first. No sign-up to start.

At a glance

Compensation
$225–400K/yr
Location
Redwood City, CAHybrid
Schedule
Full-time
Work Authorization
Not specified

Requirements

Credentials this posting asks for.

Doctorate

Job overview

Character.ai is hiring a Research Engineer, AI Safety & Alignment. The role involves conducting foundational AI safety and alignment research, developing evaluation methods, creating novel techniques to mitigate risks, and translating research into scalable product solutions while contributing to the broader scientific community.

Key focus areas include Develop and implement novel evaluation methodologies and metrics to assess safety and alignment of large language models, Research and develop cutting‑edge techniques for model alignment, value learning, and interpretability, and Conduct adversarial testing to uncover potential model vulnerabilities.

Successful candidates bring PhD In Computer Science, PhD In Machine Learning, and PhD In Related Discipline. Important skills include Develop Evaluation Methodologies, Develop Metrics, Model Alignment, Value Learning, Adversarial Testing, and Mitigate Biases. Preferred (not required): Interpretability, Publications, Product Experimentation, and A/B Testing.

Skills & qualifications

RequiredNice to have

Skills

Develop Evaluation MethodologiesDevelop MetricsModel AlignmentValue LearningInterpretabilityAdversarial TestingMitigate BiasesMitigate ToxicityMitigate Harmful BehaviorsReinforcement Learning From Human FeedbackFine-TuningCollaborate With Engineering TeamsCollaborate With Product TeamsStay Abreast of AI Safety ResearchPublicationsPublic SpeakingWrite Production-Facing CodeWrite Training CodeWork With GPUsData PipelineData InfrastructureModern Machine Learning TechniquesTransformersResponsible Development of AISolving Complex Safety ChallengesProduct ExperimentationA/B TestingTraining Large Models in Distributed SettingML DeploymentML OrchestrationKubernetesDockerCloudExplainable AIResearch in AI SafetyResearch in AlignmentResearch in EthicsKnowledge of Societal Implications of AIKnowledge of Ethical Implications of AIPolicyData Governance

Qualifications

PhD in Computer SciencePhD in Machine LearningPhD in Related DisciplineEquivalent ExperiencePublications in Academic JournalsPublications in Conferences

Full job description

ABOUT THE ROLE AND TEAM

Joining us as a Research Engineer, you'll be at the forefront of tackling one of the most critical challenges in AI today: safety and alignment. Your work will be pivotal in understanding and mitigating the risks of advanced AI, conducting foundational research to make our models safer, and solving the core technical problems of AI alignment—ensuring our models behave in accordance with human values and intentions.

The Safety team is dedicated to pioneering and implementing techniques that make our models more robust, honest, and harmless. As a Research Engineer, you will bridge the gap between theoretical research and practical application, writing high-quality code to test hypotheses and integrating successful safety solutions directly into our products. Your research will not only protect millions of users but also contribute to the broader scientific community's understanding of how to build safe, beneficial AI.

WHAT YOU'LL DO

  • Develop and implement novel evaluation methodologies and metrics to assess the safety and alignment of large language models.

  • Research and develop cutting-edge techniques for model alignment, value learning, and interpretability.

  • Conduct adversarial testing to proactively uncover potential vulnerabilities and failure modes in our models.

  • Analyze and mitigate biases, toxicity, and other harmful behaviors in large language models through techniques like reinforcement learning from human feedback (RLHF) and fine-tuning.

  • Collaborate with engineering and product teams to translate safety research into practical, scalable solutions and best practices.

  • Stay abreast of the latest advancements in AI safety research and contribute to the academic community through publications and presentations.

WHO YOU ARE

  • Hold a PhD (or equivalent experience) in a relevant field such as Computer Science, Machine Learning, or a related discipline.

  • Write clear and clean production-facing and training code

  • Experience working with GPUs (training, serving, debugging)

  • Experience with data pipelines and data infrastructure

  • Strong understanding of modern machine learning techniques, particularly transformers and reinforcement learning, with a focus on their safety implications.

  • Are passionate about the responsible development of AI and dedicated to solving complex safety challenges.

NICE TO HAVE

  • Experience with product experimentation and A/B testing

  • Experience training large models in a distributed setting

  • Familiarity with ML deployment and orchestration (Kubernetes, Docker, cloud)

  • Experience with explainable AI (XAI) and interpretability techniques.

  • Have research in AI safety, alignment, ethics, or a related area.

  • Knowledge of the broader societal and ethical implications of AI, including policy and governance.

  • Publications in relevant academic journals or conferences in the field of machine learning

ABOUT CHARACTER.AI

Character.AI http://Character.AI empowers people to connect, learn and tell stories through interactive entertainment. Over 20 million people visit Character.AI http://Character.AI every month, using our technology to supercharge their creativity and imagination. Our platform lets users engage with tens of millions of characters, enjoy unlimited conversations, and embark on infinite adventures.

In just two years, we achieved unicorn status and were honored as Google Play's AI App of the Year—a testament to our innovative technology and visionary approach.

Join us and be a part of establishing this new entertainment paradigm while shaping the future of Consumer AI!

At Character, we value diversity and welcome applicants from all backgrounds. As an equal opportunity employer, we firmly uphold a non-discrimination policy based on race, religion, national origin, gender, sexual orientation, age, veteran status, or disability. Your unique perspectives are vital to our success.

You've read the whole posting — now see how you match it.