Senior Data Scientist III - AI Evaluation And Prompt Engineering - Remote Eligible

Data Scientist - Ai Evaluation And Prompt Engineering

Please note that this position is open to hiring on a remote basis, with strong preference for individuals who are located / willing to work in U.S. eastern time.

About Our Team

Lexisnexis Legal & Professional serves customers in more than 150 countries with over 11,000 employees worldwide and is part of RELX, a global provider of information-based analytics and decision tools for professional and business customers.

Within Lexisnexis, Intelligize focuses on empowering legal, compliance, and corporate professionals through advanced access to SEC filings and corporate disclosure data. We're a trusted partner for top law firms, corporations, and regulators seeking clarity and insight from complex financial and legal information.

Our company has been a long-time leader in applying AI and advanced technologies to the legal market—improving productivity, accuracy, and decision-making across the profession. We're now extending that leadership with ethical, practical, and powerful generative AI solutions, using a flexible multi-model approach that leverages the best capabilities from today's top model creators for each legal use case.

At Intelligize, you'll join a team that values curiosity, creativity, and collaboration. We bring together experts in law, data, and technology to build products that transform how legal professionals access and understand information.

About The Role

We're looking for a curious, creative, and practical Data Scientist who will focus on AI Evaluation and Prompt Engineering to help drive our next generation of AI-powered legal research tools. This role focuses on applying data science techniques to evaluate and improve large language model (LLM) systems, build data-driven insights, and shape our product roadmap.

You'll work closely with product managers, data engineers, and subject matter experts to make sense of large collections of legal and corporate documents (such as SEC filings). You'll help us ask better questions, run smarter experiments, and turn data into clear, actionable recommendations.

Responsibilities

• Evaluate and tune LLM-powered features, such as prompt optimization, retrieval-augmented generation (RAG) systems, and semantic search performance.
• Design and execute experiments to measure model quality, reliability, and user impact — translating technical findings into product recommendations.
• Develop and maintain data pipelines for evaluating, tracking, and improving system performance (e.g., accuracy, latency, cost, and relevance metrics).
• Analyze structured and unstructured datasets (e.g., product usage logs, document metadata, LLM outputs) to identify patterns, insights, and areas for optimization.
• Collaborate with product managers to translate product goals into measurable data science questions, propose next steps, and inform roadmap priorities.
• Provide technical guidance to data engineers who build and maintain analytics and model evaluation infrastructure.
• Communicate results clearly — through written reports, dashboards, and presentations — to technical and non-technical stakeholders.
• Stay current on emerging practices in applied NLP, LLM evaluation, and data-driven product development, and thoughtfully adapt them to our environment.

Requirements

• 3–6 years of experience in data science, applied NLP, or AI product analytics, preferably within a SaaS or research-heavy product environment.
• Strong proficiency in Python and data analysis libraries such as Pandas; solid working knowledge of SQL.
• Ability to design and evaluate LLM-based systems (e.g., RAG pipelines, prompt evaluations, output scoring), even if not specialized in deep learning.
• Experience with data exploration, experimentation, and reporting — from defining metrics to visualizing and interpreting results.
• Comfort working with document-based datasets (e.g., text corpora, metadata, embeddings) and understanding information retrieval / semantic search concepts.
• Excellent written and verbal communication skills — able to present complex ideas simply and persuasively across distributed teams.
• Proven ability to self-direct, learn new tools and concepts quickly, and apply them pragmatically.
• Strong sense of curiosity, patience, and collaboration — especially in working across different disciplines and cultures.

Preferred (Not Required)

• Familiarity with tools like LangChain, OpenAI API, Databricks, or similar LLM/AI development environments.
• Experience designing evaluation frameworks or product analytics systems for AI-driven products.
• Prior exposure to legal, financial, or corporate document datasets.
• Experience mentoring or informally guiding junior technical teammates.

Benefits & Work Environment

We believe great work happens when people are supported, trusted, and encouraged to grow. Our benefits are designed to promote well-being, flexibility, and long-term success. What we offer:

• Flexible remote-first work environment, with the option to work from our New York office
• Comprehensive health coverage, including medical, dental, and vision plans
• Retirement plan with inclusive risk benefits (disability, critical illness, life cover, and funeral cover)
• Modern family benefits, including adoption, surrogacy, and parental leave
• Paid study leave and professional development support
• Well-being initiatives and opportunities for sabbaticals and personal growth
• A culture that values work/life balance, clear communication, and continuous learning

Primary Location Base Pay Range: Home based-New York $124,500 - $207,400. If performed in New York City, the pay range is $130,100 - $216,800. If performed in Rochester, NY, the pay range is $107,500 - $179,100. This job is eligible for an annual incentive bonus.

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer to our US full- and part-time employees working at least 20 hours or more per week: Health Benefits: Comprehensive, multi-carrier program for medical, dental and vision benefits Retirement Benefits: 401(k) with match and an Employee Share Purchase Plan Wellbeing: Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity Family Benefits, including bonding and family care leaves, adoption and surrogacy benefits Health Savings, Health Care, Dependent Care and Commuter Spending Accounts

In addition to annual Paid Time Off, we offer up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers: EEO Know Your Rights.