AIML - Sr Data Scientist, Data and ML Innovation

This role is based in Seattle, Washington.

Compensation:

$171,600 - $302,200/year

Responsibilities:

• Assess and improve evaluation techniques for foundation models.
• Analyze loss patterns and their drivers throughout model development.
• Define and assess training data quality metrics.
• Document findings from ablation studies and drive experimentation strategies.
• Build tools and automate processes using LLMs.

Minimum Qualifications:

• 5+ years of data science experience with significant impact on product or model performance.
• Experience in developing evaluation sets for foundational model performance.
• Strong programming skills in SQL, Python, and Spark.
• Master’s degree in a technical or quantitative field.

Preferred Qualifications:

• Deep understanding of foundation model training life cycle.
• Experience with model evaluation simulation environments.
• Experience generating synthetic data for training.