Our client is seeking a Data Operations and Market Analyst to join their team in Cupertino, CA.
Responsibilities may include, but are not limited to: Ability to work cross-functionally with Design, Product, Editorial, Safety and Engineering teams to deliver quality on time Collaborate with cross functional teams to precisely define the evaluation requirements necessary for Machine Learning/ Large Language Models implementation across different projects Ensure data quality is maintained at high standards and continually enhance processes based on both quantitative and qualitative feedback Evaluating content, researching and verifying accuracy of relevant metadata pertaining to different media types Quality assurance reviewing, verifying, editing, scoring, transcribing, copywriting, and reporting on data and/or assets across a broad scope of media and content types Problem solve, provide clear suggestion/feedback to leads, and effectively communicate recommendations to both editorial and engineering teams Leverage established workflows and tooling for various content tasks Collaborate and follow guidance from the Project Lead, Style Guides, and Terminology Databases on all matters Conduct research with humans to validate and create automated benchmarks for LLM evaluations Collect data from human participants (e.g., surveys, experiments) with knowledge about data quality, data validity, etc Experience/Degree Required: Advanced degree in linguistics, computer science, machine learning, cognitive science, psychology, economics, or similar (preferred) 3+ Years of experience is needed Experience in Large Language Models and knowledge about LLM evaluation techniques, such as human evaluation and automated benchmarks is desirable Native-level fluency and strong written communication skills in US English language is essential to this role Linguistic/cultural skills: expert knowledge of grammar, spelling, and cultural appropriateness to accurately represent user experience early in the software development cycles The target hiring compensation range for this role is $30 to $33/hr. Compensation is based on several factors including, but not limited to education, relevant work experience, relevant certifications, and location.
About Aquent Talent: Aquent Talent connects the best talent in marketing, creative, and design with the world's biggest brands. Our eligible talent get access to amazing benefits like subsidized health, vision, and dental plans, paid sick leave, and retirement plans with a match. We also offer free online training through Aquent Gymnasium. More information on our awesome benefits! Aquent is an equal-opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics. We're about creating an inclusive environment—one where different backgrounds, experiences, and perspectives are valued, and everyone can contribute, grow their careers, and thrive.
