Data Science LLM Expert
Brillius Technologies
Date: 4 days ago
City: Redmond, WA
Contract type: Full time
Remote
Skills:
Statistical Analysis, Machine Learning, Data Visualization, Python Programming, Big Data Technologies, Predictive Modeling, Data Mining, LLM,
Job Title: Data Science LLM Expert
Location: REMOTE
Job Description:
Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation, specializing in the development and refinement of large language models (LLMs). Our mission is to create AI systems that can understand and generate high-quality code, revolutionizing the software development landscape.
Job Description:
As an LLM Evaluation Expert specializing in Coding, you will play a crucial role in assessing and improving our language models' coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted coding.
Job Responsibilities:
Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms
Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needs
Develop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiency
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output
Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities
Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations remain cutting-edge
Candidate Requirements:
Advanced degree in Computer Science, Software Engineering, or a related field
Extensive experience (5+ years) in software development across multiple programming languages and paradigms
Demonstrated ability to critically evaluate code quality, efficiency, and adherence to best practices
Strong analytical and decision-making skills, with the ability to make complex judgments under ambiguous circumstances
Excellent written and verbal communication skills, with the ability to explain technical concepts clearly
Experience in technical writing, particularly in creating coding examples or tutorials
Preferred Qualifications:
Previous experience working with or evaluating AI systems, particularly in the context of code generation
Familiarity with a wide range of software development methodologies and architectural patterns
Understanding of machine learning concepts, particularly as they apply to natural language processing and code generation
Experience in creating or contributing to coding standards or style guides
This role requires a unique blend of technical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world coding applications. Your work will directly influence the development of next-generation AI coding assistants, shaping the future of software development.
If you're passionate about code quality, have a keen eye for detail, and are excited about the potential of AI in software engineering, we encourage you to apply for this pivotal role at AGI Data Services
Top 3 Required Skills:
Statistical Analysis, Machine Learning, Data Visualization, Python Programming, Big Data Technologies, Predictive Modeling, Data Mining, LLM,
Job Title: Data Science LLM Expert
Location: REMOTE
Job Description:
Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation, specializing in the development and refinement of large language models (LLMs). Our mission is to create AI systems that can understand and generate high-quality code, revolutionizing the software development landscape.
Job Description:
As an LLM Evaluation Expert specializing in Coding, you will play a crucial role in assessing and improving our language models' coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted coding.
Job Responsibilities:
Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms
Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needs
Develop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiency
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output
Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities
Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations remain cutting-edge
Candidate Requirements:
Advanced degree in Computer Science, Software Engineering, or a related field
Extensive experience (5+ years) in software development across multiple programming languages and paradigms
Demonstrated ability to critically evaluate code quality, efficiency, and adherence to best practices
Strong analytical and decision-making skills, with the ability to make complex judgments under ambiguous circumstances
Excellent written and verbal communication skills, with the ability to explain technical concepts clearly
Experience in technical writing, particularly in creating coding examples or tutorials
Preferred Qualifications:
Previous experience working with or evaluating AI systems, particularly in the context of code generation
Familiarity with a wide range of software development methodologies and architectural patterns
Understanding of machine learning concepts, particularly as they apply to natural language processing and code generation
Experience in creating or contributing to coding standards or style guides
This role requires a unique blend of technical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world coding applications. Your work will directly influence the development of next-generation AI coding assistants, shaping the future of software development.
If you're passionate about code quality, have a keen eye for detail, and are excited about the potential of AI in software engineering, we encourage you to apply for this pivotal role at AGI Data Services
Top 3 Required Skills:
- excellent AI-assisted coding
- LLM Evaluation Expert specializing in Coding
- AGI Data Services
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Designer I
Nintendo,
Redmond, WA
$70,262
-
$105,392
per year
2 days ago
Nintendo Software Technology CorporationNintendo Software Technology Corporation, based in Redmond, Washington , is a wholly owned subsidiary of the world's largest manufacturer and marketer of video games, Nintendo Co., Ltd., headquartered in Kyoto, Japan. Nintendo Software Technology's mission is to design, develop and deliver the very best video games. We conduct research, use state-of-the-art equipment and review methods of operation...
User Interface / User Experience Designer
NomadGo,
Redmond, WA
$90,000
-
$130,000
per year
2 weeks ago
Nomad Go Inc.Company OverviewUser Interface / User Experience DesignerSince the dawn of time people have used their fingers to count inventory — a method that’s slow, error-prone, and mind-numbingly boring. At NomadGo we are on a mission to transform supply chains by providing unparalleled inventory visibility to brands in retail, foodservice, logistics, and grocery. By harnessing the power of AI,...
Research Associate Scientist
BioSpace,
Redmond, WA
2 weeks ago
About GenScriptGenScript Biotech Corporation (Stock Code: 1548.HK) is a global biotechnology group. Founded in 2002, GenScript has an established global presence across North America, Europe, the Greater China, and Asia Pacific. GenScript's businesses encompass four major categories based on its leading gene synthesis technology, including operation as a Life Science CRO, enzyme and synthetic biology products, biologics development and manufacturing,...
