Find a Career-Defining* Opportunity, Whatever Your Stage

*P9-backed companies are 4x more likely to succeed than the industry average. (Dealroom).

QA Specialist - AI Chatbot Response Evaluations (C Programming)

SuperAnnotate

SuperAnnotate

Software Engineering, Data Science, Quality Assurance
North America
Posted on Mar 28, 2025

Role Overview:

We are looking for a QA Specialist with strong experience in C programming to audit the evaluation work of Data Annotators who assess AI-generated C code. Your role will be to ensure annotators accurately rate instruction-following, validate proof-of-work, and confirm that C programs are correct, safe, and aligned with best practices.

Responsibilities:

  • Audit annotator evaluations of AI-generated C code.
  • Validate the application of instruction-following and correctness rubrics.
  • Review annotator-submitted proof-of-work to confirm code executability, correctness, and safety.
  • Identify flawed logic, incomplete testing, or inaccuracies in annotator feedback.
  • Provide concise and constructive feedback to annotators to improve future evaluations.
  • Collaborate with QA leads to uphold consistency and quality standards across the team.

Required Qualifications:

  • 7+ years of professional experience in C programming, embedded systems, or QA/code review.
  • Proficient in C syntax, memory management, pointers, and low-level debugging.
  • Experience testing and validating C programs in command-line or IDE-based environments.
  • Strong analytical thinking and clear written communication skills.
  • English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications:

  • Experience in annotation QA or evaluating AI-generated coding responses.
  • Familiarity with LLM behavior, reinforcement learning with human feedback (RLHF), or model evaluation.
  • Understanding of secure and efficient C programming practices.

Contract Type: Freelance/Contract/Part-Time

Why Join Us?

Become part of an innovative team at the forefront of AI technology. Your QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.

If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.

#CProgramming #QA #CodeReview #AI #LLM #SystemProgramming #RemoteJobs #TechHiring #Freelance