About This Role

HireArt is looking for Technology Domain Experts to help develop and evaluate AI tasks requiring engineering and systems-level reasoning. You’ll help assess model competency in real-world technical domains, debugging, architecture decisions, and system behavior analysis.

As a Technology Domain Expert, you will:

• Design challenging, field-relevant problems based on visuals, prompts, datasets, or model outputs

• Evaluate AI-generated responses using detailed rubrics

• Write or improve evaluation rubrics for complex tasks

• Stress-test model reasoning in software engineering contexts

• Provide clear, structured feedback on model performance

Required Qualifications

• 5+ years’ relevant software engineering experience (e.g. backend, frontend, full-stack, mobile development, DevOps, distributed systems, etc.)

• Experience evaluating or testing LLM outputs in technical domains

• Strong writing, analysis, and reasoning skills

• Comfortable working asynchronously with strong self-direction

• Ability to deliver structured, precise, and logically sound evaluations

• Reliable computer and internet connection
  
  

Nice to Have

• Bachelor’s degree in computer science or related field