Position listed on behalf of a partner company managing applications and next steps.
Freelance remote opportunity based in India.
Responsibilities
Evaluate AI-generated solutions to software engineering challenges and identify weaknesses in technical reasoning.
Engage with AI models on software engineering tasks, coding exercises, and technical scenarios using C#.
Evaluate model responses for logical accuracy, coding fluency, correctness, and code quality.
Assess solutions involving algorithms, data structures, object-oriented design, software architecture, and frontend/backend development.
Test and evaluate topics such as asynchronous programming, RESTful API integration, memory management, secure coding, cloud infrastructure, and distributed systems debugging.
Identify and document errors, reasoning gaps, and failure patterns with clear, reproducible examples.
Review code for readability, maintainability, efficiency, and adherence to sound engineering practices.
Recommend improvements to prompts, evaluation criteria, and testing methods.
Requirements
Demonstrated experience programming in C# and solving real-world software engineering problems.
Strong knowledge of algorithms, data structures, object-oriented programming, and software architecture.
Familiarity with asynchronous programming, RESTful APIs, memory management, secure coding, and debugging techniques.
Understanding of frontend and backend development, cloud infrastructure, or systems programming.
Ability to analyze code for correctness, efficiency, readability, and maintainability.
Strong analytical and problem-solving skills with attention to technical detail.
Excellent technical writing and communication skills.
Ability to work independently and provide consistent, evidence-based evaluations.
Preferred: degree in computer science or related field; experience writing technical documentation; open-source contributions; experience evaluating AI-generated code.
Conditions
Hourly compensation ranging from $8 to $65, depending on experience, expertise, and geographic location.
Fully remote contract work with flexibility.
Contractor must provide own secure computer and high-speed internet connection.
Company-sponsored benefits (health insurance, paid time off) are not provided.