Language and Linguistics Expert (AI Evaluation)

Language and Linguistics Expert (AI Evaluation)

Language and Linguistics Expert (AI Evaluation)

Gramian Consulting Group

Brazil

52 minutos atrás

Nenhuma candidatura

Sobre

  • Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
  • Role Overview
  • We are looking for experienced Humanities professionals to support the evaluation and improvement of advanced AI systems. The role involves reviewing questions and answers across a broad range of humanities topics and assessing whether AI-generated content is accurate, relevant, coherent, complete, and well-reasoned.
  • This opportunity is suitable for professionals with backgrounds in areas such as History, Philosophy, Literature, Linguistics, Languages, Cultural Studies, Sociology, Anthropology, Political Science, Religious Studies, and related disciplines.
  • CONTRACT: Contractor assignment, 4 weeks
  • COMMITMENT: Hourly, up to 40h/week
  • LOCATIONS: Remote - Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Pakistan, Turkey, Vietnam
  • PROCESS: The selection will be made based on an online questionnaire and resume/education
  • Key Responsibilities
  • Review and evaluate questions and answers across humanities disciplines.
  • Assess content for factual accuracy, relevance, clarity, completeness, and logical consistency.
  • Identify inaccuracies, misleading claims, ambiguities, and gaps in reasoning.
  • Apply subject-matter knowledge to nuanced or complex humanities topics.
  • Determine whether responses fully address the question and expected requirements.
  • Apply established evaluation criteria and project guidelines consistently.
  • Provide clear and structured quality assessments.
  • Work across different humanities topics while maintaining strong analytical standards.
  • Contribute to the quality of datasets used to train and evaluate AI systems.
  • At least 5 years of professional, academic, research, teaching, or related experience in a humanities field.
  • Bachelor’s degree or equivalent expertise in History, Philosophy, Literature, Linguistics, Languages, Cultural Studies, Sociology, Anthropology, Political Science, Religious Studies, Arts & Humanities, or a closely related discipline.