Talent.com
Mercor
DevOps Engineer - AI Model EvaluatorMercor • Brussels, Brussels-Capital Region, Belgium
DevOps Engineer - AI Model Evaluator

DevOps Engineer - AI Model Evaluator

Mercor • Brussels, Brussels-Capital Region, Belgium
19 uur geleden
Vacaturetype
  • Op afstand
  • Quick Apply
Functieomschrijving

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
  • Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.
  • Identify bugs, edge cases, reliability issues, and failure modes.
  • Compare outputs from multiple frontier models and assess their strengths and weaknesses.
  • Apply professional engineering judgment to realistic infrastructure engineering scenarios.
  • Work independently and asynchronously to meet sprint-based project deadlines.

Qualifications

Must-Have

  • 2+ years of professional DevOps, SRE, or Cloud Engineering experience.
  • Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
  • Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Preferred

  • Experience supporting production-scale systems.

Compensation & Legal

  • $400 per accepted task.
  • Compensation is tied to accepted work.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Maak een vacature-alert aan voor deze zoekopdracht

DevOps Engineer - AI Model Evaluator • Brussels, Brussels-Capital Region, Belgium

Vergelijkbare banen

Enterprise AI Builder Lead

Salesforce, Inc., brussel hoofdstad, belgium, brussel hoofdstad, Belgium

Builder Leader to directly manage and grow a team delivering Agentforce solutions inside complex customer environments.You will lead two specialist functions—Forward Deployed Engineers and Deployme... Laat meer zien

 • Gesponsord

Product Engineer

ICsenseAntwerp, flanders, Belgium

The job location can be Leuven or Ghent.The Product Engineer is responsible for ASIC products from product development kick-off until end of life.The Product Engineer will be responsible for defini... Laat meer zien

 • Gesponsord

Medior AI Engineer (for our client)

LACOFlemish Region, Belgium, Belgium

Build AI that actually goes live, not just demos.AI, Generative AI copilots, and scalable ML systems.Generative AI, copilots & LLM integrations.Designing and deploying scalable AI solutions in Azur... Laat meer zien

 • Gesponsord

AI-Empowered.NET Developer

EuricomAntwerpen, Vlaanderen, BE

Ben jij klaar om het verschil te maken als Software Developer in een wereld waar AI niet meer weg te denken is? Dit is jouw kans om je carrière een serieuze boost te geven! Kom bij ons werken! Al... Laat meer zien

 • Gesponsord

Cloud Engineer | Kubernetes & Terraform

recurvAntwerpen, Belgium

If you want to know about the requirements for this role, read on for all the relevant information.Location: Antwerpen & hybride; max.Contract type: Vast in loondienst.USP: Bouw mee aan een nieuw p... Laat meer zien

 • Gesponsord

Senior Engineer QA Validation | Brussels

Prothya BiosolutionsBrussels Region, Belgium, Belgium

Reports to the Supervisor QA Validation (A.As a Senior Quality Engineer, you safeguard quality levels by monitoring and ensuring that all operations at all levels are carried out in accordance with... Laat meer zien

 • Gesponsord

Technical Lead IA Appliquée / Forward Deployed AI Engineer

DeepRec.aiBrussels, Belgium

Technical Lead IA Appliquée / Forward Deployed AI Engineer.Before applying for this role, please read the following information about this opportunity found below.Localisation : EMEA (déplacements ... Laat meer zien

 • Gesponsord

Test Engineer

SII Group BelgiumArrondissement of Nivelles, wallonia, Belgium

We are looking for an IVVQ Engineer to lead system integration, verification, validation, and qualification activities across innovative, high-impact projects.In this role, you will oversee the ful... Laat meer zien

 • Gesponsord

Integration Engineer

B-flowAntwerp, flanders, Belgium

In today's connected business landscape, we are always on the lookout for new colleagues to help us deliver seamless integration flows and connections for our clients.Building upon the business kno... Laat meer zien

 • Gesponsord

DevOps Engineer

Pauwels ConsultingZaventem, Flemish Region, Belgium

At Volve, part of the Pauwels Solution Group, we're looking for a Medior/Senior DevOps Engineer to join our team and build the secure, scalable Azure infrastructure that powers our clients' data an... Laat meer zien

 • Gesponsord

GenAI & ML Engineer — Cloud AI Solutions & Growth

Capgemini SE, brussel hoofdstad, belgium, brussel hoofdstad, Belgium

We are looking for a (GEN) AI and Machine Learning Engineer to help our clients in their digital transformations.Use ML and Generative AI tools and other technologies to design, evangelize, and imp... Laat meer zien

 • Gesponsord

Remote Senior AI & HPC Architect — Enterprise Solutions

NTT DATA, Inc.antwerpen, antwerpen, Belgium
Op afstand

Senior Principal AI/HPC Architect in Antwerp, Belgium.The successful candidate will lead design initiatives for complex managed service solutions, working closely with clients and sales teams.Respo... Laat meer zien

 • Gesponsord

Lead DevOps Engineer Remote, Self-Hosted GPU Infra

Noxtua, , belgium, Belgium
Op afstand

Noxtua is hiring a Lead DevOps Engineer to manage infrastructure for its Legal AI platform.This role requires ownership over our GPU servers and a managed Kubernetes environment while leading a sma... Laat meer zien

 • Gesponsord

Senior DevOps Engineer - Brussels (On site) - Eurocontrol

The White TeamBrussels, Brussels, Belgium

Senior DevOps Engineer at Brussels (On site) for EUROCONTROL.CI/CD Pipeline Implementation & Customization.Adopt and implement the standard CI/CD pipelines (defined by the central DevOps team) usin... Laat meer zien

Strategic Enterprise Platform Architect & AI Lead

Stella SA, , belgium, Belgium

Stella SA in Belgium is seeking an Enterprise Platform Architect & Tech Lead who will act as the senior technical authority.This role involves leading the integration of AI technologies, ensuring s... Laat meer zien

 • Gesponsord

Data Engineer

ACENSIBrussels, brussels capital, Belgium

ACENSI is looking for a Data Engineer for one of their clients int the energy sector based in Brussels :.Within the corporate Digital & Data department, we aim at facilitating and driving our organ... Laat meer zien

 • Gesponsord

Studies engineer M/V/X

ActirisAntwerpen 2, BE

Beschrijving van het bedrijf Franki Foundations is de Belgische marktleider in dieptefunderingen.Elk jaar realiseren ze meer dan 500 uitdagende projecten: van woningbouw tot industrie, van infrast... Laat meer zien

 • Gesponsord

Project Engineer Life Sciences met ervaring

USG Professionals BelgiumAntwerpen, BE

Nieuwe geneesmiddelen succesvol introduceren op een productiesite vraagt heel wat voorbereiding achter de schermen.Voor een toonaangevende internationale farmaceutische speler in Puurs zijn we op z... Laat meer zien