Je brug naar de volgende stap.Even overleggen? 085 060 2192

Rabobank in Utrecht

Data Scientist

Croeselaan 18, Utrecht

Reageren vóór: 19 november 2026 om 08:00

De opdracht

For Rabobank in Utrecht we are looking for a Data Scientist (Responsible GenAI).

Details:
• Duration: 6 months (extension possible);
• Start: ASAP;
• Language: English;
• Application process details: The process consists of an initial one-hour interview with two of our Data Scientists to assess your technical skills, followed by a 30-minute conversation with the team manager to evaluate team fit;
• Not suitable for ZZP;
• Suppliers may submit a maximum of 1 candidate. If multiple candidates are submitted by the same supplier, all candidates will be rejected;
• Please clearly indicate in the motivation field whether the candidate has any planned vacation and/or special leave during the duration of the assignment;
• Please clearly state in the CV whether an internal reference may be requested. If the candidate is currently working, or has recently worked, within Rabobank, please provide the name and job title of the relevant team lead;
• In case of sufficient suitable candidates, the vacancy may be closed before the stated deadline in the portal;

The Role:

As a Data Scientist in our Responsible GenAI team, you build the evaluation capabilities and guardrails that help teams across Rabobank understand, measure and improve the quality and safety of their GenAI solutions.

You work at the intersection of data science, software engineering and responsible AI, translating real-world use cases and risks into robust evaluation methods, reusable tools and practical controls. Your work spans assistants, report generation, document processing and emerging agentic applications, not just chatbots.

This is a hands-on development role that requires strong statistical judgement and production experience. You design sound experiments, critically analyse data and metrics, and understand which conclusions the evidence does and does not support. You turn experiments into maintainable, tested, production-ready code and work with engineers to integrate it into deployed solutions. This is not a notebook-only role, nor does it require you to be an ML or platform engineer. The focus is not on training foundation models or conducting standalone research, but on making evaluation and safeguards work in practice.

You help answer:

“How do we know a GenAI solution performs as intended, and how do we test that its evaluations and guardrails are reliable?”

You assess existing approaches and new techniques critically, reuse suitable components where possible, and develop new methods where they add clear value.

Your Responsibilities:

• Build reusable evaluation frameworks and tools that support repeatable testing, comparison and regression analysis across GenAI use cases;
• Develop and critically validate evaluation metrics, combining deterministic checks, model-based evaluation and human assessments. Assess metric reliability, uncertainty and whether metrics measure what they are intended to measure; make clear which conclusions the data supports and where it falls short;
• Design statistically sound experiments, test datasets and evaluation scenarios, including sampling strategies, representative data, ground-truth data, edge cases and challenging inputs, together with use-case teams and domain experts. Investigate how dataset quality and representativeness affect findings;
• Develop and assess guardrails using appropriate methods, including rule-based controls, LLM-as-a-judge approaches and trained ML classifiers, for risks such as sensitive-data exposure, unsupported outputs, prompt injection and unintended system behaviour. Select approaches based on the use case and evidence, and train or evaluate classifiers where appropriate;
• Measure guardrail effectiveness and trade-offs, including precision and recall, detection thresholds, class imbalance, missed detections, false positives, robustness, drift, latency and cost;
• Deliver maintainable, tested, production-ready code and work closely with engineers to integrate evaluations and controls into CI/CD, APIs, pipelines, deployment, monitoring and production workflows, with reproducible results and clear diagnostics;
• Translate use-case needs into actionable evaluation criteria, explain findings and limitations, and turn delivery experience into reusable methods, documentation and tooling;

Required Skills (Must-Haves):

1. Demonstrated expertise in GenAI systems:
• Practical experience with LLM-based applications and an understanding of their limitations and failure modes;
• Familiarity with retrieval-augmented generation, prompting, grounding and context management;
• Ability to assess GenAI outputs against explicit criteria rather than relying only on intuition;
• Understanding of how changes to models, prompts, data or application logic can affect quality and safety;

2. Production-ready development and integration skills:
• Strong Python skills and demonstrated experience turning experiments and prototypes into maintainable, tested, production-ready code, not only exploratory notebooks;
• Practical experience integrating data-science components with APIs, structured and unstructured data, and automated data-processing or evaluation pipelines;
• Hands-on experience with version control, automated testing, CI/CD and reproducible experimentation;
• Sufficient production experience to understand deployment, monitoring and production workflows, diagnose issues and deliver code that engineers can integrate and operate. ML or platform engineering specialisation is not required;

3. Statistical expertise, measurement and experimentation:
• Demonstrated experience designing sound evaluations and experiments, and critically analysing metrics and datasets, not just applying evaluation frameworks;
• Strong applied statistical knowledge of sampling, dataset representativeness, uncertainty, metric reliability and experimental design, including the limitations of aggregate scores;
• Demonstrated experience validating automated evaluations against human assessments, assessing reliability and investigating disagreement;
• Ability to distinguish between weaknesses in the GenAI solution, the evaluation dataset and the evaluator itself, and explain which conclusions the data does and does not support;

4. Hands-on guardrail development and validation:
• Practical experience assessing and selecting guardrail methods, including rule-based controls, LLM-as-a-judge approaches and trained ML classifiers, with clear reasoning about their suitability and limitations in context;
• Ability to translate a risk or expected behaviour into testable criteria and measurable controls, and to train or evaluate a classifier when that is the appropriate approach;
• Applied knowledge of precision and recall, detection thresholds, false positives, false negatives and class imbalance, and the ability to balance safety, usability and operational constraints;
• Experience testing controls across realistic scenarios, critically checking assumptions and assessing how data or behaviour drift affects guardrail performance over time;

5. Clear communication and collaboration:
• Explain evaluation results, methodological choices and limitations to engineers, product managers and stakeholders;
• Work with use-case teams and domain experts to define what good performance means in context;
• Write clear technical proposals, evaluation reports and practical documentation;
• Turn ambiguous requirements into concrete experiments and implementation steps;

Nice to Have:

• Experience with agentic evaluation, including tool selection, multi-step workflows and task completion;
• Experience testing privacy controls, prompt-injection defences or other GenAI safeguards;
• Experience with controlled adversarial testing or robustness assessment;
• Experience with evaluation tooling, observability or continuous evaluation in production;
• Experience working in a regulated environment and producing traceable validation evidence;

Who Will Thrive Here:

You enjoy turning the question “Can we trust this result?” into a concrete test, a measurable criterion and a useful tool.

You are curious about why AI systems and their evaluators behave the way they do. You combine statistical rigour with a builder’s mindset: you enjoy designing methods, critically analysing data and metrics, and turning experiments into maintainable, tested code that holds up in production.

You value evidence over impressive-looking scores, make limitations explicit and work closely with others to solve real problems. You want your work to help multiple teams build better GenAI solutions, rather than improve a single chatbot.

Please include a personal motivation describing how the candidate meets the required competencies.

Additional information:
• Hybrid working applies, according to the Rabobank @anywhere principle;
• Due to increasing pressure on the Rabobank location at Croeselaan in Utrecht, a new parking policy has been in place since April 2026. From Monday through Thursday, external workers can no longer park on the Croeselaan premises. Parking for external workers remains possible on Fridays only;
• Please note: midlance employment constructions are not permitted under Rabobank policy. Do not submit candidates through this construction. Compliance will also be checked during screening;
• Candidate suppliers are expected to be fully aware of the applicable laws and regulations regarding employment conditions and the Rabobank collective labour agreement (CAO). This assignment falls within scale 9 of the Rabobank CAO;
• We would like to receive the personal motivation and CV in English;
• The candidate may only be submitted to one request at a time. This means that during the exclusivity period (4 working days), the candidate may only be submitted to Magnit - Rabobank;
• It is important that the candidate is available for the entire duration of the assignment;
• Pre-employment screening: if the candidate is selected to start with the client, a pre-employment screening will take place. As of 1 July 2026, a new PES policy applies. The screening is performed by an external party. More information can be found in Annex A. Candidates may only start after successful completion of the pre-employment screening;
• The candidate must possess a valid form of identification (passport or identity card) that is valid both during the intake and on the contract start date and can be presented for verification;
• When proposing an indirectly contracted self-employed professional, the contract will be handled through a fee-only agreement. This agreement is available upon request;
• By submitting a candidate, you are deemed to agree to the conditions of this specific client. If you are not familiar with these conditions, they can be requested from the responsible recruiter;

IMPORTANT:
Please ensure that all candidate details are entered correctly. Enter the candidate's own contact details under 'email address and telephone number'. The same applies to the address information. These are details the client requires as part of the submission. Incomplete or incorrect submissions cannot be presented to the client and will be rejected.

Eisen

  • Benodigde opleiding: HBO

Wensen

De bron noemt nog geen afzonderlijke wensen.

Direct reageren

Je kunt reageren zonder account en zonder verplicht cv. Het reactieformulier wordt geladen.

Noor, jouw digitale recruiter

Noor helpt je op basis van je eigen cv. De check is optioneel.