Job Description

Senior Software Tester (AI & Test-Aware)

CONTEXT/INTRODUCTION

Directorate B “Digital Enablers & Innovation” provides the foundational components, tools, guidance and services, from design to implementation and operations for the digitalisation of the Commission, European Institutions and Member States. The mission of ‘Digit B1 – Data, Artificial Intelligence & Web’ unit is to provide digital enablers for the transformation of the European Commission and of its ICT domain in the areas of data, artificial intelligence, and web presence. Moreover, the unit fosters the innovation at corporate level through the management of the digital innovation policy framework.

The activities of the unit in the areas of data, artificial intelligence and web contribute to the realisation of the corporate digital priorities of the European Commission Digital Strategy (ECDS), to the realisation of the corporate objectives in the areas of data, artificial intelligence, digital innovation and web presence, and to the realisation of the specific objectives of the Strategic Plan of Digit.

Profile Overview

Senior Software tester with 10+ years of experience Python-based backend systems, AI/LLM pipelines, and automated testing infrastructure. Capable of owning quality assurance across the full stack.

Technical Skills

Software Testing

• 10+ years Python background development: async patterns, package design, CLI tooling, REST/gRPC APIs

• FastAPI or equivalent for backend service testing

• Containerized deployments with Kubernetes

• Knowledge on CI/CD pipeline (GitHub Actions, GitLab CI)

Testing & Quality Assurance

• Authoring and maintaining automated test suites with pytest (fixtures, parametrize, asyncio)

• Browser and API end-to-end testing with Playwright

• Contract and integration testing for REST and gRPC APIs

• Flaky test detection and remediation

• E2E coverage across UI, API layer, and AI pipeline execution

Observability & Metrics

• OpenTelemetry instrumentation within application code (traces, metrics, logs)

• Latency threshold assertions integrated into automated tests

• Experience with Jaeger, Grafana, or equivalent observability stacks

End-to-End Ownership

• Full lifecycle coverage: from API entry point through AI pipeline to validated response

• Auth flow testing (SSO, token-based access)

• Failure injection and resilience testing (timeouts, malformed inputs, empty results)

• Containerized E2E test environments mirroring production topology

Deliverables Expected

• Automated test suites with >80% critical path coverage

• E2E test plans covering user flows, edge cases, and failure modes

• Trace-based regression reports for AI pipeline runs

• Documentation link to testing: test cases and testing strategy

Methodology and Tools

• Experience in the use of Atlassian collaborative tools (like Confluence and Jira) is required

• Experience with Agile development methodologies is a plus

• Experience in working with the EU institutions is a plus

Regime: Remote

EU Citzens only