AI Test Engineer (f/md)

In this role, you will help validate and optimize AI systems that directly impact digital government services and citizen experiences. In this role, you will design, develop, and optimize AI-powered solutions that help modernize public administration and create seamless digital experiences for citizens and institutions.

• Design, implement, and maintain testing strategies for AI-powered applications and machine learning systems
• Evaluate AI model performance, accuracy, robustness, and reliability across different use cases
• Identify system weaknesses, edge cases, biases, hallucinations, and security vulnerabilities
• Develop automated test frameworks and quality assurance processes for AI solutions
• Collaborate closely with AI Engineers, Product Managers, and Software Developers throughout the development lifecycle
• Analyze datasets and outputs to ensure compliance with quality and ethical standards
• Support continuous improvement of AI systems through structured feedback and testing insights
• Document testing methodologies, findings, and recommendations for internal and external stakeholders
• Contribute to establishing best practices for responsible and trustworthy AI within public administration environments

• Degree in Computer Science, Software Engineering, AI, Data Science, or a related field
• Experience in software testing, quality assurance, or AI/ML system evaluation
• Strong understanding of machine learning concepts, AI system behavior, and testing methodologies
• Familiarity with automated testing tools, scripting languages, and test frameworks
• Experience analyzing model outputs, performance metrics, and potential biases
• Understanding of security, privacy, and compliance considerations in AI applications
• Strong analytical thinking and problem-solving skills
• Excellent communication skills and the ability to work in interdisciplinary teams
• Fluent in English; German is a plus

Benefits

• Attractive above-average compensation package
• State-of-the-art IT equipment enabling flexible hybrid working worldwide - from home, our Berlin office, or on-site with partners
• Centrally located offices with access to the unique ThinkTank Campus in Berlin-Wannsee
• Comfortable travel policy as well as free snacks and beverages in our offices
• Flat hierarchies, fast decision-making, and room for your own ideas
• International team spirit with recognition of both collective and individual successes
• Early responsibility and creative freedom from day one
• Structured onboarding with a buddy and experienced mentor
• Continuous training programs and regular development discussions