At JetBrains, Project Kineto has a clear mission: to push the boundaries of what's possible in automating application development. We're currently focused on creating an autonomous pipeline for generating web applications, but our ultimate goal is broader – developing technology flexible enough to support the creation of any type of app, from web to desktop and mobile. We're exploring just how far we can take AI-driven app generation, and we're looking for enthusiasts to join us on this adventure, shaping the future of software development together.

Why join us? The journey has only begun, and while we’re already seeing impressive progress, the most exciting and challenging work lies ahead. If you’re passionate about shaping the future of software development, we invite you to join us.

In this role, you will:

• Help build and enhance the evaluation pipeline, introducing new metrics to effectively measure the quality of the generator.
• Analyze agent logs (traces/trajectories) to identify bottlenecks and areas for potential improvement.
• Implement your solutions and improvements in Kotlin (our generator is written in Kotlin), working on them until they are successfully deployed to production.

We're looking for Machine Learning Engineers who:

• Have at least 5 years of experience developing ML-based applications.
• Possess strong foundational knowledge in machine learning.
• Have proven experience building and maintaining reliable evaluation pipelines for AI/ML systems.
• Excel at tackling difficult, open-ended technical problems and continuously exploring multiple innovative solutions.
• Are eager to dig deeply into complex challenges, comfortable with uncertainty, and resilient enough to iterate through multiple failures before achieving success.
• Can effectively balance detailed technical implementation with the broader strategic thinking necessary to advance our ambitious project goals.
• Thrive in fast-paced environments.

We’d be especially thrilled if you:

• Have experience building Retrieval-Augmented Generation (RAG) and agent systems.
• Have experience creating robust evaluation pipelines specifically tailored for RAG and agent systems.

• Fascinating work in a friendly team.
• A flexible working schedule.
• 30 days of paid vacation (local regulations apply).
• An office library with specialized work-related books and magazines.
• A comfortable working environment, ergonomic workstations, a gym and leisure facilities, and a range of commuter benefits.
• Excellent opportunities for professional and personal development, including travel to professional conferences worldwide, access to the LinkedIn Learning platform, and more.
• Additional benefits include: lunch, free refreshments, and snacks provided in the office, and much more.
• Hybrid work from your home in any location where JetBrains' offices are