Intermediate Backend Engineer, AI Powered: ModelOps

GitLab is an open core software company that develops the most comprehensive AI-powered DevSecOps Platform, used by more than 100,000 organizations. Our mission is to enable everyone to contribute to and co-create the software that powers our world. When everyone can contribute, consumers become contributors, significantly accelerating the rate of human progress. This mission is integral to our culture, influencing how we hire, build products, and lead our industry. We make this possible at GitLab by running our operations on our product and staying aligned with our values. Learn more about Life at GitLab.

An overview of this role

As a Backend Engineer on GitLab’s MLOps team, you will be at the forefront of shaping the future of machine learning operations (MLOps) and large language model operations (LLMOps). You will play a critical role in enabling GitLab customers to build and integrate their data science workloads directly within GitLab, driving innovation for teams across the globe.

One of the key challenges you’ll help solve is moving our Experimental and Beta MLOps features to General Availability (GA). You’ll work closely with a small, highly collaborative team of engineers, using technologies like Ruby, MLFlow, and GitLab to deliver robust MLOps solutions. As part of this team, you will interact with multiple stakeholders across different functions, including teams working on Custom Models, Model Evaluation, and AI Frameworks.

The team currently includes two Staff Fullstack Engineers and is set to grow by adding two more Backend Engineers. This expansion allows you to impact the product and the larger GitLab community directly, ensuring our MLOps features meet the highest standards and serve a wide range of users. Whether you're located in AMER, EMEA, or APAC, this remote-first team offers the flexibility to collaborate globally while having a significant voice in the direction of MLOps at GitLab.

Success in this role means delivering against your assigned work, contributing to the team’s goals, and helping GitLab push the boundaries of MLOps and LLMOps. With growth plans on the horizon, this is a great opportunity to be part of a pioneering team at the cutting edge of machine learning.

To dive deeper into the team's work and roadmap, check out our handbook and Group Direction.

What You’ll Do  

• Develop and maintain CI/CD pipelines for ML model deployment in Ruby environments
• Implement and optimize data processing pipelines using Ruby and relevant frameworks
• Collaborate with data scientists to productionize ML models efficiently
• Design and implement monitoring and alerting systems for ML model performance
• Ensure scalability, reliability, and efficiency of ML systems in production
• Contribute to the development of internal MLOps tools and libraries in Ruby
• Develop features and improvements to the GitLab product in a secure, well-tested, and performant way
• Collaborate with Product Management and other stakeholders within Engineering (Frontend, UX, etc.) to maintain a high bar for quality in a fast-paced, iterative environment
• Advocate for improvements to product quality, security, and performance
• Solve technical problems of moderate scope and complexity
• Craft code that meets our internal standards for style, maintainability, and best practices for a high-scale web environment
• Conduct Code Review within our Code Review Guidelines and ensure community contributions receive a swift response
• Recognize impediments to our efficiency as a team (“technical debt”), propose and implement solutions
• Represent GitLab and its values in public communication around specific projects and community contributions
• Confidently ship small features and improvements with minimal guidance and support from other team members. Collaborate with the team on larger projects
• Participate in Tier 2 or Tier 3 weekday and weekend and occasional night on-call rotations to assist in troubleshooting product operations, security operations, and urgent engineering issues

What You’ll Bring 

• Professional experience with Ruby on Rails
• Experience with MLOps practices and tools (e.g., MLflow, Kubeflow, or similar)
• Solid understanding of machine learning concepts and workflows
• Familiarity with containerization (Docker) and orchestration (Kubernetes) technologies
• Experience with Python ML libraries (scikit-learn, TensorFlow, PyTorch) as plus
• Proficiency in the English language, both written and verbal, is sufficient for success in a remote and largely asynchronous work environment.
• Demonstrated capacity to clearly and concisely communicate about complex technical, architectural, and/or organizational problems and propose thorough iterative solutions.
• Experience with performance and optimization problems and a demonstrated ability to both diagnose and prevent these problems.
• Comfort working in a highly agile, intensely iterative software development process.
• An inclination towards communication, inclusion, and visibility.
• Experience owning a project from concept to production, including proposal, discussion, and execution.
• Self-motivated and self-managing, with excellent organizational skills.
• Demonstrated ability to work closely with other parts of the organization.
• Share our values, and work in accordance with those values.
• Ability to thrive in a fully remote organization.

How To Stand Out

• Have contributed a merge request to GitLab or an open source project in the ML space
• A Masters or PhD in Data Science or similar discipline
• Professional Python or Golang experience

About the team

The MLOps team at GitLab is on a mission to empower users to seamlessly integrate and manage their data science workloads within the GitLab platform. Our goal is to make machine learning operations (MLOps) and large language model operations (LLMOps) more accessible, ensuring that teams can build, train, evaluate, and deploy their models directly from GitLab. By integrating these complex workflows, we help teams enhance productivity, streamline model deployment, and ensure continuous integration and delivery for machine learning models.

One of the key challenges we’re working on is moving our Experimental and Beta features to General Availability (GA). This means you’ll be contributing to making MLOps a core part of the GitLab platform, helping users efficiently manage models, from custom model development to serving models using frameworks like MLFlow, Kubernetes, and deep learning tools such as TensorFlow and PyTorch.

What makes the MLOps team interesting is not just the technology we work with but also our dedication to transparency and open collaboration. Thanks to GitLab's value of openness, you can see exactly what we’re working on, including our roadmap and even some of our meetings. This level of visibility allows everyone, including you, to contribute and stay informed.

Our team is still growing, and we’re set to expand by adding Backend Engineers to help scale these efforts. We work closely with other teams, such as Custom Models, Model Evaluation, and AI Frameworks, to deliver features that support a wide range of machine learning use cases.

Want to learn more? You can dive into the full details on our MLOps team page and explore how we’re transforming MLOps and LLMOps at GitLab.

How GitLab will support you

• Benefits to support your health, finances, and well-being
• All remote, asynchronous work environment
• Flexible Paid Time Off
• Team Member Resource Groups
• Equity Compensation & Employee Stock Purchase Plan
• Growth and development budget 
• Parental leave 
• Home office support

Please note that we welcome interest from candidates with varying levels of experience; many successful candidates do not meet every single requirement. Additionally, studies have shown that people from underrepresented groups are less likely to apply to a job unless they meet every single qualification. If you're excited about this role, please apply and allow our recruiters to assess your application.

The base salary range for this role’s listed level is currently for residents of listed locations only. Grade level and salary ranges are determined through interviews and a review of education, experience, knowledge, skills, abilities of the applicant, equity with other team members, and alignment with market data. See more information on our benefits and equity. Sales roles are also eligible for incentive pay targeted at up to 100% of the offered base salary.

California/Colorado/Hawaii/New Jersey/New York/Washington/DC pay range

$98,000 - $210,000 USD

Country Hiring Guidelines: GitLab hires new team members in countries around the world. All of our roles are remote, however some roles may carry specific location-based eligibility requirements. Our Talent Acquisition team can help answer any questions about location after starting the recruiting process.  

Privacy Policy: Please review our Recruitment Privacy Policy. Your privacy is important to us.

GitLab is proud to be an equal opportunity workplace and is an affirmative action employer. GitLab’s policies and practices relating to recruitment, employment, career development and advancement, promotion, and retirement are based solely on merit, regardless of race, color, religion, ancestry, sex (including pregnancy, lactation, sexual orientation, gender identity, or gender expression), national origin, age, citizenship, marital status, mental or physical disability, genetic information (including family medical history), discharge status from the military, protected veteran status (which includes disabled veterans, recently separated veterans, active duty wartime or campaign badge veterans, and Armed Forces service medal veterans), or any other basis protected by law. GitLab will not tolerate discrimination or harassment based on any of these characteristics. See also GitLab’s EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know during the recruiting process.