Note: The job is a remote job and is open to candidates in USA. Dynatrace is a leader in unified observability and security. They are seeking a Principal Generative AI Engineer to design and ship production-grade agentic AI systems that connect development workflows with production observability, helping engineers understand code and assess the impact of changes before they hit production.

Responsibilities

• Design, build, and ship agentic AI systems and tooling that helps engineers understand code, assess the impact of changes before they hit production, and act on real runtime signals
• Build production LLM systems end to end, managing prompting, tool calling, retrieval, memory management, and the agent loops that tie them together
• Define the evaluation strategies, metrics, and datasets that make agent quality measurable, ensuring we ship on evidence and catch regressions across model and prompt changes
• Connect development workflows with production observability, turning code context and runtime signals into reliable, actionable insight, and collaborate with product, design, and platform teams to identify developer problems
• Set technical strategy and architectural direction for the team's AI systems, mentor engineers across the organization, and take full ownership of systems using Dynatrace to monitor and optimize them

Skills

• Degree in Software Engineering or equivalent practical experience in software development, combined with a track record of technical leadership and the judgment to set direction in an ambiguous, fast-moving space
• Extensive experience shipping production systems that use LLMs, including prompting, tool calling, evaluation, and iteration
• A strong foundation in at least one of: developer tooling (IDEs, compilers, static analysis, code intelligence), AI/ML engineering, or large-scale distributed systems
• Hands-on experience with agentic patterns, specifically planning, tool use, retrieval, and memory management
• The ability to evaluate and critique AI-generated output, understanding why a model is wrong, not just that it is, with familiarity with observability and the Dynatrace platform as a strong advantage

Benefits

• Unlimited personal time off
• An employee stock purchase plan
• A reward system
• Medical/dental benefits
• A company-matched 401(k) plan for retirement

Company Overview

Company H1B Sponsorship