Note: The job is a remote job and is open to candidates in USA. Xylo Technologies is seeking a Senior Software Engineer for AI Platform Engineering. The role involves designing high-performance hosting environments and building scalable hybrid-cloud infrastructure for AI capabilities, ensuring operational excellence and collaboration with cross-functional teams.

Responsibilities

• Design and implement high-performance hosting environments for both specialized models and autonomous agents
• Build multi-tenant platform capabilities that support seamless agent and model execution across diverse cloud and on-prem environments
• Implement robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents & models in production
• Act as a member of our rotational platform operational team, ensuring the reliability and uptime of critical AI services
• Partner with cross-functional AI teams to identify system friction, streamlining their workflows and accelerating the delivery of AI-driven value

Skills

• Proven experience building scalable back-end systems, ideally with a focus on containerization and orchestration (4+ years of in-depth Kubernetes is a must)
• Strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architectures
• A track record of implementing observability (logging, metrics, tracing) in complex, distributed environments
• The ability to turn abstract AI research into production-grade, hardened platform features
• Have in-depth knowledge of software engineering with experience coding applications or services in a high-level programming language, preferably Python, and a basic knowledge of related fields
• Demonstrated problem solving and time management skills
• Possesses strong technical aptitude for designing and implementing software solutions
• Experience with modern application development frameworks
• Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Deep hands-on technical expertise, excellent verbal and written communication skills
• Experience with Agile software development techniques
• Bachelor's Degree in Computer Science/Engineering or related field with 5 years of experience as noted below; OR an Associate's degree in Computer/Science/Engineering or related field with 7 years of experience
• Ability to use a wide variety of open-source technologies and cloud-based services
• Experience writing software for hybrid cloud (GCP, AWS, Azure)
• Experience building high-performance, highly available and scalable distributed systems
• Experience developing software for healthcare related industries

Company Overview

• Over the past decade, Xylo Technologies has emerged as a leading provider of technology based solutions. It was founded in 2000, and is headquartered in Rochester, Minnesota, USA, with a workforce of 51-200 employees. Its website is https://xylotechnologies.com.

Company H1B Sponsorship

• Xylo Technologies has a track record of offering H1B sponsorships, with 2 in 2025, 2 in 2024, 1 in 2023, 1 in 2022, 2 in 2021, 9 in 2020. Please note that this does not guarantee sponsorship for this specific role.

Apply To This Job