Software Engineer II

Global technology company empowering people and organizations through innovative software and cloud solutions.
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
4+ years of experience
AI · Enterprise SaaS

Description For Software Engineer II

Microsoft's Azure GenAI team is seeking a Software Engineer II to join their cutting-edge work on large language model technologies. This role is part of the Azure OpenAI team, working closely with OpenAI and various Microsoft product teams including GitHub and Office. The position focuses on developing and scaling distributed systems for LLM applications, with an emphasis on safety and performance.

The ideal candidate will bring 4+ years of software development experience and strong expertise in cloud native infrastructure and distributed systems. You'll be working in a fast-paced, startup-like environment, contributing to the Azure AI Platform products and services. The role involves designing and implementing scalable finetuning platforms, collaborating across teams, and pushing the boundaries of AI technology.

Microsoft offers a comprehensive benefits package, including industry-leading healthcare, educational resources, and parental leave. The position is hybrid-based in Hyderabad, with up to 50% work from home flexibility. This is an exceptional opportunity to work at the forefront of AI technology while contributing to Microsoft's mission of empowering every person and organization on the planet to achieve more.

The role requires a blend of technical expertise in Python, Kubernetes, and cloud technologies, combined with a deep understanding of ML concepts and LLMs. You'll be part of a team that values innovation, collaboration, and technical excellence, with the chance to make a significant impact on the future of AI technology.

Last updated 5 days ago

Responsibilities For Software Engineer II

  • Understand state of the art LLM fine-tuning and training workflows and contribute to new features and platform enhancements
  • Design, implement and maintain scalable, reliable, secure and performant finetuning platforms using Microsoft Azure
  • Collaborate with product groups across Microsoft and within AI platform

Requirements For Software Engineer II

Python
Kubernetes
  • Bachelor's Degree in Computer Science or related technical field
  • 4+ years of relevant software development experience
  • Solid grasp of Object-Oriented Programming and proficiency in C#/Python or similar languages
  • Good understanding of modern cloud native infrastructure, distributed systems and frameworks
  • Must pass Microsoft Cloud Background Check

Benefits For Software Engineer II

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Software Engineer II

Language Engineer

Language Engineer role at Microsoft AI, focusing on building next-generation capabilities for Copilot through language engineering and LLM development.

Software Engineer II

Microsoft Azure AI Platform Software Engineer II position focusing on machine learning, AI model training, and distributed systems development in Hyderabad, India.

Software Engineer II

Software Engineer II position at Microsoft Security working on Security Copilot and generative AI services in Hyderabad, India.

Software Engineer II

Software Engineer II position at Microsoft working on Azure Specialized team, focusing on SAP workload optimization and machine learning integration.

Software Engineering

Software Engineering role at Microsoft focusing on Azure Machine Learning platform development and large-scale AI model serving infrastructure.