Machine Learning Engineer - II

Microsoft builds the end-to-end Azure AI stack/PaaS and is core to Azure's innovation and differentiation, powering flagship products from Office to Teams to Xbox.
$120,000 - $200,000
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
6+ years of experience
AI · Enterprise SaaS

Description For Machine Learning Engineer - II

Microsoft's AI Platform organization is seeking a Machine Learning Engineer to join their Evaluation AI team. This role focuses on building evaluation frameworks for cutting-edge deep learning models, including Large Language Models, Small Language Models, RAG, and fine-tuned models across NLP, vision, and multimodal frameworks. The position offers an opportunity to work with state-of-the-art AI technologies while developing the next-generation model evaluation platform for generative applications.

The ideal candidate will have strong expertise in machine learning, deep learning, and natural language processing, with practical experience in Python and frameworks like TensorFlow and PyTorch. They will be responsible for building sophisticated evaluation frameworks, implementing state-of-the-art solutions, and developing end-to-end pipelines for model training and evaluation.

Working at Microsoft means joining a company where passionate innovators collaborate to push the boundaries of what's possible in a cloud-enabled world. The role offers exposure to Azure OpenAI, Azure ML, and Cognitive Services, allowing you to work on the largest AI workloads globally. Benefits include industry-leading healthcare, educational resources, parental leave, and opportunities for professional growth.

This position combines technical challenges with the opportunity to shape the future of AI evaluation at scale. The successful candidate will work with cross-functional teams, engage in sophisticated prompt engineering, and contribute to building highly performant, scalable systems that power Microsoft's AI infrastructure.

Last updated 2 minutes ago

Responsibilities For Machine Learning Engineer - II

  • Build sophisticated Evaluation framework for cutting-edge deep learning models
  • Develop the next generation of Azure AI's evaluation platform
  • Implement State-of-the-art evaluation frameworks
  • Engage in sophisticated prompt engineering techniques
  • Build end-to-end pipelines covering model training, data analysis, model serving and model evaluation
  • Build and Utilize CI/CD pipelines
  • Collaborate with cross-functional teams
  • Implement new product features and evaluation metrics

Requirements For Machine Learning Engineer - II

Python
  • Master's AND 4+ years' experience, or Bachelor's AND 6+ years' experience in Computer Science or related field
  • Strong hold on Data Structures, algorithmic problem solving
  • Proficiency in Python and open-source tools (TensorFlow, PyTorch)
  • Knowledge with Generative AI suite, transformer-based and diffuser-based models
  • Proficiency in Agile development practices and CI/CD
  • Experience with cloud platforms and distributed computing
  • Excellent verbal and written communication skills

Benefits For Machine Learning Engineer - II

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Machine Learning Engineer - II

Software Engineer II

Microsoft is hiring a Software Engineer II to join their Azure ML team, focusing on large-scale AI inferencing and LLM services, offering competitive pay and benefits.

Applied AI Engineer II

Applied AI Engineer II position at Microsoft Security focusing on developing AI-powered security solutions with competitive compensation and comprehensive benefits.

Software Engineer II - AI/ML

Microsoft Software Engineer II position focusing on AI/ML development for business applications, offering hybrid work and comprehensive benefits.

AI Hardware/Software Co-design Engineer II

AI Hardware/Software Co-design role at Microsoft focusing on performance optimization and architecture for machine learning systems and GPU workloads.

Software Engineering

Software Engineering role at Microsoft focusing on Azure Machine Learning infrastructure and large-scale AI model serving.