Machine Learning Engineer - II

Microsoft builds the end-to-end Azure AI stack/PaaS and is core to Azure's innovation and differentiation, powering flagship products from Office to Teams to Xbox.
$120,000 - $200,000
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
6+ years of experience
AI · Enterprise SaaS

Description For Machine Learning Engineer - II

Microsoft's AI Platform organization is seeking a Machine Learning Engineer to join their Evaluation AI team. This role focuses on building evaluation frameworks for cutting-edge deep learning models, including Large Language Models, Small Language Models, RAG, and fine-tuned models across NLP, vision, and multimodal frameworks. The position offers an opportunity to work with state-of-the-art AI technologies while developing the next-generation model evaluation platform for generative applications.

The ideal candidate will have strong expertise in machine learning, deep learning, and natural language processing, with practical experience in Python and frameworks like TensorFlow and PyTorch. They will be responsible for building sophisticated evaluation frameworks, implementing state-of-the-art solutions, and developing end-to-end pipelines for model training and evaluation.

Working at Microsoft means joining a company where passionate innovators collaborate to push the boundaries of what's possible in a cloud-enabled world. The role offers exposure to Azure OpenAI, Azure ML, and Cognitive Services, allowing you to work on the largest AI workloads globally. Benefits include industry-leading healthcare, educational resources, parental leave, and opportunities for professional growth.

This position combines technical challenges with the opportunity to shape the future of AI evaluation at scale. The successful candidate will work with cross-functional teams, engage in sophisticated prompt engineering, and contribute to building highly performant, scalable systems that power Microsoft's AI infrastructure.

Last updated 2 months ago

Responsibilities For Machine Learning Engineer - II

  • Build sophisticated Evaluation framework for cutting-edge deep learning models
  • Develop the next generation of Azure AI's evaluation platform
  • Implement State-of-the-art evaluation frameworks
  • Engage in sophisticated prompt engineering techniques
  • Build end-to-end pipelines covering model training, data analysis, model serving and model evaluation
  • Build and Utilize CI/CD pipelines
  • Collaborate with cross-functional teams
  • Implement new product features and evaluation metrics

Requirements For Machine Learning Engineer - II

Python
  • Master's AND 4+ years' experience, or Bachelor's AND 6+ years' experience in Computer Science or related field
  • Strong hold on Data Structures, algorithmic problem solving
  • Proficiency in Python and open-source tools (TensorFlow, PyTorch)
  • Knowledge with Generative AI suite, transformer-based and diffuser-based models
  • Proficiency in Agile development practices and CI/CD
  • Experience with cloud platforms and distributed computing
  • Excellent verbal and written communication skills

Benefits For Machine Learning Engineer - II

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Machine Learning Engineer - II

Machine Learning Engineer

Machine Learning Engineer position at Microsoft Security's CFAR team, focusing on AI solutions for cybersecurity and fraud prevention, offering competitive salary and benefits.

Software Engineer II

Software Engineer II position at Microsoft focusing on machine learning and SAP workload optimization for Azure platform, offering competitive salary and remote work options.

Software Engineer II

Mid-level Software Engineer position at Microsoft Security, focusing on developing generative AI services and LLM capabilities for security applications.

Software Engineer

Microsoft is seeking a Software Engineer to develop AI-driven services for scientific discovery within their Strategic Missions and Technologies division.

Software Engineer II- AI/ML

Software Engineer II position at Microsoft focusing on AI/ML development for Business & Industry Copilots group, working on Dynamics 365 and enterprise solutions.