Taro Logo

Machine Learning Engineer - II

Microsoft builds the end-to-end Azure AI stack/PaaS and is core to Azure's innovation and differentiation, powering flagship products from Office to Teams to Xbox.
$120,000 - $200,000
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
6+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Software Engineer II

Software Engineer II position at Microsoft's Ads Fraud Detection team, focusing on ML-based fraud detection at web scale, offering $98K-$193K salary with hybrid work model.

Software Engineer (AI/ML) - Azure Core Storage

Software Engineer position focusing on AI/ML in Azure Core Storage, working on distributed systems and cloud infrastructure at Microsoft.

Machine Learning Engineer – Xbox Games Technology Group – The Coalition

Machine Learning Engineer position at Microsoft's The Coalition studio, focusing on applying ML solutions to enhance game development processes for the Xbox Games Technology Group.

Software Engineer 2, Gaming AI

Software Engineer II position at Microsoft's Xbox Gaming AI team in Barcelona, focusing on developing AI-powered gaming services and frameworks with hybrid work options.

Software Engineering IC3

Software Engineering role at Microsoft Security focusing on developing generative AI services and LLM capabilities for Security Copilot.

Description For Machine Learning Engineer - II

Microsoft's AI Platform organization is seeking a Machine Learning Engineer to join their Evaluation AI team. This role focuses on building evaluation frameworks for cutting-edge deep learning models, including Large Language Models, Small Language Models, RAG, and fine-tuned models across NLP, vision, and multimodal frameworks. The position offers an opportunity to work with state-of-the-art AI technologies while developing the next-generation model evaluation platform for generative applications.

The ideal candidate will have strong expertise in machine learning, deep learning, and natural language processing, with practical experience in Python and frameworks like TensorFlow and PyTorch. They will be responsible for building sophisticated evaluation frameworks, implementing state-of-the-art solutions, and developing end-to-end pipelines for model training and evaluation.

Working at Microsoft means joining a company where passionate innovators collaborate to push the boundaries of what's possible in a cloud-enabled world. The role offers exposure to Azure OpenAI, Azure ML, and Cognitive Services, allowing you to work on the largest AI workloads globally. Benefits include industry-leading healthcare, educational resources, parental leave, and opportunities for professional growth.

This position combines technical challenges with the opportunity to shape the future of AI evaluation at scale. The successful candidate will work with cross-functional teams, engage in sophisticated prompt engineering, and contribute to building highly performant, scalable systems that power Microsoft's AI infrastructure.

Last updated 4 months ago

Responsibilities For Machine Learning Engineer - II

  • Build sophisticated Evaluation framework for cutting-edge deep learning models
  • Develop the next generation of Azure AI's evaluation platform
  • Implement State-of-the-art evaluation frameworks
  • Engage in sophisticated prompt engineering techniques
  • Build end-to-end pipelines covering model training, data analysis, model serving and model evaluation
  • Build and Utilize CI/CD pipelines
  • Collaborate with cross-functional teams
  • Implement new product features and evaluation metrics

Requirements For Machine Learning Engineer - II

Python
  • Master's AND 4+ years' experience, or Bachelor's AND 6+ years' experience in Computer Science or related field
  • Strong hold on Data Structures, algorithmic problem solving
  • Proficiency in Python and open-source tools (TensorFlow, PyTorch)
  • Knowledge with Generative AI suite, transformer-based and diffuser-based models
  • Proficiency in Agile development practices and CI/CD
  • Experience with cloud platforms and distributed computing
  • Excellent verbal and written communication skills

Benefits For Machine Learning Engineer - II

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?