Software Engineer II

Microsoft is a global technology company that empowers every person and organization on the planet to achieve more.
$98,300 - $193,200
Backend
Mid-Level Software Engineer
Hybrid
2+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Technical Support Engineering

Senior Technical Support Engineer role at Microsoft, focusing on resolving complex technical issues and delivering exceptional customer support with hybrid work options.

Software Engineer - CTJ - Poly

Mid-level Software Engineer position at Microsoft focusing on identity and security solutions, requiring TS/SCI clearance and offering hybrid work arrangement.

Technical Support Engineer - Exchange & Outlook

Technical Support Engineer position at Microsoft focusing on Exchange & Outlook solutions, offering remote work and comprehensive benefits.

Critical Environment Electrical Engineering

Critical Environment Electrical Engineering role at Microsoft's Cloud Operations & Innovation team, focusing on datacenter infrastructure and power systems.

Technical Support Engineering - Windows Performance

Technical Support Engineer position at Microsoft Japan, focusing on Windows performance troubleshooting with remote work options and comprehensive benefits.

Description For Software Engineer II

Join Microsoft's Bing Metrics Team as a Software Engineer II, working on the next generation of metrics and quality control for Bing search. The role involves working with petabytes of user activity data and leveraging large language models (LLMs) to ensure high-quality search results. As part of an international team, you'll be responsible for identifying issues and implementing search quality metrics, collaborating with over 80 different teams across Bing.

The position offers unique opportunities to work with big data, design complex pipelines, and directly influence search engine relevance. You'll be building tools for running multi-step prompts to evaluate search engine quality and generate actionable insights. The team uses cutting-edge technologies including LLMs, Azure cloud services, and modern web development tools.

The role requires expertise in multiple programming languages, automation tools, and cloud services, particularly Azure. You'll be working in a hybrid environment with up to 50% work from home flexibility. The compensation is competitive, ranging from $98,300 to $193,200 USD annually, with additional benefits including healthcare, educational resources, and parental leave.

This is an ideal opportunity for engineers passionate about search quality, data analytics, and AI technologies. You'll be part of Microsoft's mission to empower every person and organization globally, working in a culture that values growth mindset, innovation, and collaboration. The position offers high visibility and impact within one of the world's leading search engines.

Last updated 3 months ago

Responsibilities For Software Engineer II

  • Build tools and pipelines with Bing Logs using Big Data platforms
  • Design and implement E2E pipelines (from data collection, evaluation and result display)
  • Design and implement tools for LLM models, engineer prompts for textual and multi-model LLMs
  • Design and implement creative visualization for results

Requirements For Software Engineer II

Python
JavaScript
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience
  • 2+ years of experience in writing automation code with Chromium and Puppeteer
  • 2+ years of experience in developing solutions on Azure
  • 2+ years of experience with SQL, T-SQL, SQL Server
  • 3+ years of experience with modern web development [HTML, JavaScript, jQuery]
  • Experience in testing and relevance evaluation
  • Experience or deep interest in Large-Language Models (ChatGPT)
  • Experience in (big) data and data analytics

Benefits For Software Engineer II

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?