Software Engineer

Share job

You will join the Experimentation (A/B test) team within CoreAI’s Foundry Agent platform, where innovation drives impact at scale. As part of a group that powers experimentation for Microsoft’s most critical AI services, you’ll help shape the future of data-driven decision-making.

In this role, you will build scalable compute pipelines for A/B scorecard calculation, supporting one of the largest experimentation platforms in the industry. Your work will be essential to delivering reliable, high-performance experimentation infrastructure. You’ll gain hands-on experience with A/B test methodology, distributed systems, and big data optimization, all while collaborating with top engineers in a flexible, in-office environment.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more, and we’re dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.

Required/Minimum Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.

• Experience with A/B testing methodologies and experimentation platforms.

• Proficiency in at least one big data technology (e.g., Hadoop, Spark) and experience with job tuning for large-scale data processing.

• Hands-on experience designing, building, and maintaining distributed systems or compute pipelines.

• Coding proficiency in at least one programming language such as C++, C#, Java, Python, or similar.

• Ability to work collaboratively in a diverse, cross-functional engineering environment.

Preferred Qualifications

• Master’s degree in Computer Science, Engineering, or a related technical field.

• Experience supporting both first-party and third-party customers in a cloud or distributed systems environment.

• Familiarity with Microsoft Azure, Azure Data Lake, Azure Synapse, or similar cloud data platforms.

• Experience optimizing experimentation infrastructure for reliability and performance.

• Demonstrated commitment to continuous learning and knowledge sharing.

1. Design, build, and maintain scalable compute pipelines for A/B scorecard calculation, supporting both first-party and future third-party customers.
2. Develop and optimize distributed systems for high-performance experimentation infrastructure.
3. Implement and tune big data technologies (e.g., Hadoop, Spark) to ensure efficient processing of large-scale experiment data.
4. Collaborate with engineers, product managers, and stakeholders to define requirements and deliver impactful experimentation solutions.
5. Apply A/B testing methodology to drive data-driven decision-making across Microsoft.
6. Monitor, troubleshoot, and improve the reliability and performance of experimentation pipelines.
7. Contribute to a culture of innovation, continuous learning, and knowledge sharing within the team.