Software Engineer II - Apache Spark
Microsoft
Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.
Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture.
Within Azure Data, the big data analytics team provides a range of products that enable data engineers and data scientists to extract intelligence from all data – structured, semi-structured, and unstructured. We build the Data Engineering, Data Science, and Data Integration pillars of Microsoft Fabric.
Within Azure Data, the big data analytics team provides a range of products that enable data engineers and data scientists to extract intelligence from all data – structured, semi-structured, and unstructured. We build the Data Engineering, Data Science, and Data Integration pillars of Microsoft Fabric.
The Fabric Spark team is looking to push the frontiers of analytics performance and scale. You will have to help rebuild the way analytics engines process data. We build services that enable big data developers to build mission critical applications with high levels of SLA through auto detection and healing. We enable advanced data Insights and recommendations externally to our customers. As a Software Engineer II on our team, you will have an opportunity to work on and extend OSS technologies like Spark, Gluten, Velox, Delta and Hadoop as well as proprietary Microsoft services. You will help design & implement software components, participate in code reviews, design reviews, assist customers as needed to be able to leverage the service and keep the service running. You will work with a team of talented engineers aiming to solve performance issues by looking at an entire workload and learning from its execution history. Your goal is to make onboarding new workloads on to Fabric a breeze and to help keep them continuously tuned with changes in the Spark engine and user workload. This will require exploring the frontiers of what is possible. You should be AI forward in your approach to delivering impact.
Are you interested in solving challenges that you didn’t know existed and want to solve at Azure scale? Come join us on the Azure Big data team!
We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.
Responsibilities
- Work with a team of passionate engineers to deliver success for customers
- Design, implement, test, and operate data services.
- Release features on time, with high quality, meeting functional, performance, scalability, and compliance requirements.
- Drive quality right from the design phase, incorporating best practices and engineering for testability.
- Solve problems relating to mission critical services and create solutions to prevent problem recurrence.
- Participate in product live site and operations.
Qualifications
Required Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience
- 1+ year professional experience with Apache Spark, MapReduce, database internals, or compete technologies
Additional Job Requirements:
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:
- This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
- Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Experience with database internals
- Experience with OSS components like the Spark eco system
- Experience with building scalable cloud services.
#azdat #azuredata #sparkjobs #fabricspark
Software Engineering IC3 - The typical base pay range for this role across Canada is CAD $85,000 - CAD $166,800 per year.
Find additional pay information here:
https://careers.microsoft.com/v2/global/en/canada-pay-information.html
Software Engineering IC3 - L'échelle salariale de base typique pour ce rôle dans l'ensemble du Canada est de 85,000 $ CAD à 166,800 $ CAD par année.
Pour plus d'information au sujet de la rémunération, veuillez cliquer ici:
https://careers.microsoft.com/v2/global/en/canada-pay-information.html
Ce poste sera ouvert pendant au moins cinq jours et les candidatures seront acceptées de façon continue jusqu’à ce que le poste soit pourvu.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft est un employeur offrant l’égalité d’accès à l’emploi. Tous les candidats qualifiés seront pris en considération pour l’emploi, sans égard à l’âge, à l’ascendance, à la citoyenneté, à la couleur, aux congés médicaux ou familiaux, à l’identité ou à l’expression de genre, aux renseignements génétiques, à l’état d’immigration, à l’état matrimonial, à l’état de santé, à l’origine nationale, à un éventuel handicap physique ou mental, à l’affiliation politique, au statut de vétéran protégé ou au statut militaire, à la race, à l’ethnie, à la religion, au sexe (y compris la grossesse), à l’orientation sexuelle ou à toute autre caractéristique protégée par les lois, ordonnances et règlements locaux applicables. Si vous avez besoin d’aide avec des accommodements religieux et/ou d’un accommodement raisonnable en raison d’un handicap pendant le processus de candidature, apprenez-en plus sur la demande d’accommodement.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.