Senior Data Engineer – Copilot Notebooks

jobs-near-me.org

<div class="isg-job-description“>OverviewAre you passionate about shaping the future of AI and empowering millions of users to unlock their full potential? The Notebooks Team in the Office Product Group organization (OPG) is leading an exciting transformation with Copilot Notebooks-intelligent, dynamic experiences infused with powerful AI that act as a true “second brain.” The Notebooks team is hiring a Senior Data Engineer to help us bring our mission to life of helping our customers effortlessly capture ideas, intuitively understand complex information, and seamlessly take informed action. As a Senior Data Engineer on the Notebooks team you will play a critical role in ensuring product telemetry is piped, aggregated, verified, and delivered to Data Scientists. Your work will span across multiple hosts and endpoints of Copilot Notebooks and scale to data coming in from around the world. The clarity driven by this data will enable us to have deep insight and understanding of how customers are using the product, influence decision making and shape the future of the product.This opportunity will build your experience working directly with Software Engineers, Data Scientists & Product Managers, all working together to build an innovative product that delights users. The complexity and planet-scale nature of the data will challenge and increase your data pipeline design skills. The direct connection to both the customer and the building of the product will advance your skills in truly delivering product visions & missions.Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
ResponsibilitiesYou will coordinate with Data Scientists, Product Managers and Software Engineers to ensure that the production telemetry contains the information required to generate insights and understanding of how customers are using the product.You will build code to extract raw data, validate its quality, and apply your deep data knowledge to ensure the correct data is ingested across the pipeline. You’ll also create techniques to transform raw data into forms compatible with downstream data sources.You will identify opportunities to leverage and contribute to the development of data tools that are used to transform, manage, and access data. You’ll also write and validate code to test the storage and availability of data platforms so that they’re more resilient.You will write code to implement performance monitoring protocols across data pipelines, building visualizations and aggregations to monitor pipeline health. You’ll also implement solutions and self-healing processes that minimize points of failure across multiple product features.You will anticipate data governance needs, designing data modeling and handling procedures to ensure compliance with all applicable laws and policies. You’ll also govern data accessibility within your assigned pipelines.Embody our culture and values.

To help us track our recruitment effort, please indicate in your cover/motivation letter where (usajobvacancies.com) you saw this job posting.