Sr Data Engineer

Requisition Number: 94405 

Data Engineer

The Data Management Platform (DMP) is a platform for running analytics to support different business areas across the enterprise. DMP is built entirely on Azure services and over the years it has evolved into a very stable product. We are looking to take advantage of improvements in technology and evolving requirements to enhance the platform for the future.

Must Have Technical Skills:

Python, SQL Server, Databricks Unity catalog, Databricks API, PySpark, Stored procedures, Azure Data Factory, Databricks, Terraform module, Terraform, Azure DevOps, GitHub, T-SQL, Synk, DataDog, Azure Data Lake Storage, Azure Service Bus, Azure Event Grid, Azure App Insights, Azure Kubernetes Service, GitHub actions, and Azure Cosmos DB

Other Requirements:

• Ability to provide technical guidance on technologies and architecture challenges 
• Implemented Domain driven Data Architecture for other organizations
• Familiar with Data mesh and federating data consumption from source
• Able to communicate technical roadmap/architecture to broad set of users
• Comfortable working cross functionally with product management
• Certified in Databricks and abreast with features of Databricks (Databricks CLI, Asset Bundles, Terraform module, API)

Key Responsibilities

• Architect Microsoft Azure/Databricks/Off the shelf tools for DMP to meet current and future needs of Kroger
• Serve as Technical Lead to coordinate and guide Platform, Ingestion, DQ and Ops & Support teams
• Provide technical guidance on technologies and architecture challenges 
• Refine Ingestion process and enable self-service capabilities for Data Producer
• Enhance Data quality of data ingested into DMP by adding additional checks
• Review and provide feedback on core Platform code changes and support production deployments
• Update security plan manager (SPM) for DMP and manage releases with team
• Participate in team Scrum ceremonies and hands-on keyboard for Product deliverables
• Communicate technical roadmap/architecture to broad set of users

The position described above provides a summary of some the job duties required and what it would be like to work at Insight. For a comprehensive list of physical demands and work environment for this position, click here.

Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law.

Posting Notes: Remote || Arizona (US-AZ) || United States (US) || IT Infrastructure & Support || None || Remote ||