Share this Job
Apply now »

Team Lead-Data Engineer (SQL, PySpark, Azure)

Gurugram, HR, IN

Requisition Number: 86717 

Skills

  • 8+ year experience with ETL and software development

  • 2+ years managed small teams

  • 8+ years SQL professional experience

  • Structured programming language experience: python, Java, .Net, etc….

  • Azure experience / familiarity, specifically Azure Data Factory

  • Data pipeline/ETL experience 

  • Analytic, critical thinking skills

  • Familiar working within an  Agile and Scrum project environment

  • Nice to Haves

    • Spark experience

    • Azure Synapse experience

    • Python experience

Duties

Our stack is an ELT process inside of Azure Synapse.  Day to day we work on SQL queries in spark notebooks, and manage the metadata controlling the data pipeline flow.

  • This is a hands-on role that will also require assisting junior team members and interfacing with the client to understand work items, prioritize work items, and resolve problems.  So communcation is key!

  • Responsible for creating dimension and fact tables in sql using definitions provided by the business

  • Ingest new data source objects into the ETL framework using metadata.  Requires the ability to understand different schemas, adapt existing data processing steps to handle the new data object using SQL in a spark notebook environment

  • Troubleshooting data discrepancies in existing dimension and fact tables by tracing the data flow through various SQL transformations

  • Maintaining metadata that defines the ETL processing steps and troubleshooting metadata inconsistencies

  • Manage team of 4 data engineers

  • Daily interface with client data engineers to review work progress, identify and resolve blockers

 

The position described above provides a summary of some the job duties required and what it would be like to work at Insight. For a comprehensive list of physical demands and work environment for this position, click here.

 

Today, every business is a technology business. Insight Enterprises, Inc. empowers organizations of all sizes with Insight Intelligent Technology Solutions™ and services to maximize the business value of IT. As a Fortune 500-ranked global provider of digital innovation, cloud/data center transformation, connected workforce, and supply chain optimization solutions and services, we help clients successfully manage their IT today while transforming for tomorrow. From IT strategy and design to implementation and management, our 11,000 teammates help clients innovate and optimize their operations to run smarter. Discover more at insight.com 

  • Founded in 1988 in Tempe, Arizona
  • 11,000+ teammates in 19 countries providing Insight Intelligent Technology Solutions™ for organizations across the globe
  • $8.3 billion in revenue in 2020
  • Ranked #360 on the Fortune 500, #15 on the CRN Solution Provider 500, 2020 CRN Innovator of the Year Award
  • 2021 Intel Innovation Partner of Year, 2021 Microsoft Worldwide Customer Experience Partner of the Year
  • Ranked #7 on the 2021 Fortune World's Most Admired Companies (Information Technology Services industry), #70 on the Fortune 100 Best Workplaces for Diversity, #296 on Forbes World's Best Employers (#27 within IT)
  • Signatory of the United Nations (UN) Global Compact and Affiliate Member of the Responsible Business Alliance

 

Today's talent leads tomorrow's success. Learn about careers at Insight: jobs.insight.com

 

Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law.

 

Insight India Location:Level 16, Tower B, Building No 14, Dlf Cyber City In It/Ites Sez, Sector 24 &25 A Gurugram Gurgaon Hr 122002 India


Job Segment: Database, SQL, Manager, Supply Chain, Cloud, Technology, Management, Operations

Apply now »