Data Engineer III

Gurugram Gurgaon HR, IN

Requisition Number: 99422

Data Engineer III

Shift: Rotational, 2:00 pm- 11:00 PM IST
Location: Delhi NCR, Hyderabad, Bangalore, Pune, Chennai, this is a hybrid work opportunity.

Insight at a Glance

14,000+ engaged teammates globally with operations in 25 countries across the globe.
Received 35+ industry and partner awards in the past year
$9.2 billion in revenue
#20 on Fortune’s World's Best Workplaces™ list
#14 on Forbes World's Best Employers in IT – 2023
#23 on Forbes Best Employers for Women in IT- 2023
$1.4M+ total charitable contributions in 2023 by Insight globally

Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people-first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. As a Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we guide organizations through complex digital decisions.

About the role

As a Data Engineer III, you will focus on delivering the vision of the customer through process, development, and lifecycle. We will count on you to work directly with stakeholders and team members to define, design, and deliver actionable insights while working with ETL developers and BI developers in an agile environment.

As a Data Engineer III, you will get to:

Implement ETL pipelines using Azure Databricks and event-driven streaming data engineering
Develop and optimize data pipelines using Microsoft Fabric's data integration tools
Design and implement data lakes and data warehouses using Fabric's storage solutions
Fixing and improving existing data Ingestion Pipelines for customers
Implement data governance and security measures across the Fabric ecosystem
Optimize data workflows for performance, scalability, quality and cost-efficiency
Formulates and recommends standards for achieving maximum performance and efficiency of the DW ecosystem.
Participates in the DataOps activities for supporting various customer problem-statement/situations.

Be Ambitious: This opportunity is not just about what you do today but also about where you can go tomorrow. As a Data Engineer, you are positioned for swift advancement within our organization through a structured career path. When you bring your hunger, heart, and harmony to Insight, your potential will be met with continuous opportunities to upskill, earn promotions, and elevate your career.

What we’re looking for Data Engineer III with:

6+ years of experience with ETL Process, business intelligence & data warehouse architecture
6+ years of experience with Azure Data services i.e. Azure Databricks, ADF, ADLS Gen 2, Azure SQL dB, Synapse, Microsoft Fabric and Power BI
2+ years of hands-on experience with event-driven streaming data engineering, preferably with Apache Flink and/or Confluent.
Strong proficiency in SQL and Python/pyspark
Implementation experience of Medallion architecture and delta lake (or lakehouse)
Working knowledge of Azure DevOps and CICD (build and release)
Good analytical and problem-solving skills
Fluent in relational database concepts and flat file processing concepts
Has strong presentation and collaboration skills and can communicate all aspects of the job requirements, including creating formal documentation.

Good to Have:

Experience with Change Data Capture (CDC) frameworks, with Debezium experience being a bonus.
Familiarity with containerized environments for event-driven streaming
Experience in Unity catalog & DBT knowledge
Experience in Snowflake

What you can expect
We’re legendary for taking care of you, your family and to help you engage with your local community. We want you to enjoy a full, meaningful life and own your career at Insight. Some of our benefits include:

Freedom to work from another location—even an international destination—for up to 30 consecutive calendar days per year.
Medical Insurance
Health Benefits
Professional Development: Learning Platform and Certificate Reimbursement
Shift Allowance

But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities.

Join us today, your ambITious journey starts here.

Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law.

When you apply, please tell us the pronouns you use and any reasonable adjustments you may need during the interview process.
At Insight, we celebrate diversity of skills and experience so even if you don’t feel like your skills are a perfect match - we still want to hear from you!

Today's talent leads tomorrow's success. Learn more about Insight:
https://www.linkedin.com/company/insight/

Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law.

Insight India Location:Level 16, Tower B, Building No 14, Dlf Cyber City In It/Ites Sez, Sector 24 &25 A Gurugram Gurgaon Hr 122002 India