Share this Job
Apply now »

Azure Databricks Data Engineer

Columbus, OH, US

Requisition Number: 86348 

Insight is dedicated to making the impossible possible.  We combine cutting-edge technology, creative thinking, and the power of scale to deliver radical business transformation.   

Our areas of expertise include Modern Workplace, Intelligent Edge, Modern Apps, Data & AI, Modern Infrastructure, and Cybersecurity

 

From IT strategy and design to implementation and management, our employees help clients innovate and optimize their operations to run smarter.   

 

                    Fortune World’s Most Admired Companies- #7 

                    Forbes America’s Best Employer’s for Diversity- #59 

                    Microsoft Worldwide Solution Assessments Partner of the Year 

                    Microsoft Worldwide Migration to Azure Partner of the Year 

                    Microsoft US Application Innovation Partner of the Year 

                    Microsoft US Azure Team Partner Choice Award for Data & AI 

                    Intel Innovation Partner of the Year 

                    Google Cloud Application Development Specialization 

 

Senior Azure Data Engineer

 

Overview:

 

Work with Insight and our clients to develop best-in-class data & analytics platforms leveraging the Microsoft Azure data stack, including Azure Synapse Analytics, Spark and Azure Data Factory.  To be successful in this role you will have strong knowledge of Python & Spark development and experience working with Azure Data Factory to build scalable, efficient data pipelines.  You will work closely with client stakeholders and an award-winning team of engineers, architects and thought leaders to design, build and implement next-generation solutions.

What you’ll do at Insight:

 

  • Build enterprise-grade data solutions for a variety of external clients. 
  • Design and code solutions to tough data challenges and provide feedback on others’ work. 
  • Provide mentorship and oversight to other developers
  • Work directly with client stakeholders to develop technical solutions for business cases. 
  • Aggressively grow your skillset and expertise to meet the emerging needs of our clients. 

What you’ll need to join Insight:

  • 8+ years of experience developing enterprise big data solutions

5+ years of experience working Microsoft Azure data platform and an excellent grasp of the following:

    • Azure Cloud Services
    • Development of Complex Data Ingestion & Transformation Pipelines
    • Spark Programming (Scala, Python, PySpark, SparkSQL)
    • Advanced SQL Programming
    • Azure Data Factory
    • Azure Data Lake Storage 
    • Azure Synapse Analytics or Azure Databricks
  • Develop and solidify client relationships through excellent communication, positive attitude, adaptability, and strong work ethic to become the trusted partner of clients.
  • Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments.
  • Lead and mentor our development teams to deliver a quality data solution.
  • Translate business requirements to technical solutions leveraging strong business acumen.
  • Analyze current business practices, processes, and procedures as well as identify future business opportunities for leveraging cloud services (Microsoft, Amazon, and/or Google).
  • Deliver architectures for transformations and modernizations of enterprise data solutions using cloud data technologies.
  • Design and build modern data pipelines and data streams.
  • Design and build data service APIs.
  • Develop and maintain data warehouse schematics, layouts, architectures, and relational/non-relational databases for data access and Advanced Analytics.
  • Expose data to end users using Power-BI, Azure API Apps, or any other modern visualization platform or experience.
  • Implement effective metrics and monitoring processes.

 

Other Requirements:

  • Demonstrated experience of turning business use cases and requirements to technical solutions.
  • Experience in business process mapping of data and analytics solutions.
  • Experience in leading and mentoring development teams.
  • Ability to model business processes using industry best practices.
  • Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
  • Excellent grasp of data warehousing and ETL/ELT use cases and patterns at scale
  • The ability to apply such methods to solve business problems in combination with building data pipelines, data streams, and system integration.
  • Advanced SQL experience is required.

 

The position described above provides a summary of some the job duties required and what it would be like to work at Insight. For a comprehensive list of physical demands and work environment for this position, click here.

 

Today, every business is a technology business. Insight Enterprises, Inc. empowers organizations of all sizes with Insight Intelligent Technology Solutions™ and services to maximize the business value of IT. As a Fortune 500-ranked global provider of digital innovation, cloud/data center transformation, connected workforce, and supply chain optimization solutions and services, we help clients successfully manage their IT today while transforming for tomorrow. From IT strategy and design to implementation and management, our 11,000 teammates help clients innovate and optimize their operations to run smarter. Discover more at insight.com 

  • Founded in 1988 in Tempe, Arizona
  • 11,000+ teammates in 19 countries providing Insight Intelligent Technology Solutions™ for organizations across the globe
  • $8.3 billion in revenue in 2020
  • Ranked #409 on the Fortune 500, #15 on the CRN Solution Provider 500, 2020 CRN Innovator of the Year Award
  • 2020 Intel Innovation Partner of Year, 2020 Microsoft U.S. Partner of the Year and Worldwide Customer Experience Partner of the Year
  • Ranked #7 on the 2021 Fortune World's Most Admired Companies (Information Technology Services industry), #70 on the Fortune 100 Best Workplaces for Diversity, #296 on Forbes World's Best Employers (#27 within IT), and #5 on the Phoenix Business Journal 2020 list of Best Places to Work
  • Signatory of the United Nations (UN) Global Compact and Affiliate Member of the Responsible Business Alliance

 

Today's talent leads tomorrow's success. Learn about careers at Insight: jobs.insight.com.

 

Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law.

 

#LI-Remote

#Dice

 


Nearest Major Market: Columbus
Nearest Secondary Market: Dublin

Job Segment: Construction, Data Warehouse, Supply Chain, Data Center, Developer, Engineering, Technology, Operations

Apply now »