Role : Lead Azure Data Engineer
Location : Malvern, PA (Local only)
Contract job
Overview
Join our innovative team as an Azure Data Engineer and become a vital driver of our data-driven initiatives! In this role, you will design, develop, and optimize scalable data pipelines and architectures within the Azure cloud environment. Your expertise will enable seamless data integration, management, and analysis across diverse big data systems, empowering business intelligence and strategic decision-making. If you thrive on solving complex data challenges with cutting-edge cloud technologies and enjoy working in a dynamic, collaborative setting, this opportunity is perfect for you!
Duties
- Develop and maintain robust ETL (Extract, Transform, Load) pipelines to facilitate efficient data flow from various sources into cloud data warehouses.
- Design and implement scalable data models and schemas using dimensional modeling techniques to support business intelligence tools and analytics.
- Manage and optimize cloud-based data storage solutions such as Azure Data Lake and cloud databases to ensure high performance and security.
- Collaborate with cross-functional teams to integrate data from multiple platforms including AWS, Hadoop, Oracle, SQL Server, and other big data systems.
- Build automated workflows using scripting languages like Python, Bash (Unix shell), or Shell Scripting to streamline data processing tasks.
- Implement RESTful APIs for seamless data exchange between applications and services.
- Support model training, analysis activities, and insights generation by leveraging Spark, Apache Hive, Hadoop, and other analytics tools.
Requirements
- Proven experience in data engineering within a public cloud environment such as Azure or AWS.
- Strong proficiency in SQL databases including Microsoft SQL Server, Oracle, and cloud-based SQL solutions.
- Expertise in big data systems like Hadoop, Spark, Apache Hive, and related technologies for processing large datasets.
- Hands-on experience with ETL pipeline development using tools such as Informatica or Talend.
- Solid understanding of data management integration techniques including data warehousing design and data modeling principles.
- Programming skills in Python, Java, or similar languages for software development and automation tasks.
- Familiarity with business intelligence tools like Looker or equivalent platforms for reporting and visualization.
- Knowledge of cloud databases such as Azure Data Lake or other cloud storage solutions for scalable data warehousing.
- Experience working within Agile development methodologies to deliver iterative solutions efficiently.
- Strong analysis skills combined with database design expertise to support complex queries and analytics projects.
Embark on a journey where your technical prowess fuels impactful insights! We’re dedicated to fostering an environment that encourages innovation while supporting your professional growth through continuous learning opportunities. Join us to shape the future of enterprise data management!
Pay: $55.00 - $65.00 per hour
Work Location: In person
