Job Overview
Ignite your career as a Data Engineer and become a vital force in transforming raw data into actionable insights! In this dynamic role, you will design, develop, and optimize scalable data pipelines and architectures that empower organizations to harness the full potential of their data assets. You will work at the forefront of big data technologies, cloud platforms, and advanced analytics to support strategic decision-making and innovative projects. Your expertise will drive efficiency, accuracy, and agility across diverse data ecosystems, making a tangible impact on business success.
Duties
- Develop and maintain robust ETL (Extract, Transform, Load) processes to integrate data from multiple sources such as AWS, Azure Data Lake, Oracle, and Microsoft SQL Server.
- Design and implement scalable data warehouses and data lakes using tools like Hadoop, Spark, Apache Hive, and Informatica to support large-scale analytics.
- Build efficient database schemas and optimize SQL queries for performance across various platforms including Oracle, SQL Server, and Big Data environments.
- Collaborate with cross-functional teams using Agile methodologies to gather requirements, plan sprints, and deliver high-quality data solutions.
- Create RESTful APIs for seamless data access and integration with Looker dashboards or other visualization tools.
- Write complex scripts in Python, Bash (Unix shell), Shell Scripting, or VBA to automate workflows and streamline data processing tasks.
- Engage in model training and analysis skills to support advanced analytics initiatives and machine learning projects.
- Design data models that facilitate linked data concepts for enhanced interoperability across systems.
Experience
- Proven experience in designing and developing large-scale data pipelines using AWS services such as S3, Lambda, or Glue.
- Strong proficiency in Java, Python, SQL (including T-SQL), and Shell Scripting for building reliable data solutions.
- Hands-on experience with big data frameworks like Hadoop, Spark, Apache Hive, or similar technologies.
- Familiarity with cloud platforms including Azure Data Lake and related services for scalable storage and processing.
- Knowledge of ETL tools such as Talend or Informatica for efficient data integration workflows.
- Demonstrated ability to work within Agile teams on complex projects involving database design and analytics.
- Understanding of RESTful API development for integrating diverse systems seamlessly.
- Excellent analysis skills with a focus on database optimization, modeling techniques, and linked data concepts. Join us in shaping the future of data-driven decision-making! We are committed to fostering an inclusive environment where innovation thrives through talented professionals dedicated to excellence in analytics and technology solutions.
Job Type: Full-time
Pay: $108,044.87 - $130,118.55 per year
Benefits:
- 401(k)
- Dental insurance
- Flexible schedule
- Health insurance
- Paid time off
- Tuition reimbursement
- Vision insurance
Work Location: Remote
