Overview
Join our dynamic team as a Data Engineer and become a vital driver of our data-driven decision-making process! In this role, you will design, develop, and maintain robust data pipelines and architectures that empower our organization to harness the full potential of big data. You’ll work with cutting-edge technologies and collaborate across teams to deliver scalable, efficient, and innovative data solutions. Your expertise will enable us to turn complex data into actionable insights, fueling strategic growth and operational excellence.

Responsibilities

Develop, implement, and optimize ETL (Extract, Transform, Load) processes to ensure seamless data flow across various platforms using tools like Talend, Informatica, and Shell Scripting.
Design and maintain scalable data warehouses and data lakes utilizing AWS, Azure Data Lake, Hadoop, Apache Hive, Spark, and related big data technologies.
Build and manage databases with Microsoft SQL Server, Oracle, and other relational systems; ensure high performance and security standards.
Collaborate with cross-functional teams to gather requirements, analyze data needs, and translate them into technical solutions using SQL, Python, Java, and Bash scripting.
Integrate linked data sources through RESTful APIs for comprehensive analytics capabilities.
Support model training initiatives by preparing large datasets for machine learning applications.
Conduct analysis to identify trends or issues within datasets; communicate findings effectively using Looker or other visualization tools.
Maintain documentation of data architecture designs, workflows, and procedures following Agile methodologies for continuous improvement.

Experience

Proven experience in designing and implementing large-scale data pipelines using AWS services such as S3, Glue, or Redshift.
Strong proficiency in programming languages including Java and Python for data processing tasks.
Extensive knowledge of big data frameworks like Hadoop ecosystem (HDFS, Hive) and Spark for distributed processing.
Hands-on experience with SQL Server, Oracle databases, and Data Warehouse concepts to support enterprise analytics initiatives.
Familiarity with ETL tools such as Talend or Informatica for efficient data integration workflows.
Experience working with cloud platforms like Azure Data Lake or similar environments is highly desirable.
Solid understanding of database design principles combined with analysis skills to interpret complex datasets effectively.
Knowledge of shell scripting (Bash), Unix/Linux environments, RESTful API integration, and VBA is a plus. Join us if you’re passionate about transforming raw data into powerful insights! We’re committed to fostering an innovative environment where your technical expertise makes a real impact on our organization’s success.

Pay: $118,783.29 - $143,050.84 per year

Benefits:

Dental insurance

Work Location: Remote

Xlent IT Service LLC

New Jobs

Data Engineer