Data Engineer - Contract
We have an opening for a 4-month contract Data Engineer position based out of our Houston, TX location. Reporting to the Digitization Manager, the Data Engineer will work with the data team to modernize our data infrastructure. Specifically, they will build and optimize pipelines in Microsoft Fabric, ensuring efficient data processing and management. The ideal candidate will have expertise in handling large-scale data systems and optimizing workflows.
Responsibilities also include:
- Develop and maintain scalable data pipelines using modern tools and frameworks.
- Implement data transformation processes to ensure efficient storage and retrieval.
- Collaborate with cross-functional teams to design and optimize data architecture.
- Utilize T-SQL and PySpark to process and analyze large datasets.
- Manage and monitor data workflows, ensuring high performance and reliability.
- Integrate and maintain ETL processes to streamline data operations.
- Troubleshoot and resolve issues related to data systems and workflows.
- Ensure data security and compliance with industry standards.
- Document processes and provide technical support to stakeholders.
- Assist with other duties as assigned.
- Perform all duties to meet the responsibilities listed in the Employee and Corporate HSE Handbooks.
- Perform duties according to the Company’s quality system procedures and work instructions.
The successful candidate will have a strong data architecture background with mastery of medallion/lakehouse, data warehouse, data fabric, and MDM frameworks. They will be an expert in PySpark, T-SQL, scalable ETL/ELT, and distributed processing for high-volume structured and semi-structured data, with the proven capability in solution design, optimization, performance tuning, and building reusable data engineering frameworks. They will require previous hands-on experience implementing Azure Dev ops, governance, security, lineage, and modeling standards across enterprise platforms, and proven capability in solution design, optimization, performance tuning, and building reusable data engineering frameworks. Excellent verbal and written communication, with strong interpersonal skills and the ability to collaborate effectively and work as part of a team is a prerequisite for this role.
Job Type: Contract
Experience:
- Data Architecture: 5 years (Required)
Location:
- Houston, TX 77066 (Required)
Ability to Commute:
- Houston, TX 77066 (Required)
Work Location: In person
