Lead Data Engineer

Selby Jennings • Full-time • New York, NY, US • $175k - $250k / year • 1w ago

Responsibilities

Lead the development of cloud-based data platforms, pipelines, and data products leveraging Python, SQL, Snowflake, and AWS.
Build scalable solutions for a variety of data sources, including market, alternative, and enterprise datasets.
Enhance the firm's data platform through APIs, automation, metadata management, and emerging AI-driven capabilities.
Improve data reliability through quality controls, monitoring, testing, and operational best practices.
Troubleshoot complex data issues and implement long-term solutions to improve platform stability.
Design efficient data models and datasets that support analytics, reporting, and quantitative research.
Collaborate with investment, research, and technology teams to deliver scalable data solutions.
Provide technical leadership through architecture guidance, code reviews, mentorship, and engineering best practices.
Drive projects from design through production while influencing the future direction of the data platform.
Opportunity to mentor and potentially lead a growing team of engineers.

Qualifications

Experience building and supporting enterprise-scale data platforms and pipelines.
Strong programming skills in Python and SQL.
Expertise with Snowflake or a similar modern cloud data warehouse.
Hands-on experience designing and deploying solutions within AWS.
Experience with workflow orchestration tools such as Airflow.
Knowledge of relational and NoSQL database technologies.
Strong understanding of data modeling, data architecture, and large-scale data processing.
Proven ability to lead technical initiatives and deliver complex projects.

Preferred Qualifications

Experience with Go or other backend development languages.
Background in platform engineering or service-oriented architectures.
Exposure to AI/LLM-powered data solutions and automation.
Experience within financial services, investment management, trading, or market data environments.
Track record of building highly reliable and scalable data systems.

Related Jobs

Data Engineer - AWS, python

JSR Tech Consulting • Contract • Newark, NJ, US • $60 - $70 / hour • 1w ago

Data Science

1w ago

Ab Initio Data Engineer

Pyramid Consulting, Inc • Contract • Berkeley Heights, NJ, US • $45 - $53 / hour • 1w ago

Data Science

1w ago

Senior Software Engineer - Data Platform

MetTel • New York, NY, US • $145k - $165k / year • 1w ago

Data Science

1w ago

GCP Data Engineer - W2/Remote

Tricon Solutions • Secaucus, NJ, US • $45 - $50 / hour • 2w ago

Data Science

2w ago

Data Analytics Engineer

Rugs USA • Full-time • New York, NY, US • $110k - $120k / year • 2w ago

Data Science

2w ago

Azure Data Engineer

Orion Innovation • Montvale, NJ, US • 2w ago

Data Science

2w ago

IT Analyst, Budget and Procurement

Long Island Power Authority • Full-time • Uniondale, NY, US • 3w ago

Data Science

3w ago

Data Engineer

DCI Solutions • Full-time • New York, NY, US • $175k - $260k / year • 3w ago

Data Science

3w ago

Data Engineer

Experis • Contract • Montvale, NJ, US • 3w ago

Data Science

3w ago

IT Senior Analyst, Applications

Long Island Power Authority • Full-time • Uniondale, NY, US • 1m ago

Data Science

1m ago