Position Summary
We are seeking a highly skilled Senior Data Engineer to lead the development, optimization, and operational support of our enterprise data platform. This role will work closely with offshore engineering teams to design, build, and maintain scalable data infrastructure and pipelines supporting analytics, reporting, and business intelligence initiatives.
The ideal candidate has strong experience in modern data engineering architectures, distributed data processing systems, cloud platforms, and production-grade data operations. This position is also responsible for ensuring the reliability, scalability, security, and ongoing support of the data platform in a production environment.
Key Responsibilities
Data Platform Engineering
- Collaborate with offshore engineering teams to design and implement scalable enterprise data architecture
- Build, optimize, and maintain ETL/ELT pipelines for structured and semi-structured data
- Develop and support enterprise data warehouse and lakehouse solutions
- Integrate data from ERP systems, CRM platforms, APIs, flat files, streaming systems, and SaaS applications
- Design and maintain semantic and curated data layers for analytics and reporting
Production Support & Operations
- Provide technical leadership and operational support for the production data platform environment
- Monitor platform reliability, performance, and availability
- Troubleshoot and resolve production data pipeline and platform issues
- Implement logging, alerting, observability, and operational best practices
- Ensure platform scalability, resiliency, and disaster recovery readiness
Data Processing & Orchestration
- Design and manage workflow orchestration and job scheduling frameworks
- Optimize distributed data processing workloads and streaming pipelines
- Improve data processing efficiency, latency, and throughput
- Implement data quality validation, governance, and reconciliation processes
Security & Governance
- Support data security, access control, and compliance requirements
- Establish standards for data modeling, naming conventions, metadata management, and data lifecycle management
- Collaborate with cross-functional teams to ensure consistency and governance across the enterprise data ecosystem
Collaboration & Leadership
- Coordinate development activities with offshore teams across multiple time zones
- Participate in architecture reviews, code reviews, and technical design discussions
- Mentor junior engineers and promote engineering best practices
- Partner with BI, analytics, infrastructure, and application teams to support enterprise data initiatives
Required Qualifications
- Master’s degree or Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field
- 5+ years of experience in data engineering, big data, or data platform development
- Strong hands-on experience with SQL and Python
- Experience building enterprise-grade ETL/ELT pipelines
- Strong knowledge of distributed data processing and streaming technologies
- Experience supporting production data platforms and mission-critical workloads
- Experience working with offshore or distributed engineering teams
- Strong troubleshooting and performance optimization skills
Required Technical Skills
Data Engineering & Processing
- SQL
- Python
- dbt
- Apache Airflow
- Apache Spark
- Apache Flink
- Apache Kafka
Data Platforms & Storage
- Databricks
- Apache Pinot
- Apache Doris
- Data warehouse/lakehouse architectures
Cloud Platforms
- AWS and/or Microsoft Azure
Additional Preferred Skills
- CI/CD and DevOps practices
- Infrastructure as Code (Terraform or similar)
- Containerization and Kubernetes
- Monitoring and observability tools
- Data governance and metadata management platforms
Preferred Qualifications
- Experience with real-time streaming architectures and large-scale distributed systems
- Experience supporting BI and analytics workloads
- Familiarity with modern medallion/lakehouse architecture patterns
- Experience in high-availability and high-throughput production environments
- Strong communication and cross-functional collaboration skills
Key Competencies
- Technical leadership
- Problem-solving and root cause analysis
- Production support ownership mindset
- Scalability and performance optimization
- Cross-team collaboration
- Process improvement and operational excellence
Equal Employment Opportunity
Pay: From $65,000.00 per year
Benefits:
- 401(k)
- Dental insurance
- Health insurance
- Life insurance
- Paid time off
- Vision insurance
Work Location: In person
