Primary Talent Partners has an open 12 month W2 contract with a large utilities client of ours in the Charlotte, NC area.
Pay Range: $80.00 to $90.00 per hour (No PTO, benefits, etc but self funded ACA-compliant healthcare plan available to opt-in to)
Our Enterprise Data Platforms Team is seeking a Subject Matter Expert to help develop our Data Fabric as an interconnected network of data capabilities and data products designed to deliver data efficiently and at scale. Candidates should have expertise in developing and building data platforms, demonstrating experience with overcoming obstacles and avoiding pitfalls. They should also possess skills in optimizing and automating deliverables to production using the required tech stack. Additionally, candidates should be experienced and adaptable to changing demands and priorities in an Agile development environment.
- At least 5 years of experience in Data Engineering and/or Software Engineering roles.
- Experience with building/optimizing Data LakeHouse with Open Table formats.
- Kubernetes deployments/cluster administration.
- Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS.
- Experience with distributed systems, microservice architecture, and containers.
- Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis).
- Git Hib and Git Hub Actions.
- AWS (IAM, API Gateway, Lambda, Step Functions, Lake formation, EKS & Kubernetes, Glue: Catalog, ETL, Crawler, Athena, S3).
- Apache Hudi and Apache Flink.
- PostgreSQL and SQL.
- RDS (Relational Database Services).
- Python and Java.
- Terraform Enterprise with an understanding of modules, providers, functions, and the ability to write and debug TF.
- Helm.
- Kafka and Kafka Schema Registry.
- AWS Services: CloudTrail, SNS, SQS, CloudWatch, Step Functions, Aurora, EMR, Redshift, Iceberg.
- Secrets Management Platform: Vault, AWS Secrets manager.
- Provide technical direction, engage the team in discussion on how to best guide/build features on key technical aspects, and be responsible for product tech delivery.
- Work closely with the Product Owner and team to align on delivery goals and timing.
- Collaborate with architects on key technical decisions for data and overall solutions.
- Lead design and implementation of data quality check methods.
- Ensure data security and permissions solutions, including data encryption, user access controls, and logging.
- Think unconventionally to find the best way to solve for a defined use case with fuzzy requirements.
- Self-starter mentality, willing to do their own research to solve problems, and can clearly present findings.
- Thrive in a fail-fast environment, involving mini PoCs, and participate in an inspect and adapt process.
- Questioning and Improvement mindset, ready to ask questions about current processes and suggest alternative solutions.
- Customer-facing skills, interfacing with stakeholders and other product teams via pairing, troubleshooting support, and debugging issues.
Primary Talent Partners is an Equal Opportunity / Affirmative Action employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, disability, protected veteran status, gender identity, or any other factor protected by applicable federal, state, or local laws.
If you are a person with a disability needing assistance with the application or at any point in the hiring process, please contact us at info@primarytalentpartners.com
#PTPJobs
#LI-PTP
