Job Title: Data Engineer – Hiring FAST!
Industry: Utility
Location: Charlotte, NC
Pay Rate: $75-90/HR on W2 Only – NO C2C
Setting: Hybrid Required (Remote is NOT an Option)
Duration: 12+ months
Job ID: 244305
Required Qualifications:
- 5+ years of AWS experience
- AWS services: S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions, QuickSight
- Experience with Kafka/Messaging, preferably Confluent Kafka
- Experience with EMR databases such as Glue Catalog, Lake Formation, Redshift, DynamoDB, and Aurora
- Experience with AWS data warehousing tools such as Amazon Redshift and Amazon Athena
- Proven track record in the design and implementation of data warehouse solutions using AWS
- Skilled in data modeling and executing ETL processes tailored for data warehousing
- Competence in developing and refining data pipelines within AWS
- Proficient in handling both real-time and batch data processing tasks
- Extensive understanding of database management fundamentals
- Expertise in creating alerts and automated solutions for handling production problems
- Tools and Languages: Python, Spark, PySpark, and Pandas
- Infrastructure as Code technology: Terraform/CloudFormation
- Experience with Secrets Management Platform like Vault and AWS Secrets manager
- Experience with Event Driven Architecture
- DevOps pipeline (CI/CD): Bitbucket; Concourse
- Experience with RDBMS platforms and strong proficiency with SQL
- Experience with Rest APIs and API gateway
- Deep knowledge of IAM roles and Policies
- Experience using AWS monitoring services like CloudWatch, CloudTrail, and CloudWatch events
- Deep understanding of networking DNS, TCP/IP, and VPN
- Experience with AWS workflow orchestration tool like Airflow or Step Functions.
Pay: $75.00 - $90.00 per hour
Expected hours: 40.0 per week
Experience:
- Data Engineering: 5 years (Required)
- AWS: 5 years (Required)
- ETL: 1 year (Required)
Location:
- Charlotte, NC 28206 (Required)
Work Location: Hybrid remote in Charlotte, NC 28206