Job Overview
We are seeking an experienced Data Engineer to architect, build, and maintain the complex, real-time data streams generated by our fleet of mobile and static robots. This critical role involves managing video, telemetry, and sensor data, ensuring low-latency processing for real-time monitoring, efficient debugging, and training of our machine learning models.
Due to the nature of the projects worked on in this position, applicants must be a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees.
Primary duties include:
· Design, build, and optimize high-throughput, low-latency data pipelines using cloud (Azure) and on-prem services, specialized for streaming and time-series data.
· Manage and process data generated from robot telemetry (position, velocity, battery life, etc.).
· Develop solutions for efficient ingestion, storage, and retrieval of high-resolution video and Lidar point cloud data.
· Facilitate efficient access to data for R&D teams.
· Work with software engineers to define data formats and communication protocols for transmission from the robot to the cloud.
· Implement mechanisms for dealing with intermittent connectivity and ensuring data completeness.
Required Skills and Experience:
· Minimum of 3 years of hands-on experience in a Data Engineering role, with significant focus on real-time or streaming data.
· Experience with data storage services, including cloud-based (such as Azure Data Lake) and self-hosted.
· Expert-level proficiency in Python and data query languages.
· Experience with streaming data processing frameworks.
· Experience with time-series databases.
Preferred Experience:
· 5+ years of experience in Data Engineering, particularly within the robotics, IoT, or autonomous systems domain.
· Experience handling and processing video data at scale.
· Familiarity with Kubernetes for deploying scalable processing applications.
· Knowledge of geospatial data (GIS) processing and mapping libraries.
· Strong understanding of networking concepts and low-latency data transfer protocols relevant to robotics.
Job Type: Full-time
Pay: $120,000 - $160,000
Schedule:
- Monday to Friday
- Weekends as needed
Education:
· Bachelor’s (Required)
Work Location: In person
Job Type: Full-time
Pay: $120,000.00 - $160,000.00 per year
Benefits:
- 401(k)
- Dental insurance
- Health insurance
- Paid time off
- Relocation assistance
- Vision insurance
Application Question(s):
- Are you a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees. Yes Or No
Experience:
- Data Engineer in Robotics, IoT or Autonomous Systems Domain: 5 years (Required)
Work Location: In person
