Software Engineer - Big Data
Description For Software Engineer - Big Data
Motive is seeking a Software Engineer - Big Data to join their Data Platform team. This role involves full ownership and driving key data platform initiatives, including data ingestion, processing, storage, and querying systems. The ideal candidate will design and develop scalable distributed systems, focus on fault-tolerance and high availability, and collaborate with cross-functional teams.
Motive serves over 120,000 customers across various industries, including transportation, logistics, construction, energy, field service, manufacturing, agriculture, food and beverage, retail, and the public sector. The company provides a unified platform that combines safety, operations, and finance management for drivers, vehicles, equipment, and fleet-related expenses.
As a Software Engineer - Big Data, you will:
- Design and develop scalable distributed systems and frameworks for data management
- Address fault-tolerance and high availability issues
- Scale ingestion pipelines and improve ETL frameworks
- Collaborate with engineers across teams
- Participate in all aspects of the software development life cycle
The ideal candidate should have:
- 3+ years of hands-on software engineering experience
- Strong backend programming skills, proficiency in Python
- Solid CS fundamentals
- Experience with Apache Kafka, Apache Spark, Airflow, and Kubernetes
- Familiarity with service-oriented architectures and containerized platforms
- BS in Computer Science or related field (Masters preferred)
- Excellent communication and troubleshooting skills
Motive values diversity and inclusion, offering equal opportunities to candidates from all backgrounds. The position is remote-friendly.
Responsibilities For Software Engineer - Big Data
- Design and develop scalable distributed systems and frameworks for data management
- Focus on addressing fault-tolerance and high availability issues
- Work on scaling ingestion pipelines, improving and adding features to ETL framework
- Maintain SLAs on performance, reliability, and system availability
- Collaborate with engineers across teams to identify and deliver cross-functional features
- Participate in all aspects of the software development life cycle, from design to implementation and delivery
Requirements For Software Engineer - Big Data
- 3+ years hands-on software engineering experience
- Backend programming skills including multi-threading, concurrency, etc.
- Proficient in Python
- Strong CS fundamentals including data structures, algorithms, and distributed systems
- Experience in designing, implementing, and operating highly scalable software systems and services
- Experience building systems using technologies like Apache Kafka, Apache Spark, Airflow, Kubernetes
- Experience with service-oriented architectures
- Excellent troubleshooting skills
- Hands-on experience with containerized platforms like Docker and Kubernetes
- BS in Computer Science or a related field; Masters preferred
- Excellent verbal and written skills
Jobs Related To Motive Software Engineer - Big Data
