Senior Data Engineer
Description For Senior Data Engineer
PrePass is revolutionizing the transportation industry as North America's leading weigh station bypass and toll management platform. We create solutions that enable commercial vehicles to operate safely, efficiently, and in compliance with regulations across the nation.
As a Senior Data Engineer, you'll be at the forefront of designing and developing data pipelines for ingestion, processing, and distribution, working with both batch processing and real-time data streaming solutions. The role demands expertise in building scalable data infrastructures on cloud environments, particularly Azure.
You'll be responsible for developing ETL pipelines, writing complex SQL queries, and implementing data transformations in Databricks. The position requires strong technical leadership, with opportunities to mentor junior engineers and shape the future of transportation technology.
The ideal candidate brings 6+ years of data engineering experience, strong Python programming skills, and expertise in SQL and data modeling. Experience with big data technologies like Apache Spark, Delta Lake, and stream-processing systems is highly valued.
PrePass offers a comprehensive benefits package including medical, dental, and vision insurance from day one, 401(k) with employer match, and unique perks like a company-funded lifestyle account. The hybrid work environment combines flexibility with collaborative opportunities, and the company's culture emphasizes professional development and work-life balance.
Join a team that's making a real impact on the transportation industry, working on solutions that help fleets go farther, faster. This role offers complex challenges, opportunities for innovation, and the chance to shape the future of transportation infrastructure.
Responsibilities For Senior Data Engineer
- Develop and manage production ETL pipelines on the Azure cloud
- Formulate complex SQL queries for transforming and collating data across multiple sources
- Code data transformations and processing logic in Databricks
- Troubleshoot data integration and data quality issues
- Tune and optimize cluster performance
- Design and implement strategy for re-architecting legacy SQL Server Integration Services
- Develop solutions for traceability and observability
- Contribute to documentation and maintain architecture diagrams
- Participate in proof-of-concept exercises and prototyping
- Mentor and guide junior engineers
Requirements For Senior Data Engineer
- Bachelor's degree in computer science or equivalent experience
- 6+ years of industry experience in data engineering
- 3+ years of experience providing technical leadership on large projects
- Experience using Databricks for data engineering tasks
- Expert in writing, analyzing, and tuning complex SQL queries
- Advanced experience with design and data modeling
- Programming proficiency in Python
- Familiarity with big data technologies and frameworks such as Apache Spark and Delta Lake
- Experience with stream-processing systems like Apache Spark and Kafka
- Familiarity with data quality and governance principles
Benefits For Senior Data Engineer
- Medical, dental, and vision insurance starting on date of hire
- Paid Time Off including vacation, sick, holidays, and floating holidays
- 401(k) plan with employer match
- Company-funded lifestyle account for physical and mental well-being
- Tuition Reimbursement Program
- Voluntary benefits including Legal and Pet Discounts
- Employee Assistance Program
- Company-sponsored Culture Team
- Community Give-Back initiatives
- Culture focused on employee development
Jobs Related To PrePass, LLC Senior Data Engineer
