Lead Software Engineer - Data

Egen is a fast-growing, entrepreneurial company with a data-first mindset, bringing together top engineering talent to work with advanced technology platforms like Google Cloud and Salesforce. As a Lead Software Engineer - Data at Egen, you'll be at the forefront of building scalable data pipelines using Python, Spark, and cloud services (GCP and AWS).

Your role will involve architecting and implementing cloud-native data pipelines and infrastructure to enable analytics and machine learning on rich datasets. You'll work with cutting-edge technologies such as Kafka, Storm, and Elasticsearch, and be part of a team that's implementing a continuous deployment pipeline for rapid on-demand releases.

Key responsibilities include:

• Leveraging Spark and GCP to design and build robust data pipelines
• Implementing ETL/ELT processes for multi-terabyte enterprise data warehouses
• Developing analytics applications using various database technologies
• Defining data contracts and writing specifications for REST APIs
• Transforming data using modern PySpark practices
• Building cloud-native applications with technologies like Docker, CI/CD, and microservices

The ideal candidate will have experience in building and running resilient data pipelines in production, implementing analytics applications across multiple database technologies, and working in agile environments. Knowledge of GCP is preferred, but AWS experience is also valuable.

Join Egen to apply your engineering and technology expertise to envision how data and platforms can change the world for the better. You'll be part of a team dedicated to learning, solving tough problems, and continually innovating to achieve fast, effective results in the world of data engineering.