Data Engineer
Description For Data Engineer
Sunscrapers, a prominent software development company, is seeking a Data Engineer to join their team either in Warsaw or remotely. The role focuses on building a robust data platform for healthcare brands, supporting omnichannel digital health experiences. You'll work with cutting-edge technologies like Apache Spark, Databricks, and Delta Tables to design and implement scalable data solutions.
The position requires expertise in Python, PySpark, and data infrastructure design, with a strong emphasis on data governance and quality. You'll be responsible for creating efficient data pipelines, both batch and streaming, and maintaining data systems in Azure. The ideal candidate should have at least 3 years of experience and strong analytical skills.
Sunscrapers offers a competitive work environment with flexible arrangements and comprehensive benefits. The company values technical excellence and supports professional growth through mentoring and feedback culture. You'll be part of a talented team working on innovative healthcare solutions while having access to modern tools and comfortable working conditions.
The role presents an excellent opportunity for career advancement in data engineering, working with leading healthcare brands and contributing to meaningful projects that help consumers access essential healthcare programs and benefits. The company's strong focus on R&D initiatives and trust-based partnerships creates an ideal environment for professional growth and innovation.
Responsibilities For Data Engineer
- Design and optimize data infrastructure using Python, PySpark, Apache Spark, and Delta Spark
- Implement strong data governance frameworks to ensure quality, security, and compliance
- Connect Delta Tables to a SQL engine for efficient querying and analytics
- Leverage DevOps expertise to deploy and maintain data systems in Azure
- Create batch and streaming pipelines for data processing
Requirements For Data Engineer
- At least 3 years of professional experience as a data engineer
- Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar
- Excellent command of spoken and written English (at least C1)
- Experience in designing data infrastructure using Python, PySpark, Apache Spark, and Delta Spark
- Experience in managing production spark clusters in Databricks
- Proficiency in SQL and experience with Delta Lake architectures
- Great analytical skills and attention to detail
- Creative problem-solving skills
- Great customer service and troubleshooting skills
Benefits For Data Engineer
- Flexible working hours and remote work possibility
- Comfortable office in central Warsaw with necessary tools (Macbook, external screen, ergonomic chairs)
- Fully equipped kitchen with fruit, hot and cold drinks
- Multisport card & Private medical care
- Culture of good feedback: evaluation meetings, mentoring
- Support for learning and professional growth
Jobs Related To Sunscrapers Data Engineer
