Data Engineer Sênior

Creditas is seeking a Senior Data Engineer to join their Product Technology team. The ideal candidate will be responsible for designing, building, and maintaining scalable and reliable data pipelines and database systems, managing solutions and automating processes using tools such as Spark, AirFlow, Redash, EMR, and Redshift. The role involves working with AWS services, implementing CI/CD processes, and leveraging Infrastructure as Code (IaC) tools to streamline data operations. The candidate will be expected to implement data solutions using cutting-edge technologies like Spark, Python, and various AWS services, as well as design and develop a data architecture focused on decentralization and Data Mesh culture. Additionally, the role includes mentoring and training fellow engineers, promoting a culture of continuous growth and improvement, and identifying and addressing team capability gaps to increase efficiency and success.

Key Responsibilities:

• Design, build, and maintain scalable data pipelines and database systems
• Develop solutions on AWS, implementing CI/CD processes and using IaC tools
• Implement data solutions using Spark, Python, and AWS services
• Design and develop a decentralized data architecture focused on Data Mesh culture
• Mentor and train team members
• Identify and address team capability gaps

Requirements:

• Strong programming skills in Python, Java, Scala, or similar languages
• Experience with technologies like Spark, Hadoop, Databricks, AWS SQS, AWS Kinesis, Kafka
• Deep knowledge of data processing, comfortable working with large datasets and high-scale distributed data processing
• Familiarity with industry databases and analytical technologies, including Data Warehouse, Data Lakes, ETL, and relational databases
• Commitment to quality and delivering high-standard work

Preferred Qualifications:

• Comfortable with modern back-end system building blocks and event-driven architecture
• Experience with containerization and orchestration technologies (Docker, Kubernetes)

Creditas offers a comprehensive benefits package, including health and dental insurance, life insurance, corporate university, psychology sessions, gym access, birthday day off, parental leave, and more. The company values diversity and inclusion, promoting an environment that respects all differences and provides equal opportunities for growth and development.