Data Engineer Sênior
Description For Data Engineer Sênior
Creditas is seeking a Senior Data Engineer to join their Product Technology team. The ideal candidate will be responsible for designing, building, and maintaining scalable and reliable data pipelines and database systems, managing solutions and automating processes using tools such as Spark, AirFlow, Redash, EMR, and Redshift. The role involves working with AWS services, implementing CI/CD processes, and leveraging Infrastructure as Code (IaC) tools to streamline data operations. The candidate will be expected to implement data solutions using cutting-edge technologies like Spark, Python, and various AWS services (S3, Redshift, EMR, Athena, Glue). They will also design and develop a data architecture focused on decentralization and Data Mesh culture, guide and train fellow engineers, and identify and resolve team capability gaps to increase efficiency and success. This position offers an opportunity to work with a company that transforms realities through technology, scaling business, optimizing processes, reducing costs, and delivering the best experience to enable new achievements for their clients.
Responsibilities For Data Engineer Sênior
- Design, build, and maintain scalable and reliable data pipelines and database systems, managing solutions and automating processes using tools like Spark, AirFlow, Redash, EMR, and Redshift
- Design, build, maintain, and optimize solutions on AWS, developing scalable data processing solutions and implementing CI/CD processes
- Implement data solutions using cutting-edge technologies such as Spark, Python, and various AWS services (S3, Redshift, EMR, Athena, Glue)
- Design and develop a data architecture focused on decentralization and Data Mesh culture
- Guide and train fellow engineers on the team, promoting an environment of growth and continuous improvement
- Identify and resolve team capability and process gaps to increase efficiency and success
Requirements For Data Engineer Sênior
- Strong programming skills in Python, Java, Scala, or similar languages
- Experience using technologies such as Spark, Hadoop, Databricks, AWS SQS, AWS Kinesis, Kafka, etc.
- Deep knowledge of data processing, comfortable working with large volume datasets and high-scale distributed data ingestion, transformation, and processing processes
- Familiarity with industry databases and analytical technologies, including Data Warehouse, Data Lakes, ETL, and relational databases
- Commitment to quality, pride in delivering work that stands out for data accuracy, performance, and reliability
- Differential: Comfortable with modern back-end system building blocks, event-driven architecture, and ability to articulate pros/cons of different approaches with recommended solutions
- Differential: Comfortable working with containerization and orchestration technologies (Docker, Kubernetes)
Benefits For Data Engineer Sênior
- Group Life Insurance
- Health Plan (SulAmérica)
- Dental Plan (SulAmérica)
- Corporate University (Academy)
- Wellz: free monthly sessions with psychology specialists 100% online
- Wellhub: access to gyms and studios with sports modalities
- Birthday day off
- Childcare Assistance & Assistance for Children with Disabilities
- Family Care: family support during the new maternity and paternity journey
- Parental Leave: 6 months of leave for the pregnant person and 35 days of parental leave
- Work model: in-person, remote, or hybrid, according to the possibilities of your role
- Transportation Voucher (VT) or subsidized parking
- Meal Voucher: Flexible benefits card (Creditas Card)
- WeWork: coworking spaces in various places in Brazil
- Pharmacy agreement
- Payroll loan
- Salary advance
- Financial Education Program
Jobs Related To Creditas Data Engineer Sênior
