Big Data Engineer

We are expanding our Engineering teams, and we're looking for a Big Data Engineer with experience in Python or Scala, Spark, and Cloud technologies. Our vision is to build multidisciplinary teams that self-manage projects in an AGILE manner to find and implement the best solutions.

What you'll do:

• Get involved in projects from the initial stages of client relationships, understanding business needs to propose the most appropriate technical solution.
• Develop projects from scratch with minimal supervision and team collaboration.
• Participate in architecture design and decision-making in a constructive environment with co-creation dynamics.
• Be a key player in developing best practices, clean and reusable code.
• Develop ETLs with Spark (Python / Scala).
• Develop cloud projects (Azure / AWS).
• Build scalable pipelines with different technologies.

Requirements:

• At least 4 years of experience in software / data engineering.
• Experience in architecture design.
• Solid experience in Python or Scala and Spark processing large volumes of data.
• Solid experience in Cloud (Azure or AWS).
• Experience in creating data pipelines (CI/CD).
• Experience in testing (unit, integration, etc.).
• Experience with BI (Power BI) is a plus.
• Experience with Databricks, Snowflake, or Fabric is a plus.
• Experience with IaC is a plus.
• Knowledge of SQL and NoSQL databases.
• Good level of English (essential).
• Team player.

Plain Concepts is a technology-driven company with over 400 passionate individuals focused on finding the best solutions for clients and projects. They have 14 offices in 6 different countries and aim to grow as a team while working on advanced market projects. The company values diversity, inclusion, and equal opportunities for all applicants.