Data Engineer

Technology company focused on leveraging cutting-edge technologies for data-driven decision making and industry revolution.
Data
Senior Software Engineer
In-Person
5+ years of experience
Enterprise SaaS

Description For Data Engineer

3Pillar is at the forefront of technological innovation, specializing in transformative data-driven solutions. As a Data Engineer, you'll be integral to our mission of revolutionizing industries through advanced data analytics. The role offers an exciting opportunity to work on cutting-edge projects that directly impact our clients' competitive positioning.

You'll be responsible for developing and maintaining data pipelines, working with both relational and non-relational databases, and implementing ETL processes. The position requires expertise in Python, particularly with data-focused libraries like Pandas and NumPy, along with strong SQL skills. You'll work with cloud platforms (AWS/GCP), handling various AWS services including S3, Lambda, GLUE ETL, Athena, RDS, Redshift, and EC2.

The ideal candidate will bring 5+ years of data engineering experience, demonstrating proficiency in data collection and integration from multiple sources. Knowledge of technologies like PySpark, Hadoop, and MariaDB is crucial. You'll be working in an on-site environment in Mumbai, contributing to a team that's passionate about creating impactful data analytics solutions.

This role offers an excellent opportunity to be part of transformative projects while working with cutting-edge technologies in data science and engineering. You'll be instrumental in helping clients gain competitive advantages through data-driven decision-making capabilities. If you're passionate about data analytics and want to make a real-world impact, this position offers the perfect platform to advance your career in data engineering.

Last updated 3 months ago

Responsibilities For Data Engineer

  • Develop and maintain data pipelines
  • Implement ETL processes
  • Work with relational and non-relational databases
  • Integrate data from multiple sources based on business needs
  • Create data analytics solutions for clients

Requirements For Data Engineer

Python
JavaScript
  • Minimum of 5+ years of experience as data engineer or similar role
  • Advanced SQL skills and experience with relational and non-relational databases
  • Strong Python skills with hands-on experience on Panda, NumPy and other data-related libraries
  • Strong exposure to write ETL
  • Experience in Data collection from multiple sources and integrating based on business needs
  • Core Python, PySpark, Hadoop, MariaDB, SQL knowledge
  • Familiarity with AWS/GCP data engineering services
  • Knowledge of AWS services (S3, Lambda, GLUE ETL, Athena, RDS, Redshift, EC2)
  • Proficiency in English language

Interested in this job?

Jobs Related To 3Pillar Data Engineer

Senior Bigdata Developer

Senior Bigdata Developer role at Dun & Bradstreet, focusing on developing and maintaining big data platforms using cloud technologies and distributed systems.

Senior Software Engineer, Data Platform

Senior Software Engineer position at Jobgether, focusing on data platform development and management, offering remote work in the US with comprehensive benefits.

Senior Data Developer

Senior Data Developer position at CI&T, focusing on data engineering, ETL processes, and business intelligence, offering remote work with occasional office presence in Campinas, Brazil.

Senior Data Engineer

Senior Data Engineer position at Javelot, leading post-harvest agriculture digital transformation through data engineering and cloud solutions.

Senior Data Engineer (with ML knowledge)

Senior Data Engineer position at Qodea focusing on GCP services, Python development, and ML implementation with hybrid work options across UK locations.