Senior Data Engineer
Description For Senior Data Engineer
3Pillar Global is seeking a Senior Data Engineer to join their innovative product development team. This role offers an exciting opportunity to work on cutting-edge data analytics solutions that drive real-world impact. As a Senior Data Engineer, you'll be responsible for designing and implementing data pipelines, managing ETL processes, and ensuring data quality and security. The position requires expertise in Python, SQL, and various cloud platforms, with a focus on building scalable data solutions. The company offers a flexible remote work environment, comprehensive benefits package, and opportunities for professional growth within a global team. You'll be part of a culture that values innovation, collaboration, and work-life balance, while working on projects that help industry leaders in Software, SaaS, Media, and Retail sectors gain competitive advantages through data-driven decision making. The role combines technical expertise with mentorship opportunities, making it ideal for experienced data engineers looking to make a significant impact.
Responsibilities For Senior Data Engineer
- Understanding the business requirements
- Writing code and implementing the proposed solutions
- Creating data pipelines, versioning and change management
- Manage the complexity inherent in versioned data pipelines
- Develop ETL/ELT processes to help extract and manipulate data from multiple sources
- Design, build and maintain batch or real-time data pipelines in production
- Automate data workflows such as data ingestion, aggregation, and ETL processing
- Logging and instrumentation of pipelines and services
- Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures
- Train and mentor junior engineers
Requirements For Senior Data Engineer
- Advanced SQL skills and experience with relational databases and database design
- Experience working with cloud Data Warehouse solutions
- Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
- Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive
- Proficient in data pipeline and workflow management tools e.g. Airflow
- Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight
- Experience with the AWS/Azure/GCP data engineering services
- Very good exposure of working on Data Lakes & Data Warehouses solutions
- Excellent problem-solving, communication, and organizational skills
- Proven ability to work independently and with a team
- Ability to guide other data engineers
Benefits For Senior Data Engineer
- Medical Insurance benefits
- Life Insurance
- 15 days of paid vacation plus additional days based on tenure
- Vacation bonus
- Sick leave and paid holidays
- Profit sharing
- Paternity and maternity leave
- Marriage, bereavement and graduation leaves
- Christmas bonuses
- Work from home allowance
- Punctuality and attendance bonuses
- Food tickets
- Direct deposit of payroll
- Paid professional certifications
