Senior GCP Data Engineer

AI-focused technology company specializing in data engineering and cloud solutions.
Data
Senior Software Engineer
Remote
4+ years of experience
AI · Enterprise SaaS

Description For Senior GCP Data Engineer

Digitals AI Inc is seeking an experienced Senior GCP Data Engineer to join their team in a remote capacity. This role requires a seasoned professional with 4+ years of experience in ETL and Data Warehousing, with a strong focus on Google Cloud Platform technologies.

The ideal candidate will be responsible for designing, developing, and maintaining sophisticated data pipelines and warehousing solutions. You'll work with cutting-edge technologies including GCP BigQuery, Cloud Storage, Dataflow, Cloud Functions, and Pub/Sub, while implementing best practices in data engineering and analytics.

Your role will involve collaborating with cross-functional teams to gather requirements, transform data to meet end-user needs, and ensure data quality and consistency across various sources. You'll be instrumental in creating robust ETL solutions, writing complex SQL queries, and developing metadata-based frameworks for data pipelines.

This position offers an excellent opportunity for growth in a dynamic environment where you'll be exposed to modern cloud technologies and data engineering practices. The role combines technical expertise with leadership opportunities, requiring both strong communication skills and technical proficiency.

Benefits include private health insurance, paid time off, and performance bonuses, making this an attractive opportunity for experienced data engineers looking to make an impact in an AI-focused organization. The remote work arrangement offers flexibility while working on challenging projects that push the boundaries of data engineering.

Last updated 5 hours ago

Responsibilities For Senior GCP Data Engineer

  • Analyze different source systems, profile data, understand, document & fix Data Quality issues
  • Gather requirements and business process knowledge for data transformation
  • Write complex SQLs to extract & format source data for ETL/data pipeline
  • Create design documents, Source to Target Mapping documents and deployment documentation
  • Design, Develop and Test ETL/Data pipelines
  • Design & build metadata-based frameworks for data pipelines
  • Write and execute Unit Test cases and document results
  • Deploy ETL/Data pipelines
  • Use DevOps tools for version control and deployment
  • Support team during troubleshooting & debugging
  • Perform production support, enhancements and bug fixes
  • Work with stakeholders to communicate EDW incidents/problems
  • Leverage ITIL concepts for incident management
  • Perform data cleaning, transformation, and validation
  • Stay current on industry best practices and emerging technologies

Requirements For Senior GCP Data Engineer

Python
  • 4+ years of experience in ETL & Data Warehousing
  • Excellent leadership & communication skills
  • Experience in developing Data Engineering solutions with Airflow, GCP BigQuery, Cloud Storage, Dataflow, Cloud Functions, Pub/Sub, Cloud Run
  • Experience in solution automations with ETL tools
  • Executed at least 2 GCP Cloud Data Warehousing projects
  • Worked on at least 2 projects using Agile/SAFe methodology
  • Mid-level experience in Pyspark and Teradata
  • Working experience with DevOps tools like GitHub, Jenkins, Cloud Native
  • Experience with semi-structured data formats like JSON, Parquet and/or XML files
  • In-depth understanding of Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping

Benefits For Senior GCP Data Engineer

Medical Insurance
  • Private Health Insurance
  • Paid Time Off
  • Performance Bonus

Interested in this job?

Jobs Related To Digitals AI Inc Senior GCP Data Engineer

Senior BI Engineer (Data Visualization)

Senior BI Engineer position at Digitals AI Inc focusing on data visualization, analytics, and business intelligence, offering remote work and comprehensive benefits.

Business Intelligence Engineer, Amazon Store Customer Service Product & Tech

Senior Business Intelligence Engineer role at Amazon focusing on data modeling, analytics, and customer service improvement through data-driven solutions.

Senior Business Intelligence Engineer, Long-term planning

Senior Business Intelligence Engineer role at Amazon focusing on logistics optimization and data analytics for the consolidation systems.

Business Intelligence Engineer, ROW Supply Chain Analytics, Research and Product

Senior Business Intelligence Engineer role at Amazon focusing on supply chain analytics, requiring expertise in data analysis, visualization, and machine learning.

Senior Business Intelligence Engineer, Transportation Network Design Insights

Senior BI Engineer role at Amazon focusing on transportation network optimization, requiring Python, SQL, and data visualization expertise to drive multi-million dollar efficiency improvements.