Senior GCP Data Engineer

AI-focused technology company specializing in data engineering and cloud solutions.
Data
Senior Software Engineer
Remote
4+ years of experience
AI · Enterprise SaaS

Description For Senior GCP Data Engineer

Digitals AI Inc is seeking an experienced Senior GCP Data Engineer to join their team in a remote capacity. This role requires a seasoned professional with 4+ years of experience in ETL and Data Warehousing, with a strong focus on Google Cloud Platform technologies.

The ideal candidate will be responsible for designing, developing, and maintaining sophisticated data pipelines and warehousing solutions. You'll work with cutting-edge technologies including GCP BigQuery, Cloud Storage, Dataflow, Cloud Functions, and Pub/Sub, while implementing best practices in data engineering and analytics.

Your role will involve collaborating with cross-functional teams to gather requirements, transform data to meet end-user needs, and ensure data quality and consistency across various sources. You'll be instrumental in creating robust ETL solutions, writing complex SQL queries, and developing metadata-based frameworks for data pipelines.

This position offers an excellent opportunity for growth in a dynamic environment where you'll be exposed to modern cloud technologies and data engineering practices. The role combines technical expertise with leadership opportunities, requiring both strong communication skills and technical proficiency.

Benefits include private health insurance, paid time off, and performance bonuses, making this an attractive opportunity for experienced data engineers looking to make an impact in an AI-focused organization. The remote work arrangement offers flexibility while working on challenging projects that push the boundaries of data engineering.

Last updated a month ago

Responsibilities For Senior GCP Data Engineer

  • Analyze different source systems, profile data, understand, document & fix Data Quality issues
  • Gather requirements and business process knowledge for data transformation
  • Write complex SQLs to extract & format source data for ETL/data pipeline
  • Create design documents, Source to Target Mapping documents and deployment documentation
  • Design, Develop and Test ETL/Data pipelines
  • Design & build metadata-based frameworks for data pipelines
  • Write and execute Unit Test cases and document results
  • Deploy ETL/Data pipelines
  • Use DevOps tools for version control and deployment
  • Support team during troubleshooting & debugging
  • Perform production support, enhancements and bug fixes
  • Work with stakeholders to communicate EDW incidents/problems
  • Leverage ITIL concepts for incident management
  • Perform data cleaning, transformation, and validation
  • Stay current on industry best practices and emerging technologies

Requirements For Senior GCP Data Engineer

Python
  • 4+ years of experience in ETL & Data Warehousing
  • Excellent leadership & communication skills
  • Experience in developing Data Engineering solutions with Airflow, GCP BigQuery, Cloud Storage, Dataflow, Cloud Functions, Pub/Sub, Cloud Run
  • Experience in solution automations with ETL tools
  • Executed at least 2 GCP Cloud Data Warehousing projects
  • Worked on at least 2 projects using Agile/SAFe methodology
  • Mid-level experience in Pyspark and Teradata
  • Working experience with DevOps tools like GitHub, Jenkins, Cloud Native
  • Experience with semi-structured data formats like JSON, Parquet and/or XML files
  • In-depth understanding of Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping

Benefits For Senior GCP Data Engineer

Medical Insurance
  • Private Health Insurance
  • Paid Time Off
  • Performance Bonus

Interested in this job?

Jobs Related To Digitals AI Inc Senior GCP Data Engineer

Senior BI Engineer (Data Visualization)

Senior BI Engineer position at Digitals AI Inc focusing on data visualization, analytics, and business intelligence, offering remote work and comprehensive benefits.

Senior, Data Scientist

Senior Data Scientist position at Sam's Club focusing on merchandising financial planning, offering $90k-$180k salary with comprehensive benefits in Bentonville, AR.

Senior, Data Scientist

Senior Data Scientist position at Walmart focusing on security compliance and analytics, offering competitive salary and comprehensive benefits in Bentonville, AR.

Data Scientist III

Senior Data Scientist role at Sam's Club AI Labs focusing on machine learning, big data analytics, and AI implementation across retail operations.

Sr. Business Intelligence Engineer, Amazon Search

Senior BI Engineer role at Amazon Search, developing reinforcement learning systems for shopping experience optimization, offering competitive salary and benefits.