Data Engineer GCP
Description For Data Engineer GCP
We are seeking a highly skilled GCP Engineer with expertise in BigQuery and other GCP services to join our team. The role focuses on designing, implementing, and optimizing data solutions on Google Cloud Platform. The ideal candidate will bring 10+ years of experience in data engineering, with strong expertise in BigQuery, ETL pipelines, and cloud computing. You'll work with cutting-edge technologies including Cloud Dataflow, Dataproc, and Cloud Composer, while ensuring data security and governance. This position offers the opportunity to work with large-scale datasets, implement real-time processing solutions, and collaborate with Data Scientists and Analysts. The role combines technical expertise in GCP services with strategic thinking in data architecture and optimization. You'll be responsible for building robust data pipelines, optimizing performance, and maintaining infrastructure while working in a hybrid environment with locations in Florida and Texas.
Responsibilities For Data Engineer GCP
- Design, develop, and optimize BigQuery data warehouses, ensuring high performance and cost efficiency
- Build and maintain scalable ETL pipelines using GCP services
- Implement data ingestion, transformation, and processing workflows
- Work with Cloud Storage, Pub/Sub, and Cloud Functions for real-time and batch data processing
- Ensure data security, governance, and compliance
- Collaborate with Data Scientists and Analysts to optimize query performance
- Troubleshoot performance issues and manage BigQuery cost and resource utilization
- Implement CI/CD pipelines for data workflows
- Monitor and maintain GCP infrastructure
Requirements For Data Engineer GCP
- 10+ years of experience working as a GCP Data Engineer or similar role
- Strong expertise in Google BigQuery – performance tuning, partitioning, clustering, and cost optimization
- Hands-on experience with ETL tools and frameworks
- Proficiency in SQL, Python, and Shell scripting
- Experience with Google Cloud Storage, Pub/Sub, and Cloud Functions
- Strong understanding of GCP IAM, security best practices, and data governance
- Familiarity with Terraform, Cloud Build, and CI/CD for infrastructure automation
- Ability to work with large-scale datasets and real-time streaming data processing
- Experience in data modeling, schema design, and optimization techniques
- Strong analytical and problem-solving skills
- GCP Professional Data Engineer Certification is a plus
- Experience with Machine Learning workflows on GCP is a plus
- Experience with Kubernetes (GKE) and containerized deployments is a plus
Jobs Related To Qode Data Engineer GCP
