Senior Engineer (Data Platform)

Product engineering company working with innovative startups and enterprises, providing full-stack product development for 110+ startups globally.
Data
Senior Software Engineer
Hybrid
101 - 500 Employees
4+ years of experience
Enterprise SaaS · AI

Description For Senior Engineer (Data Platform)

Velotio Technologies, a product engineering company with 400+ elite software engineers, is seeking a Senior Engineer for their Data Platform team. The role focuses on optimizing Spark clusters, implementing data infrastructure, and working with cutting-edge big data technologies. The ideal candidate will have 4+ years of experience in Data Platform engineering, with expertise in Python, big data tools, and AWS cloud services. The company offers a collaborative environment with a flat hierarchy and emphasis on personal growth. They work with 110+ global startups, building products in cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. The position is based in Pune, India with a hybrid work arrangement. The role requires strong analytical skills and experience with various data technologies including Spark, Kafka, and cloud services. Velotio promotes an inclusive culture where diversity is valued and engineers are encouraged to take ownership of their work.

Last updated 20 hours ago

Responsibilities For Senior Engineer (Data Platform)

  • Optimize Spark clusters for cost, efficiency and performance
  • Implement robust monitoring systems to identify bottlenecks
  • Optimize infrastructure for ETL processes using SQL and AWS big data technologies
  • Work with data and analytics experts for cost efficiencies
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management

Requirements For Senior Engineer (Data Platform)

Python
Cassandra
PostgreSQL
Kafka
  • Experience with processing large workloads and complex code on Spark clusters
  • Proven experience in setting up monitoring for Spark clusters
  • Experience in designing and implementing scalable Data Warehouse solutions
  • Strong analytic skills related to working with unstructured datasets
  • Expertise with Python and Jupyter notebooks
  • Experience with big data tools: Spark, Kafka
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra
  • Experience with data pipeline tools: Azkaban, Luigi, Airflow
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift
  • Working knowledge of stream-processing systems: Storm, Spark-Streaming

Benefits For Senior Engineer (Data Platform)

  • Autonomous and empowered work culture
  • Flat hierarchy with fast decision making
  • Strong, fun & positive environment
  • Regular celebrations of success
  • Inclusive and diverse environment

Interested in this job?

Jobs Related To Velotio Technologies Senior Engineer (Data Platform)

Senior Engineer (Data Engineer)

Senior Data Engineer position at Velotio Technologies - Build scalable data infrastructure and ETL pipelines using modern big data technologies in a remote work environment.

Senior Engineer (Data Engineer)

Senior Data Engineer position at Velotio Technologies, focusing on building scalable data infrastructure and ETL/ELT pipelines using modern big data technologies.

Senior Data Scientist, Research, Ads Metrics

Senior Data Scientist position at Google focusing on ads metrics research, offering competitive compensation and the opportunity to shape advertising products.

Senior Data Scientist, Research, Workspace

Senior Data Scientist position at Google focusing on Workspace products, requiring 5+ years of analytics experience and expertise in Python, R, and SQL.

Senior Data Scientist, Product, Google Store

Senior Data Scientist position at Google Store focusing on product analytics, requiring 5+ years of experience in data analysis, statistics, and programming.