Software Engineer II (Python and Data pipelines)
Description For Software Engineer II (Python and Data pipelines)
Jobgether is a Talent Matching Platform leveraging AI-driven job matching to connect talent with opportunities globally. As a Software Engineer II, you'll be instrumental in designing and optimizing data pipelines for large-scale applications. The role involves working with cutting-edge technologies including Python, Ruby on Rails, AWS, and Databricks. You'll collaborate with machine learning teams and product managers to process and enrich metadata, ensuring system efficiency and scalability. The position offers comprehensive benefits including fully paid healthcare, 401k matching, parental leave, and professional development opportunities. The remote work environment allows flexibility while maintaining connection through company-wide events and team engagement initiatives. This role is perfect for experienced engineers passionate about data pipeline development and system optimization, offering the chance to impact millions of users while working with advanced technologies.
Responsibilities For Software Engineer II (Python and Data pipelines)
- Design and develop data pipelines to extract, enrich, and process vast amounts of metadata from diverse content types
- Collaborate with machine learning engineers, product managers, and other teams to create efficient and scalable metadata solutions
- Optimize and refactor existing systems for improved performance, scalability, and reliability
- Ensure data quality and accuracy by implementing automated validation and monitoring processes
- Participate in code reviews and maintain high standards for quality and best practices
- Manage and maintain the infrastructure for data pipelines, ensuring security and operational efficiency
Requirements For Software Engineer II (Python and Data pipelines)
- 4+ years of experience in backend software engineering, with hands-on experience in developing data pipelines
- Proficient in one or more programming languages such as Ruby, Python, or similar
- Experience working with public cloud providers (AWS, Azure, or Google Cloud)
- Hands-on experience with AWS services such as ECS, EKS, or AWS Lambdas
- Familiarity with queueing and streaming technologies like SQS, Kafka, or Kinesis
- Experience with large-scale systems, external APIs, and data transformations
- Strong skills in testing, optimizing, and scaling systems for performance and reliability
- Bachelor's degree in Computer Science or equivalent professional experience
- Bonus: Experience working with Machine Learning systems is a plus
Benefits For Software Engineer II (Python and Data pipelines)
- Competitive salary based on experience and location
- Healthcare coverage (Medical, Dental, and Vision) fully paid for employees
- 12 weeks of paid parental leave
- Short-term and long-term disability plans
- 401k/RSP matching
- Home office stipend for peripherals and accessories
- Tuition reimbursement and Learning & Development programs
- Quarterly stipends for wellness, connectivity, and comfort
- Mental health support and resources
- Free subscription to Scribd + gift memberships for friends and family
- Referral bonuses and book benefits
- Sabbatical opportunities
- Company-wide events and team engagement budgets
- Generous vacation, personal days, and paid holidays (including winter break)
- Flexible sick time and volunteer day
- Inclusive company culture with employee resource groups
Jobs Related To Jobgether Software Engineer II (Python and Data pipelines)
