Software Engineer II (Python and Data pipelines)
Description For Software Engineer II (Python and Data pipelines)
Scribd is a dynamic platform revolutionizing digital content access through its three major products: Everand, Scribd, and Slideshare. As a Software Engineer II on the ML Data Engineering team, you'll be at the forefront of managing and processing hundreds of millions of documents and billions of images. The role involves building robust systems for metadata extraction and enrichment, working with cutting-edge technologies including Python, Scala, and AWS services. The team operates at an unprecedented scale, handling diverse datasets from UGC documents to ebooks and audiobooks. The company offers a flexible work environment through their Scribd Flex program, balancing remote work with intentional in-person collaboration. With competitive compensation ranging from $103,500 to $196,000 depending on location, comprehensive benefits, and a culture focused on GRIT (Goals, Results, Innovation, Team), this position offers an exciting opportunity to impact content discovery and structured metadata across multiple platforms. The role requires 4+ years of experience in backend software engineering and expertise in data pipeline development, making it perfect for those passionate about working with data at scale.
Responsibilities For Software Engineer II (Python and Data pipelines)
- Design and develop data pipelines to extract, enrich, and process metadata from millions of documents, images, and other content types
- Collaborate with cross-functional teams, including ML engineers and product managers, to deliver scalable, efficient, and reliable metadata solutions
- Build and maintain systems that operate at a massive scale, handling hundreds of millions of documents and billions of images
- Optimize and refactor existing systems for performance, scalability, and reliability
- Ensure data accuracy, integrity, and quality through automated validation and monitoring
- Participate in code reviews, ensuring best practices are followed and maintaining high-quality standards in the codebase
- Manage and maintain data pipelines, security and infrastructure
Requirements For Software Engineer II (Python and Data pipelines)
- 4+ years of experience in backend software engineering, with hands-on work in developing data pipelines and building and deploying your own infrastructure
- Proficient in one or more programming languages, such as Python, Ruby or similar
- Experience working with a public cloud provider (AWS, Azure, or Google Cloud)
- Hands-on experience with building, deploying, and optimizing solutions using ECS, EKS or AWS Lambdas
- Experience with queueing and streaming technologies like SQS, Sidekiq, Kafka or Kinesis
- Experience working with systems at scale such as External APIs, and data transformations
- Proven ability to test and optimize systems for performance and scalability
- Bachelor's in CS or equivalent professional experience
Benefits For Software Engineer II (Python and Data pipelines)
- Healthcare Insurance Coverage (Medical/Dental/Vision): 100% paid for employees
- 12 weeks paid parental leave
- Short-term/long-term disability plans
- 401k/RSP matching
- Onboarding stipend for home office peripherals + accessories
- Tuition Reimbursement
- Learning & Development programs
- Quarterly stipend for Wellness, Connectivity & Comfort
- Mental Health support & resources
- Free subscription to Scribd + gift memberships for friends & family
- Referral Bonuses
- Book Benefit
- Sabbaticals
- Company wide events
- Team engagement budgets
- Vacation & Personal Days
- Paid Holidays (+ winter break)
- Flexible Sick Time
- Volunteer Day
Jobs Related To Scribd Software Engineer II (Python and Data pipelines)
