Data Engineer II, Attack Surface Module

World's most advanced intelligence company with 1,000 professionals, serving 1,800+ clients worldwide with $300M+ in sales.
Data
Mid-Level Software Engineer
Contact Company
501 - 1,000 Employees
3+ years of experience
Cybersecurity

Description For Data Engineer II, Attack Surface Module

Recorded Future, the world's largest intelligence company with over $300M in sales and 1,800+ global clients, is seeking a Data Engineer II for their Attack Surface Module team. This role is crucial in building internet inventory, robust APIs, and Data Services for security teams. As a Data Engineer, you'll join a small team of highly skilled professionals where you'll have the opportunity to shape the company culture and work on challenging data engineering problems.

The role involves working with large-scale data processing, including parsing global whois data, handling internet scan data, and building sophisticated monitoring systems. You'll be responsible for implementing data pipelines and creating high-value analytics that directly impact the organization's security capabilities. Within your first three months, you'll contribute to expanding the company's internet scanning capabilities.

Recorded Future, known as "Futurists," represents over 40 nationalities and maintains a strong focus on core values including high standards, inclusion, and ethical practices. The company has earned an impressive 4.8-star user rating from Gartner and serves more than 45 Fortune 100 companies. They're committed to maintaining a diverse and inclusive environment where all employees can bring their whole selves to work.

The ideal candidate will bring strong Python engineering experience, excellent problem-solving skills, and the ability to communicate effectively across teams. Additional valuable skills include experience with cloud computing, modern web frameworks like Flask or FastAPI, and big data tools such as Spark, Scylla, and Airflow. Knowledge of Elasticsearch and column-oriented databases like Clickhouse would be advantageous.

Join a company that's at the forefront of cyber threat intelligence, offering opportunities to work with cutting-edge technology while making a real impact in the cybersecurity landscape.

Last updated 9 days ago

Responsibilities For Data Engineer II, Attack Surface Module

  • Implement and test data pipelines supporting business objectives
  • Solve data engineering problems related to parsing global whois data
  • Process large volumes of internet scan data
  • Build high value analytics on raw data from scanning pipelines
  • Index data for searchability
  • Build systems to monitor data processes

Requirements For Data Engineer II, Attack Surface Module

Python
  • 3+ years experience in software engineering using Python
  • Great problem solving capabilities and experience troubleshooting data issues
  • Proactive communication across teams
  • Cloud computing experience (preferred)
  • Experience with Flask or FastAPI (preferred)
  • Experience with Spark, Scylla, Airflow, and other big data tools (preferred)
  • Elasticsearch experience and work with Clickhouse / column oriented databases (preferred)

Interested in this job?

Jobs Related To Recorded Future Data Engineer II, Attack Surface Module

Data Engineer II, Data Pipelines

Data Engineer II at Recorded Future: Build and maintain high-volume data pipelines for cyber threat intelligence.

Data Engineer

Data Engineer role at Recorded Future, building data pipelines for cyber threat intelligence. 1+ years Python experience required.

Business Intelligence Engineer, ORC (ORC- Operations Risk Compliance) Program Analytics

Business Intelligence Engineer role at Amazon focusing on ORC Analytics, combining statistical analysis, data engineering, and business intelligence expertise in London.

Data Engineer

Data Engineer position at WorldQuant focusing on developing data pipelines and engineering solutions for financial strategies.

Data Engineer

Data Engineer position at G-P, developing solutions for their Global Employment Platform, working with Python, SQL, and modern data technologies in a remote environment.