Senior Software Engineer - Big Data

Palo Alto, California, United States Full-time

We build scalable near real-time big-data pipeline that processes millions of records per second containing network traffic and system activities like processes and network connections. The high-performance pipeline relies on many open-source projects like hdfs, spark, hbase, druid, kafka, yarn, zookeeper, and many home-grown libraries and tools. We have a tradition of celebrating elegantly designed and well-tested code for every part of our product. We take pride in being able to push our latest code to production environments in matter of days.

As a member of the team you will develop large scale solutions and algorithms for features like network data visibility and indexing, network policy management, application discovery, application performance, network security, anomaly detection, etc.

We hope that you are a self-motivated, passionate and curious team member who enjoys creating scalable solutions to problems. You embrace agile methodologies that involve rapid prototyping by feedback gathered from customers, peers and technical support engineers.

Qualifications

  • BS in Computer Science, Electrical Engineering or equivalent practical experience.
  • Strong software engineer with solid computer science fundamentals in areas such as data structures, algorithms, object oriented design and networking
  • Experience with big-data technologies like hadoop, spark, druid, kafka
  • Experience programmer in Java and Python
  • Experience building / packaging / deploying / debugging system applications
  • Experience troubleshooting production deployment
  • Familiar with test-driven development. You are expected to write extensive unit-tests and integration-tests
  • At least 5 years working with production code in immediately relevant field

Preferred Skills

  • MS or PhD in Computer Science.
  • Domain knowledge related to Network traffic analytics and anomaly detection.
  • Domain knowledge for Application Discovery and Performance Management.
  • Code committed to open source like spark, druid.
  • Knowledge of Data science technologies, Machine Learning, R.