Senior Big Data Engineer

Location: New york, New York
Date Posted: 08-09-2017

We'll trust you to:

  •  Design and implement distributed data analytics systems, using Hadoop/Spark, Python, and C/C++
  •  Manage cloud resources in order to maintain resiliency and performance
  •  Effectively roll out new features using an Agile methodology
  •  Work with a small team on all parts of the system, from data capture to display
  •  Participate with the rest of the team in analyzing the latency data, finding bottlenecks, and proposing solutions

You need to have:

  •  2+ years experience with Hadoop and Spark
  •  2+ years experience with Openstack or Amazon EC2 (or equivalent)
  •  4+ years experience with Python
  •  BS or MS in Computer Science or equivalent experience
  •  Experience with GitHub and a solid understanding of core concepts with Git
  •  Familiarity with Linux
  •  A solid understanding of basic statistics and core computer science concepts

We'd love to see:

  •  A strong understanding of distributed computing
  •  Familiarity with web technologies, including NGinx, Flask, and REST APIs
  •  Experience with chef, puppet or ansible
  •  Familiarity with system administration tasks, such as managing services, hardware, and network configurations
  •  Prior experience working with trading or market data
or
this job portal is powered by CATS