Skip to content

Instantly share code, notes, and snippets.

@chicagobuss
Created February 15, 2017 23:23
Show Gist options
  • Select an option

  • Save chicagobuss/2a41e2b37da49ba4f3e3864015effe0c to your computer and use it in GitHub Desktop.

Select an option

Save chicagobuss/2a41e2b37da49ba4f3e3864015effe0c to your computer and use it in GitHub Desktop.
job_rec
Data Engineering
Purpose of the role:
Be part of a new Data Engineering team tasked with building the next generation of data ingestion, processing and storage framework at Citadel. Data engineers will be working directly with business customers to understand their processing needs and building solutions that can be repurposed across the entire organization. Team members will come up with creative solutions on tight deadlines to real world business problems that will have a significant impact to the business successes. As such, individual engineers will see and feel significant impact and responsibility.
Citadel has unique challenges of scale and rate of scale in terms of both compute, data volumes and user experience. If you enjoy pushing the boundaries of what is possible and building creative solutions this is the place and role for you.
Key job responsibilities include:
Design, build and support Citadel's data processing platforms
Conduct proof of concept studies on new data technologies
Build monitoring and alarming systems for production data services
Build self-service tools for application teams, such as schema migration tools, data cataloging systems, etc.
Design hardware and cloud infrastructure to run supported products.
Skills and Qualifications:
Required:
Hands-on experience with some new database technologies, e.g. Cassandra, Riak, VoltDB, Druid, Vertica etc...
Some development experience - preferably in Python, Java or golang
Experience running production services
Excellent communication skills
Ability to work in high pressure environment
Preferred:
Experience building production Big Data services, e.g. Spark, Hadoop
Experience running, administering, or conducting performance-tuning of MS SQL Server or Vertica, both is a huge plus
Deep understanding of relational vs unstructured data
Strong Python skills
Experience working on public or private cloud infrastructure, e.g. AWS, Google, Openstack or Azure, especially their database offerings
Running databases on public or private cloud infrastructure
Education: Bachelors of Science (Master Degree preferred) in engineering, science, or mathematics.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment