Data Engineer (Hadoop / Postgres / SQL)

Starcount is a new breed of consultancy blending proprietary technology and machine learning with a deep expertise and pedigree in data-based insights. 

 We partner our clients in navigating the complexities of customer behaviours and passions. We can predict seemingly irrational behaviour.  

We will tell you things no one else can. We drive these insights through businesses and we do this at scale and quicker than anyone else.

We're creating a SaaS platform that interprets complex data and tells stories about customer passions and behaviour and we're looking for a Data Engineer to push boundaries with what is possible with our data; to design, develop and and automate a data pipeline that will collect data from numerous transactional, social media and geographical data sets as we build the next generation of our product.

- Applying systems architecture and software design skills in the development of data pipelines

- Design and develop new algorithms for extracting insight from social data 

- Develop crawlers to extract data from the web or APIs

- Develop infrastructure around existing internal tools to enhance capabilities and improve data flow.

- Implement statistical models and algorithms including clustering on large scale graph data

Some of the skills and technologies you'll need experience of:

Hadoop, PostgreSQL, Spark, SQL, Pig, Python, Pyspark

We work in an open plan office right in the heart of Oxford Circus.  We have a fun social culture with regular showcase (lunch and learn) sessions and after-hours social functions, all adding up to a balanced work-life environment with a 4pm finish on Fridays!