Senior Data Engineer

You Will :

•  Create highly scalable Big Data solutions that can collect, store, process & analyse huge sets of data.

•  Be responsible for setting up Big Data Infrastructure, ETL workflows, highly available and scalable data systems that supports digital entertainment products which are used by millions of users

•  Work fast. The media industry moves fast to meet launch timelines with big advertising and content production budgets at stake. We make quick releases to receive customer and user feedback which helps us create the very best products on the market

•  Partner with designers, project managers, QA engineers, operations engineers, third party systems providers and customers

•  Think about and implement automation to make your team’s high quality development as efficient as possible

•  At all times consider how to develop your code the right way for better maintenance by a wider team and for high performance instead of taking short cuts to get the job done

•  Have potential to be a mentor and leader for other developers as the Diagnal team grows over time

You Have :

•  4 or more years of experience of data engineering and Big Data systems in a project services or product engineering organisation

•  Proficient understanding of distributed computing principles

•  Hands on experience in programming or scripting languages like Java, Javascript, Ruby, Python, R

•  Good knowledge of various ETL techniques and frameworks such as Flume

•  Experience with various messaging systems such as Kafka, RabbitMQ

•  Experience with building stream processing systems using solutions such as Storm, Spark Streaming, Kinesis

•  Experience on Data Visualisation frameworks like D3.js

•  Experience with NoSQL databases such as HBase, Cassandra, MongoDB

•  Good Knowledge of Big data querying tools such as Hive, Pig

•  Experience with Machine Learning toolkits such as Mahout, SparkML, H2O

•  Good understanding of Lambda architecture and when to use them

•  Experience or Knowledge on Columnar Databases such as Redshift

Apply Now

    Your Name

    Your Email

    Job you are applying for

    Your Message