Big Data Engineer

Lisbon, Lisbon
  1. Full Time
  2. IT/Technology
257541
Posting date:16 Oct, 2019
SORRY, THIS VACANCY HAS NOW EXPIRED

If you love to build applications that make use of large volumes of data and generate outputs that allow commercial actions to generate incremental value probably the challenge we have is the right for you!


Challenges:


> Be Technology & Data savvy

- Designing and producing high performing and stable applications to process massive volumes of data in a clustering environment (e.g. Spark)


> Be reliable

- Building real-time data processing applications integrated with business systems to enable rapid decision making


> Be a Data cruncher

- Integrate and process the data from several local data sources necessary for analysis and commercial actions;


> Be a Q&A professional

- Guarantee the quality of end-to-end applications (through review and testing) that make use of large volumes of data from the operational systems and output insights back to business systems


> Be a Contributor

- Support and contribute, with the Data Engineering, QA and Data Science teams, to define best practices for the agile development of applications to run on the Big Data Platform


> Be part of a Global Community

- Comply with the framework and Dev/Ops approach defined by the Big Data Platform team which defines the QA strategy, tools, AND ways of working applied in every Local Market.

 

Ideal Background

 - Previous experience in designing, building and managing applications to process large amounts of data in a Hadoop ecosystem (Spark, Hive/Impala, HBase, Yarn, Oozie)

- Strong software development experience in Python, Java or Scala programing languages (other programing languages desirable);

- Experience building systems to perform real-time data processing using Spark Streaming, Storm and Kafka, or similar technologies;

- Experience with common SDLC, including SCM, build tools, unit testing, TDD/BDD, continuous delivery and practices);

- Experience with Unix-based systems, including bash programming;

- Experience with other distributed technologies such as Cassandra, Solr/ElasticSearch, Flink, Flume is a plus.  


Life at Vodafone

Raniya's Work Experience

James "Vodafone changed my life"

James "Vodafone changed my life"