Big Data Engineer
The Big Data Engineer provides expert guidance and delivers through self and others to source and integrate structured and unstructured data from dozens of local data sources including streaming data feeds into a data lake. You will implement solutions to wrangle, cleanse, validate and govern the petabyte scale data lake, and build machine learning applications that make use of large volumes of data to generate outputs and commercial actions that deliver incremental revenue or reduce cost.
Designing and producing high performing and stable applications to perform complex processing of massive (petabyte scale) volumes of data in a Hadoop based environment.
Working alongside Data Scientist to build end-to-end applications that make use of large volumes of source data from the operational systems and output insights back to business systems
Building real-time data processing applications which are integrated with business systems to enable value from analytic models to drive rapid decision making
Sourcing, ingesting, wrangling and validating data sets, building pipelines to transform data and produce analytical records for machine learning
- Managing complex stakeholder relationships
Languages and Data Tools
- Hadoop ecosystem (Spark, Hive/Impala, HBase, Yarn)
- Scala and Python
- Unix-based systems, including bash programming
Other distributed technologies such as Cassandra, Solr/ElasticSearch, Flink, Flume would also be desirable
We need someone with expert level experience in designing, building and managing applications to process large amounts of data in a Hadoop / Spark ecosystem. Extensive experience with performance tuning applications on Hadoop and configuring Hadoop based systems to maximise performance. Ideally, also knowledge of building systems to perform real-time data processing using Spark Streaming and Kafka, or similar technologies. It would be great if you have dealth with common SDLC, including SCM, build tools, unit testing, TDD/BDD, continuous delivery and agile practises and also working in large-scale multitenancy Hadoop environments both on-premise and cloud.
What’s in it for you?
Great reward with a competitive salary. We will also throw in 28 days’ holiday and a flexible work environment. You will get to work with a fun, diverse and driven team who love what they do and a leadership team who listen, support and inspire you to be your very best!
Vodafone is committed to attracting, developing and retaining the very best people by offering a flexible, motivating and inclusive workplace in which talent is truly recognised, developed and rewarded. We believe that diversity plays an important role in the success of our business and we are committed to creating an inclusive work environment, which respects, values, celebrates and makes the most of people’s individual differences - we are not only multinational but multicultural too.
Vodafone is committed to making reasonable adjustments for all candidates considered to have a disability during the recruitment assessment process. Should you meet the minimum criteria for the role you are applying to, we will contact you to discuss the reasonable adjustments that you may need.
Join Vodafone Hungary and build a better tomorrow! We are looking for a Mobile OSS Expert for our Technology Team #Vodafonelife At Vodafone we connect everybody to live a better today and build a
Low Level Network Design for Global Enterprise Customers. 1) Provide technical consultancy & expertise for complex customer requirements during “SELL” phase on Vodafone Fixed Line and Unified Communi
London, Greater London
Role Title: Architect – Orchestration Location: Paddington/Newbury At Vodafone Group we build connections to all our Global operations, acting as an advisory board to drive consistency and customer
As a bold global technology leader, our products and services touch the lives of millions, as well as lending a huge helping hand to some of the country’s most crucial organisations. From contactless
Admin support - Manage Application Operation support for Digital IT Ops - Daily & weekly & monthly task, health checks, monitoring, housing keeping activities, & proactive restarts - Troubleshooting &
Performing day-to-day L2 support activities, incident and service request ma nagement, problem analysis and resolution, configuration changes, health check & housekeeping activity, Triage tickets to s
•Technically sounds to resolve complex technical and functional issuesin Amdocs CRM 6.0 •Good in web logic. •Expert in writing/modifying shell complex script. •Expert in writing/modifying complex SQL
London, Greater London
Role Title: Integration and Data Lead - Internet of Things (Consumer) Location: London Are you bold? Innovative? Inquisitive? Great, then we can help you thrive… The V by Vodafone team was created
Join Vodafone Hungary and build a better tomorrow! We are looking for a Business Relationship Manager for our Virtual Infrastructure & OSS Engineering Team! #Vodafonelife At Vodafone we connect ev
Join Vodafone Hungary and build a better tomorrow! We are looking for a QA Engineer for our Technology Team! #Vodafonelife At Vodafone we connect everybody to live a better today and build a bette
Primary responsibility in engineering and operating fixed products delivering broadband internet, telephony and collaboration services to Vodafone customersWork in a team environment sharing responsib