Applicants must be eligible to work in the specified location
Data Engineer - Streaming - Spark tuning - Scala/Java/Kafka/Datasets/Linux - Contract
This role will be looking after the Core Datawarehouse Platform
Opportunity to do full end to end - make changes in the UI
Stream based
Sourcing data from Kafka
Webservices
UI
Principal Responsibilities
- Create/enhance/maintain Spark ETL data pipelines using Scala and Kafka
- Adding new data feeds, tuning, and supporting releases
- Application Profiling and Tuning
Qualifications/Skills Required
- 4+ years of Scala Spark Streaming development
- Automated testing: Unit testing, Integration/Performance testing
- Background in an OO language such as Java/C++/C#
- 2+ years of professional Database development experience (mixed technologies)
Scala Spark Experience at an Investment Bank or Hedge Fund is ESSENTIAL
Inside IR35 - office role - Central London based
By applying to this job you are sending us your CV, which may contain personal information. Please refer to our Privacy Notice to understand how we process this information. In short, in order to supply you with work finding services, we will hold and process your personal data, and only with your express permission we will share this personal data with a client (or a third party working on behalf of the client) by email or by upload to the Client/third parties vendor management system. By giving us permission to send your CV to a client, this constitutes permission to share the personal data that would be necessary to consider your application, interview you (Phone/video/face to face) and if successful hire you.
Scope AT acts as an employment agency for Permanent Recruitment and an employment business for the supply of temporary workers. By applying for this job you accept the Terms and Conditions, Data Protection Policy, Privacy Notice and Disclaimers which can be found at our website.
London, Hybrid, UK
initial 6 months - to be extended
ASAP
Negotiable
Vig Patel
JSSCALASPARK
26/04/2024 10:24:56
We strongly recommend that you should never provide your bank account details to an advertiser during the job application process. Should you receive a request of this nature
please contact support giving the advertiser's name and job reference.