Data Engineer - Cyber Security solutions
- Fixed term contract - 12 months (renewable)
- Large MNC
- Excellent salary available
Data Engineer required by largescale successful MNC to assist on cybersecurity projects and operations for a range of clients. Excellent opportunity to join a global, market leading business!
Responsibilities:
- Design, Develop and Unit Test a scalable and high-performance data pipeline to process batch and stream data
- Deploy and maintain the data pipelines in Production environment
- Use industry standard tools/technologies to maintain security and privacy of the data
- Translate complex technical and functional requirements into detailed designs
- Work closely with Data Analyst and Data Scientist to help in data exploration and to build Machine Learning / Artificial Intelligence (ML/AI) models
- Create necessary Design and technical documents
- Serve as a mentor for junior staff members by conducting technical training sessions and reviewing code standards
Requirements:
- Minimum 5 years of experience in Data Engineering role and an interest in or experience of Cybersecurity
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
- Experience in designing and building Data warehouses and Data lakes
- Experience in building big data pipelines to process huge volumes of structured and unstructured data using batch and stream processing techniques
- Experience in any of the programming languages like Python, Scala or Java
- Hands-on experience on big data tools or technologies like Spark, Hadoop, Hive etc
- Experience with stream processing systems like Kafka, Flink or Storm
- Experience in any of the cloud platforms like AZURE, GCP or AWS
- Proficient in UNIX scripting
- Knowledge of Devops tools like GIT, CICD, Docker and Kubernetes
- Experience with or Knowledge of Agile software development methodologies.
Sebastian Christensen
Associate Director
EA Licence: 20C0336
EA Recruiter Number: R1871073
