Nagarro logo

Associate Principal Engineer (Big Data Engineer)

Nagarro
1 day ago
Full-time
On-site
London, United Kingdom
Data Science

Company Description

In a changing and evolving world, challenges are ever more unique and complex. Nagarro helps to transform, adapt, and build new ways into the future through a forward-thinking, agile, and caring mindset. Today, we are 18,000+ experts across 37+ countries, forming a Nation of Nagarrians, ready to help our customers succeed.

The nature of IT & digital product engineering has reached an incredible state of velocity and transition. We must adapt and meet it with an agile mindset that isn't afraid to iterate towards the perfect solution. If we only solve today's problems, it's not enough. We must do more. We must courageously embrace the future, with vision and clarity about where technology & business are heading. Thinking breakthroughs gets us there.

Nagarro - https://www.nagarro.com/en

Job Description

Must have Skills : Python (Strong), Databricks, Apache Kafka, Airflow/DBT

Good To Have Skills : Kubernetes (Strong)

  • Technical Leadership: Take in charge of the design, development and delivery of cyber data platform solutions and provide technical guidance and mentorship across all teams of cyber data platform.
  • Data Architecture: Design, build and management of realtime, near realtime and batch data architectures that support threat detection, incident response and reporting through advanced analytics, machine learning and GenAI capabilities.
  • Coding: Contribute to raising the quality bar of the team''s codebase by producing high-quality code, conducting thorough peer reviews, and proactively providing constructive feedback to other team members on their code
  • Data Security and Compliance: Implement and enforce data security standard methodologies, ensuring the protection of sensitive information and compliance with relevant regulations.
  • Automation and DevOps: Implement various automations and DevOps practices to streamline the deployment, configuration, and management of data platform components.
  • You will need Proven experience in leading the teams to deliver resilient systems and providing technical guidance for optimal product solutions.
  • Experience building data platforms on cloud services like Databricks on Azure or GCP BigQuery, with the goal of delivering a self-service data platform for users. Proficient in Python and SQL, with a solid grasp of architectural patterns, coding standards, code reviews, version control, and CI/CD practices.
  • Expertise in ETL and ELT frameworks for large scale realtime and batch data processing, with hands-on experience in Kafka, Flink, Airflow and dbt as well as containerisation technologies like Docker and Kubernetes.
  • Ability to provide clear input, guide, opportunities to help engineers develop and advance. Knowledge of cybersecurity principles and practices.