Senior Data Engineer – Java Spark Cloud-Native Applications · ITDS Portugal
Entrar para candidatar

Senior Data Engineer – Java Spark Cloud-Native Applications

ITDS Portugal
Lisboa · Híbrido · Há 4 sem.
Contratação lenta
✓ Híbrido ✓ Efectivo
💬 in

Sobre a função

Unleash transformative data solutions — drive innovation at the forefront of cloud-native technologies!Lisbon-based opportunity with hybrid work model (up to 3 days remote per week).

As a Senior Data Engineer, you will be working for our client, a leader in data-driven solutions, focusing on the conception and development of a robust Data Processing platform using Spark in a dynamic and multicultural environment. You will contribute to shaping scalable and efficient data pipelines that empower strategic decision-making and innovation.

Your main responsibilities:Design and develop high-performance data processing applications utilizing Apache Spark in batch mode.

Implement solutions with Java 9+ and Spring frameworks, incorporating modern language features like lambdas, streams, and futures.

  • Collaborate on cloud-native architectures using Docker and Kubernetes to ensure scalable deployment.
  • Optimize performance and troubleshoot complex data workflows, ensuring stability and efficiency.
  • Work with relational databases such as PostgreSQL and Oracle ExaCC, and manage object storage solutions like S3.
  • Contribute to CI/CD pipelines using tools like Maven, GitLab, ArgoCD, and Liquibase to streamline development.
  • Apply best practices in solution design, pattern implementation, and performance tuning.
  • Participate in code reviews and knowledge sharing to foster continuous improvement.

You're ideal for this role if you have:At least 8 years of experience in Java/J2EE development, preferably in Data Processing contexts.

  • Minimum of 1-year hands-on experience with Apache Spark.
  • Strong proficiency with cloud-native applications, Docker, and Kubernetes.
  • Solid understanding of modern Java features, including lambdas, streams, and futures.
  • Experience with transactional SQL and Spark SQL.
  • Knowledge of relational databases like PostgreSQL and Oracle ExaCC.
  • Familiarity with CI/CD tooling such as Maven, GitLab, and Liquibase.
  • Good command of English (fluent) and French (B2 level).
  • It is a strong plus if you have:Experience with Argo Workflow.
  • French language skills at B2 level.
  • Language Required for the role:Fluent English and French.

Eligibility for the role:Only candidates with an existing legal right to work in Europe will be considered for this role.#MAKEYourCareerBETTERInterested? Apply now and include your CV in English or Polish, along with a statement confirming your consent to the processing and storage of your personal data.https:

Detalhes da oferta
TIPO
Efectivo
MODALIDADE
Híbrido
LOCALIDADE
Lisboa
EXPIRA
Agora
A empresa
IT
ITDS Portugal
Ver perfil da empresa
Estatísticas
0
Visualizações
0
Candidaturas