Unleash transformative data solutions — drive innovation through scalable, cutting-edge pipelines!Porto-based opportunity with hybrid work model (up to 3 remote days per week).
As a Senior Data Engineer, you will be working for our client, a leading player in the data engineering and big data landscape. You will be instrumental in designing, developing, and maintaining robust ETL/ELT pipelines, data warehousing solutions, and large-scale data processing systems. Join a forward-thinking team focused on turning complex data into actionable insights and pioneering data-driven strategies for global impact.
Your main responsibilities:Design, develop, test, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources into data warehouses and lakes.
- Configure and manage ETL tools (e.g., Semarchy, Stambia, Talend, DataStage) to automate data integration processes.
- Write and optimize complex SQL queries
- develop and maintain data models (ODS, staging, core analytics schemas).
- Implement data quality checks, lineage tracking, and monitoring to ensure data accuracy, security, and compliance.
- Develop and manage job orchestration workflows using VTOM or similar tools
- troubleshoot failures, monitor job execution, and implement retry strategies.
- Automate operational tasks utilizing UNIX shell scripting and develop reusable scripts for system automation.
Collaborate closely with data architects, analysts, and business stakeholders to translate requirements into scalable data solutions.
- Optimize pipeline performance and scalability, identifying bottlenecks and proposing improvements.
- Ensure adherence to data governance, security policies, and regulations, including data masking and access controls.
- Prepare comprehensive technical documentation, runbooks, and facilitate knowledge transfer.
- You're ideal for this role if you have:5+ years of experience in data engineering or a related field.
- Proven expertise with ETL/ELT tools (Semarchy, Stambia, Talend, DataStage or similar).
- Strong SQL skills and experience with relational databases (Oracle, SQL Server, PostgreSQL, Snowflake).
- Hands-on experience with data modeling and warehousing concepts.
- Familiarity with job orchestration tools (VTOM, Virtual-M or equivalent).
- Knowledge of UNIX/Linux scripting (shell scripting, awk, sed, Python is a plus) to automate tasks.
- Solid understanding of data warehousing, data quality, data lineage, and metadata management.
- Strong problem-solving, debugging, and troubleshooting skills.
- Excellent communication skills in English
- French-speaking ability is a plus.
- Ability to work effectively in a fast-paced environment and collaborate with diverse stakeholders.
- It is a strong plus if you have:Experience with cloud data platforms such as GCP.
- Knowledge of data governance, data cataloging, and security standards.
- Familiarity with big data technologies (Spark, Hadoop).
- Understanding of CI/CD and DevOps practices for data pipelines.
- Language Required for the role:Fluent in English. French language skills are a plus.
Eligibility to work in the EU:Only candidates with an existing legal right to work in Europe will be considered for this role.#MAKEYourCareerBETTERInterested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.https: