Data Engineer - Python + GCP

Lisbon, Portugal; Porto, Portugal

Specialist (5+ Years)

Hybrid

English Required Not Accepting Candidates Living Abroad

Data Engineer with strong Python development skills and practical experience with Google Cloud Platform (GCP). The ideal consultant will design, build, and maintain scalable data pipelines and data platforms to enable data-driven decision making. A demonstrated interest in testing (including UAT and QA testing) and familiarity with orchestration tools such as Control-M are pluses. French language proficiency (minimum B2) is required to collaborate with our French-speaking teams and stakeholders.

Key Responsibilities

Design, develop, and maintain end-to-end data pipelines (ELT/ETL) to ingest, process, and store large volumes of data from diverse sources.
Build robust data models and schemas (data warehouse/data lake) on GCP using BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, and related services.
Develop in Python to implement data transformations, orchestration, automation tasks, and data quality checks.
Integrate testing into the data engineering lifecycle, including planning and executing testing activities (UAT/QA), validating data correctness, and ensuring release-ready pipelines.
Collaborate with Data Engineers, Data Scientists, Analysts, and Business Stakeholders to understand data needs and deliver solutions.
Leverage and/or implement data quality, monitoring, logging, and alerting to ensure data reliability.
Ensure data governance, security, privacy, and compliance requirements are met (IAM, encryption, access controls).
Create and maintain technical documentation, data dictionaries, runbooks, and test plans.
Participate in code reviews, testing, and Agile/Scrum ceremonies.
Stay current with GCP offerings and best practices; advocate for cloud-native data engineering patterns.
Optional but valued: experience with Control-M or other job orchestration tools; familiarity with CI/CD for data pipelines.
Qualifications

Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field (or equivalent practical experience).
3+ years of professional data engineering experience.
Strong Python development skills (design patterns, testing, packaging, performance considerations).
Practical experience with Google Cloud Platform (BigQuery, Cloud Storage, Dataflow/Beam, Dataproc, Pub/Sub, Cloud Composer/Airflow) and SQL.
Hands-on experience building and maintaining data pipelines, data lakes, or data warehouses.
Proficiency with ETL/ELT concepts, data modeling, and schema design (star/snowflake schemas, normalization).
Familiarity with data orchestration tools (Airflow/Cloud Composer) and CI/CD for data pipelines.
Experience with version control (Git) and collaboration tooling.
French language proficiency at least B2 (speaking, reading, and writing) to communicate with French-speaking stakeholders and teams.
Exposure to testing practices: UAT, QA testing, test planning, data validations, and test automation is highly desirable.
Excellent problem-solving skills, attention to detail, and ability to work autonomously as well as in a team.
Optional but valued: experience with Spark/Databricks, Control-M or other enterprise scheduling tools, BI/Analytics tools, and data privacy regulations (GDPR/CCPA).
Nice-to-Haves

Certification or strong working knowledge of GCP (e.g., Professional Data Engineer).
Experience with streaming data (Kafka, Pub/Sub) and real-time analytics.
Knowledge of data visualization and BI tools (Looker, Tableau, Power BI).
Experience in regulated industries (finance, healthcare, telecom) and related data governance.
Soft Skills

Proficient communication in English
Collaborative mindset with the ability to explain complex technical concepts to non-technical stakeholders.
Proactive, with strong documentation habits and the ability to manage multiple priorities.

We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in-house specialists - our People Experience Partners - to guide them through our journey with us.

What we offer:

A project that matches your skills and ambitions, as well as your preferences for working policies and culture.
A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income.
An empowering and respectful work culture enriched with social and learning events.
A People Experience Partner specially assigned to you - your go-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work-life balance at KWAN.

At KWAN, they make sure that I feel comfortable with the client I’m working for and that what I’m doing aligns with my career aspirations.

Luis Caldeira, DevOps @ KWAN

At KWAN, I’m given the space to be myself and do what I love. I have control over the projects I work on, as well as the direction of my career.

Pedro Fonseca, Front End Developer @ KWAN

I see my People Experience Partner as someone who is always available to provide me with motivation and constant feedback, which helps me be sure that I am in the right place.

Josimar dos Reis, Software Developer @ KWAN

I know that I’ve contributed to the growth of a company that truly values a “people first culture”, because my ideas, experiences, and individuality were always appreciated.

João Nascimento, Software Developer (KWAN Alumni)

My two years at KWAN were an incredible experience! From the start, I was welcomed into a warm and collaborative environment where I felt truly supported.

Laís Ortiz, Software Developer @ (KWAN Alumni)

Grab this opportunity, apply now!