Data Engineer
Portugal, PT
Senior (4-6 Years)
Full remote
English Required
Not Accepting Candidates Living Abroad
Skills:
- Proven experience building and maintaining data pipelines for production systems, with demonstrable expertise in ETL/ELT processes and data orchestration.
- Proficiency in SQL and strong understanding of relational and non-relational database systems, including PostgreSQL, MySQL, Redis, and DynamoDB.
- Experience with data warehouse and analytics platforms, such as Snowflake, Redshift, BigQuery, or equivalent cloud data warehouses.
- Demonstrated ability using data pipeline orchestration tools, such as Apache Airflow, AWS Step Functions, Luigi, or equivalent platforms.
- Proficiency in Python for data processing, transformation, and automation scripting.
Experience with big data technologies and distributed processing frameworks, such as Apache Spark, Kafka, Kinesis, or Flink (desirable).
- Familiarity with AWS data services, including S3, Glue, Athena, EMR, Kinesis, Lambda, and RDS.
- Strong understanding of data modeling techniques, including dimensional modeling, normalization, denormalization, and schema design for analytics.
Experience with Infrastructure as Code (IaC) tools such as Terraform, CloudFormation, or Ansible for managing data infrastructure.
Proven ability implementing data quality frameworks, including validation, monitoring, and alerting for data integrity issues.
- Experience with version control systems (Git) and CI/CD pipelines for data pipeline deployment and infrastructure management.
Strong problem-solving and optimization skills, capable of diagnosing and resolving data pipeline performance bottlenecks.
Additional requirements for seniors and leads:
- Extensive experience designing and implementing enterprise-scale data platforms and data lakes.
Proven ability to architect end-to-end data solutions, including ingestion, storage, processing, and consumption layers.
- Demonstrable experience collaborating with Data Scientists, Analytics teams, and Business Intelligence stakeholders, translating requirements into scalable data architectures.
- Strong mentorship skills, supporting junior engineers in developing data engineering expertise and best practices.
Technical environment
- AWS Cloud services, including S3, Glue, Athena, Redshift, EMR, Kinesis, Lambda, Step Functions, and RDS.
- Database systems, including PostgreSQL, MySQL, Redis, - ElasticSearch, and DynamoDB.
Data orchestration platforms such as Apache Airflow or AWS Step Functions.
- Data processing frameworks including Apache Spark, Kafka, and Python-based ETL libraries (Pandas, PySpark).
- Business intelligence and visualization tools such as Tableau, Looker, or Grafana.
- Monitoring and observability platforms such as DataDog, CloudWatch, and Grafana.
- Version control and CI/CD tools including GitHub, Bitbucket, and automated deployment pipelines.
- Proven experience building and maintaining data pipelines for production systems, with demonstrable expertise in ETL/ELT processes and data orchestration.
- Proficiency in SQL and strong understanding of relational and non-relational database systems, including PostgreSQL, MySQL, Redis, and DynamoDB.
- Experience with data warehouse and analytics platforms, such as Snowflake, Redshift, BigQuery, or equivalent cloud data warehouses.
- Demonstrated ability using data pipeline orchestration tools, such as Apache Airflow, AWS Step Functions, Luigi, or equivalent platforms.
- Proficiency in Python for data processing, transformation, and automation scripting.
Experience with big data technologies and distributed processing frameworks, such as Apache Spark, Kafka, Kinesis, or Flink (desirable).
- Familiarity with AWS data services, including S3, Glue, Athena, EMR, Kinesis, Lambda, and RDS.
- Strong understanding of data modeling techniques, including dimensional modeling, normalization, denormalization, and schema design for analytics.
Experience with Infrastructure as Code (IaC) tools such as Terraform, CloudFormation, or Ansible for managing data infrastructure.
Proven ability implementing data quality frameworks, including validation, monitoring, and alerting for data integrity issues.
- Experience with version control systems (Git) and CI/CD pipelines for data pipeline deployment and infrastructure management.
Strong problem-solving and optimization skills, capable of diagnosing and resolving data pipeline performance bottlenecks.
Additional requirements for seniors and leads:
- Extensive experience designing and implementing enterprise-scale data platforms and data lakes.
Proven ability to architect end-to-end data solutions, including ingestion, storage, processing, and consumption layers.
- Demonstrable experience collaborating with Data Scientists, Analytics teams, and Business Intelligence stakeholders, translating requirements into scalable data architectures.
- Strong mentorship skills, supporting junior engineers in developing data engineering expertise and best practices.
Technical environment
- AWS Cloud services, including S3, Glue, Athena, Redshift, EMR, Kinesis, Lambda, Step Functions, and RDS.
- Database systems, including PostgreSQL, MySQL, Redis, - ElasticSearch, and DynamoDB.
Data orchestration platforms such as Apache Airflow or AWS Step Functions.
- Data processing frameworks including Apache Spark, Kafka, and Python-based ETL libraries (Pandas, PySpark).
- Business intelligence and visualization tools such as Tableau, Looker, or Grafana.
- Monitoring and observability platforms such as DataDog, CloudWatch, and Grafana.
- Version control and CI/CD tools including GitHub, Bitbucket, and automated deployment pipelines.
We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in-house specialists - our People Experience Partners - to guide them through our journey with us.
What we offer:
What we offer:
- A project that matches your skills and ambitions, as well as your preferences for working policies and culture.
- A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income.
- An empowering and respectful work culture enriched with social and learning events.
- A People Experience Partner specially assigned to you - your go-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work-life balance at KWAN.
At KWAN, they make sure that I feel comfortable with the client I’m working for and that what I’m doing aligns with my career aspirations.
Luis Caldeira, DevOps @ KWAN
At KWAN, I’m given the space to be myself and do what I love. I have control over the projects I work on, as well as the direction of my career.
Pedro Fonseca, Front End Developer @ KWAN
I see my People Experience Partner as someone who is always available to provide me with motivation and constant feedback, which helps me be sure that I am in the right place.
Josimar dos Reis, Software Developer @ KWAN
I know that I’ve contributed to the growth of a company that truly values a “people first culture”, because my ideas, experiences, and individuality were always appreciated.
João Nascimento, Software Developer (KWAN Alumni)
My two years at KWAN were an incredible experience! From the start, I was welcomed into a warm and collaborative environment where I felt truly supported.
Laís Ortiz, Software Developer @ (KWAN Alumni)
Grab this opportunity, apply now!
What You Can Expect as a KWANer
Respect isn’t optional here
Dedicated People Experience Partner
Someone accountable for your growth, not your allocation.
Continuous learning, built in
Recognition that’s visible
A culture you can feel
Flexible spaces to work your way
Didn't find your mission yet?
Strong profiles don’t always match timing. That doesn’t mean there isn’t alignment.
We review every application. If there’s alignment, we won’t let it get lost in a database.