T&O Workplace - Data Engineer - BigData DH036528
Porto, Portugal
Senior (4-6 Years)
Hybrid
English Required
Years of xp:
• 5+ years
Main Tasks & Responsibilities:
• Develop Datalake pipelines using Python and PySpark.
• Analyze requirements and propose Architecture Solutions in within our Datalake;
• Gather, document, examine and manage application requirements in an Agile environment;
• Implement from basic to complex use cases, bring efficiency and promoting automation;
• Maintain existing processes and support other users’ technical needs;
• Work closely with business users, business analysts, data engineers and developers to deliver data driven solutions.
Mandatory Technical Requirements:
• At least 4 years of Experience in BigData and NoSQL Technology (Hadoop, HDFS, Hive, Kerberos, Starburst) at professional level;
• Experience with VisualSudio Code or similar frameworks
• Experience with Python and Pyspark (Spark is a plus);
• Knowledge on Data Modeling principles and SQL;
• Familiarity with DevOps concepts
• Source Code Management (Git)
• Build - Jenkins
• Deploy - XL Deploy and XL Release
Mandatory non-Technical requirements :
• Good level of English - minimum B2 (mandatory);
• Analytical mindset, to identify patterns, trends, seasonality and other data behaviors;
• Clearly communicate data insights, findings and results to internal and external stakeholders;
• Able to be quickly autonomous, proactive;
• Experience in agile methodologies and tools (Scrum/Kanban)
• Ability to work in an international and distributed team;
• Autonomy, organization and prioritizing skills;
• Willingness to learn and share knowledge;
• Innovative thinking and proactive attitude;
• Availability to travel abroad for short periods of time, as required.
Nice to Have / Plus:
• Optimization and performance improvement experience will be a plus (Shell Script; Execution plan)
• Knowledge in PowerBI, PowerApps and PowerAutomate;
• Microsoft Certifications: PL-100, PL-200, PL-300, PL-400, PL-500, PL-600, PL-700, PL-900 or DP-X00
• Administration of SharePoint Online and Dataverse Environments;
• Experience with Rest API’s;
• SSAS, SSIS and Azure;
• French is highly valued.
• 5+ years
Main Tasks & Responsibilities:
• Develop Datalake pipelines using Python and PySpark.
• Analyze requirements and propose Architecture Solutions in within our Datalake;
• Gather, document, examine and manage application requirements in an Agile environment;
• Implement from basic to complex use cases, bring efficiency and promoting automation;
• Maintain existing processes and support other users’ technical needs;
• Work closely with business users, business analysts, data engineers and developers to deliver data driven solutions.
Mandatory Technical Requirements:
• At least 4 years of Experience in BigData and NoSQL Technology (Hadoop, HDFS, Hive, Kerberos, Starburst) at professional level;
• Experience with VisualSudio Code or similar frameworks
• Experience with Python and Pyspark (Spark is a plus);
• Knowledge on Data Modeling principles and SQL;
• Familiarity with DevOps concepts
• Source Code Management (Git)
• Build - Jenkins
• Deploy - XL Deploy and XL Release
Mandatory non-Technical requirements :
• Good level of English - minimum B2 (mandatory);
• Analytical mindset, to identify patterns, trends, seasonality and other data behaviors;
• Clearly communicate data insights, findings and results to internal and external stakeholders;
• Able to be quickly autonomous, proactive;
• Experience in agile methodologies and tools (Scrum/Kanban)
• Ability to work in an international and distributed team;
• Autonomy, organization and prioritizing skills;
• Willingness to learn and share knowledge;
• Innovative thinking and proactive attitude;
• Availability to travel abroad for short periods of time, as required.
Nice to Have / Plus:
• Optimization and performance improvement experience will be a plus (Shell Script; Execution plan)
• Knowledge in PowerBI, PowerApps and PowerAutomate;
• Microsoft Certifications: PL-100, PL-200, PL-300, PL-400, PL-500, PL-600, PL-700, PL-900 or DP-X00
• Administration of SharePoint Online and Dataverse Environments;
• Experience with Rest API’s;
• SSAS, SSIS and Azure;
• French is highly valued.
We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in-house specialists - our People Experience Partners - to guide them through our journey with us.
What we offer:
What we offer:
- A project that matches your skills and ambitions, as well as your preferences for working policies and culture.
- A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income.
- An empowering and respectful work culture enriched with social and learning events.
- A People Experience Partner specially assigned to you - your go-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work-life balance at KWAN.
At KWAN, they make sure that I feel comfortable with the client I’m working for and that what I’m doing aligns with my career aspirations.
Luis Caldeira, DevOps @ KWAN
At KWAN, I’m given the space to be myself and do what I love. I have control over the projects I work on, as well as the direction of my career.
Pedro Fonseca, Front End Developer @ KWAN
I see my People Experience Partner as someone who is always available to provide me with motivation and constant feedback, which helps me be sure that I am in the right place.
Josimar dos Reis, Software Developer @ KWAN
I know that I’ve contributed to the growth of a company that truly values a “people first culture”, because my ideas, experiences, and individuality were always appreciated.
João Nascimento, Software Developer (KWAN Alumni)
My two years at KWAN were an incredible experience! From the start, I was welcomed into a warm and collaborative environment where I felt truly supported.
Laís Ortiz, Software Developer @ (KWAN Alumni)
Grab this opportunity, apply now!
What You Can Expect as a KWANer
Respect isn’t optional here
Dedicated People Experience Partner
Someone accountable for your growth, not your allocation.
Continuous learning, built in
Recognition that’s visible
A culture you can feel
Flexible spaces to work your way
Didn't find your mission yet?
Strong profiles don’t always match timing. That doesn’t mean there isn’t alignment.
We review every application. If there’s alignment, we won’t let it get lost in a database.