Data Engineer
Manpower is seeking a talented and motivated Data Engineer to join our Client's dynamic Data Engineering team. In this role, you will play a pivotal part in designing, developing, and maintaining our data infrastructure.
This is an exciting opportunity to be at the forefront of building and evolving a brand-new data lake house from scratch a rare learning experience for professional growth. Additionally, the role provides invaluable exposure to the telecommunications industry, offering a wealth of knowledge and hands-on experience.
Key responsibilities
- Gain a deep understanding of the companys diverse data sources to design, build, and maintain reliable data pipelines and processes.
- Collaborate with analysts to understand data requirements and translate them into technical solutions.
- Design, build, and maintain the data warehouse, data lakehouse, and other data repositories.
- Optimise and create new data pipelines to ensure performance, scalability, and reliability.
- Ensure data quality and integrity through validation and cleansing processes.
- Implement data security and privacy best practices across all systems.
- Learn and gain hands-on experience with the existing data warehouse environment.
- Provide 24/7 support for data infrastructure and pipelines as part of an on-call rotation.
- Stay up-to-date with the latest advancements in data technologies and AI foundations to help lay the groundwork for AI-driven solutions.
Tech stack
- Languages: Linux shell scripting, Python, Bash with PL/SQL.
- ETL/ELT Tools: Oracle, Airflow, dbt, PySpark, Dremio, Talend.
- Databases: Oracle, PostgreSQL, MariaDB, and Iceberg tables (e.g., Parquet).
- Storage Systems: AWS S3 and other modern data lakes.
- Development Tools: GitLab, Docker, VSCode.
- BI Reporting: SAP BusinessObjects, Power BI.
- Collaboration Tools: JIRA, Confluence, SharePoint.
Behaviour and competencies
- Strong ability to analyse and solve complex problems by identifying requirements and developing effective solutions.
- Self-starter who can work independently and take initiative.
- Effective team player who thrives in collaborative environments.
- Rapid learner with the ability to acquire new knowledge and skills quickly.
- Strong planning and prioritisation skills to manage multiple tasks effectively.
- Creative thinker with strong problem-solving abilities.
- Curiosity for data and enthusiasm for building foundations for AI technologies.
Credentials and experience
- Bachelors degree in Computer Science, Engineering, or a related field.
- 2+ years of experience as a Data Engineer or similar role.
- Strong proficiency in SQL and Python.
- Hands-on experience with data warehousing and data lake technologies (e.g., Dremio, Snowflake, Databricks, AWS S3).
- Familiarity with cloud platforms and container orchestration (e.g., Kubernetes).
- Experience with data tools like Airflow, dbt, and Python libraries.
- Solid understanding of data modelling, data warehousing, and data lakehouse concepts.
- Experience with Linux operating systems is an asset.
- Knowledge of telecommunications and database administration is a plus.
- Strong analytical skills with a problem-solving mindset.
- Excellent communication and collaboration abilities.
Benefits
- Hybrid and flexible work environment
- Modern open-plan office space
- Health insurance
- Free company services
- Free parking
- Social events and team-building activities
- Referral program with paid compensation