Talent.com
Deze vacature is niet beschikbaar in je land.
Data Engineer

Data Engineer

Uni SystemsBrussels, Brussels, BE
30+ dagen geleden
Vacaturetype
  • Quick Apply
Functieomschrijving

At Uni Systems, we are working towards turning digital visions into reality. We are continuously growing and we are looking for a Data Engineer to join our UniQue team.

What will you be bringing to the team?

  • Design, implement, and maintain scalable data pipelines sourcing data from REST APIs using Python, PySpark, SQL, and ETL tools such as Azure Synapse for data ingestion, transformation, and preparation.
  • Process and convert complex JSON and GIS data into structured, analysis-ready datasets by parsing, transforming, and validating content to ensure high data quality and consistency.
  • Manage the loading and organization of processed data into Azure Data Lake Storage, ensuring optimal accessibility and performance.
  • Create and maintain comprehensive documentation for ETL processes, including metadata definitions, data lineage, and technical specifications to support transparency and future reusability.
  • Collaborate closely with data analysts, BI developers, and business stakeholders to gather data requirements and deliver reliable, well-documented datasets tailored to organizational objectives.
  • Integrate data quality controls, logging mechanisms, and monitoring features within pipelines to ensure maintainability and effective troubleshooting.

Requirements

What do you need to succeed in this position?

  • Bachelor Degree with minimum 17 years of general IT experience (or Master Degree with minimum 13 years of experience).
  • Minimum of 5 years of proven expertise with Azure Data Lake Storage and Oracle databases.
  • At least 5 years of hands-on experience in developing data pipelines from REST APIs and integrating data using PySpark, Python, Azure Synapse, and SQL.
  • Strong proficiency in processing JSON and GIS data, with a minimum of 5 years of relevant experience.
  • Excellent command of data engineering tools, including Python, PySpark, and Azure Synapse Analytics.
  • Ability to design and implement robust data quality checks, logging, and monitoring mechanisms within ETL workflows.
  • Strong skills in documenting ETL workflows, metadata definitions, and technical specifications in a clear and consistent manner.
  • Familiarity with DevOps principles and version control best practices; experience working with CI / CD pipelines.
  • Prior experience working within Agile and Scrum methodologies.
  • Microsoft Azure Data Engineer Associate Certification is required.
  • Microsoft Certified : Azure Solutions Architect Expert, Azure Developer Associate, Azure Database Administrator Associate will be an advantage.
  • An excellent command of the English language, corresponding to at least level C1 (French will be an advantage).
    • Maak een vacature-alert aan voor deze zoekopdracht

    Data Engineer • Brussels, Brussels, BE