Data Engineer

At Uni Systems, we are working towards turning digital visions into reality. We are continuously growing and we are looking for a Data Engineer to join our UniQue team.

What will you be bringing to the team?

• Design, implement, and maintain scalable data pipelines sourcing data from REST APIs using Python, PySpark, SQL, and ETL tools such as Azure Synapse for data ingestion, transformation, and preparation.
• Process and convert complex JSON and GIS data into structured, analysis-ready datasets by parsing, transforming, and validating content to ensure high data quality and consistency.
• Manage the loading and organization of processed data into Azure Data Lake Storage, ensuring optimal accessibility and performance.
• Create and maintain comprehensive documentation for ETL processes, including metadata definitions, data lineage, and technical specifications to support transparency and future reusability.
• Collaborate closely with data analysts, BI developers, and business stakeholders to gather data requirements and deliver reliable, well-documented datasets tailored to organizational objectives.
• Integrate data quality controls, logging mechanisms, and monitoring features within pipelines to ensure maintainability and effective troubleshooting.

Requirements

What do you need to succeed in this position?