Functieomschrijving
Data Platform Engineer | Video, Data & ML | Python
Apply below after reading through all the details and supporting information regarding this job opportunity.
Contract - Excellent Rates - Hybrid
Build the data platform powering the next generation of automotive AI.
We're looking for a Data Platform Engineer to own the end-to-end platform managing a large and growing collection of video data used for Machine Learning.
You'll replace ad-hoc file sharing and manual processes with a governed, automated and reproducible data platform covering ingestion, storage, metadata, dataset versioning, GDPR/consent management, processing pipelines and reporting.
What You'll Do
- Build automated video ingestion and processing pipelines, including validation, metadata extraction and deduplication
- Design robust relational data models and metadata catalogues
- Implement GDPR and consent management, audit trails, retention and automated notifications
- Establish dataset versioning and reproducibility across ML experiments
- Build APIs and interfaces for data input, browsing and management
- Develop dashboards covering data quality, dataset usage, compliance and operational metrics
- Ensure traceability aligns with ASPICE and integrate with Codebeamer
- Deploy and operate the platform securely, including appropriate isolation of sensitive data
- Occasionally support data collection and in-car testing
What We're Looking For
- Strong Data Engineering and data pipeline xlxgzvr experience
- Excellent relational database design and modelling skills
- Strong Python for automation, pipelines and API development
- Experience handling large media/binary datasets and object storage
- Experience building data dashboards and reporting
- Practical understanding of GDPR, PII, consent and data retention
- Understanding of ML dataset lifecycles and visual-data workflows
- Excellent communication and collaboration skills