Freelance · ExpertRemote
Senior Data Engineer – AI Discovery Pilot Project (m/f/d)
This project is no longer advertised.
You will find similar open projects below. You can also submit your CV without reference to a project.
Key facts
- Start
- [Start]
- Duration
- [Duration]
- Work mode
- Remote
- Location
- Germany (remote)
- Workload
- 100 %
- Contract type
- Freelance · Expert
Project description
A company in the rail infrastructure/mobility sector is seeking a Senior Data Engineer for an AI pilot project to develop and operate the underlying data pipelines and cloud infrastructure.
Responsibilities
- Implementation of data pipelines for ingesting, processing, and delivering structured and unstructured data for a pilot application in an AWS environment
- Implementation of tests, validation mechanisms, and monitoring functions for data pipelines and the target application
- Analysis and resolution of technical issues (DevOps)
- Setup, further development, and operation of CI/CD pipelines for the automated deployment of software components
- Execution of deployments, version management, and release support for the technical solution components
- Configuration and optimization of cloud and platform resources to ensure stable and high-performance operation
- Implementation of non-functional requirements regarding logging, monitoring, traceability, and operational security
- Creating and maintaining technical documentation on data flows, pipelines, deployments, and operational processes
- Close coordination with AI and data science colleagues to ensure the productive deployment and integration of developed models
Requirements
Must-have
These criteria are required for the project.
- Practical experience in the design, development, and deployment of AI systems and LLM solutions, including vector databases and MLOps/observability processes (e.g., AWS Bedrock)
- Several years of experience in software and backend development using Python, REST APIs (e.g., FastAPI), and databases
- Cloud & DevOps experience: AWS infrastructure, containerization (Docker), CI/CD, Infrastructure-as-Code (Terraform or AWS CDK/CloudFormation)
- Experience developing production-ready web interfaces with JavaScript/TypeScript based on Figma wireframes
- Experience with large data sets, as well as data cleaning, transformation, and preparation using Python and SQL
- Practical experience in agile software development (Scrum/Kanban/SAFe), including structured technical documentation
Nice-to-have
Not required, but a plus for your application.
- Project experience in the field of rail transportation or mobility companies
- Experience implementing IT security standards in enterprise environments (e.g., OIDC/SSO such as Azure AD/Entra ID, secrets management, TLS/CORS, GDPR compliance)
Skills
- Python
- LLM
- FastAPI
- AWS
- Terraform
- SQL
More projects
-
-
Pharma, Medical Technology & Life Sciences
Senior Design Validation Engineer – Medical Device Software (m/f/d)
-
Pharma, Medical Technology & Life Sciences
Senior Risk Management Engineer – Medical Device Software (m/f/d)
-
Senior Consultant, Customer Service Optimization, France (Fluent in French) – (m/f/d)
-
Industry, Machinery & Plant Engineering
Marketo Campaign Manager, B2B (m/f/d)
-
Interim Account Executive – Health IT Enterprise Sales (m/f/d)
-
Energy Management / Energy Procurement Specialist for Energy Utilities (m/f/d)
-
Shop Floor Expert, Assembly Task Force – Polish-speaking (m/f/d)
-
Microsoft 365 Tenant-to-Tenant Migration (m/f/d)
No matching project?
Submit your CV without reference to a project, so we know your profile when a matching project comes in.