Job Information
IBM Data Engineer Python - Data Platforms in Cluj, Romania
Introduction
Your role and responsibilities
The successful candidate will be responsible for designing, developing, and maintaining scalable data processing systems, collaborating with cross-functional teams, and ensuring high-quality data. Key responsibilities include:
Designing and developing data processing systems, including ETL processes and databases
Collaborating with data scientists, software engineers, and business stakeholders
Ensuring data quality and integrity through testing, validation, and documentation
Implementing data security measures and adhering to relevant policies and regulations
Monitoring system performance and conducting optimizations
Required technical and professional expertise
Strong scripting skills in languages such as Python
Proven experience as a Data Engineer, preferably in a consulting or banking environment
Proficiency in data management tools and technologies such as SQL, NoSQL databases (e.g., MongoDB, Cassandra) and Big Data frameworks (e.g., Hadoop, Spark)
Design, develop, and maintain scalable data processing systems, including ETL processes, data pipelines, and databases to support AI models.
Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand data needs and translate them into technical solutions.
Preferred technical and professional experience
Experience with cloud platforms (AWS, Azure, Google Cloud)
Familiarity with AI/ML workflows and tools is preferred
Experience with ETL tools (e.g., Apache NiFi, Talend)
Knowledge of data security measures and regulations, particularly in the banking sector
Experience with continuous monitoring and optimization of system performance