نظرة عامة على الوظيفة
- مستوي الخبرة
- +1 سنة
- نوع العمل
- دوام كامل
- نوع مكان العمل
- Not specified
- الموقع
- القاهرة
- Job function
- Not specified
- اخر موعد للتقديم
- 29 ديسمبر 2024
عن الوظيفة
Data Transformation and Integration: Perform data transformation and integration tasks to ensure data from various sources are accurately processed and made ready for annotation projects and for delivery to clients per client requirements. Data Manipulation: Ensuring efficient data storage, retrieval, and optimization to support data annotation workflows. Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy, consistency, and integrity of data used in annotation projects. Data Pipeline Design and Development: Collaborate with the Data Engineering team to design and implement robust and scalable data pipelines for importing and exporting data used in our data annotation projects. Performance Optimization: Identify and address performance bottlenecks in data pipelines to enhance the speed and efficiency of data import and export processes. Automation and Process Improvement: Continuously seek opportunities to automate manual processes and improve data annotation workflows for increased productivity. Collaboration and Communication: Work closely with cross-functional teams, including data annotation teams, backend developers, and project managers, to understand project requirements and provide timely data support. Documentation: Maintain comprehensive documentation of data pipelines, processes, and data structures to facilitate knowledge sharing and seamless project handovers. Troubleshooting and Support: Address and resolve data-related issues, providing technical support to data annotation teams when required. Stay Updated on Emerging Technologies: Stay abreast of industry trends, tools, and technologies related to data engineering, and propose innovative solutions for data annotation projects.
المتطلبات
Bachelor’s degree in computer science, Data Engineering, or a related field. Proven experience as a Data Engineer, with 1-3 years of hands-on experience in data pipeline design, data transformation, and data integration. Proficiency in programming languages such as Python, SQL, or Scala, and experience with data manipulation libraries and frameworks. Solid knowledge of data storage and database management systems, including relational and NoSQL databases. Familiarity with data visualization tools and techniques to facilitate data understanding and analysis. Experience with cloud-based data platforms, such as AWS, GCP, or Azure, is a plus. Solid understanding of data quality and data governance principles. Knowledge and experience with machine learning projects a big plus. Strong problem-solving skills with a keen eye for detail. Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment. A passion for data engineering and a desire to contribute to impactful data annotation projects.