We are looking for a Data Engineer on behalf of our client company with offices in Belgium.
Responsibilities:
- Conceive and build data architectures.
- Participate in the short/mid/long term vision of the overall system.
- Execute ETL (extract/transform/load) processes from complex and/or large data sets.
- Ensure data are easily accessible and that their exploitation is performing as requested, even in highly scalable circumstances.
- Participate to the architecture and planning of the big data platform to optimize the ecosystem’s performances.
- Create large data warehouses fit for further reporting or advanced analytics.
- Collaborate with machine learning engineers for the implementation and deployment of different solutions.
- Ensure robust CI/CD processes are in place.
Requirements:
- A master’s in informatics, Engineering, Mathematics, or related field
- Demonstrable experience with big data platforms (Hadoop, Cloudera, EMR, Databricks,. . )
- Data pipeline management
- Cluster management
- Workflow management ( Oozie, Airflow)
- Database management of SQL and noSQL databases
- Large file storage (HDFS, Data Lake, S3, Blob storage,)
- Strong knowledge of Hadoop ecosystem: Hortonworks/Cloudera/EMR
- Strong knowledge of Java/Scala and Python
- Strong knowledge of Spark (Scala and Pyspark)
- Strong knowledge of CI/CD concepts
- Stream processing such as Kafka, Kinesis, Elisticsearch
- Good knowledge of a cloud environment
- High level understanding of data science concepts
- Knowledge of Data Visualisation framework like QlikSense is a plus
Your Profile:
- You are quality oriented.
- You are multi-disciplined ability to work with divers’ APIs and understand multiple languages well enough to work with them.
- You are an excellent problem analyzer and solver.
- You’re open minded, collaborative, team player, ready to adapt to the changing needs
- Curiosity about new techniques and tools, eagerness to always keep learning.
- You are committed to deliver, pragmatic and solution oriented.
- Experience in telecom and/or financial sector is a plus.
- Experience with an agile way of working is a plus.
- Languages: English (very good in reading, writing, speaking) is a must
DK Global Recruitment is a multilingual recruitment agency, based in Dublin, Ireland. We specialize in finding European language-speaking jobs for job seekers in many European countries. With years of experience in the multilingual BPO sector. Our fully-trained expert recruiters help and advise job seekers throughout the recruitment process, and always treat the candidate as a high priority.
Our clients are highly-reputed companies with constant growth in the international market and we are pleased to find good employees for them. Thus, you should not hesitate to contact us regarding any kind of queries you have, related to jobs and career advice.
Why use a Recruitment Agency
You are given extra support in preparing for interviews
You have a contact person who gives you all the details of the job
You can ask for your application feedback anytime via email or phone
You don’t have to face the situation where company do not reply to you for days
All our services to job seekers are free of charge. We also offer bonus scheme to candidates
Note: Applying to this job advertisement would be considered as GDPR consent given to DK Global Recruitment. We may share your profile details directly with hiring company for initial screening of your profile suitability and duplicate check.