Ready
to boost your career?
Junior
Professional
Senior
Job Specification
Seargin is looking for a Big Data Engineer
- Position: Big Data Engineer
- Technologies: Python, Hadoop ecosystem, Kafka, REST API
- Location: Warsaw / remote
- Country: Poland
- Area: Project
- Form of employment: Permanent
- Experience Level: Mid / Senior
The main tasks for the Big Data Engineer will be:
- Creating data pipelines in the Big Data technology stack using Python (PySpark, Hadoop/HDFS, Kafka)
- Providing deployment of the connection to new source systems (e.g. Kafka, relational databases, REST API based services or file based data sources)
- Assuring that implemented artefacts are covered by automated tests and are integrated in our CI/CD pipeline
- Supporting the development lead in defining the development roadmap and breaking it down into user stories
- Supporting the implementation of a generic ETL framework using Python including test automatization
The Candidate should have:
- Working background in Python and relevant packages/frameworks in the area of Data Engineering (PySpark, PyTest)
- Good experience in
- Hadoop ecosystem as a developer (Spark, HDFS, Hive/Impala, Kafka)
- Common interfaces to data sources and data formats (Kafka, REST API, relational databases, file shares, JSON, Protocol Buffers, Parquet, JSON)
- Knowledge of
- CI/CD toolchains (GIT, Jenkins)
- Relational databases and usage of SQL
- Ability to
- Taking responsibility for deliverables during the phases of build & run in a DevOps team
- Being proactive, supportive and open for new approaches
- Contributing own ideas for technical and organizational enhancements
- Team-oriented, detail-oriented, efficient, and solution-oriented attitude
- Superb analytical and problem-solving skills
- Excellent communication and interpersonal skills
- Flexibility and ability to work independently and in a team
- Great English skills (written and spoken)
The Candidate can expect:
- Permanent Contract
- Challenging job in an international and multilingual environment
- Professional development
- Attractive and competitive compensation
- Flexible working hours with a home office also after the pandemic
- Referral Bonus Program
- Copyright costs for IT employees
- Canteen in the office with subsidized lunches
- A comprehensive working environment, professional support, and the opportunity to exchange knowledge and best practices
- Wide access to professional training, conferences, and webinars
- Language courses
- Private medical care and life insurance
- Multisport card and sports teams
- Number of benefits for families (for instance summer camps for kids)
- Public holidays on the 24 and 31 December
- Discounts for Company products
If you meet the requirements described above, please send your application in English (.doc) at gabriela.walczak@seargin.com, stating the name of the position in a subject and/or call +(48) 451 174 498.
Only applications from candidates residing in Poland will be considered, including those who need a work permit.
ABOUT COMPANY
Company size: 500+
Main location:Poland
READY TO JOIN IT REVOLUTION?
Send us a message using the contact form below.
I'm a Client looking for an IT Expert or a Professional Team
I'm an IT Expert looking for a great job / project opportunity