Big Data Specialist (M/F)

Oferta de emprego publicado há .

• Lisboa
• Full-time
• Database Administrator

Responsibilities

Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities

Implementing ETL process

Monitoring performance and advising any necessary infrastructure changes

Defining data retention policies

Requirements

Proficient understanding of distributed computing principles

Management of Hadoop cluster, with all included services

Ability to solve any ongoing issues with operating the cluster

Proficiency with Hadoop v2, MapReduce, HDFS

Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala

Experience with Spark

Experience with integration of data from multiple data sources

Experience with NoSQL databases, such as DynamoDB, Cassandra, MongoDB

Experience with various messaging systems, such as Kafka or RabbitMQ

Good understanding of Lambda Architecture, along with its advantages and drawbacks

BSc degree in Computer Science or relevant field