Big Data Engineer

Big Data Engineers are responsible for the design and development of an organization's big data infrastructure. They work closely with data scientists and other stakeholders to transform raw data into useful data systems.

Job Brief:

Big Data Engineers are responsible for the design and development of an organization's big data infrastructure. They work closely with data scientists and other stakeholders to transform raw data into useful data systems.

Roles & Responsibilities:
  • Develop, maintain, and test big data solutions.
  • Collaborate with data architects and IT team to integrate big data tools with the existing software.
  • Assist data scientists and stakeholders with data-related technical issues.
  • Build high-performance algorithms and prototypes.
Key Soft Skills:
  • Excellent analytical and problem-solving skills.
  • Strong teamwork and communication skills.
  • Attention to detail and a high level of accuracy.
Core Skills:
  • Proficiency in Hadoop-based technologies such as Hive, Hbase, and Flume.
  • Experience with data mining and stream processing technologies (Kafka, Spark, etc.)
  • Knowledge of big data querying tools, such as Pig and Hive.
Keywords:

Big Data

Hadoop

Hive

Hbase

Flume

Kafka

Spark

Pig

Data Mining