Follows company software development lifecycle to design, code, configure, test, debug, and document system and application programs. Assists in preparing technical design specifications based on functional requirements and analysis documents. Reviews functional requirements, analysis and design documents and provides feedback. Collaborates with other development staff to achieve quality and consistency. Participates in architecture, design and code reviews. Develops and maintains operational and system level documentation.
o Extensive hand-on experience on programming languages: Spark, Python, Unix, NiFi; as well as SQL and NoSQL based technologies.
o Must possess problem-solving and creative thinking ability.
o Experience working with Hadoop-based technologies: HDFS, Yarn, MapReduce, Hive…
o Experience working with Kafka.
o Knowledge of Big Data Frameworks or Hadoop-based technologies.
o Self-motivated and action oriented.
Desired Skills (not required but candidate will have exposure to these skills in this role):
o Java developing skills.
o Analytical capabilities to support Business to improve their processes.
o Strong organizational and documented skills.
o Willingness to collaborate with the other teams.
o Knowledge of visualization tools.