Logic Planet is Looking for Data Engineer Hadoop/Big Data Technologies Full Time

Job Description

Job Requirements :- In-depth knowledge of Big Data technologies – Spark, HDFS, Hive, Kudu, Impala- Solid programming experience in Python, Java, Scala, or other statically typed programming language- Production experience in core Hadoop technologies including HDFS, Hive and YARN- Strong working knowledge of SQL and the ability to write, debug, and optimize distributed SQL queries- Having advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases including NOSQL.- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.- Having experience building and optimizing big data data pipelines, architectures and data sets.- Build processes supporting data transformation, data structures, metadata, dependency and workload management.- Excellent attention to detail and communication/presentation skills- Experience in working in a highly collaborative environment with a heavy emphasis on teamwork- Experience in working in Agile scrum methodology- Experience working through all phases of SDLC including Project Management, Business Analysis, Data Analysis, Architecture Design, Development, Testing and Implementation- Having strong project management and organizational skills.- Proficient in process modeling, business process flow and data flow diagrams – Extensive experience working in a data warehouse environment.- Excellent understanding of data warehouse concepts, data marts, Extraction Transformation and Loading (ETL),Autosys, feed processing, batch processing and data modeling – ER diagrams, RDBMS- Expert in SQL for data analysis, data integrity, data accuracy, data mining and data mapping across various database platforms like Oracle and SQL Server,