Hadoop SME / Developer at Croyant Technologies Pvt Ltd

Job Title: Hadoop SME / Developer

Role Description:

This position is for a Hadoop-HBase SME who will be working on a large and complex Hadoop-HBase to Teradata migration project. Good experience of the Hadoop ecosystem will be a key competency for this position.

Minimum Requirements:

· Total IT experience of 10+ years.

· Minimum 5 years of relevant experience using key Hadoop services

· Minimum 6 months of hands-on Hbase experience

· Solid understanding of how structured data is stored and accessed in HBase, and metadata can be linked with the RDBMS to migrate the data.

· Data Integration experience is required

· Knowledge of following Hadoop components are required: HDFS, HBase, Solr, Spark, Hive.

· Experience in unstructured data processing and validation such as documents, images and text.

· Worked and developed data ingestion pipelines in Hadoop for unstructured data.

· Good hands-on experience in programming language like Java, Python, Scala and Bash scripting.

· Understanding of how Solr text search works.

· Experience in migrating, storing and retrieving data in object stores like AWS S3, and Azure Blob.

· Should be able to communicate effectively with customers and prospects.

Nice to have Experience:

· Working experience with AWS integration services like AWS Glue and Athena.

· Good Experience in Teradata Vantage SQL

· Experience with any database migration would be added plus