Job Title: Sr. Hadoop Architect / Big data Architect
Location: REMOTE
Duration: 12+ Months (possible extensions)
Job Description
Must Haves
Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must.
Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must.
4-5 experience building data pipelines using Hadoop components Sqoop, Hive, Solr, MR, Impala, Spark, Spark SQL., HBase.
4-5 years of programming experience in Python, Java and Scala is must.
Strong experience with REST API development using Python frameworks (Django, Flask etc.)
Micro Services/Web service development experience using Spring framework is highly desirable
The Big Data Engineer shall lead the Big Data Engineering team. The consultant will play the role of technical lead and provide professional services to support the long term IT strategy and planning to include high level analysis, professional reports and presentations, and mentoring, support and training.
A. Deliverables or Tasks:
Provide vision, gather requirements and translate client user requirements into technical architecture.
Design and implement an integrated Big Data platform and analytics solution
Design and implement data collectors to collect and transport data to the Big Data Platform.
4. Implement monitoring solution(s) for the Big Data platform to monitor health on the infrastructure
Technical Knowledge and Skills:
4-5 years of programming experience in Python, Java and Scala is must.
Strong experience with REST API development using Python frameworks (Django, Flask etc.)
Micro Services/Web service development experience using Spring framework.
Strong experience in Amazon EMR/DataBricks/Cloudera CDP
Experience with Dask, Numpy, Pandas, Scikit-Learn
Hands-on experience in Big Data, Cloudera Distribution 7.x, RDBMS
Hands-on experience building data pipelines using Hadoop components Sqoop, Hive, Solr, MR, Impala, Spark, Spark SQL., HBase.
Strong experience working in Real-Time analytics like Spark/Kafka/Storm
Experience with Jenkins, JIRA
Expertise in Unix/Linux environment in writing scripts and schedule/execute jobs.
We are looking for consultant who can provide vision and technical leadership on the project. The resource will review the existing the architecture and recommend new technologies as appropriate. Hadoop engineer will closely work with business units and recommend changes to provide value to business.
Vishwa Dubey
Delivery Head
KPG99 Inc.
E: vishwa@kpgtech.com
3240 E State St EXT , Hamilton, NJ 08619
Greetings!!! We have an urgent opening for “BigData Engineer”- Sydney,Australia. Please let me know your interest. Also you can refer...
Apply For This JobIntégrer l’informatique de l’Assurance Maladie, c’est participer à des chantiers d’envergure en matière d’architecture, d’efficience technologique ou de sécurité de...
Apply For This JobLa empresa Navantia S.A., S.M.E. realiza la siguiente Convocatoria para sus oficinas centrales de Madrid: 1 vacante de Técnico/a Superior...
Apply For This JobOne of the largest health insurers in the nation is focused on&#; continuously building an industry-defining, world-class IT capability. Healthcare...
Apply For This JobRole: Big Data engineer Remote Requirements: Bachelor’s degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related...
Apply For This JobJob Description Azure ADF with Synapse G5 Key Responsibilities: – Design, develop, and maintain data pipelines using Azure Data Factory...
Apply For This Job