If you are looking for a new opportunity, send your resume to pujan.motivaras@collabera.com  

Job Description:  

Client: Banking  

Position:  Application Architect 

Duration:  12 months    

Location: New York, NY 

Daily Task: 

• Hadoop Admin Ops / SRE role supporting NextGen Platforms built around Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more).
• Requires experience in cluster management of vendor based Hadoop and Data Science (AI/ML) products like Cloudera, DataRobot, C3, Panopticon, Talend, Trifacta, Selerity, ELK, KPMG Ignite etc.
• DevOps Analyst is involved in the full life cycle of an application and part of an agile development process.
• They require the ability to interact, develop, engineer, and communicate collaboratively at the highest technical levels with clients, development teams, vendors and other partners.
• The following section is intended to serve as a general guideline for each relative dimension of project complexity, responsibility and education/experience within this role. 

• Works on complex, major or highly visible tasks in support of 

• multiple projects that require multiple areas of expertise 

• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around 

• Cloudera Hadoop, Jupyter Notebook, Openshift, Docker-Container Cluster Management and Administration 

• Integrates solutions with other applications and platforms outside the framework 

• He / She will be responsible for managing platform operations 

• across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident / problem / capacity management 

• Serves as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs 

Required Skills :

• Hadoop, Kafka, Spark, Impala, Hive, HBase etc. 

• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator's role 

• Intimate knowledge of fully integrated AD/Kerberos authentication 

• Experience setting up optimum cluster configurations 

• Debugging knowledge of YARN. 

• Hands-on with analyzing various Hadoop log files, compression, encoding, & file formats 

• Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper and Postgres 

• Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, Shell scripting, Infrastructure. 

• Experience in Monitoring & Alerting, and Job Scheduling Systems 

• Being comfortable with frequent, incremental code testing and deployment 

• Strong grasp of automation / DevOps tools – Ansible, Jenkins, 

• SVN, Bitbucket 

Pujan Motivaras 

Pujan.motivaras@collabera.com