Job Title: Hadoop Data Engineer
Location: Chicago, IL/Denver, CO/Washington, DC
Work Arrangement: Fully Onsite
Client Industry: Enterprise BFSI client
Duration: 18+ Months Contract
Schedule: Monday to Friday, Standard working hours

About the Role:

We are seeking a skilled Big Data Engineer to support Aspire Projects by implementing and enhancing the ServiceNow Vulnerability Management platform. This role focuses on building scalable data pipelines, enabling secure data ingestion, and ensuring data integrity across distributed systems in a high-performance banking environment.

Top Three skills:

• Spark & Hadoop-Based Data Engineering

  • Spark Structured Streaming, MapReduce

  • Hadoop ecosystem (HDFS, Hive, Impala, HBase)

  • Distributed data processing & performance tuning

• Data Ingestion & Integration

  • Kafka, REST APIs, file shares, relational databases

  • Handling JSON, CSV, XML formats

  • Building reliable batch & near-real-time pipelines

• Advanced SQL & Big Data Querying

  • Spark SQL, Hive, Impala, MySQL

  • Data transformation, validation, and optimization

  • Ensuring data integrity and profiling

What We’re Looking For:

• Strong SQL Skills – one or more of MySQL, HIVE, Impala, SPARK SQL
• Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
• Experience working with SPARK Structured streaming
• Experience working with Hadoop/Big Data and Distributed Systems
• Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.
• Hands on programming experience in at least one of Scala, Python, PHP.

Compensation:
Hourly Rate: $64 – $65 per hour
This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications.

Benefits:
The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time , paid sick and safe time , hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)

About Us:

At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.

Ready to Apply?

Apply now on shivani.soni@collabera.com/973-841-2468