Job Title: Hadoop Data Engineer 

Location: Chicago, IL/Denver, CO/Washington DC (Local Only No relocation - In person Interview )
Work Arrangement: Fully Onsite
Client Industry: Banking 
Duration: 12 Months Contract

Day-to-Day: 

• Design, develop, and maintain batch and near-real-time data pipelines using Spark Structured Streaming, MapReduce, and other Big Data frameworks. 

• Ingest data from multiple sources such as message queues (Kafka), file shares, REST APIs, and relational databases. 

• Transform, clean, and validate data in HDFS, Hive, Impala, or Spark SQL. 

• Convert and manage data in formats like JSON, CSV, XML to support downstream analytics. 

• Perform data validation, profiling, and analysis to identify anomalies and ensure data integrity. 
• Troubleshoot issues in data pipelines, SQL jobs, or Spark applications, including slow-running jobs or failures. 

Must Haves: 

•  Strong SQL Skills – one or more of MySQL, HIVE, Impala, SPARK SQL 

•  Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml 

• Experience working with SPARK Structured steaming 

• Experience working with Hadoop/Big Data and Distributed Systems 

•  Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.  

• Hands on programming experience in at least one of Scala, Python, PHP,  

PLUSES

• Banking or finance 

• Compensation 
• Hourly Rate: 60$-65$ per hour 
  This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications.

 Benefits: 

• The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)

• About Us
• At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.

• Ready to Apply?
• Apply now or reach out to Pritam Palai at pritam.palai@collabera.com for more information. We look forward to speaking with you!