Job Title: Hadoop data engineer

Location: Chicago, IL
Work Arrangement: Onsite 
Client Industry: Financial Services
Duration: 12 Months Contract
Schedule: Standard Hours( Monday - Friday, 8 AM to 5 PM)

Day-to-Day:

• Design, develop, and maintain batch and near-real-time data pipelines using Spark Structured Streaming, MapReduce, and other Big Data frameworks.
• Ingest data from multiple sources such as message queues (Kafka), file shares, REST APIs, and relational databases.
• Transform, clean, and validate data in HDFS, Hive, Impala, or Spark SQL.
• Convert and manage data in formats like JSON, CSV, XML to support downstream analytics.
• Perform data validation, profiling, and analysis to identify anomalies and ensure data integrity.
• Troubleshoot issues in data pipelines, SQL jobs, or Spark applications, including slow-running jobs or failures.

Must Haves:

• Strong SQL Skills – one or more of MySQL, HIVE, Impala, SPARK SQL
• Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
• Experience working with SPARK Structured steaming
• Experience working with Hadoop/Big Data and Distributed Systems
• Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.
• Hands on programming experience in at least one of Scala, Python, PHP,

Plusses:

• Prior Bank Experience
• Experience in Service Now

Compensation

• Hourly Rate: $60 - $65 per hour
  This reflects base compensation and may vary based on candidate qualifications.

Benefits

The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, paid time off, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, and paid holidays annually – as applicable.

About Us

At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.