Location: Chicago, IL

Pay Range: $55/hr-$65/hr

About the role:

Build new data pipelines, identifying existing data gaps, and providing automated solutions to deliver advanced analytical capabilities and enriched data to applications that are supporting the operations team. Responsible for obtaining data from the System of Record and establishing real-time data feed to provide analysis in an automated fashion.

Must Haves:

• Good Programming background
• Strong Hadoop/ Big Data experience
• Python, Spark/Scala, Kafka expertise
• Strong knowledge in Spark and Kafka 
• Sr. Level experience

Roles & Responsibilities:

• Working experience on tools like Hive, Spark, HBase, Sqoop, Impala, Kafka, Flume, Oozie, MapReduce, etc.
• Hands on programming experience in perhaps Java, Scala, Python, or Shell Scripting, to name a few
• Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
• Strong experience with SQL and Data modelling
• Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
• Experience using Source Code and Version Control systems like SVN, Git, etc.
• Deep understanding of the Hadoop ecosystem and strong conceptual knowledge in Hadoop architecture components
• Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
• Ability to comprehend customer requests and provide the correct solution
• Strong analytical mind to help take on complicated problems
• Desire to resolve issues and dive into potential issues