Hadoop Architect

Palo Alto, CA, US

Job Description / Skills Required

The Data Systems Engineering team is looking for a senior software engineer in their Palo Alto office to drive the growth of distributed logging, log aggregation, real-time log processing, and petabyte scale log analysis. You’ll be responsible for designing, and implementing big data tools and services which can be leveraged by teams throughout the Groupon engineering community.  In addition, you will also be responsible for Hadoop implementation, configuration, troubleshooting, and customizations – this include YARN, Map Reduce, HDFS as well as Hive.  You will have the opportunity to collaborate with a team of fantastic engineers. As a member of the infrastructure team, your efforts will be making a direct impact on the experiences of millions of customers as well as pushing Groupon’s data infrastructure to the next level.

10+ years in software development, in that, more than 5+ years of experience in the Big data area.
Experience designing and implementing large, scalable distributed systems
Experience deploying and working with big data technologies like Hadoop, Kafka, Storm, Spark
Highly proficient in OO programming (Java preferred)
BS or MS in Computer Science or equivalent experience
Hadoop committers preferred
Understanding of Hadoop Ecosystem ( HDFS, Yarn, MapReduce, Spark Hive ) and should be able to coach the other members of the team
Proficiency on Linux / Unix command line
Ability to debug production issues using standard command line tools
Understanding of networking technology 
Knowledge of automation systems ( Ansible, Puppet )Ability to debug Hadoop / Hive job failures
Using Ambari in administering Hadoop
Experience in administering and developing software in Hadoop clusters greater than or equal to 6 PB OR 200 Datanodes
JIRA for issues and project tracking
Design documentation and maintaining process documents
Groupon provides a global marketplace where people can buy just about anything, anywhere, anytime. We’re enabling real-time commerce across an expanding range of categories including local businesses, travel destinations, consumer products, and live or lively events. At the same time, we are providing advertising options and tools that merchants can use to grow and manage their businesses. Culturally, we believe that great people make great companies and that starting with the customer and working backward moves us forward. Community matters to us on an internal, local and global scale—it’s fundamental to our company’s growth and to the well-being of the world at large. We also value self-awareness, candor, lunch and WiFi. If we match with you, please apply to join us.