Software Data Engineer – Customer Data

Job Description / Skills Required

Requisition ID: R15268
Groupon is looking for a strong Software Data Engineer who is passionate about building world-class software. The successful candidate will have strong experience developing high quality, service-oriented architecture software in an internet company. As part of the computational marketing team, this role will work on designing and developing a highly scalable and flexible authority engine for all Groupon's customer data. This role works with product, marketing, business owners, and business intelligence from the data infrastructure and warehousing teams.

Requirements

The position will be leading data creation, ingestion, aggregation, management, and client consumption for all customer related information.

This individual has an absolute requirement to be well versed in Big Data fundamentals such as HDFS and YARN.

More than a working knowledge of Sqoop and Hive is required with understanding of partitioning/data formats/compression/performance tuning/etc.

Preferably, the candidate has a strong knowledge of Spark on either Python or Scala. Experience in Spark is must.

SQL for Teradata/Hive Query is required. Knowledge of other industry ETL tools (including No SQL) such Cassandra/Drill/Impala/etc. is a plus.

Data Science Background to work with DS Team

Job Duties:

Develop software solutions for centralized customer data, using various Big Data technologies.

Design, develop, test, debug, implement, and support data collection, filtering, and aggregation processes in data warehouse.

Develop Extract Transform Load (ETL) process and data structures using efficient programming standards and practices

Troubleshoot new and existing ETL processes as well as recommend appropriate solutions

Operation focused, including building proper monitoring on data process and data quality.

Perform analysis on data discrepancies and recommend solutions based upon root cause.

Provide information by collecting, analyzing, and summarizing development and service issues.

Work with an international group for global standards, accomplishes engineering and organization mission by completing related results as needed.

Protect operations by keeping information confidential.

Groupon provides a global marketplace where people can buy just about anything, anywhere, anytime. We’re enabling real-time commerce across an expanding range of categories including local businesses, travel destinations, consumer products, and live or lively events. At the same time, we are providing advertising options and tools that merchants can use to grow and manage their businesses. Culturally, we believe that great people make great companies and that starting with the customer and working backward moves us forward. Community matters to us on an internal, local and global scale—it’s fundamental to our company’s growth and to the well-being of the world at large. We also value self-awareness, candor, lunch and WiFi. If we match with you, please apply to join us.