Job Description / Skills Required
Extend and maintain Groupon centralized data ingestion pipeline, specifically:
Streaming and Batch Data Quality Validations
Schema design and maintenance for persistence layer, including partitioning
Analyze and translate functional requirements/change requests into technical specifications
Onboard new data sources and help upstream engineers/data PMs with configurations
Coordinate and collaborate with EDW Engineering team and business users to implement required streaming transformations functions (UDFs)
Create/execute unit tests and validate expected results
Create and maintain clear documentation on data models/schemas as well as transformation/validation rules
Troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers.
Execute and evolve proactive data quality measures, specifically:
Work with upstream QA teams on integrating data validation tests. Evaluate new releases from data quality perspective.
Contribute to anomaly detection and alerting tools evolution in the pipeline (both real-time and batch)
Conform to adopted SDLC procedures (2-week sprints, daily standups and daily ticket triaging)
100% fluency in ANSI SQL. Hive/spark SQL. R is a plus
Scripting skills: python, shell, pig etc.
Basic OOO and/or functional programming skills (Java, Scala).
Working knowledge of big data persistence. Hadoop and Teradata are preferred.
Hands-on experience in RDMS technologies: Mysql, Oracle etc
Knowledge of data modeling and designing relational databases, specifically for OLAP (star/snowflake schemas etc)
Ability to work in a fast-paced environment on several projects concurrently
Strong analytical and troubleshooting skills
Ability to develop and organize high-quality documentation
Groupon provides a global marketplace where people can buy just about anything, anywhere, anytime. We’re enabling real-time commerce across an expanding range of categories including local businesses, travel destinations, consumer products, and live or lively events. At the same time, we are providing advertising options and tools that merchants can use to grow and manage their businesses. Culturally, we believe that great people make great companies and that starting with the customer and working backward moves us forward. Community matters to us on an internal, local and global scale—it’s fundamental to our company’s growth and to the well-being of the world at large. We also value self-awareness, candor, lunch and WiFi. If we match with you, please apply to join us.