Senior Software Engineer- Pricing & Profitability Competitive Intelligence

Offer by Wayfair

python

hadoop

design

About this job

Job type: Full-time
Experience level: Senior
Industry: Computer Software, eCommerce, Retail
Company size: 5k-10k people
Company type: Public



Technologies

python, hadoop, design



Job description

Wayfair's Pricing & Profitability Engineering team develops algorithms and tools to optimize and manage profit, revenue, and price perception. We are seeking an experienced, creative, and determined senior engineer to drive our Competitive Intelligence data ingestion efforts. The mission of our Competitive Intelligence team is to define, gather, analyze and distribute intelligence about products and competitors to enable market-based assessments of Wayfair's performance, guide targeted interventions, and track progress filling competitive gaps. This is a unique opportunity to collaborate with our Competitive Intelligence business partners and design techniques to gather, store, transform a vast amount of competitive information at scale. Working within a quickly growing team at Wayfair, you will utilize your expertise in .NET or Python, and data ETL to ensure rapid and consistent intelligence gathering. The intelligence you gather will form the foundation of a valuable data system that will drive major business decisions across every major department at the company. The scope of impact is broad and ambitious; we want you to take pride and ownership in what you're building - a truly cutting edge Competitive Intelligence system unmatched in the industry.

Recent Pricing & Profitability Projects:

  • A proprietary web scraper built on scrapy, an open source framework
  • Leveraging distributed technologies (Kafka, Spark, Hadoop) to scale data processing and storage
  • Creating in-house software analytics dashboards enabling swift business decision capabilities


Responsibilities:

  • Fully own the responsibilities of ongoing and new projects starting from discovery, design, development and deployment.
  • Create and maintain best practices for data ingestion of big dataset at scale
  • Mentor junior developers and help the team to troubleshoot any roadblocks
  • Work closely with the Data Science team to normalize, classify and continually improve upon our growing data system
  • Write test-driven Python, SQL code using Docker containers and GitLab CI


A new version is available REFRESH