Yelp’s Kafka infrastructure ingests tens of billions of messages each day to facilitate data driven decisions and power business-critical pipelines and services. We have recently made some improvements to our Kafka deployment architecture by running some of our clusters on PaaSTA, Yelp’s own Platform as a Service. Our Kubernetes (k8s) based deployment leverages a custom Kubernetes operator for Kafka, as well as Cruise Control for lifecycle management. Kafka on PaaSTA on Kubernetes Architectural Motivations and Improvements In the past, all of our Kafka clusters ran on dedicated EC2 instances on AWS. Kafka was deployed directly on these hosts and configuration...

Continue reading

At Yelp we are always striving to optimize our user experience so we can help guide our customers to success. We aim to streamline the onboarding process for business owners by centralizing customer products into a single page. The Challenge Yelp offers an array of free and paid products that help local businesses connect with consumers. To set up these products on their Yelp page, business owners previously had to navigate through multiple tabs, which negatively impacted product setup rates (roughly 55%) and lowered overall user engagement. Previously, the only way businesses could set up Yelp advertising products was through...

Continue reading

Yelp has many teams of mobile developers who collectively maintain two different mobile apps on iOS and Android: Yelp (hereinafter “Consumer App”) and Yelp for Business (hereinafter “Biz App”). We’re always looking for ways to ship features more quickly and consistently on all these platforms! We adopt vendor and open-source libraries when possible, and we develop our own shared libraries when necessary. While many teams were already independently adopting server-driven UI (SDUI) to build their features faster and cheaper, we felt something was missing – a foundation that tied all our libraries together into a shared, server-driven, end-to-end solution for...

Continue reading

Yelp’s employee resource group for women in engineering, Awesome Women in Engineering (AWE), recently held its first virtual summit! The summit was designed for women and allies at Yelp to learn, network, and have fun. AWE started in 2013 with a mission to build a strong community for women and allies at Yelp by facilitating professional career-building activities, networking, leadership, and mentorship opportunities. As a resource group, we provide support and organize activities targeted towards professional growth for women engineers, helping them to maximize their potential at Yelp and beyond. We are excited to share the different activities that helped...

Continue reading

Search and ranking are part of many important features of Yelp - from looking for a plumber to showing relevant photos of the dish you search for. These varied use-cases led to the creation of Yelp’s Elasticsearch-based ranking platform, allowing real-time indexing, learning-to-rank, lesser maintenance overhead, and enabling access to search functionality to more teams at Yelp. We recently built Nrtsearch, a Lucene-based search engine, to replace Elasticsearch. Why Replace Elasticsearch? Our Elasticsearch-based ranking platform had been working well with a wide variety of applications deployed on it. But as we onboarded more use-cases, Elasticsearch costs didn’t scale as well...

Continue reading

This post brings our Engineering Career Series to an end. I hope you’ve enjoyed reading it as much as we’ve enjoyed sharing Yelp’s philosophy on building engineering careers in a thoughtful, equitable, and enjoyable way. As the series has shown, building a thriving engineering team requires ongoing investment in people and in processes. It requires you to recognize and acknowledge your successes and failures, and continue to iterate and improve. There are no quick fixes and the job is never truly done, but the rewards of improving are huge, for the individuals and for the success of your company as...

Continue reading

Recruiting, hiring, and onboarding new employees in Engineering at Yelp is a multi-team, cross-functional effort as we have laid out in our Career Series blog posts. But once people are here, how do we retain them? While career advancement, technical leadership, and pay equity are all important components to building a happy engineering team, we believe fostering inclusion and belonging is also a fundamental component in supporting, and thus retaining, people. While this is an area that’s received a lot of recent attention in the tech industry, we’ve prioritized inclusion and belonging for many years because we want all of...

Continue reading

At Yelp, we care deeply about ensuring all employees are compensated fairly for their contributions, regardless of their gender, race, and ethnicity. Within Yelp Engineering, we work hard to achieve equal pay for equal work through a combination of tactics: Well-defined career levels and corresponding pay bands A systematic levels calibration process across teams Transparency of our outcomes with the entire Engineering team In a previous blog post, we described how we think about career progression and leveling. Each level within Engineering and Engineering Management has an associated merit band, equity band, and cash bonus target based on location. We...

Continue reading