At Yelp we use Docker containers everywhere: we run tests in them, build tools around them, and even deploy them into production. In this post we introduce dumb-init, a simple init system written in C which we use inside our containers. Lightweight containers have made running a single process without normal init systems like systemd or sysvinit practical. However, omitting an init system often leads to incorrect handling of processes and signals, and can result in problems such as containers which can’t be gracefully stopped, or leaking containers which should have been destroyed. dumb-init is simple to use and solves...

Continue reading

We’re excited to release our first image dataset with hundreds of thousands of user-submitted photos as part of a challenge to all data scientists, launching this week on Kaggle! Yelp’s users provide several kinds of “unstructured” data such as reviews, photos, and videos. They can also answer structured questions like, “Is the restaurant romantic?” These structured answers are incredibly useful to users who want a quick summary of important attributes of a business. We want to know: can you extract these attributes from our photos dataset, and what is the right way to approach this problem? If this type of...

Continue reading

Yelp has an incredible amount of information about businesses to power local search experiences. Many of our users use our advanced search filters to explore and find exactly the place they are looking for. While most people don’t have any trouble filtering their searches using filters such as price, distance, and rating, it was harder for users to employ our more specialized filters such as “Outdoor Seating” or “Live Music”. We set off on a mission to make our advanced filters more approachable for casual users without hindering the experience for our advanced users. Before designing the new filters, we...

Continue reading

In case you missed it last month, we open sourced PaaSTA, our platform-as-a-service which received a lot of excitement and support from the community. We want to bring our friends together to learn more, so we’re hosting our last Yelp Tech Talk of the year in conjunction with Mesosphere on December 17th, featuring PaaSTA + Mesos! Our lead engineer on PaaSTA, Kyle Anderson, will introduce the platform and speak to how it uses Mesos to power our SOA architecture while Sunil Shah, from Mesosphere, will speak on Mesosphere’s DCOS and how it enables PaaS tools like PaaSTA to exist. We’ll...

Continue reading

As an Operations engineer, my first priority is to keep the site up. A close second is enabling developers to quickly go from an idea to running code in production. Once an organization grows, the only sane way to ship code with any reasonable frequency is to split it up into microservices, also known as building a Service Oriented Architecture (SOA). We’ve previously talked about the philosophy behind services and why we build them. This blog post explains the tool we use to make those services available to developers: PaaSTA! What is PaaSTA? PaaSTA is Yelp’s platform-as-a-service. It allows developers...

Continue reading

Last month a group of Yelp engineers attended the Grace Hopper Conference in Houston. We had a great time presenting on crucial conversations and talking to amazing women at our after party. To keep the momentum going through the holiday season, we’re ramping up to launch our 18th internal hackathon at the beginning of this month! On November 7th, we’re excited to be partnering with Next.ML to bring machine learning workshops and panels to Yelp HQ. We’ll be hearing from leaders in the industry on a number of topics and will contribute to the presentations by sharing some of the...

Continue reading

To an outsider visiting the Yelp offices last month, it would’ve been quite a fascinating sight. People were huddled around whiteboards brainstorming the next killer idea. Floors were lined up with copious fresh fruits, snacks and catered gourmet food. And most noticeably, our all-hands space was transformed into a Jurassic World-like set complete with inflatable dinos, prehistoric plants and laser guns to shoot down malicious targets. Welcome to the 17th edition of our internal Product & Engineering Hackathon! Our SVP of Engineering kicks off proceedings with a Mimosa Toast Engineers, product managers and designers across all of our offices came...

Continue reading

Collecting System Metrics at Scale Monitoring system metrics (e.g. CPU utilization, loadavg, memory) is not a new problem. It’s been necessary for a long time and there are a few that already exist, most notably diamond and collectd. At Yelp, we run thousands of different machines hosted all over the world. The simple volume of metrics we monitor quickly starts to complicate how we collect them. After trying out a few different solutions (and breaking many things) we decided to write our own: fullerite. A History of System Metrics Collection We started using diamond to report our system metrics. Everything...

Continue reading