Introducing OSXCollector We use Macs a lot at Yelp, which means that we see our fair share of Mac-specific security alerts. Host based detectors will tell us about known malware infestations or weird new startup items. Network based detectors see potential C2 callouts or DNS requests to resolve suspicious domains. Sometimes our awesome employees just let us know, “I think I have like Stuxnet or conficker or something on my laptop.” When alerts fire, our incident response team’s first goal is to “stop the bleeding” - to contain and then eradicate the threat. Next, we move to “root cause the...

Continue reading

This past November, Yelp Engineering hosted a Bay Area Girl Geek Dinner and I had the pleasure of presenting a brief overview of how Yelp uses MySQL. I received a lot of great questions and wanted to take a few minutes to share the information with our wider blog audience. Overview: MySQL @ Yelp Yelp has used MySQL since the beginning, and in more recent years has adopted the Percona fork. We like MySQL because it fits our data needs, is configurable, fast, and scalable. The Percona fork includes performance enhancements and additional features on top of stock MySQL, we...

Continue reading

At Yelp, we solve a lot of different information retrieval problems ranging from highlighting reviews for businesses to recommending nearby restaurants. We recently improved one system called business matching, moving from a naive ranking function to a machine learned approach using Learn to Rank. The Business Matching Problem Business matching is a system that accepts a description of a business (e.g. name, location, phone number) and returns the Yelp businesses that description best fits. We can use this in several different contexts. For example, in 2012 Yelp announced a partnership spearheaded by the City of San Francisco to allow municipalities...

Continue reading

While we’re all still recovering from our Thanksgiving-induced food comas, we wanted to share some of our upcoming events for December! This Thursday, some of our engineers will be giving lightning talks at the Women Who Code meetup so make sure to come! We’re also very excited to be sponsoring the Women Who Code Holiday Party in Waterloo Ontario on December 11th. If you’re in the area, RSVP and stop by! For the rest of the week (through December 5th), Yelp will also be matching donations to Women Who Code (up to $5,000 total). Please consider donating and helping them...

Continue reading

We recently held the 15th edition of Hackathon, a two-day event comprising of pure, unadulterated hacking, innovation, creativity and fun. Folks clustered together, hammering on their keyboards, scribbling on whiteboards, and some electrical engineers were plugging away on their breadboards. The kitchens were filled with delicious catered food, and fresh fruits and snacks lined up in the common spaces. We even had a school of remote-controlled sharks lurking around the office and taking over the meeting rooms. Those ominous-looking RC sharks do not seem to deter our intrepid hackers! Close to 60 great projects came out of the event from...

Continue reading

Yelp uses Elasticsearch to rapidly prototype and launch new search applications, and moving quickly at our scale raises challenges. In particular, we often encounter difficulty making changes to query logic without impacting users, as well as finding client library bugs, problems with multi-tenancy, and general reliability issues. As the number of engineers at Yelp writing new Elasticsearch queries grew, our Search Infrastructure team was having difficulty supporting the multitude of ways engineers were finding to send queries to our Elasticsearch clusters. The infrastructure we designed for a single team to communicate with a single cluster did not scale to tens...

Continue reading

This month we have a handful of exciting events and a few new ones! We kicked off the month with Hackathon 15.0 where Yelpers created and shared some amazing projects (more on that in a few weeks!). Now that the hackathon dust has settled, we’re starting off by hosting the Bay Area Girl Geek Dinner to help encourage networking between girl geeks. On top of that, we’ll be at AnDevCon November 18 - 21 so make sure to find us there too. Events happening at Yelp HQ: Tuesday, November 11, 2014 - 5:30PM - Yelp Girl Geek Dinner ( Bay...

Continue reading

Yelp Dataset Challenge Round 3 Winners We recently opened the fourth round of the Yelp Dataset Challenge. This announcement included an update to the dataset, adding four new international cities and bringing the total number of reviews in the dataset to over one million. You can download it and participate in the challenge here. Submissions for this round are open until December 31, 2014. See the full terms for more details. With the opening of our fourth iteration of the challenge, we closed the third round, which ran from February 1, 2014 to July 31, 2014. We are proud to announce...

Continue reading