Subscribe / Unsubscribe Enewsletters | Login | Register

Pencil Banner

Why GoDaddy built its search engine from scratch

Clint Boulton | Dec. 21, 2015
GoDaddy, seeking to improve customer service, built a custom search engine that generates domain names on the fly for its small business customers. Building it wasn’t the best option, the company's executives say. It was the only option.

search results page
GoDaddy needs to string together and render custom indexes at Google-like speed.

When Mike McLaughlin joined GoDaddy in 2013 he asked a handful of peers whether they thought he could use commercial search software to help grow its domain name registrar business, supporting emerging small businesses looking for catchy domain names. McLaughlin, the company's newly appointed senior vice president general manager of domains, was tasked with adding support for hundreds of different name spaces and expanding the domain business internationally.

Although he believed he could buy a product off the shelf and layer some customizations on top of it as needed, he wanted to be sure because search is an integral part of GoDaddy's business. The response from his peers, many of whom had created comparative shopping engines, was unanimous: "God, no. You're going to have to do that yourself."

mike mclaughlin
Mike McLaughli, senior vice president general manager of domains at GoDaddy.

Many CIOs face buy-versus-build decisions as they seek to grow their businesses. Most commercial-off-the-shelf, or COTS, software products are safe because they've been vetted by other businesses and are typically ready to work out of the box. The tradeoff is that such products can’t be adapted to suit the unique needs of some businesses.

Custom software development is the preferred approach among online businesses. Online retailers as large as Amazon and as small as Zulily, build custom analytics, logistics and other tools to operate their businesses. Online marketplace Etsy rewrote its search engine with custom software, including a structured taxonomy. GoDaddy, as a retailer of domain names, had its own special search requirements.

Building search for the domain-hungry crowd

When people type queries into a Google, Microsoft or Yahoo search box, they receive results from a finite corpus of documents indexed and ranked for relevancy by algorithms. But typical GoDaddy customers are entrepreneurs are looking for suitable domain names from which to hang their Web shingle. And GoDaddy needs to string together and render custom indexes at Google-esque speeds of about 200 milliseconds.

However, a major caveat is that while an apparel retailer may have tens or even hundreds of a shirt or pair of jeans in stock, GoDaddy has exactly one of each domain name. Once it's sold, it's gone. "We have to be able to tell you, 'sorry, that exact thing you wanted wasn't available, but here's a whole bunch of options that meet your needs,’ " McLaughlin says. That scenario happens a lot in a world where many of the most common, popular or trendy names are quickly seized.

"The fundamental problem that we're trying to solve is this [domain name] doesn't exist yet," says Charles Beadnall, the GoDaddy vice president of engineering who left Yahoo in 2013 to craft the search capabilities previously provided by a third-party. "We're pulling this string of names together and checking to see if they're available."


1  2  Next Page 

Sign up for CIO Asia eNewsletters.