Subscribe / Unsubscribe Enewsletters | Login | Register

Pencil Banner

Facebook's Graph Search puts Apache Giraph on the map

Joab Jackson | Aug. 15, 2013
Powering Facebook Open Graph, Apache Giraph was built from Yahoo and Google technologies.

Facebook modified Giraph in a number of ways to make it run more efficiently, according to Ching.

Company engineers devised a number of tweaks to trim Giraph's memory usage on servers. "Giraph was a memory behemoth due to all data types being stored as separate Java objects," Ching wrote.

To improve Giraph's scalability, Facebook linked it with the Netty event-driven framework.

In one test using user interaction data, Facebook was able to use Giraph to create a 1 trillion-edge social graph in under four minutes, using 200 commodity servers.

Facebook's benchmark dwarfed previously published Giraph tests by other companies by at least two orders of magnitude. Heretofore, researchers have been able to create a 6.6 billion-edge graph using Yahoo Altavista data and a graph of Twitter data with 1.5 billion edges.


Previous Page  1  2 

Sign up for CIO Asia eNewsletters.