Facebook use cold to deal with huge amounts of data

 Facebook use cold to deal with huge amounts of data 

 

Electronics Facebook is think about the way in which stores data to cope with 7 petabytes of new photos of The Social Network, users sent each month. As the number of images increases, Facebook needs to find a cheaper, less energy-intensive ways to store them all, according to the companys vice president of engineering infrastructure. Users upload approximately 300 million pictures day, more for special occasions, Facebook Jay Parikh said the structure of the European conference in Amsterdam on Wednesday. "Halloween is one of our biggest Photo Upload days a year.ll Probably be somewhere between 1 and 2 billion photos uploaded just in one day," he said. Pictures like those made on Halloween quickly lose interest to anyone looking at them for a few days or weeks, but "Our agreement with our users is that you can not delete the data when it is not available, we need to keep it, "he said. This led to the idea of ??putting pictures into a kind of "cold" Parikh said. To do this, Facebook is planning to build a new data center with different types of storage, servers and networking hardware equipment that uses less energy and costs less than existing data centers - all without changing the servers response times, said Parikh But how effective can Facebook make its cold? When the cost and power consumption in data centers is reduced, it usually happens at the expense of speed of access.

 Storing data on tapes, for example, reduces energy consumption, but seriously slows down access to the data. Amazon Web Services follow a middle path of his Glacier cloud storage services, which breaks down as an alternative to tape. The service is optimized for data that is rarely used for the download times of several hours are acceptable. Its too slow for Facebook, according to Parikh. "I can not have a picture to go with the available five or 10 years ago, and for me to show up to a banner that says," Hey, why do not you try again within 24 hours, "It still has to be relatively real-time "he said. Most data centers, which are currently used are optimized to use a lot of force to deal with tasks that require high computing power. "Cold" Facebook thinks of technology is on the other end, said Parikh. "You have lots and lots of space, but you do not need too much energy," he said, adding that all of the data center needs to be rethought to handle the scale of the problem in the face on Facebook. At the high level, Facebook is working on software that will find out how and where to store the content of a piece of infrastructure when it aged, Parikh said. "This means that the data will move back in time and

 use of the various elements of the infrastructure that we have optimized the age of content." Some of the inventions in the software layer will allow Facebook to continue to respond quickly, but to store the data in a more cost-effective, he said. Cold will be part of Facebooks infrastructure in the next year or two, he said. Facebook plans to reveal and share the parts that are important to consider using the Open Compute Project, initiative started by a Facebook application open-source software model of cooperation in the world of data center equipment. Loeks Correspondent in Amsterdam and includes privacy, intellectual property, open source and online payments for the IDG News Service