Google’s data centers: an inside look

Very few people have stepped inside Google’s data centers, and for good reason: our first priority is the privacy and security of your data, and we go to great lengths to protect it, keeping our sites under close guard. While we’ve shared many of our designs and best practices, and we’ve been publishing our efficiency data since 2008, only a small set of employees have access to the server floor itself.

Today, for the first time, you can see inside our data centers and pay them a virtual visit. On Where the Internet lives, our new site featuring beautiful photographs by Connie Zhou, you’ll get a never-before-seen look at the technology, the people and the places that keep Google running.

  

 In addition, you can now explore our Lenoir, NC data center at your own pace in Street View. Walk in the front door, head up the stairs, turn right at the ping-pong table and head down the hall to the data center floor. Or take a stroll around the exterior of the facility to see our energy-efficient cooling infrastructure. You can also watch a video tour to learn more about what you’re viewing in Street View and see some of our equipment in action.

Finally, we invited author and WIRED reporter Steven Levy to talk to the architects of our infrastructure and get an unprecedented look at its inner workings. His new story is an exploration of the history and evolution of our infrastructure, with a first-time-ever report from the floor of a Google data center.

Fourteen years ago, back when Google was a student research project, Larry and Sergey powered their new search engine using a few cheap, off-the-shelf servers stacked in creative ways. We’ve grown a bit since then, and we hope you enjoy this glimpse at what we’ve built. In the coming days we’ll share a series of posts on the Google Green Blog that explore some of the photographs in more detail, so stay tuned for more!


The Official Google Blog

A look inside our 2011 diversity report

We work hard to ensure that our commitment to diversity is built into everything we do—from hiring our employees and building our company culture to running our business and developing our products, tools and services. To recap our diversity efforts in 2011, a year in which we partnered with and donated $ 19 million to more than 150 organizations working on advancing diversity, we created the 2011 Global Diversity & Talent Inclusion Report. Below are some highlights.

In the U.S., fewer and fewer students are graduating with computer science degrees each year, and enrollment rates are even lower for women and underrepresented groups. It’s important to grow a diverse talent pool and help develop the technologists of tomorrow who will be integral to the success of the technology industry. Here are a few of the things we did last year aimed at this goal in the U.S. and around the world:

We not only promoted diversity and inclusion outside of Google, but within Google as well.

  • We had more than 10,000 members participate in one of our 18 Global Employee Resource Groups (ERGs). Membership and reach expanded as Women@Google held the first ever Women’s Summit in both Mountain View, Calif. and Japan; the Black Googler Network (BGN) made their fourth visit to New Orleans, La., contributing 360 volunteer hours in just two days; and the Google Veterans Network partnered with GoogleServe, resulting in 250 Googlers working on nine Veteran-related projects from San Francisco to London.
  • Googlers in more than 50 offices participated in the Sum of Google, a celebration about diversity and inclusion, in their respective offices around the globe.
  • We sponsored 464 events in 70 countries to celebrate the anniversary of International Women’s Day. Google.org collaborated with Women for Women International to launch the “Join me on the Bridge” campaign. Represented in 20 languages, the campaign invited people to celebrate by joining each other on bridges around the world—either physically or virtually—to show their support.

Since our early days, it’s been important to make our tools and services accessible and useful to a global array of businesses and user communities. Last year:

  • We introduced ChromeVox, a screen reader for Google Chrome, which helps people with vision impairment navigate websites. It’s easy to learn and free to install as a Chrome Extension.
  • We grew Accelerate with Google to make Google’s tools, information and services more accessible and useful to underrepresented communities and diverse business partners.
  • On Veterans Day in the U.S., we launched a new platform for military veterans and their families. The Google for Veterans and Families website helps veterans and their families stay connected through products like Google+, YouTube and Google Earth.

We invite you to take a look back with us at our 2011 diversity and inclusion highlights. We’re proud of the work we’ve done so far, but also recognize that there’s much more to do to. These advances may not happen at Internet speed, but through our collective commitment and involvement, we can be a catalyst for change.


The Official Google Blog

Inside view on ads review

This is the first in a series of posts that will provide greater transparency about how we make our ads safer by detecting and removing scam ads. -Ed.

A few weeks ago, we posted here about our efforts in fighting bad ads, and we shared a video with the basics of how we do it. Today I wanted to delve a little deeper and give some insight into the systems we use to help prevent bad ads from showing. Our ads policies are designed with safety and trust in mind—we don’t allow ads for malicious downloads, counterfeit goods, or ads with unclear billing practices, to name a few examples. In order to help prevent these kinds of ads from showing, we use a combination of automated systems and human input to review the billions of ads submitted to Google each year. I’m one of many engineers whose job is to help make sure that Google doesn’t show bad ads to users.

We’ve designed our approach based on a three-pronged strategy, each focused on a different dimension of the problem: ads, sites, and advertiser accounts. These systems are complementary, sharing signals among each other so that we can comprehensively attack bad ads.

For example, in the case of a site that is selling counterfeit goods, this three-pronged approach aims to look for patterns that would flag such a site and help prevent ads from showing. Ad review notices patterns in the ads and keywords selected by the advertiser. Site review analyzes the entire site to determine if it is selling counterfeit goods. Account review aims to determine if a new advertiser is truly new, or is simply a repeat offender trying to abuse Google’s advertising system. Here’s more detail on how we review each of these three components.

Ad Review
An ad is the snippet of information presented to a user, along with a link to a specific webpage, or landing page. The ads review system inspects individual ads and landing pages, and is probably the system most familiar to advertisers. When an advertiser submits an ad, our system immediately performs a preliminary examination. If there’s nothing in the ad that flags a need for further review, we tell the advertiser the ad is “Eligible” and show the ad only on google.com to users who have SafeSearch turned off. If the ad is flagged for further review, in most cases we refer to the ad as “Under Review” and don’t show the ad at all. From there, the ad enters our automated pipeline, where we employ machine learning models, a rules engine and landing page analysis to perform a more extensive examination. If our automated system determines an outcome with a high degree of confidence, we will either approve the ad to run on Google and all of our partners (“Approved”), approve the ad to show for appropriate users in specific locations (“Approved – Limited”) or reject the ad (“Disapproved”). If our automated system isn’t able to determine the outcome, we send the ad to a real person to make a final decision.

Site Review
A site has many different pages, each of which could be pointed to by different ads, often known as a domain. Our site review system identifies policy issues which apply to the whole site. It aggregates sites across all ads from all advertisers and regularly crawls them, building a repository of information that’s constantly improving as new scams and new sites are examined. We store the content of advertised sites and use both machine learning models and a rules engine to analyze the sites. The magic of the site review system is it understands the structure of language on webpages in order to classify the content of sites. Site review will determine whether or not an entire site should be disabled, which would prevent any ads leading to that site showing from any account. When the automated system isn’t able to determine the outcome with a high degree of confidence, we send it to a real person to make a decision. When a site is disabled, we tell the advertiser that it’s in violation of “Site Policy.”

Account Review
An account is one particular advertiser’s collection of ads, plus the advertiser’s selections for targeting and bidding on those ads. An account may have many ads which may point to several different sites, for example. The account review system constantly evaluates individual advertiser accounts to determine if the whole account should be inspected and shut down for policy violations. This system “listens” to a variety of signals, such as ads and keywords submitted by the advertiser, budget changes, the advertiser’s address and phone number, the advertiser’s IP address, disabled sites connected to this account, and disapproved ads. The system constantly re-evaluates all accounts, incorporating new data. For example, if an advertiser logs in from a new IP address, the account is re-evaluated to determine if that new signal suggests we should take a closer look at the content of the advertiser’s account. If the account review system determines that there is something suspect about a particular account with a high degree of confidence, it automatically suspends the account. If the system isn’t sure, it stops the account from showing any ads at all and asks a real person to decide if the account should be suspended.

Even with all these systems and people working to stop bad ads, there still can be times when an ad slips through that we don’t want. There are many malicious players who are very persistent—they seek to abuse Google’s advertising system in order to take advantage of our users. When we shut down a thousand accounts, they create two thousand more using different patterns. It’s a never-ending game of cat and mouse.

We’ve put a great deal of effort and expense into building these systems because Google’s long-term success is based on the trust of people who use our products. I’ve focused my time and energy in this area for many years. I find it inspiring to fight the good fight, to focus on the user, and do everything we can to help prevent bad ads from running. I’ll continue to post here from time to time with additional thoughts and greater information about how we make ads safer by detecting and removing scam ads.


The Official Google Blog

Ten algorithm changes on Inside Search

We make roughly 500 changes to our search algorithm in a typical year. Our goal is to make search run so smoothly, you don’t even notice the changes. That said, we like giving you insights into what we’re doing behind the search results you see each day. Today on Inside Search, we’ve posted a recap of some of the algorithmic changes we’ve made over just the past couple weeks. These changes improve everything from translation, to snippets to autocomplete. For the complete list including descriptions of the changes, check out the post on the Inside Search blog.


The Official Google Blog

Step inside the map with Google MapsGL

(Cross-posted on the Lat Long Blog)

You’re now one step closer to experiencing and interacting with a 3D mirror of the real world within your browser with Google MapsGL. Google MapsGL takes Google Maps and harnesses the power of Web Graphics Library (WebGL) to create far richer visuals and animations.

WebGL is a new technology that brings hardware-accelerated 3D graphics to the browser without additional installed software. With WebGL your maps experience is much better with 3D buildings, smoother transitions between imagery and the ability to instantly “swoop” into Street View without a plugin.


Starting today, if you’re using supported browsers (such as Chrome 14+ or Firefox Beta) with compatible video cards, you can opt in to the early beta release. Visit maps.google.com and click “Try it now,” or visit maps.google.com/gl to learn more.

We’ve been using WebGL to create experiences like our Chrome experiments “3 Dreams of Black” and “All is Not Lost,” which happen right in the browser. Previously, such sophisticated 3D graphics have only been possible on traditional desktop applications and have required manual installation. WebGL ushers in a whole new generation of graphics on the web, and with that, we can begin to redefine the expectations of an online map.

Check out Chrome Experiments WebGL for more WebGL-powered applications, and opt in to Google MapsGL to begin using the next generation of mapping today.


The Official Google Blog

Inside Google’s search office

(Cross-posted on the Inside Search Blog)

I’ve been working with Matt Cutts and Ben Gomes in the same office for over 10 years. We work on search every day, and earlier this week, we took our office talk to the stage at an event hosted by the Churchill Club. Search Engine Land’s Danny Sullivan moderated our in-depth discussion on search, how it works, and what’s ahead for us in the future. We also reminisced about first joining Google, the time my car ran out of gas as Ben and I discussed a change to the algorithm, and other great memories over the years.

Come sit inside our office for a chat about Google Search:

  • To hear more about the principles that drive changes to the algorithm and how these changes are tested and implemented, go to 15:40
  • To hear the discussion on why we don’t hand-pick results, start watching at 41:04
  • For more on my vision for the future of search, jump to 1:12:28
  • Guess who Danny thinks is the brains, looks, and brawn of this operation at 1:08 (hint: I’m the brains).


The Official Google Blog

Inside a fake Chinese Apple Store [Video]

IMG_6541

The fake Chinese Apple Stores we reported on last week have certainly grabbed the attention of the mainstream media (it is the summer ‘silly season’, after all). MSNBC have even sent a camera crew down to one of the stores (presumably one that wasn’t asked to close) and took a look around.

You can see why customers would be confused – it looks and feels just like the real thing, and we imagine Apple’s lawyers are busily preparing to take them out for ever. As the report states, trademark law exists even in China – even if you could be forgiven for thinking that it didn’t.

TNW Aggregated Feed

Powered by Yahoo! Answers