Mea culpa: OK, I was wrong. Facebook got things back up in about 20 minutes for some users, who are Tweeting about it. However, as of 8.37 a.m. GMT, I am still seeing Tweeters whose Facebooks remain down.
Looks like some people do work there after hours. What a surprise!
However, I reckon things aren’t all well there, with two big outages in such a short space of timeâand I stand behind my suspicions that Facebook has reached some sort of limit, given the increase in bug reports and the widespread nature of the outage tonight.
That didn’t last long, did it?
Facebook returned late morning on Tuesdayâas predicted, it would only be back once the folks at Facebook, Inc. got back to work at 9 a.m. on Monday and realized something had run amok.
Now it’s Thursday night NZST, and if Twitter’s to be believed, a lot of people globally can no longer access Facebook. This is a major outage: it seems one of every few Tweets is about Facebook being down.
Just over two days, and it’s dead again.
Looks like I wasn’t wrong when I wondered whether that I had hit a limit on Facebook. To be out for nearly three days suggests that there was something very wrong with the databasing, and the number of people affected were increasing daily.
And when you look at the bugs I had been filing at Get Satisfaction, there has been a marked increase of errors over the past few weeks, suggesting that there was some instability there.
For it to have such a major failing now, after being out for some users this weekend, doesn’t surprise me. This time, groups and Messenger have been taken out, too.
Facebook really should have taken note of the errors being reported by users.
My experience with Vox was very similar, although there the techs couldn’t get me back online. They gave up at the end of 2009. The similarities are striking: both sites had databasing issues but only with certain users; and both sites were overrun with spammers creating fake accounts. That’s one thing that did piss me off: spammers having more privileges than a legitimate user.
Well, we can probably wait till 9 a.m. PDT when they get back to work. It may say, ‘We’re working on getting this fixed as soon as we can,’ in the error message, but as far as I can make out from what happened to me, Facebook is a MondayâFriday, 9â5 operation, not a 24-hour, seven-day one.
At least it died on a weekday: we can count ourselves lucky.
Long before Google started pissing me off with its various funny acts (such as spying on users without their consent), it released a program called Google Earth. I installed it in July 2009 on my laptop, and decided to feed in 1600 Pennsylvania Avenue NW, Washington, DC 20009, just to see how it had rendered the White House. Other than various Wellington locales, that was my first search query. This was the result, confirmed by others at the time:
There’s no White House there, unless when the Google Earth people made the program, aliens had beamed up the entire block temporarily.
Google has since fixed this. However, back in 2009, it didn’t know where the White House was. And here I was, thinking that it was an American program, where those working on it would double-check where its most famous building stood. This was four years after Google Earth was released.
So any time people say that a big company full of techs must know more than an individual, think of this example, and some others I’ve posted over the years.
The same lesson, I might add, applies to big countries versus small countries. Big definitely doesn’t mean right. The key for the small countries often is to outmanĆuvre the large ones, by being more inventive and more innovative.
God, I love New Zealand.
That was an interesting experiment. Although Lucire Men is still clear (for now), Google decided it would play silly buggers a few hours after we put our (clean) ad server code back on Autocade:
But why? Here’s what Google says:
which means: we can’t find anything wrong with this site since April 8, even though our last scan was on the 23rd. Really? There has been nothing wrong for 15 days, but you’ll still block our site? (Note: Google did not block this site on the 23rd.)
Let’s go to Google Webmaster Tools to see what it says there:
That’s right: nothing. There’s nothing wrong with the site.
Maybe we’ve been flagged somewhere else, then? How about Stop Badware?
Nope, we’re all fine there, too.
In fact, even Google is wrong when it says there were problems on April 8âanother sign of its malware bot reading from a cache instead of fresh pages, because we say we fixed everything on April 6. Well, here’s what Google itself says about Autocade when you go into Webmaster Tools in more depth:
which correlates with the claims we have made all along: our ad server got hacked on April 6 (NZST), and we sorted it within hours that day.
We’re interested to see if the false malware warnings can carry on for a monthâafter all, Google will block a blog for six months even though it says it will lift a block in 48 hours after an investigation. Things take a bit longer there than they claim. There’s a case of one gentleman who has had his site blocked by Google for two months for no reason. I’m sure many, many others are being wrongly identified by Googleâand there are far too many companies relying on the Californian company’s hypocrisy in identifying malware.
The Google belief that webmasters are wrongly claiming there to be false positives is looking more dubious by the day.
PS.: The last post at this forum entry is interesting: Google blocks a website based on stale data. The website where the malware allegedly was did not even exist, but it still triggered a warning at Google. The webmaster writes, ‘The site concerned doesn’t exist and more to the point, there is no DNS record for it eitherâso it cannot exist. / The IP which was once assigned to it is now assigned to someone else.’ That was in March. Judging by the articles online, Google’s been having problems with this particular bot since the beginning of 2013. The sooner they retire the program, the better, I say.âJY
Not a political post, sorry. This one follows up from the Google boycott earlier this month and is further proof of how the house of G gets it very, very wrong when it comes to malware warnings.
As those who followed this case know, our ad server was hacked on April 6 but both my web development expert, Nigel Dunn, and I fixed everything within hours. However, Google continued to block any website linking to that server, including this blogâwhich, as it turned out, delayed my mayoral campaign announcement sufficiently for things to go out on the same day as the marriage equality bill’s final reading and Baroness Thatcher’s funeralâand any of our websites carrying advertising. Lucire was blacklisted by Google for six days despite being clean, and some of our smaller websites were even blocked for weeks for people using Chrome and Firefox.
We insisted nothing was wrong, and services such as Stop Badware gave our sites the all-clear. Even a senior Google forum volunteer, who has experience in the malware side of things, couldn’t understand why the block had continued. There’s just no way of reaching Google people though, unless you have some inside knowledge.
We haven’t done any more work on the ad server. We couldn’t. We know it’s clean. But we eventually relented and removed links to it, on the advice of malware expert Dr Anirban Banerjee, because he believed that Google does get it wrong. His advice: remove it, then put it back after a few days.
The problem is, Google gets it wrong at the expense of small businesses who can’t give it sufficient bad publicity to shatter its illusory ‘Don’t be evil’ claim. It’s like the Blogger blog deletions all over again: unless you’re big enough to fight, Google won’t care.
Last night, we decided to put back the old codeâthe one that Google claimed was dodgyâon to the Lucire Men website. It’s not a major website, just one that we set up more or less as an experiment. Since this code is apparently so malicious, according to Google, then it would be logical to expect that by this morning, there would be warnings all over it. Your browser would exclaim, ‘You can’t go to that siteâyou will be infected!’
Guess what? Nothing of the sort has happened.
It’s clean, just as we’ve been saying since April 6.
And to all those “experts” who claim Google never gets it wrong, that the false positives that we netizens claim are all down to our own ignorance with computing, well, then, there’s proof that Google is fallible. Very fallible. And very harmful when it comes to small businesses who can lose a lot of revenue from false accusations. Even we had advertising contracts cancelled during that period because people prefer believing Google. One ad network pulled every single ad they had with Lucireâs online edition.
People are exposed to its logo every day when they do a web search. And those web searches, they feel, are accurate and useful to them, reinforcing the warm fuzzies.
Can we really expect a company that produces spyware (and ignores red-flagging its own, naturally) to be honest about reporting the existence of malware on other people’s websites? Especially when the code the hackers used on April 6 has Google’s name and links all over it?
It can be dangerous, as this experience has illustrated, to put so much faith in the house of G. We’ll be steadily reintroducing our ad server code on to our websites. While we’re confident we’re clean, we have to wear kid gloves dealing with Google’s unpredictable manner.
It’s day six on the Google blacklist for Lucire. And no, we still don’t know what they are talking about. StopBadware doesn’t know what they are talking about. Our web guys and all our team in different parts of the world don’t know what they are talking about.
Today, I decided to venture to the Google forums. Google forums are generally not a good place to go to, based on my experience with Blogger, but I came across a really helpful guy called Joe (a.k.a. Redleg x3), a level 12 participant, who has gone some way to redeeming them.
I told Joe the same story. He begins writing, ‘First I think you really need an explanation from Google, I can see why your site was flagged originally but do not understand why Google did not clear it today.’
Exactly. But what was fascinating was that when he checked through a private version of aw-snap.info, which helps you see what malware spiders see, he found the old Google Adsense code the hackers injected.
This very code has been absent from our servers since Saturday, otherwise we would never have received the all-clear from StopBadware.org. We also don’t use a caching service any more (we used to use Cloudflare). But, if Google saw what Joe did, then it means Google’s own bot can’t load fresh files. It loads cached ones, which means it keeps red-flagging stuff that isn’t there.
If you read between the lines of what Joe wrote, then it’s clear that Google relies on out-of-date data for its malware bot. He checked the infected site and the file that caused all the problems has gone. And we know the hacks are gone from our system. It’s totally in line with what we were told by Anirban Banerjee of Stopthehacker.com on the errors that Google makes, too. I can only conclude that it’s acceptable for Google to publish libel about your site while relying on outdated informationâinformation that it gathered for a few hours six days ago, which has no relevance today.
We still don’t know if things are sorted yet. We know this has been a devilishly frustrating experience, and damaging to our reputation and our finances. Yet we also know Google will just shrug its shoulders and do a Bart Simpson: ‘I didn’t do it.’ It’ll get blamed on the computer, which is terribly convenient. It’ll also blame covering up my Google Plus status criticizing them on the computer.
It looks like we are not alone. I’ve been reading of The New York Times and The Guardian getting red-flagged. Google even decided to blacklist YouTube at one point this year (given where I think the hackers’ code comes from, I am not surprised a Google property is malicious). The difference is that the big guys are more noticeable, so Google whitelists them more quickly. Our situation actually mirrored what happened at ZDNet, except they got cleared within hours (even though we fixed our problem within hours). The little guy, the honest business person, the legitimate blogger, the independent online store-ownerâwe’re in for a much harsher ride.
With Google supplying its corrupted data to other security programs like Eset as well as browsers such as Chrome and Firefox, then putting all your eggs in one basket is terribly dangerous, as we have seen. More so if that organization has no real oversight and your complaints are silenced. And as we have seen, Google will go to great lengths to preserve its advantages in the online advertising market.
Frustrated with ongoing Google’s false accusations over our websites, I joined the Stop Badware community today (Badware Busters), and got some sensible advice from a Dr Anirban Banerjee of www.stopthehacker.com.
He had checked what Google was on about, and noted that it was still making the same accusations it did on Saturdayâwhen we know that we had already removed the hack that day.
I told him this, and he replied:
One policy that a customer followed since Google was just not letting them off the blacklist inspite of cleaning the server, DB, etc.. was to âsuspend/removeâ all ad code pointing to the mother pipe (your main server in your case) â get the request for reviews pushed in asap, get the sites off the blacklist (since Google did not see any openx ads, nothing to analyze, hence the sites were let off within 5 hours) â then put the ads back again. They used a simple grep command to strip out the ad code, and then restored the pages and code from a relatively fresh backup once the blockages were lifted. I know this is kind of hack-ish â but sometimes inspite of all the meticulous cleaning that people do â automated system will flag sites.
In other words, Google can cock up. This time, it did. So you basically need to fool Google, get your site off the blacklist, and put things back to normal afterwards.
Or: there may be a drunk driver swerving left and right at the wheel of the Google truck, so it’s your job to make sure that you build a nice road in front for them, rather than insist that they clean up their act and stay on the road.
Mind you, the last time Google claimed to analyse something in two days, it took six monthsâhere’s hoping we’re back online before then. It’s getting embarrassing telling clients what had happened, especially as most drink the Google Kool-Aid and believe the firm can do no wrong. Peel back only one layer, and you can see plenty that goes wrong.
It’s not fair, but what can you do against the Google juggernaut when so many people rely on it, especially Chrome users who are getting the false red flags more than anyone else?
Facebook received this bug report from me today (the âSincerely,â etc. at the end have been omitted).
I know youâve said that the bug reported in the media about private messages going on to walls between 2007 and 2009 cannot be confirmed, but it has happened. Back in those days, with âUser Name isâ, I wrote in the third person. Yet I can find these allegedly public posts in the first person on othersâ walls. Before you introduced private message threading, people often took excerpts from a previous message in their replies. I can see those, too. Your investigations will have shown that these messages cannot be found in usersâ PMs. They will also have shown that they were public to begin with. I can confirm that with a full data download in October 2011, I saw exactly the same thing as you. This leads me to believe that some of these PMs were incorrectly classified at some stage, leading to their recent publication. I even know of a case where a contractual dispute done in DMs was published. After Timeline was introduced in September 2011, I spent a lot of time looking at previous years, because I was fascinated about how you did the annual summaries of the most significant posts (and the most significant new friendships). I distinctly remember that the number of messages on our walls increased per annum. Right now, the sequence decreases between 2007 and 2011, beginning with 786 messages in 2007. I know for a fact that that number was not 786 when Timeline was first introduced and I have a photographic memory. Please donât dismiss users and say that we donât know the difference between DMs and wall posts. Most of us do, and there are many signs that these messages are privateâmaybe not in the way you have categorized them now, but certainly in the way they once were categorized and in the context and manner of those messages.
I’d urge everyone to check their Facebooks. While I thought the first reports about this were hoaxes (and Snopes continues to report that they are, and the US mainstream media have taken Facebook’s side), I’ve taken a look at my Facebook and the structure of some of these “public” 2007â9 messages are akin to private ones. Better yet, check your own and see if your private messages have been broadcast.
PS.: At one netizen’s suggestion, I looked back through my 2007 notifications and can confirm what Facebook saysâat least for messages before August 1, 2007 (the day I turned off wall post notifications). Every notification correlates with a wall post or a wall-to-wall. I’m still convinced the annual summary that year showed far fewer than 786, so my only conclusion there is that Facebook must have not shown a lot of the wall-to-walls.âJY
After I got back from India, my desktop computer went into meltdown. This was Nigel Dunn’s old machine, which I took over after he went to Australia, and it gave me excellent service for over two years.
I wasn’t prepared to go and buy a brand-new machine, but having made the plunge, I’m glad I did. The installation went rather well and the only major problem was Wubi and Ubuntu, which, sadly, did not do what was promised. The installer failed, the boot sequence either revealed Linux code or a deep purple screen, and the time I spent downloading a few programs to sample was wasted (not to mention the two hours of trying to get Ubuntu to work). Shame: on principle, I really wanted to like it.
Funnily enough, everything on the Microsoft end went quite well apart from Internet Explorer 9 (the same error I reported last year), which then seemed to have taken out Firefox 9 with the same error (solved by changing the compatibility mode to Windows XP). Eudora 7.1 had some funny changes and would not load this morning without ﬁddling with the shortcut, Windows 7 forgot to show me the hidden ﬁles despite my changing the setting thrice, and there were some other tiny issues not worth mentioning. But, I am operating in 64-bit land with a lot of RAM, DDR5s on the graphics’ card, and more computing power than I could have imagined when, in 1984, my father brought home a Commodore 64, disk drive, printer and monitor, having paid around NZ$100 more than I did on Tuesday.
I could have gone out and bought the computer last week, after the old machine died. But there’s the whole thing about New Year. The focus was family time, preparing food and pigging out for New Year’s Eve (January 22 this time around), and New Year’s Day is deﬁnitely not one for popping out and spending money.
Which brings me to my next thought about how immigrant communities always keep traditions alive. You do have to wonder whether it’s still as big a deal “back home”: I was in Hong Kong brieﬂy en route back to Wellington, and you didn’t really feel New Year in the air. There was the odd decoration here and there, but not what you’d imagine.
It’s the Big Fat Greek Wedding syndrome: when the ﬁlm was shown in Greece, many Greeks found it insulting, portraying their culture as behind the times and anachronistic, while they had moved on back in the old country. The reality was a lot more European, the complainants noted.
And you see the same thing with the Chinese community. People who would never have given a toss about the traditions in the old country suddenly making them out to be sacrosanct in the new one. Maybe it’s motivated by a desire to transmit a sense of self to the next generation: in a multicultural society, you would hope that youngsters have the chance to pick and choose from the best traditions from both their heritage and their new nation, and carry them forward.
A retro note: I love Fontographer 3.5. So I put it on a virtual machine running XP. Fun times, courtesy of Conrad Johnston, who told me about Oracle VM Virtual Box.
I also found a great viewer, XnView, to replace the very ancient ACDSee 3.1 that I had been using as a de facto ﬁle manager. (Subsequent versions were bloatware; XnView is freeware and does nearly the same thing.) I’ve ticked almost all the boxes when it comes to software.
Because of the thoroughly modern set-up, I haven’t been able to put in a 3Âœ-inch ﬂoppy as threatened on Twitter. Fontographer was transferred on to a USB stick, though I have yet to play with it properly inside the virtual machine. Both the Windows 7 and virtual machines are, in typical fashion, Arial-free.
Although I have seen VMs before, I am still getting a buzz out of the computer-within-a-computer phenomenon.
To those who expected me to Tweet doom and gloom from my computing experience last night, I’m sorry I disappointed you. My posts about technology, whether written on this blog or on Twitter, are not to do with some belief in a computing industry conspiracy, as someone thought. The reason: to show that even this oh-so-logical profession is as human as the next. Never, ever feel daunted because of someone’s profession: we are all human, and we are all fallible. Sometimes I like reminding all of us of that: in fact, the more self-righteous the mob, the more I seem to enjoy bringing them down to a more realistic level, where the rest of us live. We’re all a lot more equal in intellect than some would like to think, and that assessment goes right to the top of the political world.
Above: My Facebook Timeline, as it appeared in October.
As more of the planet gets on to Facebook Timeline, it’s been interesting to watch reactions.
When Facebook went to a new layout three years ago, plenty of peopleâmyself includedâwent to an anti-new Facebook group. Most were there because they didn’t like change, threatened to leave, and failed to carry out their threat. It was like those who said they would stop reading tabloids after the Princess of Wales diedâas circulation rose the following year.
I joined not because I disliked the changeâI thought the redesign was quite goodâbut because Facebook never did any testing and we were the guinea pigs. The new design was about as reliable as a Wall Street banker, and given it kept failing, I joined to voice my opposition.
No such issue with Timeline, at least not till regularly. Having been on it for two months, I haven’t come across the concerns the majority haveâat all.
Here are a few I’ve heard, including in the mainstream media.
My privacy is compromised. How? Timeline has exactly the same settings as Facebook had, prior to Timeline’s introduction. I didn’t like these new settings when they were introduced in mid-September, because I was used to shutting my wall off to certain people (e.g. those having a company name on a personal accountâyes, I did want to hear from the company, but no, I don’t know who runs the account), but I could see the merit of having public posts which rendered such a setting irrelevant.
If there was a time to complain, it was three months ago. If you’re complaining now, you’re well late. I doubt Facebook will make any changes since relatively few of us made any complaints when the privacy settings were changed last quarter. Those of us who knew were probably spending more time ﬁguring them out and protecting ourselves.
People can now see what I posted x years ago at an instant. Among the changes was a setting that allowed you to restrict all past posts. That was a new privacy entry that wasn’t there before September. Use it and restrict them to yourself, or yourself and your closest friends. I never had this problem, since Facebook always had different classes of friendsâat least since I joined in April 2007âand my statuses were always customized to different audiences.
People can now go back to a particular year and ﬁnd out more about me. True, but see above.
Itâs ugly. This is one I have some sympathy with. Design is subjective, and there is some merit to the argument that Timeline introduces extra elements on to the page (see below). The rule of good design, in my book, is the reduction of elements. So in some ways, I can understand this complaint, but, I rather like the idea of a “timeline” going down the middle, and I can see why Facebook used the two columns: to minimize the need to scroll.
I can’t go back to the old Facebook. I always thought it was clear that when you changed, that was it.
As usual, my problems with Timeline seem to be different to those of the general public.
Why two friends’ boxes? When Timeline was introduced in September, it was actually cleaner than it is now. There was one friends’ box: in the header. Last week, when it was rolled out to New Zealand, a second box was introduced that was completely superﬂuous.
I joked that this was typical of American design. They start out with a clean design, like the original Buick Riviera or Oldsmobile Toronado, or even the Ford Taurus, and then they add unnecessary stuff to it and clutter it up. That’s what’s happened with Facebook.
This second box is probably not helping people understand what Timeline is about, and it does contribute to its clumsy look. Amazing how one thing can ruin it, but that’s how design sometimes works.
The location settings. When Facebook allowed friends to tag you at a location, it also gave us the option to approve each tag. Problem: this has never worked properly if using Mobile Facebook. Even when you change the settings to allow automatic tagging, they don’t tend to stick and the tags plain disappear regardless.
You can no longer use the lists properly. This was a huge surprise, when Facebook stopped me from selecting ‘Limited Proﬁle’ in any privacy setting, be it a status update or a photo album. This has still not been ﬁxed. I traced the bug to Facebook’s new inability to add fan pages to your lists. It still allows you, but beware: adding a fan page to any list will render it inaccessible for your privacy settings.
Not many people seem to care about this one, though there are complaints about Facebook’s ‘Smart Lists’ on its fan page. The majority doesn’t use them, or was unaware they even existed till this year, calling Facebook copycats for taking a Google Plus feature. As mentioned above, it’s certainly been there since the mid-2000s, so I’m unsure how Facebook in 2007 managed to copy Google in 2011.
I’ve got to scroll down a long way. At the time of writing, I have to scroll down six days before I can see my December summary. Before the roll-out, Facebook had this ﬁxed at a number of posts. I preferred it beforeâagain, this lengthy scrolling is contributing to the public’s concerns about Timeline’s concept and their privacy.
The Friendfeed and Tumblr plug-ins no longer work the same way. Facebook will gather up a series of posts before it puts a summary into a Timeline “box”. The Tumblr ones have totally disappeared. (Tumblr has been notiﬁed.)
Despite my many misgivings about Facebook, especially about its privacy changes over the years and the imposed defaults that it got a lot of ﬂak about, I have increased my usage at the expense of Tumblr and other services. I now make public posts for the subscribersâthose I choose to have outside my friends’ list. When Facebook killed my Limited Proﬁle last week, I spent some time doing a cullâI’ve cut my list down by about 80 people, including those I was on a business club with but who never shared a single Facebook post with me in two or three years. (âI must have killed more men than Cecil B. de Mille.â) In my mind, these have all been healthy moves.
Popping by others’ pages is a bit more enjoyable, seeing what graphics they have chosen for their headers, although I have spent very little time visiting. I have spent some time âﬁlling in the gapsâ over November with pre-2007 statuses and photographs for me, and adding locations to other statuses.
In most of these cases, only my real friends know them: that’s the beauty of having availed myself of the privacy settings since day oneâand keeping an eye on them on a very regular basis.
Facebook never took a step back, so I’m afraid no matter what our complaints are, they’ll fall on deaf ears. Even after posting the solution to their newly introduced lists’ bug on to Facebook’s Lists’ Team page, they haven’t lifted a ﬁnger to ﬁx the faultâbut, then, since it doesn’t affect the boss, it might never get ﬁxed.
As long as their member numbers keep growing, Facebook might think itself impregnable, even if I like Timeline. Altavista once thought it would remain the number-one website in the world, too.