$ cat post/the-dns-lied-/-we-blamed-the-cache-as-always-/-the-repo-holds-it-all.md

the DNS lied / we blamed the cache as always / the repo holds it all


Title: November 23, 2009 - Cloud Wars Heat Up


It’s a crisp fall day in 2009. The leaves are turning, and the air is filled with the scent of impending change. This time last year, I was knee-deep in AWS migrations for our team, but now we’re facing some new challenges.

The Move to Cloud

Just a few months back, we made the big switch from colocation to AWS. It was a massive undertaking—transferring terabytes of data, re-architecting applications, and dealing with all the pain points that come with moving such a large system. But the initial excitement faded quickly when I started seeing how much our costs were spiraling out of control.

Cost Management Hell

Cost management has become a nightmare. We’re running EC2 instances 24/7 because we need to keep our applications up, but the spot instance pricing is just too tempting. However, when you factor in the unpredictability and the constant monitoring required, it’s not worth it. Plus, there are unexpected charges from AWS that seem to come out of nowhere.

One day, I had to deal with a sudden increase in usage from one of our apps, which triggered an AWS cost spike. It was like trying to find a needle in a haystack. I spent hours digging through logs and monitoring data just to figure out where the extra charges were coming from. It’s frustrating because you have no control over their billing system—it feels like they’re nickel-and-diming us.

Hadoop Debates

Meanwhile, back at the office, we’re having debates about whether we should use Hadoop for our big data processing needs. Some of my colleagues are convinced it’s going to revolutionize how we handle large-scale data, while others think it’s overkill and that simpler solutions like Pig or even MapReduce in Python would work just fine.

We’re still on the fence here. The learning curve is steep, but if it can save us time and money down the line, maybe it’s worth it. We’ll see how it plays out.

iPhone SDK and More

The iPhone SDK was all the rage back then. Every developer I know was trying to figure out how to make their apps for the App Store. It felt like everyone in the office had one of those little white headsets on, listening intently as they debugged their code.

On a personal note, I’m still trying to decide if I should develop an app myself. The thought is tempting, but the time commitment scares me off. Maybe next year?

GitHub’s Launch

GitHub’s launch in 2008 has really taken off. We’re using it more and more for our version control, but I still find myself resisting its charm. There are times when I feel like everything on GitHub is too noisy—pull requests, issues, comments—it can be overwhelming.

But at the same time, GitHub is becoming a standard tool in almost every developer’s arsenal. It’s making code collaboration easier and more accessible. And who knows? Maybe one day it will be as common to use Git as it is to use version control today.

The Economy

The economic crash of 2008 was still fresh on everyone’s minds. We’re seeing hiring slow down, and the uncertainty makes planning for the future difficult. But tech companies are holding their ground, at least for now. There’s a sense that while things might not be great, they could always get worse.

Agile/Scrum

Agile and Scrum have become the buzzwords of the day. Every project seems to be trying to adopt some form of these methodologies. It’s interesting how quickly people jump on bandwagons—sometimes I feel like we’re just following the latest trends instead of focusing on what’s actually effective.

Wrapping Up

As November fades into December, it feels like there are more questions than answers. We’re still figuring out how to navigate this changing landscape. The tech industry is moving so fast that you can’t help but wonder what new challenges lie ahead.

For now, I’m just trying to keep the lights on and make sure our applications stay up. It’s a tough balancing act, but it keeps things interesting.

That’s where we stand today. What will November 2010 bring? Only time will tell.