Risk and Security in the Telecommunications Industry Series – Part 1

The worst case scenario – a strong earthquake strikes California, disabling the carrier hotel at One Wilshire, disrupting operations at submarine cable landing stations in both the Los Angeles area and central California, with a resulting tsunami hitting Hawaii, Guam, the Philippines, Taiwan, and Japan.

LA Hit by TsunamiCommunications are severed to most of the South Pacific, and severely degraded to allow for only emergency services and national defense usage within the west coast of the United States. Financial and government communications are disrupted and severely limited into Japan, Hong Kong, and China.

Telecom carriers in Singapore, Japan, Hong Kong, China, and Australia work frantically to restore cable, Internet, and telecom capacity from the Pacific submarine cable systems through the Indian Ocean to Europe and the US east coast. Seattle and San Francisco still have some connectivity, however cable systems from Grover Beach to San Diego are inoperable, limiting connections to those which were designed with automatic rerouting through North Pacific cable systems.

Sound crazy? No, it is not crazy, and there is a very good possibility a similar scenario will occur within our lifetime. In fact, when you look at the concern raised when the recent Los Angeles “Station Fire” threatened the telecommunications facility at Mt. Wilson many people were surprised at the potential disruption to both civilian and government communications if that facility were destroyed.

Los Angeles law enforcement uses the transmission towers to manage emergency communications throughout the LA area, fire departments, AM/FM radio stations, digital broadcast television stations – many were single threaded through Mt. Wilson as their primary local communications infrastructure. Not to mention the three letter federal agencies which use the facility for, well whatever they use it for…

Not a New Problem

Several US agencies have looked at this problem for many years. Agencies addressing the problem include the National Communications System (NCS), the Federal Communications Commission (FCC), the National Reliability and Interoperability Council (NRIC), the Department of Homeland Security (DHS), and an additional continuing special taskforce mandated by the president called the National Security Telecommunications Advisory Committee (NSTAC).

As recently as four years ago, an NSTAC report concluded “the telecommunications industry has shown that it is unlikely that a loss of assets in a single telecom hotel would cause a nationwide disruption of the (USA) critical telecommunications infrastructure.” Which may be true for the US infrastructure, as all major American carriers are interconnected at numerous locations scattered across the United States. In short, while the local LA community may be seriously disrupted in the event of the big earthquake, communications between Miami and New York would still be possible with little disruption.

AT&T, Sprint, Verizon, and QWEST are all well-meshed in their networks. As long as they are not sharing the same cable routes, or even in some cases the same actual cables, if the companies are subcontracting their long distance or local loops from other wholesale cable companies such as Level 3, XO, or Time Warner Telecom.

The International Factor

Ten years ago the United States could stand alone in our communications infrastructure. International communications were strong, and submarine cables were in use, however much of the international communications infrastructure was still done through use of satellites. Even if a submarine cable was disrupted, carriers could easily restore their communications through use of existing satellite restoral and recovery agreements.

Now, in the Internet age of high capacity telecom infrastructure, generally provisioned in multiples of 10 Gigabit per second links, satellite capacity has quickly become a fraction of the bandwidth driving international communications. Even the old telephone networks are being integrated by international and US carriers into their Internet infrastructure, often sharing the same circuits are streaming media, social networks, general web traffic, and other entertainment applications.

This will not be as easy to restore in the event California gets the big earthquake we all know is coming.

The Risks and Vulnerabilities Series

This series will look at several aspects of the telecommunications business, including:

  • International telecom vulnerabilities
  • Government interest, activities, and opinions on the risks and vulnerabilities of both US and international communications infrastructure
  • The role of the carrier hotel and internet exchange point in international communications
  • Interviews with people on the front lines of communication security
  • Recommendations for both the telecommunications industry, and the global user community

I look forward to reader comments, critiques, flames, constructive recommendations, and other ideas related to this discussion. Please add your comments to this blog, and I will ensure your voice is both heard and considered.

John Savageau, Long Beach

Gaming in the Clouds – China Game Forum Los Angeles

Liu Chang from the China Ministry of Culture opened the China Game Forum in Los Angeles on Wednesday with encouraging words for both Chinese and foreign gaming companies. “China will provide tax incentives for companies to develop gaming within China,” said Chang, as well as promote funding for companies choosing to develop gaming with the country.

Chang believes development of a gaming industry in China is yet one more indication that Chinese people are improving their quality of life by having access to new leisure activities, including gaming.

At the China Gaming Forum, sponsored by ChinaCache, around 40 executives from both China and the United States gathered to discuss the state of China’s gaming industry, data centers, and the future of cloud computing within the gaming and social network community.

Richard Xu, COO of ChinaCache, highlighted the growth of the Chinese content delivery and gaming industry in both China and the United States. Having just closed their third round of funding, at a nice tag of $10 million, ChinaCache has now extended their global presence to sites in China, The US, Germany, London, Singapore, and Korea.

“Our toughest test was bringing 300,000 concurrent users online to watch streaming video of the China National Day celebration, which we supported without any processing or transmission errors” continued Chang.

ChinaCache also used the opportunity to announce their Los Angeles expansion into a new facility, designed to support Chinese gaming products, with an additional 9000sqft of space driven by over 750kW power.

Pacific Tier Communications presented an overview of the data center, telecom and Internet interconnection, and cloud compute technologies used to support both gaming, as well as the content delivery industry.

Joe Zhu from ChinaCache continued with an overview of ChinaCache’s approach to supporting gaming, including a case study on their largest North American gaming customer. “We are supporting a large global multi-user gaming platform, Empire Craft, with the following main objectives:

  • Better web control and acceleration
  • High performance software and client downloads
  • And managed hosting”

Following Joe Zhu’s introduction a panel discussion looked at the issues of hosting gaming and social media in traditional data center environments versus within cloud computing environments. Panelists included:

  • Jason Hoffman – Joyent
  • Tommy Jiang – MySpace
  • YongChul Yang – ChinaCache
  • Erik Klinker – BitTorrent

A variety of topics were hit, with a couple notable discussions, including:

  • MySpace – Tommy Jiang is an applications developer and coder for MySpace. He really doesn’t care if a server is a physical server, or a virtualized server, as long as it stays online and does the job. Tommy doesn’t get close to the data center or physical server, he just expects the server and server capacity to be available when he needs it for his applications.
  • Joyent has the idea that with cloud computing, it might be possible to bring server and compute resource capacity up to the utilization levels traditionally enjoyed within the scientific community. Or in short, use your resources at >80% all the time, and do not waste available resources.
  • All panel members agreed that the end user should have the ability to determine where their data physically exists, even if it is managed within a cloud.
  • The panel discussed the idea of on-demand processing. Tommy started the conversation by stating “when you initially write an application, you don’t know whether or not it will be a success.” However when you write the application today, you need to plan for and order physical resources to support your application. If the application fails, you have a lot of expensive, unused resources. If the application is successful, and you under-estimate the need for resources, you have sever performance problems and unhappy users. Both are unsatisfactory conditions that could be better met through use of on-demand or elastic access to compute resources.
  • Jason discussed the idea of interoperability among cloud services providers, stating “today most companies see this as a provisioning problem. It is not, it is an infrastructure standardization problem.”

The panel discussed many other issues, and had a very good interaction following the conference in an open networking opportunity.

China is getting aggressive supporting not only gaming, but also cloud computing. Additional conversations with guests from both the telecom carrier industry, as well as gaming services companies clearly indicates Chinese companies have fully engaged in the gaming, and cloud space.

ChinaCache, while initially started to support the Chinese content community in the US and homeland, has started becoming large enough that they now have the ability to compete with large American content delivery networks/CDNs such as Akamai or LimeLight.

It will be a lot of fun to watch the development of both the Chinese gaming industry, as well as the CDN industry over the next year. Both industries are run by smart, aggressive, and globally aware teams, and we will expect both industries to have a very large impact on the internet-connected community.

John Savageau, Long Beach

October Means Energy Awareness – What’s Your Carbon Footprint?

I drive a 2004 Ford Mustang with a little “6 Banger” giving me the illusion of driving a sports car. Using the Carbon Footprint Calculator my annual carbon footprint driving the Mustang at 15,000 miles is 6.99 tons. Having used (according to my SoCal Edison bill) 323kWh of electricity during the last billing period, I could be charged for an additional .09 tons of carbon. Looking at the footprint generating from a month of using Metro Rail to go to and from Long Beach to downtown Los Angeles the footprint adds, well it adds almost nothing.

Fossil Fuels - OilNow I probably use a lot less electricity than the average person, so my electrical carbon load is not too bad. My Mustang is a pig, but not as big a pig as say, an Escalade, which would be almost twice as dirty as the Mustang. Versus a Prius, which would produce 3.2 tons of carbon, I don’t fare so well.

Anyway you look at it, it is a lot of carbon, all finding its way into the environment, ozone, oceans – anyplace carbon can fly or die into the planet.

October is the International Month of Energy Awareness. The US Department of Energy reminds us that “no matter how large the problem may appear, the fact remains that each of us is a part of the solution.” Is it cute political rhetoric, or is it something we need to seriously consider? Do we need to think about “switching off unnecessary lights and equipment, using efficient ENERGY STAR® products and compact fluorescent light bulbs, and driving fuel-efficient and alternative fuel vehicles?”

You bet.

Energy Awareness Month has been around since about 1981, when it was a mere Energy Awareness Week. In 1986 a few forward looking folks in the Department of Energy pushed to extend this week of awareness to a month long campaign envisioned to aggressively bring energy awareness to all Americans. Now, withCarbon Spewing from Factory the rest of the world, including our fellow Americans, awakening to the realities of global warming, carbon impacts on the environment, and the risks/dangers of living in an energy inefficient world, Energy Awareness Month is finally getting its time in the spotlight.

Carbon Footprints in the Home

The Consortium for Energy Efficiency (CEE) provides some great guidelines and ideas for creating energy efficiency within the home. For those cretins who do not find that interesting, the same “green” thinking is also translated into monthly savings in utility and other energy fees through simple things we can do at home to use less electricity – and still maintain a high quality of life.

Have you heard of the Energy Star program?

ENERGY STAR is a joint program of the U.S. Environmental Protection Agency and the U.S. Department of Energy helping us all save money and protect the environment through energy efficient products and practices.

For the Home

Energy efficient choices can save families about a third on their energy bill with similar savings of greenhouse gas emissions, without sacrificing features, style or comfort. ENERGY STAR helps you make the energy efficient choice.

  • If looking for new household products, look for ones that have earned the ENERGY STAR. They meet strict energy efficiency guidelines set by the EPA and US Department of Energy.
  • If looking for a new home, look for one that has earned the ENERGY STAR.
  • If looking to make larger improvements to your home, EPA offers tools and resources to help you plan and undertake projects to reduce your energy bills and improve home comfort.

Starting to sound a bit more interesting?

The CEE goes on to reinforce cooperation between the Department of Energy, Environmental Protection Agency, NEMA, utilities such as SoCal Edison and PG&E (look at their websites for some great ideas, rebate programs, and general energy information), and gives a good listing of areas that we should look at in the home to become more energy aware (and save money for the rest of you folks), including:

  • Super-Efficient Home Appliance Initiative (SEHA)  SEHA establishes “super-efficient” efficiency levels for refrigerators, room air-conditioners, clothes washers and dishwashers. By promoting products that meet these specifications, SEHA complements the ENERGY STAR® Appliance Program and encourages manufacturers to increase efficiency levels.
  • High-Efficiency Residential Lighting Initiative  The objective of this initiative is to increase the availability and acceptance of energy-efficient lighting (including fixtures), and create a self-sustaining market for this technology.
  • Whole House  The “whole-house” approach, which applies to new construction and existing homes, sees the house as a collection of interacting systems. The greatest promise of decreasing energy use while increasing health, comfort, and safety is to create a cross-disciplinary understanding of the fundamentals of these systems.
  • High-Efficiency Residential Central Air Conditioning and Heat Pump Initiative      This initiative promotes high-efficiency specifications and proper installation for central air conditioning and heat pumps. In 2007, CEE revised its Residential HVAC Installation Specification, a document that defines energy-efficient installation practices
  • High-Efficiency Gas Heating Initiative  By promoting high-efficiency specifications for gas furnaces and boilers, the initiative is increasing demand for this equipment. The proper installation of energy-efficient equipment is another key element of the program.
  • Consumer Electronics Initiative  CEE’s Consumer Electronics Initiative aims to increase the energy efficiency of consumer electronics, focusing on televisions, set top boxes, and computers. As part of this initiative, CEE provides support to members who are considering running efficiency programs in this area.

    Rolling in More Green Incentives
    The Pickens Plan website gives us further incentives to think about energy efficiency. In addition to the long, long listings of environmental reasons why we should not continue to trash our planet, the financial incentives to get “green” keep coming. Are you doing a DIY (do it yourself) upgrade to your house? Ka-Ching, possibly another $1500 tax credit.

    We discussed simple things in earlier posts like using solar-aware tiles on your roof. Which, if using the highest efficiency tiling materials could save a household in Phoenix up to 70% in the cost of cooling.

    A couple of interesting facts from Corning:

    • Adding efficient insulation in your home can save up to 20% on your cooling and heating bills
    • Turning your thermostat from 72deg (F) to 65deg can save 10% on heating bills
    • Using single pane windows can cause serious heating and cooling loss, possibly adding another 25% to your cooling and heating bills
    • Using energy efficient light bulbs can reduce your lighting bill by as much as 50%
    • Old appliances, such as refrigerators, ovens, dryers, and washers can account for 20% of your energy consumption – go to Energy Star appliances
    • Do you have a fireplace? An open damper, if left open, is about the same as leaving your front door open during the winter or hottest day of the summer

    Wow, that is a lot of potential savings.

    Just checked with my family in the nether lands of some remote outpost in Minnesota. The power usage is Energy Efficient Light Bulbaround 2450kWh in January this year. In an old house. 1.69 tons of carbon just from the electricity used in the house. If you add a small village like Duluth, MN, with a census of 90,000 people in 2000 (lots more now), and assume 4 persons per household, you will come up with roughly 22,500 households. If you take off 10% for my old inefficient childhood home, you will still get 1.53 tons per household.

    34,425 tons of carbon in January produced just by households in Duluth. We are not adding industrial buildings, commercial buildings, Superior (Wisc), the Port of Duluth, the taconite processing plants, etc., etc., etc., and you will see even quaint little Duluth is providing plenty of fuel for the north woods to use in their vocation of providing photosynthesis services for northern Minnesota.

    Now, if we could find a way to reduce that carbon footprint by around 40% just by changing a few things around the house and office – that is a huge carbon footprint savings. Oh yes, for you non-tree huggers out there it also represents a big bag full of money.

    Are you angry about this topic? For? Against? Weigh in. At least we are accomplishing our objective to help create improved energy awareness.

    Next time we’ll start chiming in on other related issues such as recycling, water conservation, and other fun topics that are nonetheless important to ensuring our next generations have a planet that will support and sustain a great quality of life for all.

    Happy Energy-Aware October!

    John Savageau, Long beach

     

     

     

3tera Drops IPv6 Into Their AppLogic Cloud Computing Platform

“If we look at cloud (service) in a global sense, not just as my service or your service, or my country or your country, then IPv6 is part of the future and the solution.” (Bert Armijo, SVP 3tera)

IPv6 is hitting everybody in the Internet industry on a global scale. 3tera recognized early in the evolution of cloud products that IPv6 was critical for long term, and short term development of their AppLogic product within both public-facing Internet services, as well as cloud deployments within the enterprise. The need is real.

The IPv4 Reality 3tera Faced

The Internet operates with devices connecting to each other on a global scale. Each device, wither a physical switch, server, or computer, has an address. Each application, piece of data, and content is located in the Internet through use of an address. Everything in the Internet uses an address. Currently address defined in the Internet Protocol Version 4 (IPv4) is the most widely used series and sets of addresses. And we’ve used up most of the available addresses.

The American Registry for Internet Numbering (ARIN) is very clear on the dangers of ignoring the velocity of IPv4 address depletion. ARIN is very clear that less than 15% of the available IPv4 address space remains for distribution in the global community, and if depleted, the Internet will stop growth at that point. There may be temporary measures and “work-arounds” to get us through the near term, however the cold hard fact remains that our Internet is in danger of running out of address space.

In a notice sent to the US Internet community they were very clear in a couple of points what will happen if the US Internet community ignores the need to adopt and migrate to IPv6:

BE IT RESOLVED, that this Board of Trustees hereby advises the Internet community that migration to IPv6 numbering resources is necessary for any applications which require ongoing availability from ARIN of contiguous IP numbering resources; and,

BE IT RESOLVED, that this Board of Trustees hereby requests the ARIN Advisory Council to consider Internet Numbering Resource Policy changes advisable to encourage migration to IPv6 numbering resources where possible. https://www.arin.net/knowledge/about_resources/v6/v6-resolution.html

While IPv4 gives the Internet-connected world about 4.2 billion address, IPv6 gives the world around 3.4 x 1038 addresses. That is a bunch of addresses… Enough to get our planet through a couple more generations of Internet users, and well enough to connect virtually every possible virtual or physical device we as a species are likely to need in the next thousand years or so (OK, maybe a “forward looking statement”).

3Tera Takes on IPv6

The Los Angeles area is good place to meet the folks at 3tera, familiar faces at local industry and community events. Sometimes considered scary in their vision of the network and applications-enabled future, sometimes considered really good guys who are a lot of fun to talk with at a conference, or in the parking lot after an event. Normal guys, until they start talking about their trade. And 3tera guys are very serious about their trade.

AppLogic InterfaceMake a seemingly simple comment like, “what have you done in 3tera’s product AppLogic for developing IPv6?,” and you are awarded with a cold stare, silence, and the fear you have either said something so incredibly stupid that it is a conversation killer, or you have struck a nerve.

With Peter Nikolov (President, CTO, and COO) and Bert Armijo (SVP Sales, Marketing, Product Management, and about everything else…) the IPv6 nerve ran deep, and understanding their position in the cloud computing market, the critical issue of IPv4 depletion, the enabling qualities of adopting IPv6, and the reality our planet will need leaders in the IPv6 space, 3tera rolled up their sleeves, put more coffee in the room, and started breaking down the problem.

And on October 1st, 3tera formally launched IPv6 support in AppLogic

While in the US we have started creating awareness in the need to move to IPv6, Bert reminds us that overall, the urgency to accelerate IPv6-enabled applications and network support is more acute in Europe and Asia than in the United States. “Internationally there are fewer IPv4 addresses available (through the regional Internet address registries), addresses are harder to order (longer and more complex justification process), and are much more expensive.”

Thus 3tera has recently received much more interest in their IPv6 product planning and roadmap from both Asia and Europe than even in the US, which should also serve as a wakeup call for Americans.

What Does 3tera’s Implementation of IPv6 do for the Client?

Bert Armijo understands that building an IT infrastructure in a company is difficult enough, without the additional burden of planning for migrations, restacking applications, renumbering applications, and deploying those applications is tough. The whole philosophy of building into a cloud is to enable rapid deployment of presence and applications, and be able to control the cost of labor and capital needed for both organic and season (event driven) growth.

“We wanted to break this problem down to the simplicity of a software appliance,” advised Bert. “We built IPv6 support into Applogic (3tera’s cloud operating system and main product) as a drag and drop appliance, which when using an existing (Applogic-enabled service) would allow the user to drag and drop the IPv6 appliance into their application and automatically configure the application for IPv6 support.”

“…until now, IPv6 adoption has been slowed by the perception that it requires both support on the client side and complex code changes in applications. With its AppLogic cloud computing platform, it is no longer necessary to make changes in the configuration of the software in order to be able to support IPv6, while still keeping the data available to IPv4 users.” (from 3tera PR)

This of course works from the ground up as well, offering support to build infrastructure in native IPv6. Something the Asians and Europeans are jumping on, and something the American IT community should seriously consider.

Bert goes through a list of applications that are being made aware of IPv6 within clouds, including mobile telephony, video distribution, and security. However the most urgent customer demands fall into both disaster recovery and security implementations through the cloud.

While it is clear cloud has great support, and is starting to meet customer expectations for application and resource management – such as being able to move and schedule resources based on time or geography, there are a couple of interesting implications which are becoming apparent.

The Intercontinental Cloud

“First production implementations (for IPv6 in AppLogic) are for VPNs,” said Bert. “Predominantly for VPNs between continents, such as Asia to the USA, and Europe to the USA.”

Using IPv6 within a wide area distributed network, with the advanced security potential offered within the protocol, brings up some interesting ideas. Such as what is the future of wide area MPLS networks?

If the cloud offers the same level of security, portability, and ability for applications to easily move large data sets within a wide area, both for proximity-based process, least-cost processing, and disaster recovery purposes, then we might have some very interesting developments in the future.

What Next?

There are clearly many more aspects of 3tera’s IPv6 implementation into their AppLogic product, and it is still very early in the development process. Other cloud vendors will eventually bring out their own versions of IPv6 support. Eventually the American IT and Internet industry will awaken to the urgency of not only IPv4 depletion, but also start becoming more involved envisioning what other applications and services may emerge or become possible through a network and cloud resource world running IPv6.

Verizon Wireless will drive their LTE -> 4G network on IPv6, and the entertainment community is frantically learning what the protocol can do for the future of video. President Obama’s CIO has laid down the gauntlet on the US Government to adopt IPv6, and the Asian/European community is beginning to look at the US Internet market as a roadblock in global technology development.

We need to keep our eyes and minds open on what is happening in the IPv6 world, as well as look inside at our own businesses and organizations. We are rapidly approaching one of those points in history where our future will be defined based on our ability to plan ahead for a disruption in technology, the impact of market globalization on even mom and pop businesses (I can order breakfast cereal over the Internet!).

IPv6 will be part of that future. 3tera will be part of that future. An exciting future, and we cannot wait to see what emerges from 3tera’s research and development team next.

John Savageau, Long Beach

The Real Story Behind Independent Internet Consultants?

So you have 20 years of engineering and business management experience under your belt. It is logical that you will have a level of tacit knowledge many companies will pay for.

In the years following the Dot COM meltdown I remember encountering many consultants. Guys we’d worked with for many years, and knew the telecommunications business cold. Everybody thought when the Dot COM Old Guy Possibly a Telecom Consultantmeltdown occurred, these guys would do great with their new consulting careers. I mean, with that amount of experience young companies should be throwing money at these guys with all the experience.

In a recent post on a cloud computing mailing list, an old timer from the telecom days admitted that for him “being an independent consultant means about the same thing as “being unemployed.”

That’s impossible. The old guys are needed, and young companies cannot survive without their experience and leadership. Right?

Or is it also possible that technology is changing so fast right now, that like the old telecom guys who could quote the process of determining minutes ratios, settlement, allocators, and all those other tremendously complicated telecom negotiations just fell by the side as really smart younger guys who were tremendously Internet-savvy blew past them?

Yup – that’s pretty much what happened.

Over the past few years the joke was “you cannot swing a dead cat over your head in downtown LA without whacking an unemployed telecom engineer.” Guys that are struggling every day trying to figure out how to squeeze minutes out of Internet phones. Guys who are trying to grasp the idea of losing everything they understood and worked for in the good old days of Nortel DMS 250/300s and AT&T 4E/5ESS telephone gateway switches.

Guess what… it is happening again. The current economic meltdown, and huge unemployment numbers are hitting the telecom industry. Lots of newly established independent consulting companies on the street, established with a couple hundred dollars and a do-it-yourself LLC incorporation website. The old guys are trying desperately to throw together snappy websites with basic static HTML pages that discuss their ability to provide “powerful solutions” to “all your business needs.”

It is almost painful to see. While at the same time energetic young serial entrepreneurs aggressively hammer away at the emerging cloud computing industry, entertainment and content delivery industries, social media sites, and Internet service providers. Ooops, well maybe the guys running the ISPs should start looking at taking a couple extra courses on cloud computing at their local technical schools, as the ISP business may also be providing us with a new community of consultants during economic difficulties…

There is a need for consultants. Developing countries still lack the basic knowledge and skills needed to bring their country infrastructures up to at least “entry-level” global speed. Smaller cities in the US and Canada are still under served by both telecom/Internet services, and local adoption of Internet-enabled services into the business and local communities.

LA does not need consultants. New York, Northern Virginia, the Bay Area – all those places have passed the late stage worker generation, and left them behind in a heap of wandering consultants. Consultants who were CTOs, CEOs, VPs, …KEY MOUSEs.

The older generation (those of us past 35) need to stop, breathe, and assess where we are with our industries and professional communities. We can either go for the next generation of technology with reckless abandon (cloud computing….), or eventually find our way to the telecom “fossil” bar to talk about the good old days and whine about the indignity of our current situation.

Independent consultants are the same thing as being unemployed… Damn…

I won’t stand for that… Watch out cloud computing community!

John Savageau, Long Beach

Independent Telecom and Internet Consultant

Follow

Get every new post delivered to your Inbox.

Join 185 other followers