Industry


Ads by TechWords

See your link here


Subscribe to our e-mail newsletters
For more info on a specific newsletter, click the title. Details will be displayed in a new window.
Computerworld Daily News (First Look and Wrap-Up)
Computerworld Blogs Newsletter
The Weekly Top 10
More E-Mail Newsletters 

The world's fastest computers are Linux computers

There are fast computers, and then there are Linux fast computers. Every six months, the Top 500 organization announces "its ranked list of general purpose systems that are in common use for high end applications." In other words, supercomputers. And, as has been the case for years now, the fastest of the fast are Linux computers.

As Jay Lyman, an analyst at The 451 Group points out, Linux is only growing stronger in supercomputing. "When considered as the primary OS or part of a mixed-OS supersystem, Linux is now present in 469 of the supercomputer sites, 93.8% of the Top500 list. This represents about 10 more sites than in November 2007, when Linux had presence in 91.8% of the systems. In fact, Linux is the only operating system that managed gains in the November 2008 list. A year ago, Linux was the OS for 84.6% of the top supercomputers. In November 2008, the open source OS was used in 87.8% of the systems. Compare this to Unix, which dropped from 6% to 4.6%, mixed-OS use which dropped from 7.2% to 6.2% and other operating systems, including BSD, Mac OS X and Windows, which were all down this year from the November 2007 list."

Microsoft is proud that a system running Windows HPC Server 2008 took 10th place... behind nine supercomputers running Linux. Even then, this was really more of a stunt than a demonstration that the HPC Server system is ready to compete with the big boys.

You see, there are no Microsoft programming tools to write supercomputer compatible applications. That will come years from now with Visual Studio 2010 and when Microsoft's F# is more than a research project language. In short, Windows HPC isn't ready for prime-time.

In the meantime, the real work is being done on the Linux computers. The number one supercomputer? Once more it's IBM's Linux-powered Roadrunner That's the same supercomputer, which this summer broke supercomputing's sound barrier: a sustained run of more than one petaflop per second or 1.026 quadrillion calculations per second. Beat that Microsoft!

The Roadrunner does have competition now though. The Cray XT Jaguar also recently busted the petaflop wall. The Cray also, of course, runs Linux. In the XT's case, it's running CNL (Compute Node Linux). CNL is based on SUSE Linux.

Needless to say, all the Linux systems do have working parallel-processing languages, like GCC, PGI and PathScale. For now, and the foreseeable future, Linux will not only stay the fastest computers, they'll also be the most useful fast computers.

What People Are Saying

Linux

Linux is predominantly known for its use in server.It is also widely installed on a variety of computer hardware that ranges from mobile phones to supercomputers. However, it's popularity recently was contributed to the rise of netbooks.

furthermore...

HPC is no longer confined to national labs and academia. It once used to, but nowadays, many industries with many companies are using HPC systems, tool, and applications in order to support their operations, ranging from day-to-day operations; through long-term strategy planning. You see this in the aerospace, automotive, sports, music, entertainment, financial, medical, etc. etc. etc. The list goes on and on.

Historically, very few of these industries have paid little, if any, attention to HPC because many of the tools and resources, support, and knowledge on how to best use these machines just weren't available or if they were, they were very costly and under strict government regulation. Nowadays, the hardware's capability, and the cost have come down so much that you can have a piece of the supercomputer in your own home with any of the current generation consoles.

And people have asked me why you should care about HPC systems? Because they will help shape, define, and move the entire computing industry. Where parallel processing is "new" today (with afford quad-core systems), it is considered old school, really really old school in the HPC world. So, don't be surprised to find HPC-level technology today in your home in the next 10-20 years or so.

But just what is "High Performance" anyway?

Back when I worked in an IBM mainframe shop doing networking, they had a team of 3-4 "systems programmers" who were constantly monitoring and tweaking the system.

It consisted of two $multi-million ES9000 systems, doing massive record keeping for a large manufacturer. This included the utterly critical "Order-Ship-Bill" tracking database, and from that the statistical analysis needed to balance costs, profits and taxes/regulations internationally.

With access to the source-code, these systems programmers' job was continual optimization. Without it, the company would have needed to waste a LOT more money on hardware to keep up with a growing business.

At the time, that was a supercomputer and the need for source code was just as critical as it is today. If anything, HPC makes access to all source code far more important than for some schmoe with their desktop that they don't ever utilize at 100% anyway.

HPC OSes

To answer some of the questions that people have -- mixed OSes is as reported by/to Top500. Typically, (or at least historically), it was a parallel version of LINPACK (LINPACK HPL) which is also generally written in C and than launched (presumably as a single instance) that then spawns the number of threads/processes such that it equals the number of processors and/or processing units/cores.

That's the basic jist of it. And solves a linear algebra equation of Ax=b.

However, for HPC applications, it's a little different than running your home systems. (Unless your home system is a very tiny HPC system.)

Example of a mixed-OS could be that the compute nodes run Linux, while all the supporting systems (I/O, storage, data management, scheduling, etc.) can run on something else. This would be probably particularly true for "Roadrunner".

Notice also that a lot of the applications running on these systems are highly customized applications designed to a very very specific scientific or engineering task. While HPC is growing in industry as a competitive advantage, still; there's a general lack of availability HPC-level application without some major rewriting or tweaking/tuning.

So, until Crysis HPC and Office 2007 HPC can be had, it doesn't make a difference. On the other hand, if you know what you're doing; you can really make these machines SCREAM with performance that most normal, simple folk just can't wrap their puny little minds around.

Linux, but not Linux == Linux

What is this "mixed OS" baloney? Why not give numbers that represent true Linux supercomputers? What is "mixed"? 10,000 SGI nodes and an Ubuntu controller box? Does that make a Linux supercomputer? Why the need to stack the deck, aren't the pure linux numbers good enough for this reporter?

If Linux is as good as everyone says then it should stand on its own. You don't need to "help" it. This is Journalism 102.

Awesomeness.

The OS for All Computers: Linux.
Whether you have 4MB of RAM and a 66MHz processor on a tiny system or lots of nodes that add up to a PFlop, there's a Linux for every system. Brilliant, thanks Linux. And don't forget GNU, and all the other multinationals like Canonical that helped and sponsored us, and the public. Open source rocks!

Nothing against BSD but it still beats BSD on hardware compatibility. (I don't mean processors, yes, you win NetBSD)

Thumbs up to our community!

Ubuntu

Ever since I switched to Ubuntu I never looked back.

Don't forget kde

Once KDE 4 gains a few more upgrades, I will have no more need for Windows. And my 'need' consists of playing games, most of which can be emulated in CrossOver.

linux win mac

we know that linux is great for server / supercomputer, but for client many people still use windos and mac :)

Don't write off Windows HPC

I'm sure it can just about run Crysis ;-p

And wow, I bet Office 2007 starts and runs almost within reasonable times.