Skip to main content

skip to main content

developerWorks  >  Web development | Autonomic computing | Information Management | IBM Systems  >

The cranky user: Performance anxiety

Where does all the processing speed go?

developerWorks
Document options

Document options requiring JavaScript are not displayed


Rate this page

Help us improve this content


Level: Introductory

Peter Seebach (crankyuser@seebs.plethora.net), Writer, Freelance

02 Feb 2005

Computers are getting faster all the time, or so they tell us. But, in fact, the user experience of performance hasn't improved much over the past 15 years. Peter looks at where all the processor time and memory are going.

About 10 years ago I remember people complaining that Microsoft Word was too slow on the Mac. You could type faster than the processor handled input on such a large application. Imagine my disappointment when I recently discovered that the same thing still holds true. Similarly, my first computer with a hard drive loaded a small command-line utility in under a second and a large graphics program in perhaps half a minute. Those are good specs, but isn't it kind of sad that they haven't changed much in the past 15 years?

So the question is, where is all the CPU power going? How is it possible that a machine with a full gigabyte of memory can run out of room to run applications just as quickly as a machine with six megabytes of memory did 15 years ago? In this month's The cranky user, I'll get to the bottom of this big mystery. But first, I want to revisit an old adage and see where it stands today.

Moore's Law revisited

Moore's Law is easily one of the top five misquoted claims ever. The simplified version preferred by most pundits is that computers will become twice as fast every 18 months. In fact, Intel founder Gordon Moore observed in 1965 that the complexity of chips with the lowest cost per component was roughly doubling every year, and predicted that this trend would continue for about 10 years. So Moore's Law doesn't necessarily mean that performance will double; merely that the number of components in the most cost-effective designs will. Moore's prediction was borne out reasonably well by the data, and In 1975 he revised his estimate to about 18 months, which is the number most people cite today.

Interestingly, Moore's Law doesn't necessarily tell as much about clock speeds as it does the complexity of system designs. Modern CPUs do a lot of things differently from older CPUs: for instance, they can execute multiple instructions simultaneously. I also bears noting that whether processing speed is doubling at any predictable rate, it has certainly increased quite a bit.

What's fascinating is that, for most users, performance isn't noticeably any better today than it was 15 years ago. What's the computer doing with all this processing time? One Usenet poster, commenting on OS X's animated rainbow beachball cursor, hypothesized that the processor, like the user, is busy watching the hypnotic spinning beachball.

Jokes aside, computers are, in fact, doing more than they used to. A lot of the things computers do are fairly subtle, happening beneath the radar of a user's perception. Many functions are automatic and, as discussed in last month's column, you could probably do without some of them. But still, a lot is going on. Take a look at some of the primary uses of computer processing power today.



Back to top


Graphical displays

Many modern systems use antialiasing to render text. This makes text easier to read and can substantially improve the usability of low-resolution monitors and LCD displays. On the downside, antialiasing sucks up a lot of processing power. Visual effects like drop shadows behind windows and menus, transparent menus and effects, and real-time effects also consume a lot of processing power. The catch for computer makers is that most users expect them.

For example, older systems used bitmap fonts, which rendered quickly at the provided size but looked ugly at any other size. Most modern systems render outline fonts in real time, which users are now used to. Even with some caching involved, font rendering adds one more layer of processor overhead -- but no vendor would dare release an interface with bitmap fonts today.

The current Mac operating system gets around some graphical overhead by having the rendering hardware of video cards do additional work. The video card essentially becomes a second processor, which cuts down on the graphics processing time. Of course, knowing this makes it even more disturbing when your computer interface turns sluggish.



Back to top


Word processing

As I previously mentioned, most users feel a little put out when they can type faster than a word processor can process words. The worst days of this trend seems to be behind us now: most word processing programs started to keep up with even good typists somewhere around the 1-Ghz clock-speed mark. These days, it's the automatic features on these programs that can slow down your system.

Automatic checking is a default behavior on most word processing applications. Some simply underline misspelled words and questionable grammar while others automatically correct as you type. Not only are these corrections occasionally inaccurate (many writers turn this feature off), but the behavior also requires a lot of additional processing.

Other automatic features in the "do I really need this?" category include one company's famous Office Assistant, as well as many varieties of formatting and workflow automation.



Back to top


Safety and security

A certain amount of your system's processing power goes to improved safety and security features for your applications. Many of these features come in the form of critical security patches, since the original code was written without enough attention to sanity checking. The problem with patches is that they add up over time, meaning that individual ones only marginally affect performance, but taken together they can amount to a decent time sink.

Virus scanners are a more serious power hog than patches. As viruses become a more significant component of the daily user experience, developers are spending more energy (and processing power) trying to fight them. Most virus scanners update themselves regularly, which makes for a small, but noticeable, amount of background activity. They also scan a lot more files than they once did.

The existence of macro viruses for word processors means that virus scanners have to scan data files, not just executables. As a result, a single file might be scanned several times before you access it. Any file you download is scanned first and, since it's an archive, so are its contents. You open the archive in your archive utility, which scans everything in the archive. You extract the file to disk, which causes it to be scanned. Then you open it, and it's scanned again.

All this scanning chews up a lot of processing time, which affects every program running on a system. For instance, a video game that uses a lot of graphical files and loads them on the fly could require the same 20 MB file to be scanned a dozen times during an hour's play.

All that said, security is a worthy and necessary use of processing power, and the alternatives are worse: spyware and viruses can consume incredible amounts of time. Another common cause of slow computers, at least for Windows users, is an accumulation of any number of programs that snoop on traffic, pop up advertisements, or otherwise make themselves indispensable to a marketer somewhere.



Back to top


Program complexity

Program complexity is probably the biggest culprit when your supposedly speedy processor still runs slow. As applications become more complex, a certain amount of their code (and thus your processing power) goes into making them more manageable. This code, which I'll call support code, actually makes programs easier for developers to write. A very large program might incorporate nested layers of support code. For instance, a Linux build of Mozilla might link to 30 or so different pieces of support code -- including support code for the support code that Mozilla uses directly.

The code itself is typically very efficient for its task, and it does make the job of developing large-scale applications much easier. But the code that enables all these small pieces of code to interact in a predictable manner adds a small runtime cost. Once again, a small cost repeated many times adds up to a significant performance hit.

A few of the programs I use on Windows run special programs at system startup. Each of these programs pre-loads its own shared libraries, which in turn allows the program to launch more quickly later. At one point, the delay from the initial appearance of my desktop to my system being responsive enough for me to start using it was up to about five minutes. Why? Because it was running a dozen or so programs to make programs load faster. The irony didn't seem funny at the time, but it does now.



Back to top


In conclusion

A certain amount of code bloat is inherent in all this modern complexity, and I've talked about some of the worst offenders this month: applications that require processors to do extra work that isn't really useful to the user; support code that no one really understands (and that the system may not require), but if you leave it alone it works; over-patched code resulting from too much emphasis on rapid development and not enough on sanity checking. Whatever the problem, overemphasis on time to market is probably a contributing factor.

Another factor is the so-called second-system effect, first discussed by Frederick Brooks in The Mythical Man-Month: when developers do a second project, they want so badly to make it better that they often include ill-considered features that render the resulting system bloated and unusable. Unfortunately, a lot of the systems in widespread use today are second systems. Worse yet, the bloat introduced by a second-system design is often preserved in future revisions to preserve compatibility.

Luckily, the worst is probably over. Around the time when 800-Mhz processors came out, users stopped the driving need to upgrade constantly. Most users today can complete their work without waiting hours for the computer to perform its tasks.

This week's action item: Launch a few applications simultaneously and time their start-ups. Try it again in five years to see whether the time has improved.



Resources

  • Read about the phenomenon of the overactive user interface in Peter's column from last month, Everything's automated! (developerWorks, January 2005).

  • Focus on macro viruses -- the central topic of Peter's column on Usability vs. security (developerWorks, August 2002).

  • In Reducing the user interface by Mark Molander, discover some practical ways to cut the data bloat on your UIs as Mark notes that many applications have far more data and functions than users ever need (developerWorks, June 2001).

  • Bet you didn't know that Wikipedia maintains a page about Moore's Law.

  • Visit The Jargon File for a good description of the second-system effect.

  • Also, avail yourself of these valuable resources on developerWorks:


About the author

Photo of Peter Seebach

Peter Seebach has been using computers for years and is gradually becoming acclimated. He still doesn't know why mice need to be cleaned so often, though. You can contact Peter at crankyuser@seebs.plethora.net.




Rate this page


Please take a moment to complete this form to help us better serve you.



YesNoDon't know
 


 


12345
Not
useful
Extremely
useful
 


Back to top