Australian grid computing: Creating science fact

Beware the cluster hog


In order for Dr Carlo Kopp, a lecturer in Computer Architecture at Monash University, to attain his title, he had to solve a series of "very intensive parametrised propagation simulations", or big complex problems.

Luckily, Dr Kopp found himself at Monash University, where his research became a simulations guinea pig for Abramson's recently-commissioned clusters.

"I wanted to buy the biggest number-crunching machine the budget could support," Kopp explains. "I started with a 20 CPU cluster, hogged it completely, and kept hogging it, no matter how many CPUs David [Abramson] got the budget to add."

As a result, Kopp was able to take his research beyond the boundary simulations he had originally planned and was eventually able to map out the problems in considerable detail.

Despite his initial scepticism, Kopp soon overcame concerns regarding cluster software fragility, becoming a self-confessed departmental cluster hog, as well as an enthusiastic evangelist of the technology.

According to the CSIRO's David Abel, Kopp's previous scepticism is not uncommon amongst researchers, and this fact continues to present a significant hurdle to the uptake and development of grid computing.

"Awareness is another issue we need to overcome by making business and the science community aware of the potential of grid computing," Able says, pointing out that heightened interest in, and understanding of grid computing should lead to an increase in applications development in the area.

Martin Sevior, a grid computing convert and associate professor at the Melbourne University School of Physics, is currently involved in the development of applications aimed at solving high-energy physics problems.

"Basically I investigated it [grid computing] closely and decided it really did work," Sevior says. "We're currently involved in two very large-scale experiments; one in Japan that has already generated in the order of ten terabytes of data, an amount which we expect to increase by a factor of ten."

Using grid computing, Sevior believes it will take approximately one year to complete computations which might have otherwise taken ten. Ultimately, he hopes it will help him to locate proof of theoretical physics measure known Higgs Boson, which is thought to provide particles with their mass.

"In order to find it we need to create particle collisions at energies greater than anything that currently exists, and examine trillions of collisions. Without grid computing we would be an order of magnitude short of time and money," Sevior explains.

At this stage, the diverse but interconnected Australian-based developments in grid computing benefit from what Able describes as a "remarkable" but largely informal degree of cooperation. Through projects such as Grangenet, and what Dr Buchhorn describes as a certain degree of "generosity" with respect to grid computing resources, Australia could well carve a niche at the forefront of applications development in this area. Not to mention convert the "bang for buck" advantages of grid computing to advances in other areas of scientific endeavour.

"We need to combine the disciplinary expertise with the core academic strengths," Able says. "Collaborations of the kind we are already seeing are essential. If we compete as a set of small teams we will get left in the dust."

Advertisement

Talkback 4 comments

  1. I'd gladly donate excess processing power of 3 PCs except I'm capped on data. I think most Australian's would give excess processing time to the scientific community if they didn't have to worry about their data cap being used up in a day. Sorry, Telstra Kevin Dicker -- 12/08/02

    I'd gladly donate excess processing power of 3 PCs except I'm capped on data. I think most Australian's would give excess processing time to the scientific community if they didn't have to worry about their data cap being used up in a day. Sorry, Telstra and the lack of initiative from the Federal Government is the scientific communities greatest bane to achievment of their greatest hope.

  2. Grangenet is fine if you happen to be in the 4 cities served by it, but another case of eastern seaboard favouritism if you're not. Anonymous -- 12/08/02

    Grangenet is fine if you happen to be in the 4 cities served by it, but another case of eastern seaboard favouritism if you're not.

  3. Re: Eastern Seaboard Favouritism Bear in mind that GrangeNet was funded out of a pool of only around $40million. The Federal Government imposed a cap on any single bid of $15million. GrangeNet had to make a choice of how far one could get with o Anonymous -- 13/08/02

    Re: Eastern Seaboard Favouritism

    Bear in mind that GrangeNet was funded out of a pool of only around $40million. The Federal Government imposed a cap on any single bid of $15million. GrangeNet had to make a choice of how far one could get with only that money, based on the contributions to the consortium.

    If you look at the ANP web site (www.dcita.gov.au under BITS/ANP) you will see that another (identically funded) 10Gb/s network (CeNTIE) was funded for a Melbourne-Perth link. GrangeNet and CeNTIE are in discussions on how to connect. Hmm - DCITA have rearranged stuff on their webserver a lot, might need to search a bit

    mNet (wireless/3G) was also funded under the ANP, and that is just in Adelaide and Whyalla.

    It's Darwin and Hobart - and outside of the capitals - that have been left out at the moment. Hopefully we can solve those connectivity problems down the track (see e.g. NTN, NCF and other efforts).

    Cheers,
    Markus

  4. Count me in. Anonymous -- 14/08/02

    Count me in.

Add your opinion


Latest Videos

ZDNet's CIO Vision Series

Department of Defence | Greg Farr, CIO (part two)

In the second part of his interview, Defence CIO Greg Farr talks about outsourcing, the skills crisis and reveals his most urgent IT priority.

Sponsored content

Power Centre - Content from our premier sponsors

Blogs

  • Angus Kidman I'm a celebrity, don't back me up
    Celebrity comes with its perks — free alcohol, better-looking partners, lots of holiday time — and disadvantages — constant media intrusions, being forced to appear in films with Eddie Murphy for the long-term good of your career, and having to do mindless radio interviews with angry men who've been awake since 4am.
  • Array Lies, damned lies and telco stupidity
    Earlier this month, Telstra put out a press release trumpeting that it's come up with a new phone coaching service to help people who are "bamboozled" by their mobiles. Another excellent example of wrongheaded thinking from the mobile industry.
  • Array Dear carriers: More walking, less talking
    Sometimes, a well-placed and well-timed letter can make all the difference. Other times, it can make no difference at all — and even hurt your case. This week's missive by the Competitive Carriers' Coalition, I would suggest, falls into the latter category.
  • More blogs »

Tags

Back to top

Featured