Burning through data like nothing else

Topics

servers, storage, amd, chips

Related gallery

CeBIT 2012 opens: photos

CeBIT 2012 opens: photos

The journey to find gas or oil starts on a boat. The boat has 10 air compressor guns firing blasts into the ocean floor, from which arise reflections that are picked up by the hydrophones on the 10 12km cables the boat is dragging. The data that is created as the guns shoot again and again needs to be crunched.

The data from a typical project of this sort, usually around 35TB, would be loaded onto tapes — normally about 300 of them. This data now needs to be processed, weeding out the noise and manipulating the remainder into something that can be used to see if there's oil or gas to be found.

That's a job for companies like DownUnder GeoSolutions, according to its CTO, Stuart Midgley, who said that his company churns through compute power like nothing else.

"We burn through data like you wouldn't believe," he said.

The company, which started in a small house in Subiaco, Western Australia, with a kitchen operating as a server room, now operates around 15,000 cores in Perth — and that's a fraction of what the industry as a whole is using, according to Midgley, who said that he thought there would be 100,000 cores operating on similar jobs in Perth alone.

Every few months, the company buys a new rack, comprising of 2500 cores. These 35kW racks can't be cooled with air, so the company uses water cooling. If this stops working for some reason, the temperature in the room with the kit rises from 18 degrees Celsius to 60 degrees in three minutes.

At that point, Midgley said, it's a case of getting out screwdrivers and using them to turn the servers off at the power button, because if you pressed it with your finger you'd burn yourself.

When the company gets a project for which it doesn't have enough compute power, it calls up vendors and asks for a quote. If they're happy, they'll provide the vendor with a purchase order requesting the gear to be delivered within weeks.

Yesterday, Midgley expected delivery of a rack of SGI servers containing AMD's new Opteron 6200 Series Processor.

These chips, just launched, have up to four sockets with up to 16 cores and four memory channels with up to 1600MHz memory. Power use is 85W to 140W. AMD has also released the Opteron Series 4200 chips, which have up to two sockets with up to eight cores and two memory channels with up to 1600MHz memory.

The company decided to go with AMD's chips because they have a 10 per cent reduced power usage and 25 per cent less total cost of ownership for 30 per cent more performance that DownUnder GeoSolutions couldn't get otherwise, according to Midgley. The number of cores and amount of memory available was also a drawcard.

"All of our software is heavily threaded; we use as many flops as we can. We use a massive amount of memory," he said.

The company recently returned to AMD again after using other processors. Midgley said that this was due to the vendors that were providing hardware, including AMD processors, that didn't have the drivers needed for a Linux shop. That had since been remedied, according to Midgley.

"We used to be an AMD house. We started moving away. Now we're coming back in a big way," he said. "I anticipate that they're going to work insanely well for us."

Talkback

Add your opinion

In order to post a comment, you need to be registered. (Sign In or register below)

Post your comment

Terms of Service - As a ZDNet registrant, and by using this service, you indicate that you agree to our Terms and Conditions and have read and understand our Privacy Policy.

ZDNet Australia Live

by http://t.co/vmlLt4bh: SA Health's journey to e-health: Implementing e-health services for an entire state is a... http://t.co/NVrBd9c5

Facebook investor to sue Nasdaq over alleged bungled orders: http://t.co/XGRsNzA4 ^LH

Combining @Ariba's network & @SAP's applications - "SAP eyes cloud super network with Ariba buy" http://t.co/jeMWEKpB

SA Health's journey to e-health: Implementing e-health services for an entire state is a daunting task, but, as ... http://t.co/Vwchau6N

RT @JamesVickery: Google warns users of DNSChanger malware http://t.co/DsHUnC5r

Upskill. RT @zdnetaustralia Job vacancies are down 22 per cent on a year ago. So what are IT professionals to do? http://t.co/PrFEBfqS ^ST

Google warns users of DNSChanger malware http://t.co/DsHUnC5r

National Botnet Network coming: Earthwave http://t.co/t49r3IV0

Surely IT is more than just a game? http://t.co/WvSk0C0N

RT @JLLLOW: Revolution. RT @zdnetaustralia: Job vacancies are down 22 per cent on a year ago. So what are IT professionals to do? http://t.co/rdjqdACC

Revolution. RT @zdnetaustralia: Job vacancies are down 22 per cent on a year ago. So what are IT professionals to do? http://t.co/rdjqdACC

Google has joined in on the chorus of organisations warning users about DNSChanger infections http://t.co/ysaIHiuG ^ML

Akku Asus A32-K72 Original,Kompatibler Ersatz akku für Li-ion Asus A32-K72 Original Laptop Akkus Asus A32-K72 Original,A32-K72 Original...

2 hours ago by akkuakku on HP Compaq 6730b

It is great to see the NSW government taking this step, however there's plenty of home-grown talent loeaving or being rediverted due to l...

2 hours ago by Aceyducey on NSW Govt appoints Silicon Valley champion

Job vacancies are down 22 per cent on a year ago. So what are IT professionals to do? http://t.co/EpY9YiFg ^ST

by http://t.co/vmlLt4bh: JobWatch: where the jobs are: The latest analysis on online job ads from the Department ... http://t.co/nh1wg7Y6

@chieftech @zdnetaustralia that's a fair call. Still an area that requires consideration work. BYOD = BYOViruses & Malware :)

JobWatch: where the jobs are http://t.co/Lqo8BNVT

EMC hones focus on hybrid cloud big data Hardware News ZDNet Australia: EMC has launched 42 prod... http://t.co/uR56HXDz #bigdata #blogs

Are specific gaming development degrees bollocks? http://t.co/z2zbaWvT ^ST

#NSW Govt announces shopfront in Silicon Valley + 7 consortia to dev #mobile for public sector http://t.co/GPrIXH4F via @johnW3LLS #govcamp

JobWatch: where the jobs are: The latest analysis on online job ads from the Department of Education, Employment... http://t.co/qJce42h2

RT @johnW3LLS: #NSW Govt announces shopfront in Silicon Valley + 7 consortia to dev #mobile for public sector http://t.co/JDSdSxWu #gov2au

RT @zdnetaustralia: Android fragmentation threw a spanner into Victorian Health's app strategy: http://t.co/4pkmnkMB ^LH

What Microsoft won't tell you about Windows 7 licensing http://t.co/Y2e6sXdI #Win7

#Android fragmentation steers Vic Health - @ZDNet Australia : http://t.co/chrmWl7B

RT @zdnetaustralia: Android fragmentation threw a spanner into Victorian Health's app strategy: http://t.co/4pkmnkMB ^LH

Android fragmentation steers Vic Health - ZDNet Australia: Android fragmentation steers Vic Healt... http://t.co/VTbMBy5A #android #news

by http://t.co/vmlLt4bh: Android fragmentation steers Vic Health: Fragmentation issues in Android were a key conc... http://t.co/wOmHdAav

Android fragmentation steers Vic Health http://t.co/CqTImM5l

Android fragmentation steers Vic Health - ZDNet Australia: Android fragmentation steers Vic... http://t.co/3ssDp1SW http://t.co/KpTZdvuO

Android fragmentation steers Vic Health: Fragmentation issues in Android were a key concern for the Victorian De... http://t.co/NnjPEqSu

Android fragmentation steers Vic Health http://t.co/jcB7UGer

Chrome beats Internet Explorer in global Web browser race | ZDNet http://t.co/7G7xMfJj

Android fragmentation steers Vic Health: Fragmentation issues in Android were a key concern for the Victorian De... http://t.co/HLdurfS5

Mining the social data stream for deeper customer insight | via @ZDNet http://t.co/x4xouPQh)

Android fragmentation steers Vic Health http://t.co/A6SJkfJw

But this is the thing. There are still plenty of good-quality graduates whose skills can raise seasoned professional eyebrows... if they ...

4 hours ago by techkid on Skills shortage: companies being too picky?

I wouldn't have called Vista cheesy. Its GUI was pretty slick (and indeed handed on to Windows 7). It was, however, poorly implemented, h...

4 hours ago by techkid on Microsoft admits Vista was 'cheesy'

Thanks Nelson, it should be right now.

-Michael.

5 hours ago by Mukimu on Ausgrid network to talk back to operators

I guess the mouse was a necessary evil at the time. I mean, yes, keyboard shortcuts in the right hands are faster than any mouse action (...

5 hours ago by techkid on Microsoft admits Vista was 'cheesy'

fyi google may always lie

5 hours ago by rt luvs youh on Google shows we're killing our language

they probaly always lie about in4mation bout people

5 hours ago by rt luvs youh on Google shows we're killing our language

$6.7million, now we know the price to the tax payer of a government IT project clean up. You've got to ask the question don't you: why o...

6 hours ago by Takenforgranted on Vic scraps HealthSMART system

why some mp4 files with higher frame width can not be played in my 3m mp180??

6 hours ago by cyrusmann_ymail.com on 3M MP180 Pocket Projector

Unfortunately there is NO such place as Nelson's Bay. It's Nelson Bay!! Probably not your fault for the error, as your Media Release prob...

6 hours ago by Nelson on Ausgrid network to talk back to operators

@Wow - thats one of the benefits of the iPad (and tablets in general). They are one of the most generation neutral products ever made. ...

8 hours ago by Gav on Westpac board goes paperless with iPads

and why is this such a super idea? http://www.itnews.com.au/News/301778,thousands-affected-in-billing-cloud-breach.aspx oh, yeah, right...

9 hours ago by btone on Fed Govt steps up on shared cloud plan

Wow, seems like a fantastic initiative that helps to save the environment. It must have taken a lot of convincing to get the Board to mov...

9 hours ago by Wow on Westpac board goes paperless with iPads

I'm a payed up lib member who has voted Labor in the last 2 federal elections. I had the previlege of speaking to Mr Turnball 3 months ag...

10 hours ago by spazmanaught on NBN contracts may be left alone: Turnbull

Good to see Westpac's concentrating on the real IT issues !

10 hours ago by jeff_syd on Westpac board goes paperless with iPads

I am not sure how this issue becomes an attack on Mr Turnbull. But I guess he is fair game. In any event I would have thought a Ddos woul...

20 hours ago by Doubt on National Botnet Network coming: Earthwave

I still use 98SE. Windows ME was an abortion in a bucket and Vista was ME without the bucket. My screen may look boring, but I jumped str...

21 hours ago by Treknology on Microsoft admits Vista was 'cheesy'

This story has been voted 10 times in the last 24 hours!

21 hours ago, CeBIT 2012 opens: photos

This story has been voted 15 times in the last 24 hours!

21 hours ago, Lenovo ThinkPad 3G tablet (32GB)

Well I don't know what they have done with their EFTPOS machines, local one in WA Coles Express I used this morning and I normally do "ch...

21 hours ago by harryinthesoup on Coles ditches PINs in payment pilot

6.7 M last ditch attempt - interesting - The Auckland region (population 1.4 mil) has estimated to have spent less than this in total ...

1 day ago by debsteele on Vic scraps HealthSMART system

Facebook Activity

Keep up with ZDNet Australia

ZDNet Events Calendar

ZDNet Events Calendar