1. Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Video of the Day: 23 GeForce GTX 295 Video Cards Installed in a Single Server Rig

Discussion in 'News' started by malware, Apr 7, 2009.

  1. h3llb3nd4

    h3llb3nd4 New Member

    Joined:
    Feb 15, 2009
    Messages:
    3,323 (1.55/day)
    Thanks Received:
    307
    Location:
    Durban, South Africa
    correction...folding power
     
  2. Atlas Folder New Member

    Joined:
    Apr 7, 2009
    Messages:
    4 (0.00/day)
    Thanks Received:
    5
    Location:
    Tulsa, Oklahoma
    That is not correct. The nVidia driver only supports 8 GPUs. I have spent a lot of time researching this issue and at the current time it's not possible to use PCIe extenders or motherboards that have more than 4 PCIe slots for this reason. It is also not possible to run VMs on a machine with PCIe backplanes because there is no VM software yet that allows virtualization of the GPUs for CUDA. Xen is working on it though.

    You can see a discussion here: http://foldingforum.org/viewtopic.php?f=38&t=9340&start=0

    and here: http://foldingforum.org/viewtopic.php?f=38&t=9011

    Jason
     
    lemonadesoda says thanks.
  3. ghost101

    ghost101 New Member

    Joined:
    Jun 3, 2006
    Messages:
    1,332 (0.43/day)
    Thanks Received:
    165
    Location:
    London
    What ppd do you get? Also whats the power usage like?
     
  4. n-ster

    Joined:
    Jan 11, 2009
    Messages:
    8,864 (4.08/day)
    Thanks Received:
    1,405
  5. mtosev

    mtosev New Member

    Joined:
    Mar 21, 2005
    Messages:
    1,463 (0.41/day)
    Thanks Received:
    145
    Location:
    Maribor, Slovenia
    HARDCORE :rockout:
     
  6. sol.fides

    sol.fides New Member

    Joined:
    Nov 21, 2005
    Messages:
    65 (0.02/day)
    Thanks Received:
    1
    Location:
    Merrit BC
    The earth simulator had 41 teraflops of supercomputing power. it was #1 in the world starting in 2002 till 2004. It cost about 72 million dollars. congratulations on building an equivalent for under $30,000.
     
  7. mmaakk

    mmaakk

    Joined:
    Sep 17, 2008
    Messages:
    567 (0.25/day)
    Thanks Received:
    171
    Location:
    Brasil
    @ Atlas Folder

    On daily basis, how much time do you spend controlling all your Clients? At the moment I have only 6 Clients and sometimes I get more than one down while I'm at work.
     
  8. n-ster

    Joined:
    Jan 11, 2009
    Messages:
    8,864 (4.08/day)
    Thanks Received:
    1,405
    I believe he isn't a TPU member... unfortunately
     
  9. Atlas Folder New Member

    Joined:
    Apr 7, 2009
    Messages:
    4 (0.00/day)
    Thanks Received:
    5
    Location:
    Tulsa, Oklahoma
    My 24 hour average is ~267,000 PPD. You can see that here.

    The power consumption of a single shelf is ~1,125 Watts. I have 5 shelves and more misc equipment. Power consumption is probably around 7,000 Watts continuous. I haven't added it all up lately.

    Well thanks, but there is an important difference. True supercomputers use 64-bit floating point math (double-precision), Folding@Home makes do with 32-bit floating point math (single-precision). So yes, building supercomputers is getting cheaper fast, but there's still no free (cheap) lunch. If you need double-precision you still must pony up the cash.

    Not much... I can check for dead EUE clients anywhere from my iPhone by going here, it's updated every 60 seconds. If I need to make a correction all of the machines are controllable through LogMeIn and I have LogMeIn Ignition on my iPhone so I can log into the servers from my iPhone and tweak things as necessary.

    I made a post a couple of weeks ago about how I control and implement all of the clients. I think it's kinda slick even if I do say so myself, but necessity is the mother of invention. Controlling all the clients individually got old very, very fast. I had to think of a better way. You can see my post about that here.

    Thanks for the interest guys,

    Jason
     
    mdm-adph, n-ster and mmaakk say thanks.
  10. lemonadesoda

    lemonadesoda

    Joined:
    Aug 30, 2006
    Messages:
    6,274 (2.07/day)
    Thanks Received:
    968
    Thanks for coming to TPU and sharing your experience Jason. Great build(s), nice rack. I can see that perhaps the multiple PC route is easier than the extension bay option.

    Did I understand you are driver-limited. Therefore max 8 GPUs per PC, so you would need a minimum of 3 independent PCs to run your 24 cards? Or does the x2 thing knock that down to just 4 cards (8 GPU dies)?

    PS. Write to nVidia, show them your stuff, get them to fix the drivers, and sponsor your rack.
     
  11. Haytch

    Haytch New Member

    Joined:
    Apr 7, 2008
    Messages:
    510 (0.21/day)
    Thanks Received:
    28
    Location:
    Australia
    The Atlas Folder, very nice folding setup.
    I wonder what it will actually be crunching.
     
  12. Supreme0verlord

    Joined:
    Dec 29, 2008
    Messages:
    696 (0.32/day)
    Thanks Received:
    232
    Location:
    Elkhart, IN
    Wow that is INSANE! I wish I had the money to do something like this.
     
  13. DaMulta

    DaMulta My stars went supernova

    Joined:
    Aug 3, 2006
    Messages:
    16,132 (5.27/day)
    Thanks Received:
    1,457
    Location:
    Oklahoma T-Town
    He was short a few cards on the bottom and it really kills the look of the system:p



    Just kidding, and that's one hell of a folding rig you have!
     
  14. HammerON

    HammerON The Watchful Moderator Staff Member

    Joined:
    Mar 2, 2009
    Messages:
    6,566 (3.09/day)
    Thanks Received:
    3,677
    Welcome to TPU Atlas :)
    It is neat to see all that awsome hardware (especially the GPUs) working hard to find a cure :toast:
    For those that want to learn more about his cause, check out the link to his website at bottom of his sig.
     
    Crunching for Team TPU
  15. zCexVe

    zCexVe

    Joined:
    Apr 25, 2007
    Messages:
    417 (0.15/day)
    Thanks Received:
    30
    Location:
    Los Angeles,CA
    Its for a great cause.I wish his idea becomes true.
     
    HammerON says thanks.
  16. Hayder_Master

    Hayder_Master

    Joined:
    Apr 21, 2008
    Messages:
    5,179 (2.13/day)
    Thanks Received:
    638
    Location:
    IRAQ-Baghdad
    i think Folding@Home complete all research soon
     
  17. laszlo

    laszlo

    Joined:
    Jan 11, 2005
    Messages:
    891 (0.25/day)
    Thanks Received:
    105
    Location:
    66 feet from the ground
    i didn't hear any results like a cure or something and since 2000....

    i'm skeptikal about this f@h do you know exactly what data is processed ?

    Stanford say is protein folding and other molecular dynamics but is really this?
     
  18. The Witcher New Member

    Joined:
    Oct 7, 2008
    Messages:
    433 (0.19/day)
    Thanks Received:
    43
    Location:
    United Arab Emirates
    Finally, someone who is folding not for showing off....
     
  19. mdm-adph

    mdm-adph New Member

    Joined:
    Mar 28, 2007
    Messages:
    2,478 (0.88/day)
    Thanks Received:
    340
    Location:
    Your house.
    Welcome -- I think it's really cool what you're doing to help out your Dad. Anytime anyone criticizes the amount of money it all costs, just remind them about that.

    That being said, looks like I've found another admin who names a group of server units after characters in Atlas Shrugged. :p

    Ah, critics.

    Cures take a long, long time to develop.
     
  20. newtekie1

    newtekie1 Semi-Retired Folder

    Joined:
    Nov 22, 2005
    Messages:
    20,228 (6.10/day)
    Thanks Received:
    6,269
    @Atlas Folder: Are you also running SMP clients on the CPUs, or are you just doing pure GPU folding?
     
    Crunching for Team TPU 50 Million points folded for TPU
  21. newbielives New Member

    Joined:
    Apr 30, 2005
    Messages:
    164 (0.05/day)
    Thanks Received:
    4
    Why cure cancer when you can play Crysis over 60fps :respect:
     
  22. FordGT90Concept

    FordGT90Concept "I go fast!1!11!1!"

    Joined:
    Oct 13, 2008
    Messages:
    14,110 (6.24/day)
    Thanks Received:
    3,929
    Location:
    IA, USA
    I was expecting a custom, 23 PCI Express slot motherboard board loaded with GPUs (like a Tesla system). Needless to say, I'm disappointed. Anyway, that's quite a blatant waste of money and electricity, in my opinion.
     
    Crunching for Team TPU
  23. h3llb3nd4

    h3llb3nd4 New Member

    Joined:
    Feb 15, 2009
    Messages:
    3,323 (1.55/day)
    Thanks Received:
    307
    Location:
    Durban, South Africa
    what cpu are you using Atlas??
    I wonder if it is i7s...
    I think you can also run WCG while folding...
     
  24. newtekie1

    newtekie1 Semi-Retired Folder

    Joined:
    Nov 22, 2005
    Messages:
    20,228 (6.10/day)
    Thanks Received:
    6,269
    The boards he seems to be using looks like the MSI K9A2 Platinum, an AM2 board. So I would guess he is running some kind of Phenom.
     
    Crunching for Team TPU 50 Million points folded for TPU
  25. h3llb3nd4

    h3llb3nd4 New Member

    Joined:
    Feb 15, 2009
    Messages:
    3,323 (1.55/day)
    Thanks Received:
    307
    Location:
    Durban, South Africa
    damn! :(... I am still confused about how you link up all those pcs, and how do you get them all onto one monitor...?
     

Currently Active Users Viewing This Thread: 1 (0 members and 1 guest)

Share This Page