TPU's WCG/BOINC Team

theonedub · Nov 7, 2020

Anyone else getting some random MCM Project WUs ending in ERROR? This is the first time in over 10 years of crunching that I have ever seen a WU status say 'Computational Error' in BOINC Manager and ERROR status on the WU results page on WCG's website. Thinking it might just be a bad batch of WUs, but with my TR in a single day that led to over 7 pages of failed WUs.

In the website log it reads:
"
Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe0**363) at address 0x000**REDACTED**3B29

Engaging BOINC Windows Runtime Debugger... "

stinger608 · Nov 7, 2020

I haven't had any @theonedub

Good to see ya brother!!!!!

mstenholm · Nov 7, 2020

Same here but I only got two CPUs doing MCM, around 11 days/day. The WCG forum is as far as I can see not aware that MCM is a problem. Is your PC having memory problems like running close 100%. I did have problems due to a WCG\Rosetta\folding disagreement of who owned my 16 GB but I didn’t pick up a error message, just a frozzen PC.

theonedub · Nov 7, 2020

mstenholm said:
Same here but I only got two CPUs doing MCM, around 11 days/day. The WCG forum is as far as I can see not aware that MCM is a problem. Is your PC having memory problems like running close 100%. I did have problems due to a WCG\Rosetta\folding disagreement of who owned my 16 GB but I didn’t pick up a error message, just a frozzen PC.

I had a monitoring program open the entire time and I never went above 11GB of RAM usage (32GB in the PC). Then I saw it happen with 3 more WUs as I was typing my post earlier. I reboot the computer as it has been up for about 10 days straight loaded and will continue to monitor it for any more failed WUs.

Toothless · Nov 18, 2020

For the challenge that started and I missed day one goodness, I decided to yeah, let's get into this one. Why not?

Aus is all loaded, beautiful.

Dualie is next, nice nice.

Not sure why the threads aren't fully loaded but oh well. It's truckin' along.

And a desktop that I specifically brought back to life just for this. Sure it's a G3258 but everything helps, right?

Yes, the PSU is a bomb. Yes, stock heatsink. Yes, it's ugly. Yes, there's a 5350 board and junk on the top. Yes, it's going 100% for science!

thebluebumblebee · Nov 18, 2020

Toothless said:
Not sure why the threads aren't fully loaded but oh well. It's truckin' along.

Computing preferences?

Toothless · Nov 18, 2020

thebluebumblebee said:
Computing preferences?

100% processor at 100% of the time.

phill · Nov 18, 2020

Toothless said:
100% processor at 100% of the time.

You might have just caught it on an off time.. I'm sure it'll be hitting 100% at some point

Let us know tho!!

Toothless · Nov 18, 2020

phill said:
You might have just caught it on an off time.. I'm sure it'll be hitting 100% at some point Let us know tho!!

It's always done the little spikey thing. I wonder if it's a power limit related thing or something of the sort. Either way I've got 70 threads loaded for the next few days for the challenge so I'll be staying warm at home.

phill · Nov 18, 2020

I'd guess that with your PSU its more than man enough to run the 24 threads in the SR-2... If it's all stock and not overclocked, then you should be more than fine, even if it's overclocked to be honest..

When I had it running with Linux, all threads locked at a 100% for me.. Have you tried something like wPrime 1024m or anything to see if that locks all of the threads? There might be a setting that has been missed or something possibly? Maybe set to power saving mode or something?

I've no heating at home at the moment so I might have a few more PCs turned on to gain some heat myself!! :laugh:

Toothless · Nov 18, 2020

It's the 2680v2 with the spikes. The x5680 goes full blast all the time. Running a CPUz benchie does fully load it but for some reason WCG just never does.

phill · Nov 18, 2020

Toothless said:
It's the 2680v2 with the spikes. The x5680 goes full blast all the time. Running a CPUz benchie does fully load it but for some reason WCG just never does.

Ah my apologies... I didn't even tweak!
Have you checked under Task Manager to make sure all the cores have work? I can only imagine it does but...

Toothless · Nov 18, 2020

phill said:
Ah my apologies... I didn't even tweak!
Have you checked under Task Manager to make sure all the cores have work? I can only imagine it does but...

I just checked (yay breaks) and it's running 33 tasks, but has access to 40 threads. I believe this is the same issue I had before when I was trying to go full blast on this server. It's 100% processor slotted with 100% usage, but 33/40 used. WCG for some reason wont use all 40.

thebluebumblebee · Nov 18, 2020

Enough RAM?

Toothless · Nov 18, 2020

thebluebumblebee said:
Enough RAM?

64GB

phill · Nov 19, 2020

Toothless said:
I just checked (yay breaks) and it's running 33 tasks, but has access to 40 threads. I believe this is the same issue I had before when I was trying to go full blast on this server. It's 100% processor slotted with 100% usage, but 33/40 used. WCG for some reason wont use all 40.

That is definitely where the issue is going to be and where the spikes are coming from... I very much doubt this would have anything to do with it, but your not running like a VM for the cunching and then others in the background at all? I believe I have the same CPUs as yourself and I run just Server 2012 R2, that pegs the CPUs to 100% without any issues... Have you had a chance to perhaps remove Bonic and then reinstall again to see if that helps with the issue?
One thing possibly that you could check... How many days of spare jobs are you allowing?? It might mean that your not giving it enough jobs to get it to use all of the threads?? It's just a thought....

thebluebumblebee said:
Enough RAM?

Toothless said:
64GB

Never enough RAM!! :laugh:

Toothless · Nov 19, 2020

phill said:
That is definitely where the issue is going to be and where the spikes are coming from... I very much doubt this would have anything to do with it, but your not running like a VM for the cunching and then others in the background at all? I believe I have the same CPUs as yourself and I run just Server 2012 R2, that pegs the CPUs to 100% without any issues... Have you had a chance to perhaps remove Bonic and then reinstall again to see if that helps with the issue?
One thing possibly that you could check... How many days of spare jobs are you allowing?? It might mean that your not giving it enough jobs to get it to use all of the threads?? It's just a thought....

Never enough RAM!!

I think it's on 0.25 days extra, so there are extras there. Nothing else in the background running. Done a reinstall previously and still nothing.

phill · Nov 19, 2020

And when you select those running tasks, top to bottom, it'll show up 33 rather than 40?? Temps etc. all ok no massive high temps or throttling going on? Anything in the bios that might limit the CPUs at all @Toothless ??

Toothless · Nov 19, 2020

phill said:
And when you select those running tasks, top to bottom, it'll show up 33 rather than 40?? Temps etc. all ok no massive high temps or throttling going on? Anything in the bios that might limit the CPUs at all @Toothless ??

Bios has power savings off/performance preferred. Same with Windows power.

phill · Nov 19, 2020

Running the latest Boinc software? I've 7.16.11 installed on my Windows Server and Win 10 machines. Temps would look better if all the threads aren't being 100% used...

Such a strange issue mate it's making me wonder what the heck it could be?!

Toothless · Nov 19, 2020

Aaannndddd...

So it WILL do 100%, just not with BOINC.

Side note: those 3DNow! guys that are just killing it on WCG in points have a similar forum layout as ours but have points in the little dropdown thing. I'm jealous.

phill · Nov 19, 2020

I'm guessing a run of Cinebench as another example would be the same as well...

I will have a Google in the morning sir, working from home tomorrow so I'll try and get some 'homework' done!!

@W1zzard would something like @Toothless post be possible here for the members that run WCG/FAH etc. at all?

XZero450 · Nov 19, 2020

Toothless said:
I just checked (yay breaks) and it's running 33 tasks, but has access to 40 threads. I believe this is the same issue I had before when I was trying to go full blast on this server. It's 100% processor slotted with 100% usage, but 33/40 used. WCG for some reason wont use all 40.

What does your config file look like? This is oddly familiar to me; I don't readily recall how I fixed it. Seems like there is a ~32 core limit with "auto" something set and they removed the GUI setting to "fix" it.

Edit: It's old.. Credit to @agent00skid

WCG-TPU Cruncher's Hardware/Tech Support Discussion Thread

Moved my 2695 to a different case and mobo with a different boot drive.. Can't get it to break 90% utilization. My PPD is reflecting as this unit seems to be down ~4k on a daily basis. Halp?

www.techpowerup.com

Toothless · Nov 19, 2020

XZero450 said:
What does your config file look like? This is oddly familiar to me; I don't readily recall how I fixed it. Seems like there is a ~32 core limit with "auto" something set and they removed the GUI setting to "fix" it.

Edit: It's old.. Credit to @agent00skid

WCG-TPU Cruncher's Hardware/Tech Support Discussion Thread

Moved my 2695 to a different case and mobo with a different boot drive.. Can't get it to break 90% utilization. My PPD is reflecting as this unit seems to be down ~4k on a daily basis. Halp?

www.techpowerup.com

It works! Biiig thank you!

thebluebumblebee · Nov 19, 2020

Why did my lights just dim?

System Name	Erakith \|\| AsRock NUCS
Processor	AMD ThreadRipper 2990WX ES (32c/64t 3.5ghz@1.02v) \|\| Intel i7 1360P Raptor Lake-P
Motherboard	MSI X399 MEG Creation \|\| AsRock OE
Cooling	EK Supremacy TR4 Full Nickel, D5 w/ EK Top, 2X EK-CoolStream XTX 360 & Photon 270 Res \|\| OE
Memory	32GB (4x8GB) Corsair Vengeance PRO RGB DDR4 3000\|\| 2x16GB Corsair DDR4
Video Card(s)	Vega 64 EK FC\|\| Intel Iris Xe
Storage	250gb WD Black NVMe & (2) 2TB Intel 660p NVMe \|\| 2TB Corsair MP600 Pro
Display(s)	34" Dell Ultrasharp U3415W
Case	CaseLabs Merlin SM8 \|\| Aluminum Unibody
Power Supply	Corsair HX1000
Mouse	Corsair Harpoon Wireless RGB
Keyboard	Corsair Strafe RGB w/ Cherry MX Silent
Software	Windows 10 Pro x64 \|\| WIndows 11 Pro x64
Benchmark Scores	WCG & F@H Only

System Name	Dean Machine/2020 Ryzenfall
Processor	Intel 4790K/AMD Ryzen 3700X
Motherboard	MSI 1150 Gaming mATX/Gigabyte AORUS ELITE B550
Cooling	Cooler Master Hyper 212 LED/SilverStone AH240 AIO
Memory	16 gigs Crucial Ballistix Tactical Tracer/16 gigs G.Skill TridentZ NEO DDR4
Video Card(s)	Gigabyte 1660 Super/Gigabyte GTX 1660
Storage	Crucial SSD 256 and 2TB spinner/Dual Samsung 980 Pro M2 NVME 4.0
Display(s)	Overlord 27" 2560 x 1440
Case	Corsair Air 540
Audio Device(s)	On board
Power Supply	Seasonic modular 850 watt Platinum/EVGA T2-850 Titanium
Software	Windows 10 Pro/Windows 10 Pro

System Name	The work PC /2700x/5950x
Processor	3900X stock/ 2700x stock/ 5950x 4200 MHz fixed @ 1,056-1,08V
Motherboard	Gigabyte AORUS Master X570/2xMSI X470 M7 AC
Cooling	Custom WC XSPC RX480, Laing DDC, XSPC Laing DDC Top V3 and EK Velocity/NH15/NH-U12S SE
Memory	32 GB Viper 3600/14 /16 GB Trident Z F4-4000C18D-16GTZSW 3600 /32 GB G Skill Flare CL14 3400
Video Card(s)	2070 Super X MSI/GTX 970 MSI/ GTX 970 MSI
Storage	1 TB SSD+500 GB NVMe / 500 GB SSD/ 500 GB SSD
Display(s)	Dell UltraSharp U2518D/2408WFP
Case	Corsair 800D / Lian test bench/NZXT 500
Power Supply	AX 850 Titanium/AX 860i/AX 760
Software	Dual boot/Win 7 & 10 / Linux / Win 10

System Name	Erakith \|\| AsRock NUCS
Processor	AMD ThreadRipper 2990WX ES (32c/64t 3.5ghz@1.02v) \|\| Intel i7 1360P Raptor Lake-P
Motherboard	MSI X399 MEG Creation \|\| AsRock OE
Cooling	EK Supremacy TR4 Full Nickel, D5 w/ EK Top, 2X EK-CoolStream XTX 360 & Photon 270 Res \|\| OE
Memory	32GB (4x8GB) Corsair Vengeance PRO RGB DDR4 3000\|\| 2x16GB Corsair DDR4
Video Card(s)	Vega 64 EK FC\|\| Intel Iris Xe
Storage	250gb WD Black NVMe & (2) 2TB Intel 660p NVMe \|\| 2TB Corsair MP600 Pro
Display(s)	34" Dell Ultrasharp U3415W
Case	CaseLabs Merlin SM8 \|\| Aluminum Unibody
Power Supply	Corsair HX1000
Mouse	Corsair Harpoon Wireless RGB
Keyboard	Corsair Strafe RGB w/ Cherry MX Silent
Software	Windows 10 Pro x64 \|\| WIndows 11 Pro x64
Benchmark Scores	WCG & F@H Only

System Name	Veral
Processor	5950x
Motherboard	MSI MEG x570 Ace
Cooling	Corsair H150i RGB Elite
Memory	4x16GB G.Skill TridentZ
Video Card(s)	Powercolor 7900XTX Red Devil
Storage	Crucial P5 Plus 1TB, Samsung 980 1TB, Teamgroup MP34 4TB
Display(s)	Acer Nitro XZ342CK Pbmiiphx + 2x AOC 2425W
Case	Fractal Design Meshify Lite 2
Audio Device(s)	Blue Yeti + SteelSeries Arctis 5 / Samsung HW-T550
Power Supply	Corsair HX850
Mouse	Corsair Nightsword
Keyboard	Corsair K55
VR HMD	HP Reverb G2
Software	Windows 11 Professional
Benchmark Scores	PEBCAK

System Name	Main/DC
Processor	i7-3770K/i7-2600K
Motherboard	MSI Z77A-GD55/GA-P67A-UD4-B3
Cooling	Phanteks PH-TC14CS/H80
Memory	Crucial Ballistix Sport 16GB (2 x 8GB) LP /4GB Kingston DDR3 1600
Video Card(s)	Asus GTX 660 Ti/MSI HD7770
Storage	Crucial MX100 256GB/120GB Samsung 830 & Seagate 2TB(died)
Display(s)	Asus 24' LED/Samsung SyncMaster B1940
Case	P100/Antec P280 It's huge!
Audio Device(s)	on board
Power Supply	SeaSonic SS-660XP2/Seasonic SS-760XP2
Software	Win 7 Home Premiun 64 Bit

System Name	Not so complete or overkill - There are others!! Just no room to put! :D
Processor	Ryzen Threadripper 3970X
Motherboard	Asus Zenith 2 Extreme Alpha
Cooling	Lots!! Dual GTX 560 rads with D5 pumps for each rad. One rad for each component
Memory	Viper Steel 4 x 16GB DDR4 3600MHz not sure on the timings... Probably still at 2667!! :(
Video Card(s)	Asus Strix 3090 with front and rear active full cover water blocks
Storage	I'm bound to forget something here - 250GB OS, 2 x 1TB NVME, 2 x 1TB SSD, 4TB SSD, 2 x 8TB HD etc...
Display(s)	3 x Dell 27" S2721DGFA @ 7680 x 1440P @ 144Hz or 165Hz - working on it!!
Case	The big Thermaltake that looks like a Case Mods
Audio Device(s)	Onboard
Power Supply	EVGA 1600W T2
Mouse	Corsair thingy
Keyboard	Razer something or other....
VR HMD	No headset yet
Software	Windows 11 OS... Not a fan!!
Benchmark Scores	I've actually never benched it!! Too busy with WCG and FAH and not gaming! :( :( Not OC'd it!! :(

System Name	Phobos/Cronus/Janus
Processor	3950x/1950x/3700x
Motherboard	Auros Ultra/Auros Gaming 7/Fatal1ty ITX/ac
Cooling	Custom Water
Video Card(s)	2x1070ti/4x2070 Super/RX5700
Case	STH10/TH10/Nano S
Power Supply	SeaSonic 1200w/SeaSonic 1200w PRIME + SeasSonic 1000w/eVGA 850 Bronze

TPU's WCG/BOINC Team

habe fidem

Dedicated TPU Cruncher & Folder

habe fidem

Tech, Games, and TPU!

Tech, Games, and TPU!

Moderator

Tech, Games, and TPU!

Moderator

Tech, Games, and TPU!

Moderator

Tech, Games, and TPU!

Tech, Games, and TPU!

Moderator

Tech, Games, and TPU!

Moderator

Tech, Games, and TPU!

Moderator

Tech, Games, and TPU!

Moderator

Tech, Games, and TPU!