PrimeGrid
Please visit donation page to help the project cover running costs for this month

Toggle Menu

Join PrimeGrid

Returning Participants

Community

Leader Boards

Results

Other

drummers-lowrise

Advanced search

Message boards : Number crunching : GPU queue

Author Message
Profile j.sheridanProject donor
Send message
Joined: 21 Mar 11
Posts: 659
ID: 91622
Credit: 1,109,288,242
RAC: 2,099,192
321 LLR Turquoise: Earned 5,000,000 credits (5,019,701)Cullen LLR Ruby: Earned 2,000,000 credits (4,582,271)ESP LLR Ruby: Earned 2,000,000 credits (4,610,098)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,975,172)PPS LLR Turquoise: Earned 5,000,000 credits (8,639,452)PSP LLR Turquoise: Earned 5,000,000 credits (5,500,951)SoB LLR Turquoise: Earned 5,000,000 credits (8,583,226)SR5 LLR Ruby: Earned 2,000,000 credits (3,473,911)SGS LLR Turquoise: Earned 5,000,000 credits (5,169,619)TRP LLR Turquoise: Earned 5,000,000 credits (9,717,538)Woodall LLR Ruby: Earned 2,000,000 credits (4,084,622)321 Sieve Sapphire: Earned 20,000,000 credits (20,019,388)Cullen/Woodall Sieve (suspended) Double Silver: Earned 200,000,000 credits (265,102,350)PPS Sieve Double Gold: Earned 500,000,000 credits (514,289,554)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,801,812)AP 26/27 Emerald: Earned 50,000,000 credits (53,763,814)GFN Double Bronze: Earned 100,000,000 credits (186,978,187)
Message 143309 - Posted: 14 Sep 2020 | 19:46:12 UTC
Last modified: 14 Sep 2020 | 19:46:46 UTC

Currently there is a limit of 100 GPU tasks you can have in your work queue. While this may have made sense in the past it currently equates to around 3 hours on a stock 2080 and (guessing) about 1-1.5hours on the imminent 3080/90.
Would it be possible to increase this limit so we can fetch at least a day's worth of tasks?

While we're there, I guess it's worth mentioning that the 300 cpu task limit also doesn't last very long with the shorter tasks and 8+ core cpus.

Generally the above isn't much of an issue given most people are online 24x7 these days but having recently had a 12 hour outage and the added bonus of LLR2 being introduced it got me thinking it would be good to maintain a reasonable work buffer.

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13400
ID: 53948
Credit: 229,188,052
RAC: 135,563
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (2,005,249)ESP LLR Turquoise: Earned 5,000,000 credits (5,009,577)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (15,538,935)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,291,181)SR5 LLR Jade: Earned 10,000,000 credits (10,007,110)SGS LLR Ruby: Earned 2,000,000 credits (2,276,330)TRP LLR Turquoise: Earned 5,000,000 credits (5,084,329)Woodall LLR Ruby: Earned 2,000,000 credits (2,195,123)321 Sieve Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,118,303)GFN Emerald: Earned 50,000,000 credits (74,790,987)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 143310 - Posted: 14 Sep 2020 | 20:25:48 UTC - in response to Message 143309.
Last modified: 14 Sep 2020 | 20:26:02 UTC

While we're there, I guess it's worth mentioning that the 300 cpu task limit also doesn't last very long with the shorter tasks and 8+ core cpus.


That limit is per core. It's 320 tasks per core. That's 2560 tasks for an 8 core CPU.

Likewise, the 100 task limit on GPUs is per GPU, but an RTX 3090 is still just one GPU. It can chew through 100 small tasks very quickly.
____________
My lucky number is 75898524288+1

Profile j.sheridanProject donor
Send message
Joined: 21 Mar 11
Posts: 659
ID: 91622
Credit: 1,109,288,242
RAC: 2,099,192
321 LLR Turquoise: Earned 5,000,000 credits (5,019,701)Cullen LLR Ruby: Earned 2,000,000 credits (4,582,271)ESP LLR Ruby: Earned 2,000,000 credits (4,610,098)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,975,172)PPS LLR Turquoise: Earned 5,000,000 credits (8,639,452)PSP LLR Turquoise: Earned 5,000,000 credits (5,500,951)SoB LLR Turquoise: Earned 5,000,000 credits (8,583,226)SR5 LLR Ruby: Earned 2,000,000 credits (3,473,911)SGS LLR Turquoise: Earned 5,000,000 credits (5,169,619)TRP LLR Turquoise: Earned 5,000,000 credits (9,717,538)Woodall LLR Ruby: Earned 2,000,000 credits (4,084,622)321 Sieve Sapphire: Earned 20,000,000 credits (20,019,388)Cullen/Woodall Sieve (suspended) Double Silver: Earned 200,000,000 credits (265,102,350)PPS Sieve Double Gold: Earned 500,000,000 credits (514,289,554)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,801,812)AP 26/27 Emerald: Earned 50,000,000 credits (53,763,814)GFN Double Bronze: Earned 100,000,000 credits (186,978,187)
Message 143311 - Posted: 14 Sep 2020 | 21:30:08 UTC - in response to Message 143310.
Last modified: 14 Sep 2020 | 21:33:05 UTC

While we're there, I guess it's worth mentioning that the 300 cpu task limit also doesn't last very long with the shorter tasks and 8+ core cpus.


That limit is per core. It's 320 tasks per core. That's 2560 tasks for an 8 core CPU.

Likewise, the 100 task limit on GPUs is per GPU, but an RTX 3090 is still just one GPU. It can chew through 100 small tasks very quickly.

Was it changed during the challenge? I was only able to download 320 total even on a 48 core.

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13400
ID: 53948
Credit: 229,188,052
RAC: 135,563
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (2,005,249)ESP LLR Turquoise: Earned 5,000,000 credits (5,009,577)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (15,538,935)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,291,181)SR5 LLR Jade: Earned 10,000,000 credits (10,007,110)SGS LLR Ruby: Earned 2,000,000 credits (2,276,330)TRP LLR Turquoise: Earned 5,000,000 credits (5,084,329)Woodall LLR Ruby: Earned 2,000,000 credits (2,195,123)321 Sieve Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,118,303)GFN Emerald: Earned 50,000,000 credits (74,790,987)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 143313 - Posted: 14 Sep 2020 | 23:50:39 UTC - in response to Message 143311.

While we're there, I guess it's worth mentioning that the 300 cpu task limit also doesn't last very long with the shorter tasks and 8+ core cpus.


That limit is per core. It's 320 tasks per core. That's 2560 tasks for an 8 core CPU.

Likewise, the 100 task limit on GPUs is per GPU, but an RTX 3090 is still just one GPU. It can chew through 100 small tasks very quickly.

Was it changed during the challenge? I was only able to download 320 total even on a 48 core.


It's always per core.

It is possible that the number was lowered to less than 320, but that's usually only for the start of the challenge. Then it's raised back to normal.

I don't do the challenges anymore, so I'm not sure what was done during this last challenge.
____________
My lucky number is 75898524288+1

Profile j.sheridanProject donor
Send message
Joined: 21 Mar 11
Posts: 659
ID: 91622
Credit: 1,109,288,242
RAC: 2,099,192
321 LLR Turquoise: Earned 5,000,000 credits (5,019,701)Cullen LLR Ruby: Earned 2,000,000 credits (4,582,271)ESP LLR Ruby: Earned 2,000,000 credits (4,610,098)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,975,172)PPS LLR Turquoise: Earned 5,000,000 credits (8,639,452)PSP LLR Turquoise: Earned 5,000,000 credits (5,500,951)SoB LLR Turquoise: Earned 5,000,000 credits (8,583,226)SR5 LLR Ruby: Earned 2,000,000 credits (3,473,911)SGS LLR Turquoise: Earned 5,000,000 credits (5,169,619)TRP LLR Turquoise: Earned 5,000,000 credits (9,717,538)Woodall LLR Ruby: Earned 2,000,000 credits (4,084,622)321 Sieve Sapphire: Earned 20,000,000 credits (20,019,388)Cullen/Woodall Sieve (suspended) Double Silver: Earned 200,000,000 credits (265,102,350)PPS Sieve Double Gold: Earned 500,000,000 credits (514,289,554)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,801,812)AP 26/27 Emerald: Earned 50,000,000 credits (53,763,814)GFN Double Bronze: Earned 100,000,000 credits (186,978,187)
Message 143317 - Posted: 15 Sep 2020 | 8:32:31 UTC - in response to Message 143313.

While we're there, I guess it's worth mentioning that the 300 cpu task limit also doesn't last very long with the shorter tasks and 8+ core cpus.


That limit is per core. It's 320 tasks per core. That's 2560 tasks for an 8 core CPU.

Likewise, the 100 task limit on GPUs is per GPU, but an RTX 3090 is still just one GPU. It can chew through 100 small tasks very quickly.

Was it changed during the challenge? I was only able to download 320 total even on a 48 core.


It's always per core.

It is possible that the number was lowered to less than 320, but that's usually only for the start of the challenge. Then it's raised back to normal.

I don't do the challenges anymore, so I'm not sure what was done during this last challenge.


it may have once been per core but it isn't any more:


Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13400
ID: 53948
Credit: 229,188,052
RAC: 135,563
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (2,005,249)ESP LLR Turquoise: Earned 5,000,000 credits (5,009,577)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (15,538,935)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,291,181)SR5 LLR Jade: Earned 10,000,000 credits (10,007,110)SGS LLR Ruby: Earned 2,000,000 credits (2,276,330)TRP LLR Turquoise: Earned 5,000,000 credits (5,084,329)Woodall LLR Ruby: Earned 2,000,000 credits (2,195,123)321 Sieve Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,118,303)GFN Emerald: Earned 50,000,000 credits (74,790,987)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 143322 - Posted: 15 Sep 2020 | 13:34:16 UTC - in response to Message 143317.

While we're there, I guess it's worth mentioning that the 300 cpu task limit also doesn't last very long with the shorter tasks and 8+ core cpus.


That limit is per core. It's 320 tasks per core. That's 2560 tasks for an 8 core CPU.

Likewise, the 100 task limit on GPUs is per GPU, but an RTX 3090 is still just one GPU. It can chew through 100 small tasks very quickly.

Was it changed during the challenge? I was only able to download 320 total even on a 48 core.


It's always per core.

It is possible that the number was lowered to less than 320, but that's usually only for the start of the challenge. Then it's raised back to normal.

I don't do the challenges anymore, so I'm not sure what was done during this last challenge.


it may have once been per core but it isn't any more:




I just tried it, and I couldn't get more than 320 SGS tasks either. Not sure what's up here. That's not the way it's supposed to be working.

____________
My lucky number is 75898524288+1

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13400
ID: 53948
Credit: 229,188,052
RAC: 135,563
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (2,005,249)ESP LLR Turquoise: Earned 5,000,000 credits (5,009,577)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (15,538,935)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,291,181)SR5 LLR Jade: Earned 10,000,000 credits (10,007,110)SGS LLR Ruby: Earned 2,000,000 credits (2,276,330)TRP LLR Turquoise: Earned 5,000,000 credits (5,084,329)Woodall LLR Ruby: Earned 2,000,000 credits (2,195,123)321 Sieve Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,118,303)GFN Emerald: Earned 50,000,000 credits (74,790,987)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 143332 - Posted: 15 Sep 2020 | 17:25:30 UTC

What a mess.

Ok, first: the limit for CPUs and the limit for GPUs are both increased to 1000. As you figured out, that's total. Not per core. It can't be made any larger than that or you may start having trouble reporting the tasks back to the server.

It used to be per core, but there's a bug in the BOINC software. Unless you set your "Max threads per task" to "unlimited", you don't get the per-core part. And, of course, you don't want to run your SGS tasks multi-threaded using ALL cores, so that's not a great option. You might, maybe, possibly be able to beat BOINC into submission by setting the threads to "no limit" and then using app_info to force it to run single threaded. Go ahead and try it if you want more than 1000 tasks. If you do, let us know how it works out.

Now I've got a question for you: Why do you want such a large queue for tasks like these? You're very likely to have almost all the tasks come in second, no?
____________
My lucky number is 75898524288+1

Profile j.sheridanProject donor
Send message
Joined: 21 Mar 11
Posts: 659
ID: 91622
Credit: 1,109,288,242
RAC: 2,099,192
321 LLR Turquoise: Earned 5,000,000 credits (5,019,701)Cullen LLR Ruby: Earned 2,000,000 credits (4,582,271)ESP LLR Ruby: Earned 2,000,000 credits (4,610,098)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,975,172)PPS LLR Turquoise: Earned 5,000,000 credits (8,639,452)PSP LLR Turquoise: Earned 5,000,000 credits (5,500,951)SoB LLR Turquoise: Earned 5,000,000 credits (8,583,226)SR5 LLR Ruby: Earned 2,000,000 credits (3,473,911)SGS LLR Turquoise: Earned 5,000,000 credits (5,169,619)TRP LLR Turquoise: Earned 5,000,000 credits (9,717,538)Woodall LLR Ruby: Earned 2,000,000 credits (4,084,622)321 Sieve Sapphire: Earned 20,000,000 credits (20,019,388)Cullen/Woodall Sieve (suspended) Double Silver: Earned 200,000,000 credits (265,102,350)PPS Sieve Double Gold: Earned 500,000,000 credits (514,289,554)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,801,812)AP 26/27 Emerald: Earned 50,000,000 credits (53,763,814)GFN Double Bronze: Earned 100,000,000 credits (186,978,187)
Message 143333 - Posted: 15 Sep 2020 | 17:48:02 UTC - in response to Message 143332.
Last modified: 15 Sep 2020 | 17:51:37 UTC


Now I've got a question for you: Why do you want such a large queue for tasks like these? You're very likely to have almost all the tasks come in second, no?


Well for sieving it doesn't matter so might as well keep a buffer.
I only noticed the cpu side during the challenge - when the server fell over and stopped sending out tasks for a few hours I decided it would be better to maintain a work queue in case it happened again as that would keep me ahead of those who didn't.

and thanks.

Post to thread

Message boards : Number crunching : GPU queue

[Return to PrimeGrid main page]
DNS Powered by DNSEXIT.COM
Copyright © 2005 - 2020 Rytis Slatkevičius (contact) and PrimeGrid community. Server load 2.20, 2.41, 2.30
Generated 1 Nov 2020 | 1:53:24 UTC