PrimeGrid
Please visit donation page to help the project cover running costs for this month

Toggle Menu

Join PrimeGrid

Returning Participants

Community

Leader Boards

Results

Other

drummers-lowrise

Advanced search

Message boards : Problems and Help : Requesting new work -- "got 1 new tasks"

Author Message
xii5ku
Send message
Joined: 17 Dec 16
Posts: 67
ID: 476505
Credit: 583,266,419
RAC: 12,293
321 LLR Jade: Earned 10,000,000 credits (16,776,661)Cullen LLR Turquoise: Earned 5,000,000 credits (5,352,689)ESP LLR Turquoise: Earned 5,000,000 credits (9,069,027)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (8,844,412)PPS LLR Jade: Earned 10,000,000 credits (15,401,000)PSP LLR Jade: Earned 10,000,000 credits (11,359,246)SoB LLR Sapphire: Earned 20,000,000 credits (29,894,368)SR5 LLR Turquoise: Earned 5,000,000 credits (7,426,546)SGS LLR Turquoise: Earned 5,000,000 credits (5,029,147)TRP LLR Jade: Earned 10,000,000 credits (18,341,209)Woodall LLR Turquoise: Earned 5,000,000 credits (7,760,017)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (26,331,175)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,205,264)PPS Sieve Double Silver: Earned 200,000,000 credits (329,019,713)AP 26/27 Sapphire: Earned 20,000,000 credits (25,212,148)GFN Emerald: Earned 50,000,000 credits (56,243,798)
Message 139326 - Posted: 2 Apr 2020 | 16:50:21 UTC
Last modified: 2 Apr 2020 | 17:00:26 UTC

Hi,

circa since when the "mt" plan class was implemented here at PrimeGrid, the client's scheduler requests for new work are responded to with no more than 1 new task each.

Now, with the SGS-LLR challenge going on, my best host can finish tasks faster than it can request tasks normally. And for sure there are hosts around here with even higher throughput than mine.

I am aware of two workarounds:


  • If the client's automatic request retry rate is just a tad too low to keep the host saturated, it is possible and sufficient to force the client to slightly more frequent scheduler requests than it does on its own (with its built-in retry latency combined with PG's current <request_delay> of 7.0 seconds).
  • If the host's computational throughput significantly exceeds the client's possible request rate, then an obvious workaround is to operate more than one client on the host.


Of course, both workarounds don't fix the actual problem that a wastefully high rate of scheduler requests has to be maintained per host.

So, is there any way to get more than 1 new task per scheduler request?

PS, my job control settings are:
Max # of simultaneous PrimeGrid tasks --- No limit
Multi-threading: Max # of threads for each task --- 1

PPS, at subprojects which benefit from multithreaded tasks, I set the threadcount locally per app_config.

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13570
ID: 53948
Credit: 249,679,681
RAC: 130,309
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 2 primes in the 2021 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (3,624,591)ESP LLR Turquoise: Earned 5,000,000 credits (5,021,269)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (19,393,219)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,291,181)SR5 LLR Jade: Earned 10,000,000 credits (10,007,110)SGS LLR Ruby: Earned 2,000,000 credits (3,710,224)TRP LLR Turquoise: Earned 5,000,000 credits (5,084,329)Woodall LLR Ruby: Earned 2,000,000 credits (2,963,361)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,118,303)WW Turquoise: Earned 5,000,000 credits (9,764,000)GFN Emerald: Earned 50,000,000 credits (77,831,979)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 139333 - Posted: 2 Apr 2020 | 17:53:57 UTC

The server isn't limiting you to 1 task per RPC. The RPC limit is 5x the number of CPU cores on your system. (During challenge starts, we lower that to 1 task per core -- but that's still per core.)

____________
My lucky number is 75898524288+1

xii5ku
Send message
Joined: 17 Dec 16
Posts: 67
ID: 476505
Credit: 583,266,419
RAC: 12,293
321 LLR Jade: Earned 10,000,000 credits (16,776,661)Cullen LLR Turquoise: Earned 5,000,000 credits (5,352,689)ESP LLR Turquoise: Earned 5,000,000 credits (9,069,027)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (8,844,412)PPS LLR Jade: Earned 10,000,000 credits (15,401,000)PSP LLR Jade: Earned 10,000,000 credits (11,359,246)SoB LLR Sapphire: Earned 20,000,000 credits (29,894,368)SR5 LLR Turquoise: Earned 5,000,000 credits (7,426,546)SGS LLR Turquoise: Earned 5,000,000 credits (5,029,147)TRP LLR Jade: Earned 10,000,000 credits (18,341,209)Woodall LLR Turquoise: Earned 5,000,000 credits (7,760,017)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (26,331,175)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,205,264)PPS Sieve Double Silver: Earned 200,000,000 credits (329,019,713)AP 26/27 Sapphire: Earned 20,000,000 credits (25,212,148)GFN Emerald: Earned 50,000,000 credits (56,243,798)
Message 139334 - Posted: 2 Apr 2020 | 19:03:12 UTC - in response to Message 139333.
Last modified: 2 Apr 2020 | 19:03:51 UTC

Then what else is limiting?

My hosts don't have one core.

Ah wait. I had set the buffers to 0.02 + 0.02 days and similar. Which is 1/2 hour + 1/2 hour.

Now picture a 128 CPUs host set to use 64 CPUs, which completes SGS tasks in 13 minutes. I certainly expect to receive a metric boatload of tasks with such a setting, per request. But no, it gives 1 task per request.

And now I tried something out of this world: A buffer of 0.1 days + .01 days. Now I get... 5 (five!) new tasks per request.

Yay!

:-(

I used to run PG with 0.00 + 0.00 day buffers. Why doesn't this work reasonably anymore?

ReggieProject donor
Volunteer moderator
Project administrator
Volunteer tester
Project scientist
Send message
Joined: 10 May 14
Posts: 187
ID: 311759
Credit: 128,768,872
RAC: 124,338
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 mega prime in the 2018 Tour de Primes321 LLR Amethyst: Earned 1,000,000 credits (1,000,300)Cullen LLR Amethyst: Earned 1,000,000 credits (1,022,945)ESP LLR Amethyst: Earned 1,000,000 credits (1,517,922)Generalized Cullen/Woodall LLR Amethyst: Earned 1,000,000 credits (1,011,992)PPS LLR Ruby: Earned 2,000,000 credits (2,730,913)PSP LLR Amethyst: Earned 1,000,000 credits (1,026,142)SoB LLR Amethyst: Earned 1,000,000 credits (1,003,790)SR5 LLR Amethyst: Earned 1,000,000 credits (1,011,793)SGS LLR Amethyst: Earned 1,000,000 credits (1,000,114)TRP LLR Amethyst: Earned 1,000,000 credits (1,004,185)Woodall LLR Amethyst: Earned 1,000,000 credits (1,018,066)321 Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,000,211)Generalized Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (2,000,420)PPS Sieve Sapphire: Earned 20,000,000 credits (22,440,747)AP 26/27 Sapphire: Earned 20,000,000 credits (20,077,538)WW Jade: Earned 10,000,000 credits (10,944,000)GFN Sapphire: Earned 20,000,000 credits (38,886,436)PSA Sapphire: Earned 20,000,000 credits (20,070,245)
Message 139335 - Posted: 2 Apr 2020 | 19:44:44 UTC - in response to Message 139334.

Do you have a zero resource share for PrimeGrid? That's the only other possibility I can come up with. I know BOINC behaves somewhat differently if this is the case, but I've never messed with it. Either way, at least you've improved your setup with the buffer.

xii5ku
Send message
Joined: 17 Dec 16
Posts: 67
ID: 476505
Credit: 583,266,419
RAC: 12,293
321 LLR Jade: Earned 10,000,000 credits (16,776,661)Cullen LLR Turquoise: Earned 5,000,000 credits (5,352,689)ESP LLR Turquoise: Earned 5,000,000 credits (9,069,027)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (8,844,412)PPS LLR Jade: Earned 10,000,000 credits (15,401,000)PSP LLR Jade: Earned 10,000,000 credits (11,359,246)SoB LLR Sapphire: Earned 20,000,000 credits (29,894,368)SR5 LLR Turquoise: Earned 5,000,000 credits (7,426,546)SGS LLR Turquoise: Earned 5,000,000 credits (5,029,147)TRP LLR Jade: Earned 10,000,000 credits (18,341,209)Woodall LLR Turquoise: Earned 5,000,000 credits (7,760,017)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (26,331,175)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,205,264)PPS Sieve Double Silver: Earned 200,000,000 credits (329,019,713)AP 26/27 Sapphire: Earned 20,000,000 credits (25,212,148)GFN Emerald: Earned 50,000,000 credits (56,243,798)
Message 139336 - Posted: 2 Apr 2020 | 20:16:29 UTC - in response to Message 139335.
Last modified: 2 Apr 2020 | 20:24:04 UTC

Thanks, I actually forgot to check whether or not it's at 0 % (which I rarely, but indeed sometimes, used).
But no, resource share is 100 %, and has been already before I joined the SGS challenge.

(But even at 0 % resource share, the client used to pull 23 tasks at once if 23 CPUs were idly waiting for work. Not so now anymore.)

Profile Eudy SilvaProject donor
Avatar
Send message
Joined: 26 Aug 17
Posts: 1402
ID: 918937
Credit: 290,159,050
RAC: 1,221,543
Discovered 1 mega primeFound 2 primes in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Amethyst: Earned 1,000,000 credits (1,012,503)Cullen LLR Amethyst: Earned 1,000,000 credits (1,291,013)ESP LLR Amethyst: Earned 1,000,000 credits (1,022,307)Generalized Cullen/Woodall LLR Amethyst: Earned 1,000,000 credits (1,004,746)PPS LLR Jade: Earned 10,000,000 credits (15,783,307)PSP LLR Amethyst: Earned 1,000,000 credits (1,123,300)SoB LLR Ruby: Earned 2,000,000 credits (2,113,239)SR5 LLR Ruby: Earned 2,000,000 credits (2,954,518)SGS LLR Amethyst: Earned 1,000,000 credits (1,462,951)TRP LLR Amethyst: Earned 1,000,000 credits (1,574,163)Woodall LLR Amethyst: Earned 1,000,000 credits (1,001,901)321 Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,119,749)Generalized Cullen/Woodall Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,005,331)PPS Sieve Emerald: Earned 50,000,000 credits (68,690,867)AP 26/27 Emerald: Earned 50,000,000 credits (50,096,813)WW Emerald: Earned 50,000,000 credits (77,840,000)GFN Emerald: Earned 50,000,000 credits (59,065,224)PSA Ruby: Earned 2,000,000 credits (2,059,222)
Message 139338 - Posted: 2 Apr 2020 | 20:45:09 UTC - in response to Message 139336.

Just a shot in the dark, but how much free space in your hard disk ?
____________
"Accidit in puncto, quod non contingit in anno."
Something that does not occur in a year may, perchance, happen in a moment.

Angel
Send message
Joined: 2 Apr 20
Posts: 1
ID: 1251137
Credit: 0
RAC: 0

Message 139347 - Posted: 2 Apr 2020 | 23:43:28 UTC

quisiera saber como funciona el conseguir un trabajo y los creditos

Profile dannyridel
Volunteer tester
Avatar
Send message
Joined: 3 Feb 19
Posts: 840
ID: 1097922
Credit: 6,707,474
RAC: 52,906
321 LLR Silver: Earned 100,000 credits (100,228)Cullen LLR Silver: Earned 100,000 credits (112,212)ESP LLR Bronze: Earned 10,000 credits (48,696)Generalized Cullen/Woodall LLR Bronze: Earned 10,000 credits (22,645)PPS LLR Amethyst: Earned 1,000,000 credits (1,333,261)PSP LLR Silver: Earned 100,000 credits (100,559)SoB LLR Silver: Earned 100,000 credits (138,888)SR5 LLR Bronze: Earned 10,000 credits (64,280)SGS LLR Silver: Earned 100,000 credits (100,702)TRP LLR Bronze: Earned 10,000 credits (67,784)Woodall LLR Silver: Earned 100,000 credits (117,864)321 Sieve (suspended) Gold: Earned 500,000 credits (506,814)Generalized Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (30,033)PPS Sieve Amethyst: Earned 1,000,000 credits (1,007,929)AP 26/27 Silver: Earned 100,000 credits (161,720)WW Silver: Earned 100,000 credits (256,000)GFN Ruby: Earned 2,000,000 credits (2,164,824)PSA Silver: Earned 100,000 credits (373,034)
Message 139350 - Posted: 3 Apr 2020 | 2:32:09 UTC - in response to Message 139347.

Así que básicamente es necesario instalar primero el cliente BOINC y adjuntar al proyecto PrimeGrid.
A continuación, determinar si va ejecutar a este proyecto de forma inmanera o completa, y elegir qué tipo de subproyecto desea ejecutar. Hay LLR y tamiz y AP para que se ejecute en su CPU y GPU.
____________
SHSIDElectronicsGroup@outlook.com

waiting for a TdP prime...
Proth "SoB": 44243*2^440969+1


xii5ku
Send message
Joined: 17 Dec 16
Posts: 67
ID: 476505
Credit: 583,266,419
RAC: 12,293
321 LLR Jade: Earned 10,000,000 credits (16,776,661)Cullen LLR Turquoise: Earned 5,000,000 credits (5,352,689)ESP LLR Turquoise: Earned 5,000,000 credits (9,069,027)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (8,844,412)PPS LLR Jade: Earned 10,000,000 credits (15,401,000)PSP LLR Jade: Earned 10,000,000 credits (11,359,246)SoB LLR Sapphire: Earned 20,000,000 credits (29,894,368)SR5 LLR Turquoise: Earned 5,000,000 credits (7,426,546)SGS LLR Turquoise: Earned 5,000,000 credits (5,029,147)TRP LLR Jade: Earned 10,000,000 credits (18,341,209)Woodall LLR Turquoise: Earned 5,000,000 credits (7,760,017)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (26,331,175)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,205,264)PPS Sieve Double Silver: Earned 200,000,000 credits (329,019,713)AP 26/27 Sapphire: Earned 20,000,000 credits (25,212,148)GFN Emerald: Earned 50,000,000 credits (56,243,798)
Message 139363 - Posted: 3 Apr 2020 | 18:03:51 UTC - in response to Message 139338.
Last modified: 3 Apr 2020 | 18:06:08 UTC

Thanks to all who looked at my question, and special thanks to those who responded so far.
Apologies that I make your life harder by not showing my hosts. (I am a shy one.)

Eudy Silva wrote:
Just a shot in the dark, but how much free space in your hard disk ?

Hmm, let's see. The 5 clients on 5 hosts which are running PG currently, and all show this behaviour, report this as "free, available to BOINC":
66.49 GB, 62.24 GB, 60.47 GB, 59.10 GB, 196.99 GB
So this should be plenty.

Some other random info:

  • The client versions are "well hung": 7.8.3 on all of the 5 hosts.
  • These clients didn't do this at PG in older times. As mentioned, I think the change in behavior more or less coincided with the "mt" plan class implementation at primegrid.com.
  • I don't recall to have seen this behavior at other projects. Granted, most of the time I set larger buffers when I run other projects, but sometimes I set such small buffers at other projects too.

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 858
ID: 301928
Credit: 503,845,631
RAC: 257,254
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,233,137)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)WW Jade: Earned 10,000,000 credits (10,776,000)GFN Emerald: Earned 50,000,000 credits (55,354,440)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 139386 - Posted: 4 Apr 2020 | 5:45:31 UTC

Boinc client has a... feature. It scales amount of requested work by "availability" of your computer. If you're turning your computer off nightly, your availability drops. If you have Boinc running but computations are not allowed (auto-paused by user activity or disabled manually), it drops again. This information could be seen on a host status page: "Fraction of time BOINC is running" and "fraction of time computing is allowed". These two coefficients are multiplied together. It may lead to situation that overall availability will be very low, and client will request very small amount of work.

It may be not a reason of your problem exactly, but it's one of hidden pitfalls which peoples are not aware about.

xii5ku
Send message
Joined: 17 Dec 16
Posts: 67
ID: 476505
Credit: 583,266,419
RAC: 12,293
321 LLR Jade: Earned 10,000,000 credits (16,776,661)Cullen LLR Turquoise: Earned 5,000,000 credits (5,352,689)ESP LLR Turquoise: Earned 5,000,000 credits (9,069,027)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (8,844,412)PPS LLR Jade: Earned 10,000,000 credits (15,401,000)PSP LLR Jade: Earned 10,000,000 credits (11,359,246)SoB LLR Sapphire: Earned 20,000,000 credits (29,894,368)SR5 LLR Turquoise: Earned 5,000,000 credits (7,426,546)SGS LLR Turquoise: Earned 5,000,000 credits (5,029,147)TRP LLR Jade: Earned 10,000,000 credits (18,341,209)Woodall LLR Turquoise: Earned 5,000,000 credits (7,760,017)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (26,331,175)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,205,264)PPS Sieve Double Silver: Earned 200,000,000 credits (329,019,713)AP 26/27 Sapphire: Earned 20,000,000 credits (25,212,148)GFN Emerald: Earned 50,000,000 credits (56,243,798)
Message 139391 - Posted: 4 Apr 2020 | 8:46:34 UTC - in response to Message 139386.
Last modified: 4 Apr 2020 | 8:49:51 UTC

Good point; this built-in "intelligence" of the client (or server?) needs to be kept in mind when assessing the work buffer depth settings.

Though it doesn't apply in this case:


  • Affected were and are clients with different <on_frac> and friends, anything between ~50% to 99.999%.
  • When the client has got n logical CPUs idle, it should request work for n CPUs, and should receive it in one go* even with poor <on_frac>.** And indeed these clients do receive work for n CPUs in a single request in such a situation at other projects, and did so at PrimeGrid too in the past.



--------
*) except if the project or application is new to the client, then the 1st request fetches one task, but the next request would get several tasks
**) because the case of several idle logical CPUs removes work buffer depth from the equation

Post to thread

Message boards : Problems and Help : Requesting new work -- "got 1 new tasks"

[Return to PrimeGrid main page]
DNS Powered by DNSEXIT.COM
Copyright © 2005 - 2021 Rytis Slatkevičius (contact) and PrimeGrid community. Server load 3.97, 3.16, 3.28
Generated 27 Feb 2021 | 17:10:39 UTC