PrimeGrid
Please visit donation page to help the project cover running costs for this month

Toggle Menu

Join PrimeGrid

Returning Participants

Community

Leader Boards

Results

Other

drummers-lowrise

Advanced search

Message boards : Number crunching : Hyperthreading with AMD Threadripper

Author Message
Profile Buckeye4lfProject donor
Avatar
Send message
Joined: 27 Apr 20
Posts: 79
ID: 1257095
Credit: 393,117,638
RAC: 2,183,658
321 LLR Amethyst: Earned 1,000,000 credits (1,313,247)Cullen LLR Ruby: Earned 2,000,000 credits (2,113,606)ESP LLR Amethyst: Earned 1,000,000 credits (1,259,781)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,058,797)PPS LLR Turquoise: Earned 5,000,000 credits (6,808,295)PSP LLR Amethyst: Earned 1,000,000 credits (1,872,411)SoB LLR Ruby: Earned 2,000,000 credits (2,966,734)SR5 LLR Amethyst: Earned 1,000,000 credits (1,136,697)SGS LLR Amethyst: Earned 1,000,000 credits (1,128,995)TRP LLR Ruby: Earned 2,000,000 credits (2,301,604)Woodall LLR Amethyst: Earned 1,000,000 credits (1,149,351)321 Sieve Sapphire: Earned 20,000,000 credits (20,338,445)PPS Sieve Emerald: Earned 50,000,000 credits (59,818,395)AP 26/27 Sapphire: Earned 20,000,000 credits (45,366,503)GFN Double Silver: Earned 200,000,000 credits (229,643,634)PSA Jade: Earned 10,000,000 credits (13,841,144)
Message 143390 - Posted: 18 Sep 2020 | 16:16:09 UTC

I am currently running and have been for a long time with SMT (hyperthreading) enabled in the BIOS but setting CPUs to 50%.

I did an experiment and turned off SMT in BIOS and set CPUs to 95% and the estimated time for completion for currently running SoB tasks went from 3 days to less than 24 hours.

I was under the impression that both of these settings should be similar in performance. I understand I am basing this post of of estimated time to complete instead of an acutual result but that seems like a significant delta between the two cases.

Am I missing something? I did a search but not a lot of posts if any for AMD thread-rippers running Ubuntu 20.04 as in my case.

Profile j.sheridanProject donor
Send message
Joined: 21 Mar 11
Posts: 659
ID: 91622
Credit: 1,109,288,242
RAC: 2,099,192
321 LLR Turquoise: Earned 5,000,000 credits (5,019,701)Cullen LLR Ruby: Earned 2,000,000 credits (4,582,271)ESP LLR Ruby: Earned 2,000,000 credits (4,610,098)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,975,172)PPS LLR Turquoise: Earned 5,000,000 credits (8,639,452)PSP LLR Turquoise: Earned 5,000,000 credits (5,500,951)SoB LLR Turquoise: Earned 5,000,000 credits (8,583,226)SR5 LLR Ruby: Earned 2,000,000 credits (3,473,911)SGS LLR Turquoise: Earned 5,000,000 credits (5,169,619)TRP LLR Turquoise: Earned 5,000,000 credits (9,717,538)Woodall LLR Ruby: Earned 2,000,000 credits (4,084,622)321 Sieve Sapphire: Earned 20,000,000 credits (20,019,388)Cullen/Woodall Sieve (suspended) Double Silver: Earned 200,000,000 credits (265,102,350)PPS Sieve Double Gold: Earned 500,000,000 credits (514,289,554)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,801,812)AP 26/27 Emerald: Earned 50,000,000 credits (53,763,814)GFN Double Bronze: Earned 100,000,000 credits (186,978,187)
Message 143396 - Posted: 18 Sep 2020 | 17:16:12 UTC - in response to Message 143390.
Last modified: 18 Sep 2020 | 17:25:11 UTC

It shouldn't make that much difference. How many tasks are you running?

edit:
I can run 2 tasks of 8 threads each in under 24 hours and I have HT on.
With the 3970x you should be able to run 4.
What might upset things is if linux starts swapping things between CCXs and CCDs. It's vital to set the affinity for each task so they don't move. In windows there's a 20-30% performance hit if you don't do this. Linux is supposed to be slightly better but there's still a difference.

Profile Buckeye4lfProject donor
Avatar
Send message
Joined: 27 Apr 20
Posts: 79
ID: 1257095
Credit: 393,117,638
RAC: 2,183,658
321 LLR Amethyst: Earned 1,000,000 credits (1,313,247)Cullen LLR Ruby: Earned 2,000,000 credits (2,113,606)ESP LLR Amethyst: Earned 1,000,000 credits (1,259,781)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,058,797)PPS LLR Turquoise: Earned 5,000,000 credits (6,808,295)PSP LLR Amethyst: Earned 1,000,000 credits (1,872,411)SoB LLR Ruby: Earned 2,000,000 credits (2,966,734)SR5 LLR Amethyst: Earned 1,000,000 credits (1,136,697)SGS LLR Amethyst: Earned 1,000,000 credits (1,128,995)TRP LLR Ruby: Earned 2,000,000 credits (2,301,604)Woodall LLR Amethyst: Earned 1,000,000 credits (1,149,351)321 Sieve Sapphire: Earned 20,000,000 credits (20,338,445)PPS Sieve Emerald: Earned 50,000,000 credits (59,818,395)AP 26/27 Sapphire: Earned 20,000,000 credits (45,366,503)GFN Double Silver: Earned 200,000,000 credits (229,643,634)PSA Jade: Earned 10,000,000 credits (13,841,144)
Message 143398 - Posted: 18 Sep 2020 | 17:35:37 UTC - in response to Message 143396.

It shouldn't make that much difference. How many tasks are you running?

edit:
I can run 2 tasks of 8 threads each in under 24 hours and I have HT on.
With the 3970x you should be able to run 4.
What might upset things is if linux starts swapping things between CCXs and CCDs. It's vital to set the affinity for each task so they don't move. In windows there's a 20-30% performance hit if you don't do this. Linux is supposed to be slightly better but there's still a difference.


I am running 7 tasks, each using 4 threads as in the past I got better overall performance running 4 tasks per thread instead of 8 but I am unsure which PG app I was using at the time. Remaining 4 threads are for GPU support and OS overhead. I was under the impression that affinity was more of a Windows issue, how would I address affinity in Ubuntu 20.04?

Profile j.sheridanProject donor
Send message
Joined: 21 Mar 11
Posts: 659
ID: 91622
Credit: 1,109,288,242
RAC: 2,099,192
321 LLR Turquoise: Earned 5,000,000 credits (5,019,701)Cullen LLR Ruby: Earned 2,000,000 credits (4,582,271)ESP LLR Ruby: Earned 2,000,000 credits (4,610,098)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,975,172)PPS LLR Turquoise: Earned 5,000,000 credits (8,639,452)PSP LLR Turquoise: Earned 5,000,000 credits (5,500,951)SoB LLR Turquoise: Earned 5,000,000 credits (8,583,226)SR5 LLR Ruby: Earned 2,000,000 credits (3,473,911)SGS LLR Turquoise: Earned 5,000,000 credits (5,169,619)TRP LLR Turquoise: Earned 5,000,000 credits (9,717,538)Woodall LLR Ruby: Earned 2,000,000 credits (4,084,622)321 Sieve Sapphire: Earned 20,000,000 credits (20,019,388)Cullen/Woodall Sieve (suspended) Double Silver: Earned 200,000,000 credits (265,102,350)PPS Sieve Double Gold: Earned 500,000,000 credits (514,289,554)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,801,812)AP 26/27 Emerald: Earned 50,000,000 credits (53,763,814)GFN Double Bronze: Earned 100,000,000 credits (186,978,187)
Message 143400 - Posted: 18 Sep 2020 | 17:50:43 UTC - in response to Message 143398.

For SoB 8 threads is better - the crossover point is around 1920K.

It's very easy to check using Prime95 (mprime on linux?).

Just download it and run the benchmark.

Put in the FFT size for the project you want to run (2880-3200 for SoB) and it will go off and test run 1,2,4,8 tasks etc.

For SoB on the 3950x I see this:

[Sep 18 18:42] Worker starting
[Sep 18 18:42] Your timings will be written to the results.bench.txt file.
[Sep 18 18:42] Compare your results to other computers at http://www.mersenne.org/report_benchmarks
[Sep 18 18:42] Benchmarking multiple workers to measure the impact of memory bandwidth
[Sep 18 18:42] Timing 3200K FFT, 16 cores, 1 worker. Average times: 1.30 ms. Total throughput: 772.02 iter/sec.
[Sep 18 18:42] Timing 3200K FFT, 16 cores, 2 workers. Average times: 2.05, 2.06 ms. Total throughput: 973.94 iter/sec.
[Sep 18 18:42] Timing 3200K FFT, 16 cores, 4 workers. Average times: 9.18, 8.39, 8.47, 8.75 ms. Total throughput: 460.34 iter/sec.
[Sep 18 18:42] Timing 3200K FFT, 16 cores, 8 workers. Average times: 23.31, 23.55, 20.48, 20.49, 21.70, 22.16, 21.55, 21.88 ms. Total throughput: 366.31 iter/sec.
[Sep 18 18:42]
[Sep 18 18:42] Throughput benchmark complete.
[Sep 18 18:42] Throughput benchmark complete.
[Sep 18 18:42] Worker stopped.


Which tells me the best performance is 2 tasks of (16/2) 8 threads each.
The 3970x is essentially 2x 3950x so I'd guess yours will show 4 tasks/workers as best but it's easy to check for yourself.

It's certainly possible to set affinity in linux but I'm not familiar enough with it to offer the best solution. Hopefully someone else will pop along to help with that. In the brief testing I did on smaller tasks I seem to recall that linux was around 10% slower vs affinity-set windows.

Profile Buckeye4lfProject donor
Avatar
Send message
Joined: 27 Apr 20
Posts: 79
ID: 1257095
Credit: 393,117,638
RAC: 2,183,658
321 LLR Amethyst: Earned 1,000,000 credits (1,313,247)Cullen LLR Ruby: Earned 2,000,000 credits (2,113,606)ESP LLR Amethyst: Earned 1,000,000 credits (1,259,781)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,058,797)PPS LLR Turquoise: Earned 5,000,000 credits (6,808,295)PSP LLR Amethyst: Earned 1,000,000 credits (1,872,411)SoB LLR Ruby: Earned 2,000,000 credits (2,966,734)SR5 LLR Amethyst: Earned 1,000,000 credits (1,136,697)SGS LLR Amethyst: Earned 1,000,000 credits (1,128,995)TRP LLR Ruby: Earned 2,000,000 credits (2,301,604)Woodall LLR Amethyst: Earned 1,000,000 credits (1,149,351)321 Sieve Sapphire: Earned 20,000,000 credits (20,338,445)PPS Sieve Emerald: Earned 50,000,000 credits (59,818,395)AP 26/27 Sapphire: Earned 20,000,000 credits (45,366,503)GFN Double Silver: Earned 200,000,000 credits (229,643,634)PSA Jade: Earned 10,000,000 credits (13,841,144)
Message 143401 - Posted: 18 Sep 2020 | 17:53:44 UTC - in response to Message 143400.
Last modified: 18 Sep 2020 | 18:03:19 UTC

For SoB 8 threads is better - the crossover point is around 1920K.

It's very easy to check using Prime95 (mprime on linux?).

Just download it and run the benchmark.

Put in the FFT size for the project you want to run (2880-3200 for SoB) and it will go off and test run 1,2,4,8 tasks etc.

For SoB on the 3950x I see this:

[Sep 18 18:42] Worker starting
[Sep 18 18:42] Your timings will be written to the results.bench.txt file.
[Sep 18 18:42] Compare your results to other computers at http://www.mersenne.org/report_benchmarks
[Sep 18 18:42] Benchmarking multiple workers to measure the impact of memory bandwidth
[Sep 18 18:42] Timing 3200K FFT, 16 cores, 1 worker. Average times: 1.30 ms. Total throughput: 772.02 iter/sec.
[Sep 18 18:42] Timing 3200K FFT, 16 cores, 2 workers. Average times: 2.05, 2.06 ms. Total throughput: 973.94 iter/sec.
[Sep 18 18:42] Timing 3200K FFT, 16 cores, 4 workers. Average times: 9.18, 8.39, 8.47, 8.75 ms. Total throughput: 460.34 iter/sec.
[Sep 18 18:42] Timing 3200K FFT, 16 cores, 8 workers. Average times: 23.31, 23.55, 20.48, 20.49, 21.70, 22.16, 21.55, 21.88 ms. Total throughput: 366.31 iter/sec.
[Sep 18 18:42]
[Sep 18 18:42] Throughput benchmark complete.
[Sep 18 18:42] Throughput benchmark complete.
[Sep 18 18:42] Worker stopped.


Which tells me the best performance is 2 tasks of (16/2) 8 threads each.
The 3970x is essentially 2x 3950x so I'd guess yours will show 4 tasks/workers as best but it's easy to check for yourself.

It's certainly possible to set affinity in linux but I'm not familiar enough with it to offer the best solution. Hopefully someone else will pop along to help with that. In the brief testing I did on smaller tasks I seem to recall that linux was around 10% slower vs affinity-set windows.


Where do I download the benchmarks?

Edit: Found the benchmarks on GIMP website.

Profile firedrakes
Avatar
Send message
Joined: 7 Feb 09
Posts: 55
ID: 35268
Credit: 56,864,740
RAC: 29,031
321 LLR Gold: Earned 500,000 credits (878,090)Cullen LLR Bronze: Earned 10,000 credits (56,880)ESP LLR Gold: Earned 500,000 credits (920,612)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (273,624)PPS LLR Turquoise: Earned 5,000,000 credits (5,038,960)PSP LLR Silver: Earned 100,000 credits (104,325)SoB LLR Silver: Earned 100,000 credits (109,708)SR5 LLR Gold: Earned 500,000 credits (983,230)SGS LLR Ruby: Earned 2,000,000 credits (3,117,946)TRP LLR Silver: Earned 100,000 credits (253,030)Woodall LLR Silver: Earned 100,000 credits (117,458)321 Sieve Turquoise: Earned 5,000,000 credits (7,602,200)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (480,693)Generalized Cullen/Woodall Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,644,320)PPS Sieve Turquoise: Earned 5,000,000 credits (7,270,014)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (16,303)AP 26/27 Amethyst: Earned 1,000,000 credits (1,537,276)GFN Sapphire: Earned 20,000,000 credits (26,454,089)
Message 143607 - Posted: 24 Sep 2020 | 6:46:54 UTC

so i don know if this is bug or not.
but 321 is playing very strange with a base clock with no boost on at all.
on a 2990wx

Profile j.sheridanProject donor
Send message
Joined: 21 Mar 11
Posts: 659
ID: 91622
Credit: 1,109,288,242
RAC: 2,099,192
321 LLR Turquoise: Earned 5,000,000 credits (5,019,701)Cullen LLR Ruby: Earned 2,000,000 credits (4,582,271)ESP LLR Ruby: Earned 2,000,000 credits (4,610,098)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,975,172)PPS LLR Turquoise: Earned 5,000,000 credits (8,639,452)PSP LLR Turquoise: Earned 5,000,000 credits (5,500,951)SoB LLR Turquoise: Earned 5,000,000 credits (8,583,226)SR5 LLR Ruby: Earned 2,000,000 credits (3,473,911)SGS LLR Turquoise: Earned 5,000,000 credits (5,169,619)TRP LLR Turquoise: Earned 5,000,000 credits (9,717,538)Woodall LLR Ruby: Earned 2,000,000 credits (4,084,622)321 Sieve Sapphire: Earned 20,000,000 credits (20,019,388)Cullen/Woodall Sieve (suspended) Double Silver: Earned 200,000,000 credits (265,102,350)PPS Sieve Double Gold: Earned 500,000,000 credits (514,289,554)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,801,812)AP 26/27 Emerald: Earned 50,000,000 credits (53,763,814)GFN Double Bronze: Earned 100,000,000 credits (186,978,187)
Message 143611 - Posted: 24 Sep 2020 | 8:19:43 UTC - in response to Message 143607.

I've seen that happen when I was playing around with ryzen master. Solved by clicking the "reset" button.

Profile firedrakes
Avatar
Send message
Joined: 7 Feb 09
Posts: 55
ID: 35268
Credit: 56,864,740
RAC: 29,031
321 LLR Gold: Earned 500,000 credits (878,090)Cullen LLR Bronze: Earned 10,000 credits (56,880)ESP LLR Gold: Earned 500,000 credits (920,612)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (273,624)PPS LLR Turquoise: Earned 5,000,000 credits (5,038,960)PSP LLR Silver: Earned 100,000 credits (104,325)SoB LLR Silver: Earned 100,000 credits (109,708)SR5 LLR Gold: Earned 500,000 credits (983,230)SGS LLR Ruby: Earned 2,000,000 credits (3,117,946)TRP LLR Silver: Earned 100,000 credits (253,030)Woodall LLR Silver: Earned 100,000 credits (117,458)321 Sieve Turquoise: Earned 5,000,000 credits (7,602,200)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (480,693)Generalized Cullen/Woodall Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,644,320)PPS Sieve Turquoise: Earned 5,000,000 credits (7,270,014)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (16,303)AP 26/27 Amethyst: Earned 1,000,000 credits (1,537,276)GFN Sapphire: Earned 20,000,000 credits (26,454,089)
Message 143612 - Posted: 24 Sep 2020 | 8:36:25 UTC - in response to Message 143611.

issue is i did not mess with the master for settings. i simple using it for watching temp and clocks. nothing else

Profile j.sheridanProject donor
Send message
Joined: 21 Mar 11
Posts: 659
ID: 91622
Credit: 1,109,288,242
RAC: 2,099,192
321 LLR Turquoise: Earned 5,000,000 credits (5,019,701)Cullen LLR Ruby: Earned 2,000,000 credits (4,582,271)ESP LLR Ruby: Earned 2,000,000 credits (4,610,098)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,975,172)PPS LLR Turquoise: Earned 5,000,000 credits (8,639,452)PSP LLR Turquoise: Earned 5,000,000 credits (5,500,951)SoB LLR Turquoise: Earned 5,000,000 credits (8,583,226)SR5 LLR Ruby: Earned 2,000,000 credits (3,473,911)SGS LLR Turquoise: Earned 5,000,000 credits (5,169,619)TRP LLR Turquoise: Earned 5,000,000 credits (9,717,538)Woodall LLR Ruby: Earned 2,000,000 credits (4,084,622)321 Sieve Sapphire: Earned 20,000,000 credits (20,019,388)Cullen/Woodall Sieve (suspended) Double Silver: Earned 200,000,000 credits (265,102,350)PPS Sieve Double Gold: Earned 500,000,000 credits (514,289,554)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,801,812)AP 26/27 Emerald: Earned 50,000,000 credits (53,763,814)GFN Double Bronze: Earned 100,000,000 credits (186,978,187)
Message 143613 - Posted: 24 Sep 2020 | 9:32:32 UTC - in response to Message 143612.

try it anyway, it can't hurt.

Profile firedrakes
Avatar
Send message
Joined: 7 Feb 09
Posts: 55
ID: 35268
Credit: 56,864,740
RAC: 29,031
321 LLR Gold: Earned 500,000 credits (878,090)Cullen LLR Bronze: Earned 10,000 credits (56,880)ESP LLR Gold: Earned 500,000 credits (920,612)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (273,624)PPS LLR Turquoise: Earned 5,000,000 credits (5,038,960)PSP LLR Silver: Earned 100,000 credits (104,325)SoB LLR Silver: Earned 100,000 credits (109,708)SR5 LLR Gold: Earned 500,000 credits (983,230)SGS LLR Ruby: Earned 2,000,000 credits (3,117,946)TRP LLR Silver: Earned 100,000 credits (253,030)Woodall LLR Silver: Earned 100,000 credits (117,458)321 Sieve Turquoise: Earned 5,000,000 credits (7,602,200)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (480,693)Generalized Cullen/Woodall Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,644,320)PPS Sieve Turquoise: Earned 5,000,000 credits (7,270,014)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (16,303)AP 26/27 Amethyst: Earned 1,000,000 credits (1,537,276)GFN Sapphire: Earned 20,000,000 credits (26,454,089)
Message 143615 - Posted: 24 Sep 2020 | 10:03:35 UTC - in response to Message 143613.

k will try it some time today. need sleep and then got to sign some papers for something

Profile firedrakes
Avatar
Send message
Joined: 7 Feb 09
Posts: 55
ID: 35268
Credit: 56,864,740
RAC: 29,031
321 LLR Gold: Earned 500,000 credits (878,090)Cullen LLR Bronze: Earned 10,000 credits (56,880)ESP LLR Gold: Earned 500,000 credits (920,612)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (273,624)PPS LLR Turquoise: Earned 5,000,000 credits (5,038,960)PSP LLR Silver: Earned 100,000 credits (104,325)SoB LLR Silver: Earned 100,000 credits (109,708)SR5 LLR Gold: Earned 500,000 credits (983,230)SGS LLR Ruby: Earned 2,000,000 credits (3,117,946)TRP LLR Silver: Earned 100,000 credits (253,030)Woodall LLR Silver: Earned 100,000 credits (117,458)321 Sieve Turquoise: Earned 5,000,000 credits (7,602,200)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (480,693)Generalized Cullen/Woodall Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,644,320)PPS Sieve Turquoise: Earned 5,000,000 credits (7,270,014)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (16,303)AP 26/27 Amethyst: Earned 1,000,000 credits (1,537,276)GFN Sapphire: Earned 20,000,000 credits (26,454,089)
Message 143741 - Posted: 28 Sep 2020 | 2:47:26 UTC - in response to Message 143613.

try it anyway, it can't hurt.

try it and it wont play nice with my chip.

Post to thread

Message boards : Number crunching : Hyperthreading with AMD Threadripper

[Return to PrimeGrid main page]
DNS Powered by DNSEXIT.COM
Copyright © 2005 - 2020 Rytis Slatkevičius (contact) and PrimeGrid community. Server load 2.43, 2.21, 2.22
Generated 1 Nov 2020 | 2:15:25 UTC