PrimeGrid
Please visit donation page to help the project cover running costs for this month

Toggle Menu

Join PrimeGrid

Returning Participants

Community

Leader Boards

Results

Other

drummers-lowrise

Advanced search

Message boards : Antarctic Crunchers message board : Google Colab

Author Message
Profile PenguinProject donor
Avatar
Send message
Joined: 14 Sep 12
Posts: 537
ID: 172547
Credit: 1,208,184,385
RAC: 848,259
Discovered 3 mega primesEliminated 1 conjecture "k"Found 1 prime in the 2019 Tour de PrimesFound 15 primes in the 2020 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,211,391)Cullen LLR Ruby: Earned 2,000,000 credits (2,073,913)ESP LLR Jade: Earned 10,000,000 credits (10,390,853)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,139,193)PPS LLR Sapphire: Earned 20,000,000 credits (22,727,857)PSP LLR Jade: Earned 10,000,000 credits (10,276,533)SoB LLR Ruby: Earned 2,000,000 credits (2,092,713)SR5 LLR Jade: Earned 10,000,000 credits (12,614,296)SGS LLR Turquoise: Earned 5,000,000 credits (9,143,794)TRP LLR Turquoise: Earned 5,000,000 credits (5,506,428)Woodall LLR Ruby: Earned 2,000,000 credits (2,289,700)321 Sieve Jade: Earned 10,000,000 credits (10,170,442)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,018,833)PPS Sieve Double Bronze: Earned 100,000,000 credits (105,559,494)TRP Sieve (suspended) Silver: Earned 100,000 credits (110,630)AP 26/27 Emerald: Earned 50,000,000 credits (67,518,100)GFN Double Silver: Earned 200,000,000 credits (264,344,994)PSA Double Gold: Earned 500,000,000 credits (666,025,256)
Message 133746 - Posted: 11 Oct 2019 | 3:54:07 UTC

Figured I would start this thread to help our team members learn how to get things crunching on Google Colab.

matzetoni I think could give us a few good lessons.

Profile matzetoni
Send message
Joined: 25 Nov 17
Posts: 44
ID: 952510
Credit: 30,144,451
RAC: 86,453
Found 1 prime in the 2020 Tour de Primes321 LLR Bronze: Earned 10,000 credits (10,559)Cullen LLR Bronze: Earned 10,000 credits (31,346)Generalized Cullen/Woodall LLR Bronze: Earned 10,000 credits (65,043)PPS LLR Gold: Earned 500,000 credits (574,769)SoB LLR Bronze: Earned 10,000 credits (48,626)SGS LLR Bronze: Earned 10,000 credits (43,466)TRP LLR Bronze: Earned 10,000 credits (18,307)Woodall LLR Bronze: Earned 10,000 credits (16,701)Generalized Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (33,314)PPS Sieve Amethyst: Earned 1,000,000 credits (1,051,752)AP 26/27 Gold: Earned 500,000 credits (541,762)GFN Jade: Earned 10,000,000 credits (17,053,514)PSA Jade: Earned 10,000,000 credits (10,652,230)
Message 133944 - Posted: 16 Oct 2019 | 10:27:30 UTC

For those hesitating to run Google Colab, you can run easily run BOINC on Google Colab if you're not into MSR. It is pretty easy to set up, I posted it here:

https://www.primegrid.com/forum_thread.php?id=8839&nowrap=true#133943

Profile jshriverProject donor
Send message
Joined: 25 Jul 19
Posts: 54
ID: 1162187
Credit: 18,912,784
RAC: 66,030
321 LLR Amethyst: Earned 1,000,000 credits (1,465,733)Cullen LLR Gold: Earned 500,000 credits (812,850)ESP LLR Silver: Earned 100,000 credits (298,531)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (236,865)PPS LLR Ruby: Earned 2,000,000 credits (3,369,792)PSP LLR Gold: Earned 500,000 credits (932,091)SoB LLR Silver: Earned 100,000 credits (138,538)SR5 LLR Gold: Earned 500,000 credits (772,129)SGS LLR Silver: Earned 100,000 credits (174,382)TRP LLR Gold: Earned 500,000 credits (919,333)Woodall LLR Silver: Earned 100,000 credits (264,153)321 Sieve Amethyst: Earned 1,000,000 credits (1,481,411)PPS Sieve Silver: Earned 100,000 credits (397,778)AP 26/27 Amethyst: Earned 1,000,000 credits (1,847,651)GFN Ruby: Earned 2,000,000 credits (3,765,528)PSA Ruby: Earned 2,000,000 credits (2,036,020)
Message 133959 - Posted: 16 Oct 2019 | 15:12:48 UTC

Seems interesting. Maybe I'm on an overused node but it kept constantly starting/stopping one second later due to being in use.

16-Oct-2019 15:04:21 [---] Resuming GPU computation
16-Oct-2019 15:04:21 [PrimeGrid] Starting task genefer22_24111997_4
16-Oct-2019 15:04:22 [---] Suspending GPU computation - computer is in use
16-Oct-2019 15:07:22 [---] Resuming GPU computation
16-Oct-2019 15:07:22 [---] Suspending GPU computation - computer is in use
16-Oct-2019 15:10:23 [---] Resuming GPU computation
16-Oct-2019 15:10:24 [---] Suspending GPU computation - computer is in use

Profile matzetoni
Send message
Joined: 25 Nov 17
Posts: 44
ID: 952510
Credit: 30,144,451
RAC: 86,453
Found 1 prime in the 2020 Tour de Primes321 LLR Bronze: Earned 10,000 credits (10,559)Cullen LLR Bronze: Earned 10,000 credits (31,346)Generalized Cullen/Woodall LLR Bronze: Earned 10,000 credits (65,043)PPS LLR Gold: Earned 500,000 credits (574,769)SoB LLR Bronze: Earned 10,000 credits (48,626)SGS LLR Bronze: Earned 10,000 credits (43,466)TRP LLR Bronze: Earned 10,000 credits (18,307)Woodall LLR Bronze: Earned 10,000 credits (16,701)Generalized Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (33,314)PPS Sieve Amethyst: Earned 1,000,000 credits (1,051,752)AP 26/27 Gold: Earned 500,000 credits (541,762)GFN Jade: Earned 10,000,000 credits (17,053,514)PSA Jade: Earned 10,000,000 credits (10,652,230)
Message 133962 - Posted: 16 Oct 2019 | 15:44:53 UTC - in response to Message 133959.
Last modified: 16 Oct 2019 | 15:52:15 UTC

Have you tried to disable "Suspend work when non-BOINC CPU usage is above" or "Suspend GPU work when computer is in use" settings in your BOINC computing preferences? I had some wrong settings in there at first, too.

Profile jshriverProject donor
Send message
Joined: 25 Jul 19
Posts: 54
ID: 1162187
Credit: 18,912,784
RAC: 66,030
321 LLR Amethyst: Earned 1,000,000 credits (1,465,733)Cullen LLR Gold: Earned 500,000 credits (812,850)ESP LLR Silver: Earned 100,000 credits (298,531)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (236,865)PPS LLR Ruby: Earned 2,000,000 credits (3,369,792)PSP LLR Gold: Earned 500,000 credits (932,091)SoB LLR Silver: Earned 100,000 credits (138,538)SR5 LLR Gold: Earned 500,000 credits (772,129)SGS LLR Silver: Earned 100,000 credits (174,382)TRP LLR Gold: Earned 500,000 credits (919,333)Woodall LLR Silver: Earned 100,000 credits (264,153)321 Sieve Amethyst: Earned 1,000,000 credits (1,481,411)PPS Sieve Silver: Earned 100,000 credits (397,778)AP 26/27 Amethyst: Earned 1,000,000 credits (1,847,651)GFN Ruby: Earned 2,000,000 credits (3,765,528)PSA Ruby: Earned 2,000,000 credits (2,036,020)
Message 133967 - Posted: 16 Oct 2019 | 19:01:26 UTC

Was able to get it working. I posted the code changes in your other thread.

For fun I am trying GFN15 just to see if it works and its doing 1 task about every minute :)

16-Oct-2019 18:57:28 [PrimeGrid] Scheduler request completed: got 1 new tasks
16-Oct-2019 18:58:35 [PrimeGrid] Computation for task genefer15_28067603_1 finished
16-Oct-2019 18:58:35 [PrimeGrid] Starting task genefer15_28067736_0
16-Oct-2019 18:58:37 [PrimeGrid] Started upload of genefer15_28067603_1_r824470693_0
16-Oct-2019 18:58:40 [PrimeGrid] Finished upload of genefer15_28067603_1_r824470693_0

Profile matzetoni
Send message
Joined: 25 Nov 17
Posts: 44
ID: 952510
Credit: 30,144,451
RAC: 86,453
Found 1 prime in the 2020 Tour de Primes321 LLR Bronze: Earned 10,000 credits (10,559)Cullen LLR Bronze: Earned 10,000 credits (31,346)Generalized Cullen/Woodall LLR Bronze: Earned 10,000 credits (65,043)PPS LLR Gold: Earned 500,000 credits (574,769)SoB LLR Bronze: Earned 10,000 credits (48,626)SGS LLR Bronze: Earned 10,000 credits (43,466)TRP LLR Bronze: Earned 10,000 credits (18,307)Woodall LLR Bronze: Earned 10,000 credits (16,701)Generalized Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (33,314)PPS Sieve Amethyst: Earned 1,000,000 credits (1,051,752)AP 26/27 Gold: Earned 500,000 credits (541,762)GFN Jade: Earned 10,000,000 credits (17,053,514)PSA Jade: Earned 10,000,000 credits (10,652,230)
Message 133970 - Posted: 16 Oct 2019 | 19:37:37 UTC - in response to Message 133967.

Nice! Yes, the GPUs are not super powerful, but for lower GFNs they are totally acceptable. I will probably let it run GFN16 for a while.

Profile PenguinProject donor
Avatar
Send message
Joined: 14 Sep 12
Posts: 537
ID: 172547
Credit: 1,208,184,385
RAC: 848,259
Discovered 3 mega primesEliminated 1 conjecture "k"Found 1 prime in the 2019 Tour de PrimesFound 15 primes in the 2020 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,211,391)Cullen LLR Ruby: Earned 2,000,000 credits (2,073,913)ESP LLR Jade: Earned 10,000,000 credits (10,390,853)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,139,193)PPS LLR Sapphire: Earned 20,000,000 credits (22,727,857)PSP LLR Jade: Earned 10,000,000 credits (10,276,533)SoB LLR Ruby: Earned 2,000,000 credits (2,092,713)SR5 LLR Jade: Earned 10,000,000 credits (12,614,296)SGS LLR Turquoise: Earned 5,000,000 credits (9,143,794)TRP LLR Turquoise: Earned 5,000,000 credits (5,506,428)Woodall LLR Ruby: Earned 2,000,000 credits (2,289,700)321 Sieve Jade: Earned 10,000,000 credits (10,170,442)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,018,833)PPS Sieve Double Bronze: Earned 100,000,000 credits (105,559,494)TRP Sieve (suspended) Silver: Earned 100,000 credits (110,630)AP 26/27 Emerald: Earned 50,000,000 credits (67,518,100)GFN Double Silver: Earned 200,000,000 credits (264,344,994)PSA Double Gold: Earned 500,000,000 credits (666,025,256)
Message 134044 - Posted: 19 Oct 2019 | 14:23:38 UTC

I've been successfully doing 35P ranges of GFN22 each day. That's generating around 140,000 credit.

Azmodes pointed out that they may not like us doing continuous heavy computing. But we have been unable to find a Terms Of Service for Google Colab.


So for now I'll keep at it. maybe take a break every once in a while. I don't want to lose a good thing, but there is also nothing yet that says we can't. I believe there was something found in the FAQ that advises taking intense computing to another platform... but that's all.

Profile matzetoni
Send message
Joined: 25 Nov 17
Posts: 44
ID: 952510
Credit: 30,144,451
RAC: 86,453
Found 1 prime in the 2020 Tour de Primes321 LLR Bronze: Earned 10,000 credits (10,559)Cullen LLR Bronze: Earned 10,000 credits (31,346)Generalized Cullen/Woodall LLR Bronze: Earned 10,000 credits (65,043)PPS LLR Gold: Earned 500,000 credits (574,769)SoB LLR Bronze: Earned 10,000 credits (48,626)SGS LLR Bronze: Earned 10,000 credits (43,466)TRP LLR Bronze: Earned 10,000 credits (18,307)Woodall LLR Bronze: Earned 10,000 credits (16,701)Generalized Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (33,314)PPS Sieve Amethyst: Earned 1,000,000 credits (1,051,752)AP 26/27 Gold: Earned 500,000 credits (541,762)GFN Jade: Earned 10,000,000 credits (17,053,514)PSA Jade: Earned 10,000,000 credits (10,652,230)
Message 134046 - Posted: 19 Oct 2019 | 16:34:29 UTC

The guys who discovered this opportunity on Colab over at mersenneforum are running their stuff for over a month now and even reached out to the Colab developers on what they are doing. I'm pretty sure they are aware that a part of the Colab users are running quite heavy stuff, but unrelated to crypto mining. They seem to be okay with it, as probably only a small number of people actually use it this way at this time. Since you have to manually restart every few hours to continue your computation, it is already less appealing to many people. Of course they are always free to change their terms or ban this type of computations from their platform - it is their free service.

Profile PenguinProject donor
Avatar
Send message
Joined: 14 Sep 12
Posts: 537
ID: 172547
Credit: 1,208,184,385
RAC: 848,259
Discovered 3 mega primesEliminated 1 conjecture "k"Found 1 prime in the 2019 Tour de PrimesFound 15 primes in the 2020 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,211,391)Cullen LLR Ruby: Earned 2,000,000 credits (2,073,913)ESP LLR Jade: Earned 10,000,000 credits (10,390,853)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,139,193)PPS LLR Sapphire: Earned 20,000,000 credits (22,727,857)PSP LLR Jade: Earned 10,000,000 credits (10,276,533)SoB LLR Ruby: Earned 2,000,000 credits (2,092,713)SR5 LLR Jade: Earned 10,000,000 credits (12,614,296)SGS LLR Turquoise: Earned 5,000,000 credits (9,143,794)TRP LLR Turquoise: Earned 5,000,000 credits (5,506,428)Woodall LLR Ruby: Earned 2,000,000 credits (2,289,700)321 Sieve Jade: Earned 10,000,000 credits (10,170,442)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,018,833)PPS Sieve Double Bronze: Earned 100,000,000 credits (105,559,494)TRP Sieve (suspended) Silver: Earned 100,000 credits (110,630)AP 26/27 Emerald: Earned 50,000,000 credits (67,518,100)GFN Double Silver: Earned 200,000,000 credits (264,344,994)PSA Double Gold: Earned 500,000,000 credits (666,025,256)
Message 134239 - Posted: 25 Oct 2019 | 23:45:13 UTC - in response to Message 134046.

The guys who discovered this opportunity on Colab over at mersenneforum are running their stuff for over a month now and even reached out to the Colab developers on what they are doing. I'm pretty sure they are aware that a part of the Colab users are running quite heavy stuff, but unrelated to crypto mining. They seem to be okay with it, as probably only a small number of people actually use it this way at this time. Since you have to manually restart every few hours to continue your computation, it is already less appealing to many people. Of course they are always free to change their terms or ban this type of computations from their platform - it is their free service.


That's good info. I will resume normal Colab work. The MSR's are nice. Doing a 100P range now and restarted it without any troubles.

Profile PenguinProject donor
Avatar
Send message
Joined: 14 Sep 12
Posts: 537
ID: 172547
Credit: 1,208,184,385
RAC: 848,259
Discovered 3 mega primesEliminated 1 conjecture "k"Found 1 prime in the 2019 Tour de PrimesFound 15 primes in the 2020 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,211,391)Cullen LLR Ruby: Earned 2,000,000 credits (2,073,913)ESP LLR Jade: Earned 10,000,000 credits (10,390,853)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,139,193)PPS LLR Sapphire: Earned 20,000,000 credits (22,727,857)PSP LLR Jade: Earned 10,000,000 credits (10,276,533)SoB LLR Ruby: Earned 2,000,000 credits (2,092,713)SR5 LLR Jade: Earned 10,000,000 credits (12,614,296)SGS LLR Turquoise: Earned 5,000,000 credits (9,143,794)TRP LLR Turquoise: Earned 5,000,000 credits (5,506,428)Woodall LLR Ruby: Earned 2,000,000 credits (2,289,700)321 Sieve Jade: Earned 10,000,000 credits (10,170,442)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,018,833)PPS Sieve Double Bronze: Earned 100,000,000 credits (105,559,494)TRP Sieve (suspended) Silver: Earned 100,000 credits (110,630)AP 26/27 Emerald: Earned 50,000,000 credits (67,518,100)GFN Double Silver: Earned 200,000,000 credits (264,344,994)PSA Double Gold: Earned 500,000,000 credits (666,025,256)
Message 134242 - Posted: 26 Oct 2019 | 2:18:27 UTC

I activated my second goggle account and I do believe I have 2 Google Colab MSRs running now. It was tricky getting the right accounts to work and I wound up logging out of my google accounts on one machine and logging in with the new account and it seems to be working just fine. I wouldn't recommend running a hundred accounts like this, but if you happen to have a second like many do, you can run 2 Colab instances on 2 separate machines no problem.

Profile matzetoni
Send message
Joined: 25 Nov 17
Posts: 44
ID: 952510
Credit: 30,144,451
RAC: 86,453
Found 1 prime in the 2020 Tour de Primes321 LLR Bronze: Earned 10,000 credits (10,559)Cullen LLR Bronze: Earned 10,000 credits (31,346)Generalized Cullen/Woodall LLR Bronze: Earned 10,000 credits (65,043)PPS LLR Gold: Earned 500,000 credits (574,769)SoB LLR Bronze: Earned 10,000 credits (48,626)SGS LLR Bronze: Earned 10,000 credits (43,466)TRP LLR Bronze: Earned 10,000 credits (18,307)Woodall LLR Bronze: Earned 10,000 credits (16,701)Generalized Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (33,314)PPS Sieve Amethyst: Earned 1,000,000 credits (1,051,752)AP 26/27 Gold: Earned 500,000 credits (541,762)GFN Jade: Earned 10,000,000 credits (17,053,514)PSA Jade: Earned 10,000,000 credits (10,652,230)
Message 134250 - Posted: 26 Oct 2019 | 9:42:56 UTC - in response to Message 134242.

I activated my second goggle account and I do believe I have 2 Google Colab MSRs running now. It was tricky getting the right accounts to work and I wound up logging out of my google accounts on one machine and logging in with the new account and it seems to be working just fine. I wouldn't recommend running a hundred accounts like this, but if you happen to have a second like many do, you can run 2 Colab instances on 2 separate machines no problem.


Nice! If you're willing to do the necessary micro management, yes, you can get multiple accounts and instances running. For my part, I'm too lazy :P
Even one instance is a nice credit boost.

Profile PenguinProject donor
Avatar
Send message
Joined: 14 Sep 12
Posts: 537
ID: 172547
Credit: 1,208,184,385
RAC: 848,259
Discovered 3 mega primesEliminated 1 conjecture "k"Found 1 prime in the 2019 Tour de PrimesFound 15 primes in the 2020 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,211,391)Cullen LLR Ruby: Earned 2,000,000 credits (2,073,913)ESP LLR Jade: Earned 10,000,000 credits (10,390,853)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,139,193)PPS LLR Sapphire: Earned 20,000,000 credits (22,727,857)PSP LLR Jade: Earned 10,000,000 credits (10,276,533)SoB LLR Ruby: Earned 2,000,000 credits (2,092,713)SR5 LLR Jade: Earned 10,000,000 credits (12,614,296)SGS LLR Turquoise: Earned 5,000,000 credits (9,143,794)TRP LLR Turquoise: Earned 5,000,000 credits (5,506,428)Woodall LLR Ruby: Earned 2,000,000 credits (2,289,700)321 Sieve Jade: Earned 10,000,000 credits (10,170,442)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,018,833)PPS Sieve Double Bronze: Earned 100,000,000 credits (105,559,494)TRP Sieve (suspended) Silver: Earned 100,000 credits (110,630)AP 26/27 Emerald: Earned 50,000,000 credits (67,518,100)GFN Double Silver: Earned 200,000,000 credits (264,344,994)PSA Double Gold: Earned 500,000,000 credits (666,025,256)
Message 134255 - Posted: 26 Oct 2019 | 18:02:33 UTC - in response to Message 134250.

I activated my second goggle account and I do believe I have 2 Google Colab MSRs running now. It was tricky getting the right accounts to work and I wound up logging out of my google accounts on one machine and logging in with the new account and it seems to be working just fine. I wouldn't recommend running a hundred accounts like this, but if you happen to have a second like many do, you can run 2 Colab instances on 2 separate machines no problem.


Nice! If you're willing to do the necessary micro management, yes, you can get multiple accounts and instances running. For my part, I'm too lazy :P
Even one instance is a nice credit boost.


Absolutely it is. Was looking at 140,000 extra credit each day with the one instance and only running it 12hrs. And depending how often you restart it, 250k in PSA per day is not too hard to do.

Profile jshriverProject donor
Send message
Joined: 25 Jul 19
Posts: 54
ID: 1162187
Credit: 18,912,784
RAC: 66,030
321 LLR Amethyst: Earned 1,000,000 credits (1,465,733)Cullen LLR Gold: Earned 500,000 credits (812,850)ESP LLR Silver: Earned 100,000 credits (298,531)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (236,865)PPS LLR Ruby: Earned 2,000,000 credits (3,369,792)PSP LLR Gold: Earned 500,000 credits (932,091)SoB LLR Silver: Earned 100,000 credits (138,538)SR5 LLR Gold: Earned 500,000 credits (772,129)SGS LLR Silver: Earned 100,000 credits (174,382)TRP LLR Gold: Earned 500,000 credits (919,333)Woodall LLR Silver: Earned 100,000 credits (264,153)321 Sieve Amethyst: Earned 1,000,000 credits (1,481,411)PPS Sieve Silver: Earned 100,000 credits (397,778)AP 26/27 Amethyst: Earned 1,000,000 credits (1,847,651)GFN Ruby: Earned 2,000,000 credits (3,765,528)PSA Ruby: Earned 2,000,000 credits (2,036,020)
Message 134343 - Posted: 29 Oct 2019 | 20:59:30 UTC

I'm giving MSR a chance via colab. Wanted to share as this seems to work. I only setup 1 P on gfn18 as a quick test .

Here is my colab code:

from google.colab import drive
drive.mount('/content/drive')
import os.path
!apt-get update
!apt-get install wget
!cd /content/drive/My\ Drive/colab/
!wget http://www.primegrid.com/download/gfnsvcuda/gfnsvocl_linux_x86_64 -O /content/drive/My\ Drive/colab/gfnsvocl_linux_x86_64
!chmod +x /content/drive/My\ Drive/colab/gfnsvocl_linux_x86_64
!time /content/drive/My\ Drive/colab/gfnsvocl_linux_x86_64 18 425695 425696
!cp * /content/drive/My\ Drive/colab/

Profile matzetoni
Send message
Joined: 25 Nov 17
Posts: 44
ID: 952510
Credit: 30,144,451
RAC: 86,453
Found 1 prime in the 2020 Tour de Primes321 LLR Bronze: Earned 10,000 credits (10,559)Cullen LLR Bronze: Earned 10,000 credits (31,346)Generalized Cullen/Woodall LLR Bronze: Earned 10,000 credits (65,043)PPS LLR Gold: Earned 500,000 credits (574,769)SoB LLR Bronze: Earned 10,000 credits (48,626)SGS LLR Bronze: Earned 10,000 credits (43,466)TRP LLR Bronze: Earned 10,000 credits (18,307)Woodall LLR Bronze: Earned 10,000 credits (16,701)Generalized Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (33,314)PPS Sieve Amethyst: Earned 1,000,000 credits (1,051,752)AP 26/27 Gold: Earned 500,000 credits (541,762)GFN Jade: Earned 10,000,000 credits (17,053,514)PSA Jade: Earned 10,000,000 credits (10,652,230)
Message 134344 - Posted: 29 Oct 2019 | 21:45:27 UTC

Nice!
From my experience I would recommend to run only one Colab script at once. If you start two or more at once (which is possible), you will often get a "no GPU backend available" error message, meaning you can't run anything and you can't tell when you're able to run scripts again. Your throughput of P's is essentially highest at one instance.

Profile jshriverProject donor
Send message
Joined: 25 Jul 19
Posts: 54
ID: 1162187
Credit: 18,912,784
RAC: 66,030
321 LLR Amethyst: Earned 1,000,000 credits (1,465,733)Cullen LLR Gold: Earned 500,000 credits (812,850)ESP LLR Silver: Earned 100,000 credits (298,531)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (236,865)PPS LLR Ruby: Earned 2,000,000 credits (3,369,792)PSP LLR Gold: Earned 500,000 credits (932,091)SoB LLR Silver: Earned 100,000 credits (138,538)SR5 LLR Gold: Earned 500,000 credits (772,129)SGS LLR Silver: Earned 100,000 credits (174,382)TRP LLR Gold: Earned 500,000 credits (919,333)Woodall LLR Silver: Earned 100,000 credits (264,153)321 Sieve Amethyst: Earned 1,000,000 credits (1,481,411)PPS Sieve Silver: Earned 100,000 credits (397,778)AP 26/27 Amethyst: Earned 1,000,000 credits (1,847,651)GFN Ruby: Earned 2,000,000 credits (3,765,528)PSA Ruby: Earned 2,000,000 credits (2,036,020)
Message 134359 - Posted: 30 Oct 2019 | 13:14:04 UTC

My test worked well. Took 35minutes to do that GFN18 1P run. Once it was done it copied the resulting files to my google drive under a folder called "colab".

That way I was able to download the file and upload to the manual sieving site. Going to try 2P next.

My only issue with Colab is that somedays it works great others it doesnt even finish downloading the initial ubuntu packages before it disconnects and I see a red "cell has not been executed in this session"

So I kill all sessions and fire it back up.

Free though so just grateful when I can get a solid couple hours in :)

Profile jshriverProject donor
Send message
Joined: 25 Jul 19
Posts: 54
ID: 1162187
Credit: 18,912,784
RAC: 66,030
321 LLR Amethyst: Earned 1,000,000 credits (1,465,733)Cullen LLR Gold: Earned 500,000 credits (812,850)ESP LLR Silver: Earned 100,000 credits (298,531)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (236,865)PPS LLR Ruby: Earned 2,000,000 credits (3,369,792)PSP LLR Gold: Earned 500,000 credits (932,091)SoB LLR Silver: Earned 100,000 credits (138,538)SR5 LLR Gold: Earned 500,000 credits (772,129)SGS LLR Silver: Earned 100,000 credits (174,382)TRP LLR Gold: Earned 500,000 credits (919,333)Woodall LLR Silver: Earned 100,000 credits (264,153)321 Sieve Amethyst: Earned 1,000,000 credits (1,481,411)PPS Sieve Silver: Earned 100,000 credits (397,778)AP 26/27 Amethyst: Earned 1,000,000 credits (1,847,651)GFN Ruby: Earned 2,000,000 credits (3,765,528)PSA Ruby: Earned 2,000,000 credits (2,036,020)
Message 134394 - Posted: 31 Oct 2019 | 14:13:01 UTC - in response to Message 134255.


Absolutely it is. Was looking at 140,000 extra credit each day with the one instance and only running it 12hrs. And depending how often you restart it, 250k in PSA per day is not too hard to do.


Have 2 questions: what block size do you use for the colab K80? I've tried 10 and 13

How do you maintain 12 hours? its really hit and miss for me and often "disconnects" before packages are even done downloading. Leaving me with a red button to start from the beginning.

Profile matzetoni
Send message
Joined: 25 Nov 17
Posts: 44
ID: 952510
Credit: 30,144,451
RAC: 86,453
Found 1 prime in the 2020 Tour de Primes321 LLR Bronze: Earned 10,000 credits (10,559)Cullen LLR Bronze: Earned 10,000 credits (31,346)Generalized Cullen/Woodall LLR Bronze: Earned 10,000 credits (65,043)PPS LLR Gold: Earned 500,000 credits (574,769)SoB LLR Bronze: Earned 10,000 credits (48,626)SGS LLR Bronze: Earned 10,000 credits (43,466)TRP LLR Bronze: Earned 10,000 credits (18,307)Woodall LLR Bronze: Earned 10,000 credits (16,701)Generalized Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (33,314)PPS Sieve Amethyst: Earned 1,000,000 credits (1,051,752)AP 26/27 Gold: Earned 500,000 credits (541,762)GFN Jade: Earned 10,000,000 credits (17,053,514)PSA Jade: Earned 10,000,000 credits (10,652,230)
Message 134404 - Posted: 31 Oct 2019 | 18:14:15 UTC - in response to Message 134394.
Last modified: 31 Oct 2019 | 18:15:54 UTC

I'm not sure what exactly causes the disconnect problem for you. Still, I'd recommend to have a look at my first post at:
https://www.primegrid.com/forum_thread.php?id=8839&nowrap=true#133523
where I posted a tutorial of how I started Manual Sieve on Colab. It's a little different from your script, I copy the gfnsieve executable directly from Google Drive to the Colab host. Maybe Colab doesn't like the download part of your script. Here is my script in full length:

import os.path from google.colab import drive if not os.path.exists('/content/drive/My Drive'): drive.mount('/content/drive') %cd '/content/drive/My Drive/gfn_sieve/' !cp 'gfnsvocl_linux_x86_64' /usr/local/bin/ !chmod 755 '/usr/local/bin/gfnsvocl_linux_x86_64' !cd '.' && LD_LIBRARY_PATH="lib:${LD_LIBRARY_PATH}" /usr/local/bin/gfnsvocl_linux_x86_64 23 268910 268960 B13

Also, don't run multiple scripts at the same time, only one at a time runs smoothly for long time.

As for your other question, I assume you mean the range of P's for one reservation: the K80 runs ~75 P / day at GFN22 / 23 manual sieving, so it can run 35 P in one shot. I usually reserve ranges around this size (my range cap is at ~50 P, so I can't go much higher anyway).

Profile jshriverProject donor
Send message
Joined: 25 Jul 19
Posts: 54
ID: 1162187
Credit: 18,912,784
RAC: 66,030
321 LLR Amethyst: Earned 1,000,000 credits (1,465,733)Cullen LLR Gold: Earned 500,000 credits (812,850)ESP LLR Silver: Earned 100,000 credits (298,531)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (236,865)PPS LLR Ruby: Earned 2,000,000 credits (3,369,792)PSP LLR Gold: Earned 500,000 credits (932,091)SoB LLR Silver: Earned 100,000 credits (138,538)SR5 LLR Gold: Earned 500,000 credits (772,129)SGS LLR Silver: Earned 100,000 credits (174,382)TRP LLR Gold: Earned 500,000 credits (919,333)Woodall LLR Silver: Earned 100,000 credits (264,153)321 Sieve Amethyst: Earned 1,000,000 credits (1,481,411)PPS Sieve Silver: Earned 100,000 credits (397,778)AP 26/27 Amethyst: Earned 1,000,000 credits (1,847,651)GFN Ruby: Earned 2,000,000 credits (3,765,528)PSA Ruby: Earned 2,000,000 credits (2,036,020)
Message 134406 - Posted: 31 Oct 2019 | 20:07:22 UTC - in response to Message 134404.

Thank you very much for the information. Happy Halloween everyone.

Btw I fired up a K80 on google cloud (not colab but their actual VPS service)

426895494603157798913 | 361090730^262144+1
426895495846926745601 71643.6/s (77.1P/day) Found 75 ETA 1h05m

Impressive, I'm curious to try a P4, P100 and V100 to see what P estimates are a day.

Profile PenguinProject donor
Avatar
Send message
Joined: 14 Sep 12
Posts: 537
ID: 172547
Credit: 1,208,184,385
RAC: 848,259
Discovered 3 mega primesEliminated 1 conjecture "k"Found 1 prime in the 2019 Tour de PrimesFound 15 primes in the 2020 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,211,391)Cullen LLR Ruby: Earned 2,000,000 credits (2,073,913)ESP LLR Jade: Earned 10,000,000 credits (10,390,853)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,139,193)PPS LLR Sapphire: Earned 20,000,000 credits (22,727,857)PSP LLR Jade: Earned 10,000,000 credits (10,276,533)SoB LLR Ruby: Earned 2,000,000 credits (2,092,713)SR5 LLR Jade: Earned 10,000,000 credits (12,614,296)SGS LLR Turquoise: Earned 5,000,000 credits (9,143,794)TRP LLR Turquoise: Earned 5,000,000 credits (5,506,428)Woodall LLR Ruby: Earned 2,000,000 credits (2,289,700)321 Sieve Jade: Earned 10,000,000 credits (10,170,442)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,018,833)PPS Sieve Double Bronze: Earned 100,000,000 credits (105,559,494)TRP Sieve (suspended) Silver: Earned 100,000 credits (110,630)AP 26/27 Emerald: Earned 50,000,000 credits (67,518,100)GFN Double Silver: Earned 200,000,000 credits (264,344,994)PSA Double Gold: Earned 500,000,000 credits (666,025,256)
Message 134510 - Posted: 3 Nov 2019 | 2:49:01 UTC

I use matzetoni's script just editing it each time with the new sieve data. Never seem to have a problem with disconnects. I've been doing 100P ranges with restarting 3 times and been having success.

I do get the occasional GPU not available message but trying a few hours later or in the late night hours usually it goes through fine.

I've been doing GFN21 sieving currently on Colab.

Profile PenguinProject donor
Avatar
Send message
Joined: 14 Sep 12
Posts: 537
ID: 172547
Credit: 1,208,184,385
RAC: 848,259
Discovered 3 mega primesEliminated 1 conjecture "k"Found 1 prime in the 2019 Tour de PrimesFound 15 primes in the 2020 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,211,391)Cullen LLR Ruby: Earned 2,000,000 credits (2,073,913)ESP LLR Jade: Earned 10,000,000 credits (10,390,853)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,139,193)PPS LLR Sapphire: Earned 20,000,000 credits (22,727,857)PSP LLR Jade: Earned 10,000,000 credits (10,276,533)SoB LLR Ruby: Earned 2,000,000 credits (2,092,713)SR5 LLR Jade: Earned 10,000,000 credits (12,614,296)SGS LLR Turquoise: Earned 5,000,000 credits (9,143,794)TRP LLR Turquoise: Earned 5,000,000 credits (5,506,428)Woodall LLR Ruby: Earned 2,000,000 credits (2,289,700)321 Sieve Jade: Earned 10,000,000 credits (10,170,442)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,018,833)PPS Sieve Double Bronze: Earned 100,000,000 credits (105,559,494)TRP Sieve (suspended) Silver: Earned 100,000 credits (110,630)AP 26/27 Emerald: Earned 50,000,000 credits (67,518,100)GFN Double Silver: Earned 200,000,000 credits (264,344,994)PSA Double Gold: Earned 500,000,000 credits (666,025,256)
Message 134529 - Posted: 3 Nov 2019 | 20:05:02 UTC

Seems my excessive computing on Colab has given me limited use... in the FAQ they say they will allocate to less computational intense users first. That seems to be happening now as I can never seem to get a GPU anymore on my one account while the other one is fine.

So was good while it lasted.. it may be temporary..

Profile jshriverProject donor
Send message
Joined: 25 Jul 19
Posts: 54
ID: 1162187
Credit: 18,912,784
RAC: 66,030
321 LLR Amethyst: Earned 1,000,000 credits (1,465,733)Cullen LLR Gold: Earned 500,000 credits (812,850)ESP LLR Silver: Earned 100,000 credits (298,531)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (236,865)PPS LLR Ruby: Earned 2,000,000 credits (3,369,792)PSP LLR Gold: Earned 500,000 credits (932,091)SoB LLR Silver: Earned 100,000 credits (138,538)SR5 LLR Gold: Earned 500,000 credits (772,129)SGS LLR Silver: Earned 100,000 credits (174,382)TRP LLR Gold: Earned 500,000 credits (919,333)Woodall LLR Silver: Earned 100,000 credits (264,153)321 Sieve Amethyst: Earned 1,000,000 credits (1,481,411)PPS Sieve Silver: Earned 100,000 credits (397,778)AP 26/27 Amethyst: Earned 1,000,000 credits (1,847,651)GFN Ruby: Earned 2,000,000 credits (3,765,528)PSA Ruby: Earned 2,000,000 credits (2,036,020)
Message 134656 - Posted: 7 Nov 2019 | 19:13:56 UTC

Same, and sadly I was rotating between 4 accounts. I may get 1 to work for many hours while the others done. Seems like it comes in cycles.

So if you have two, I'd say use one, give the other a day to rest,, and swap out the next day..

Google cloud also gives you $300 credit for signing up. I've been using a K80 non stop for a few days and yesterday even bumped it up to P100 which is even stronger.

Down about $150 so it goes fast. But that is still a good 2 weeks+ of non-stop dedicated power.

Profile SoulflyProject donor
Send message
Joined: 31 Oct 10
Posts: 7
ID: 71735
Credit: 277,512,518
RAC: 185,390
Discovered 1 mega primeFound 2 primes in the 2019 Tour de PrimesFound 9 primes in the 2020 Tour de Primes321 LLR Amethyst: Earned 1,000,000 credits (1,011,932)Cullen LLR Gold: Earned 500,000 credits (506,804)ESP LLR Amethyst: Earned 1,000,000 credits (1,058,603)Generalized Cullen/Woodall LLR Amethyst: Earned 1,000,000 credits (1,013,018)PPS LLR Jade: Earned 10,000,000 credits (16,432,405)PSP LLR Ruby: Earned 2,000,000 credits (2,547,328)SoB LLR Amethyst: Earned 1,000,000 credits (1,308,032)SR5 LLR Ruby: Earned 2,000,000 credits (3,628,567)SGS LLR Ruby: Earned 2,000,000 credits (3,072,266)TRP LLR Gold: Earned 500,000 credits (739,753)Woodall LLR Gold: Earned 500,000 credits (648,551)321 Sieve Ruby: Earned 2,000,000 credits (4,912,340)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,558,543)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,708,238)PPS Sieve Emerald: Earned 50,000,000 credits (50,171,523)AP 26/27 Sapphire: Earned 20,000,000 credits (40,025,700)GFN Emerald: Earned 50,000,000 credits (74,756,816)PSA Emerald: Earned 50,000,000 credits (59,412,100)
Message 138127 - Posted: 21 Feb 2020 | 20:23:49 UTC

I am in an geographical area where runtime type switches a lot between P4, P100 and T4 – haven’t seen K80 for a while – I suspect they are being phased out. Performance on these cards are currently as follows:

Currently a GFN23 50P chunk takes roughly:
33.000 sec on an P4
20.000 sec on an P100
10.000 sec on an T4

I am curious of the performance on the recently released 2060 KO that are based on the TU104 (at least EVGA promises this die on their KO versions) where I suspect the performance somewhat will match the T4/2070/2080 I certain compute scenarios.
Anyone got a 2060 KO who can give some kind of feedback?

____________

Post to thread

Message boards : Antarctic Crunchers message board : Google Colab

[Return to PrimeGrid main page]
DNS Powered by DNSEXIT.COM
Copyright © 2005 - 2020 Rytis Slatkevičius (contact) and PrimeGrid community. Server load 9.92, 9.20, 10.45
Generated 3 Apr 2020 | 20:37:51 UTC