Author Message

Allen Paschke

Send message

Joined: 27 Jan 18

Posts: 21

Credit: 5,660,368

RAC: 375

Joined: 27 Jan 18Posts: 21Credit: 5,660,368RAC: 375 Message 959 - Posted: 31 Oct 2018, 16:24:26 UTC I am running Amicable Numbers on 3 different computers, all with Microsoft Windows 10 Professional x64, in CPU Mode with 3 CPUs selected. Each computer has 4 Intel i5 processors. Historically, each task would take 10 - 12 hours to complete. Starting a week or two ago, each task started taking 20+ hours to complete. I did upgrade from BOINC 7.12.1 to BOINC 7.14.1, but I've made no other software changes to any of the 3 PCs. This seems suspicious that all 3 computers would run Amicable Numbers slower.

- Have other people has similar experiences?

- Have there been any changes to Amicable Numbers?

- Are there any parameters which I can control, so Amicable numbers will run faster. Reply Quote ID: 959 · Rating: 0 · rate:

Brent

Send message

Joined: 6 Apr 18

Posts: 12

Credit: 20,200,952

RAC: 0

Joined: 6 Apr 18Posts: 12Credit: 20,200,952RAC: 0 Message 960 - Posted: 31 Oct 2018, 17:24:38 UTC - in response to Message 959. Same here. I am running Amicable Numbers CPU mode with 7 CPUs selected. This is on a Dell XPS 8900 PC with INTEL Core i7-6700 @ 3.40GHz, Windows 10 Home on 1 PC. I was processing 13-15 units a day but am now down to 7-10 per day. The main change was a recent upgrade to the latest Boinc software, but the slowdown started before this upgrade. Reply Quote ID: 960 · Rating: 0 · rate:

bryan

Send message

Joined: 7 Nov 17

Posts: 13

Credit: 75,061,406

RAC: 0

Joined: 7 Nov 17Posts: 13Credit: 75,061,406RAC: 0 Message 963 - Posted: 31 Oct 2018, 21:12:07 UTC The applications were last published in September https://sech.me/boinc/Amicable/apps.php



You can see how long they are recorded to take at Tasks here https://sech.me/boinc/Amicable/home.php , and then see if there is an increase.



The only thing I've noticed is the number of new discoveries has for me, been non-existent for a time- explained in another thread. Reply Quote ID: 963 · Rating: 0 · rate:

Sergei Chernykh



Project developer

Project administratorProject developer Send message

Joined: 5 Jan 17

Posts: 445

Credit: 72,451,573

RAC: 0

Joined: 5 Jan 17Posts: 445Credit: 72,451,573RAC: 0 Message 964 - Posted: 1 Nov 2018, 8:33:20 UTC My only guess is as numbers grow larger, internal buffers don't fit in CPU cache anymore. Hence the slowdown. Reply Quote ID: 964 · Rating: 0 · rate:

bryan

Send message

Joined: 7 Nov 17

Posts: 13

Credit: 75,061,406

RAC: 0

Joined: 7 Nov 17Posts: 13Credit: 75,061,406RAC: 0 Message 968 - Posted: 2 Nov 2018, 18:35:44 UTC Oh, if that bottleneck may be happening in primesieve the new versions has some more tweaks for that - (although last time they didn't have a noticeable impact)



https://github.com/kimwalisch/primesieve/blob/master/ChangeLog



Specifically 7.1:

primesieve-7.1 runs up to 30% faster on Intel Skylake-X CPUs!

The default sieve size is now (L2 cache size / 2). Using a sieve size

that is slightly smaller than the L2 cache size reduces the number

of L2 cache misses which improves performance on CPUs with slow L3

caches. primesieve-7.1 will also run slightly faster (< 3%) on most

other Intel CPUs.



Aside: is primesive used on OpenCL? I see that hasn't been updated on that branch for some time. Reply Quote ID: 968 · Rating: 0 · rate:

Sergei Chernykh



Project developer

Project administratorProject developer Send message

Joined: 5 Jan 17

Posts: 445

Credit: 72,451,573

RAC: 0

Joined: 5 Jan 17Posts: 445Credit: 72,451,573RAC: 0 Message 970 - Posted: 2 Nov 2018, 19:21:36 UTC - in response to Message 968. Oh my... I guess I'll need to update primesieve in all versions soon. This month probably because it's also used in OpenCL versions and will become a bottleneck as numbers grow larger. Reply Quote ID: 970 · Rating: 0 · rate:

Brent

Send message

Joined: 6 Apr 18

Posts: 12

Credit: 20,200,952

RAC: 0

Joined: 6 Apr 18Posts: 12Credit: 20,200,952RAC: 0 Message 972 - Posted: 2 Nov 2018, 19:59:57 UTC - in response to Message 964. Gee! If the numbers growing larger is causing the slowdown, way aren't the credits also growing larger. If it is taking twice as long to process a unit, shouldn't the credits be twice as much? Reply Quote ID: 972 · Rating: 0 · rate:

Sergei Chernykh



Project developer

Project administratorProject developer Send message

Joined: 5 Jan 17

Posts: 445

Credit: 72,451,573

RAC: 0

Joined: 5 Jan 17Posts: 445Credit: 72,451,573RAC: 0 Message 973 - Posted: 2 Nov 2018, 21:15:05 UTC - in response to Message 972. All CPU tasks should be balanced to roughly the same execution time, they were generated with primesieve performance taken into account. it's only OpenCL version that will slowdown eventually. Reply Quote ID: 973 · Rating: 0 · rate:

ccpmc

Send message

Joined: 28 May 18

Posts: 1

Credit: 34,447,580

RAC: 0

Joined: 28 May 18Posts: 1Credit: 34,447,580RAC: 0 Message 976 - Posted: 15 Nov 2018, 15:50:08 UTC

Last modified: 15 Nov 2018, 15:50:45 UTC I'm running Amicable Numbers in a machine which can only calculating about 8 hours per day.

But a workunit cost more than 20 hours.

So the period is too short for me to complete the workunit.



I think the period for workunits should be more longer. Reply Quote ID: 976 · Rating: 0 · rate:

Brent

Send message

Joined: 6 Apr 18

Posts: 12

Credit: 20,200,952

RAC: 0

Joined: 6 Apr 18Posts: 12Credit: 20,200,952RAC: 0 Message 977 - Posted: 15 Nov 2018, 17:26:00 UTC - in response to Message 973. All CPU tasks should be balanced to roughly the same execution time, they were generated with primesieve performance taken into account. it's only OpenCL version that will slowdown eventually.



Ok, so how do I avoid OpenCL so I am not wasting my computer time and electricity for less work? Ok, so how do I avoid OpenCL so I am not wasting my computer time and electricity for less work? Reply Quote ID: 977 · Rating: 0 · rate:

Matt Kowal



Send message

Joined: 12 Feb 17

Posts: 14

Credit: 175,874,429

RAC: 0

Joined: 12 Feb 17Posts: 14Credit: 175,874,429RAC: 0 Message 978 - Posted: 17 Nov 2018, 0:13:09 UTC - in response to Message 977.

Last modified: 17 Nov 2018, 0:13:45 UTC Ok, so how do I avoid OpenCL so I am not wasting my computer time and electricity for less work?



OpenCL tasks on this project are for GPUs. Your system ( OpenCL tasks on this project are for GPUs. Your system ( https://sech.me/boinc/Amicable/results.php?hostid=36634 ) is only utilizing the CPU on this project, so no changes are needed. Reply Quote ID: 978 · Rating: 0 · rate:

Brent

Send message

Joined: 6 Apr 18

Posts: 12

Credit: 20,200,952

RAC: 0

Joined: 6 Apr 18Posts: 12Credit: 20,200,952RAC: 0 Message 979 - Posted: 17 Nov 2018, 7:23:34 UTC - in response to Message 978. Ok, so how do I avoid OpenCL so I am not wasting my computer time and electricity for less work?



OpenCL tasks on this project are for GPUs. Your system (https://sech.me/boinc/Amicable/results.php?hostid=36634) is only utilizing the CPU on this project, so no changes are needed.



Then why am I experiencing the slowdown if only the Open CL tasks should be affected. I am spending almost the same computer time and electricity to process almost half the workunits. And others are reporting the same issue which began about Oct. 20. Then why am I experiencing the slowdown if only the Open CL tasks should be affected. I am spending almost the same computer time and electricity to process almost half the workunits. And others are reporting the same issue which began about Oct. 20. Reply Quote ID: 979 · Rating: 0 · rate:

Jozef J

Send message

Joined: 24 Jan 17

Posts: 20

Credit: 1,001,730,789

RAC: 1,156

Joined: 24 Jan 17Posts: 20Credit: 1,001,730,789RAC: 1,156 Message 981 - Posted: 17 Nov 2018, 19:12:58 UTC

Last modified: 17 Nov 2018, 19:23:45 UTC hi, i see some slowing down on gpu nvidia 2080Ti ,,, on same setup and all... in win10... i see about 10 sec. more per task

most proably new nvidia drivers after 400.0 i have last always . now 416.94

Or increasing app diff.??'

I ask you for share your experience .

thank you

edit: i have also always disabled HW accelr. in web browser , clean OS from "bad bugs"

now i check task run time and i find some with "old good time" 85-92 second

but most of all other task have now 95-110 ..

Is it diff increase or nvidia..? that is big todays question..) windows 10 1803.. Reply Quote ID: 981 · Rating: 0 · rate:

Kellen

Send message

Joined: 14 Nov 17

Posts: 70

Credit: 1,000,005,236

RAC: 0

Joined: 14 Nov 17Posts: 70Credit: 1,000,005,236RAC: 0 Message 982 - Posted: 18 Nov 2018, 0:56:01 UTC - in response to Message 981. Hi Jozef,



As we approach the end of the project the CPU time for each task will continue to increase, and for that reason you will need to run more than 1 task per GPU to reach full utilization. I switched to 2 concurrent tasks on my RTX 2070 today as the GPU utilization was down to 94%. The utilization went up to 99%-100% and now I am doing two tasks every 295 seconds instead of 1 task every 153 seconds, or a 3.7% increase in throughput.



I looked at your tasks and you can see that the CPU time and the Run Time for most of them are the same. This means that the Run Time is being limited by the CPU and not using the GPU completely.



To run two tasks concurrently, make a file called app_config.xml (make a text file, then change the extension to .xml from .txt) in your Amicable Numbers data directory and put the following text in it;



<app_config>

<app>

<name>amicable_10_20</name>

<gpu_versions>

<gpu_usage>0.5</gpu_usage>

<cpu_usage>1</cpu_usage>

</gpu_versions>

</app>

</app_config>



Once that is in there, select the Options menu in BOINC and click "Read Config Files" and two units should start running at the same time. Each unit will get a full CPU core and half of the GPU.



Once CPU usage becomes about 80-90% of the total run time of a task, then the GPU utilization will probably start to decrease. If that happens, then you can change the <gpu_usage> line to make more tasks run. 0.33 would be 3 tasks, 0.25 would be 4 tasks, 0.2 would be 5 tasks, etc. Just be aware that each task will use additional memory. At this time, each task is approximately 1400MB GPU memory, so 5 tasks would be 7GB.



Based on the potential total performance of your GPU compared to mine, 2 tasks might not be enough to fully utilize the RTX 2080ti and you may have to run 3 to get full use. The number of required tasks will continue to increase until the end of the project.



Hope this helps.



Regards,

Kellen Reply Quote ID: 982 · Rating: 0 · rate:

Jozef J

Send message

Joined: 24 Jan 17

Posts: 20

Credit: 1,001,730,789

RAC: 1,156

Joined: 24 Jan 17Posts: 20Credit: 1,001,730,789RAC: 1,156 Message 983 - Posted: 18 Nov 2018, 2:44:50 UTC i remember just few day ago was utilizing on my 2080ti about 94-96% . But now is 85% . Booth on kernel size 23 ..

So is maybe time yo use kernel 24 , as we before discus, also some people with nv tesla V 100 need higher kernel.to get more from gpu.-. Reply Quote ID: 983 · Rating: 0 · rate:

Kellen

Send message

Joined: 14 Nov 17

Posts: 70

Credit: 1,000,005,236

RAC: 0

Joined: 14 Nov 17Posts: 70Credit: 1,000,005,236RAC: 0 Message 984 - Posted: 18 Nov 2018, 3:28:12 UTC - in response to Message 983. Hi Jozef,



I do not think that the kernel size will help anymore. I have not gone through all of the code in detail, however it is my understanding that the issue now is that the CPU must determine all of the prime numbers over a very large range of values and that range of values will continue to get larger towards the end of the project. Sergei would be able to confirm it, but I suspect that the only way to increase GPU utilization from now on will be to run more tasks concurrently.



Running multiple tasks will solve the problem for now and Sergei may have other solutions to the low utilization, but I am not familiar enough with the code to figure out anything else.



Regards,

Kellen Reply Quote ID: 984 · Rating: 0 · rate:

Jozef J

Send message

Joined: 24 Jan 17

Posts: 20

Credit: 1,001,730,789

RAC: 1,156

Joined: 24 Jan 17Posts: 20Credit: 1,001,730,789RAC: 1,156 Message 985 - Posted: 18 Nov 2018, 11:28:36 UTC "make a text file, then change the extension to .xml from .txt" its not work in win 10

I try change but "file" always stay as "text file" and boinc manager not read this config file.. i try many times in other projects

did you try changing " extension" with "open in some program".. ? but this not work

can you put edited app_config.xml on some (megaupl) and share ..? Reply Quote ID: 985 · Rating: 0 · rate: