ATLAS@home releases a beta application for the multi core jobs


Advanced search

Message boards : News : ATLAS@home releases a beta application for the multi core jobs

1 · 2 · Next
Author Message
Profile Wenjing Wu
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 23 Jun 14
Posts: 31
Credit: 2,849,678
RAC: 18
      
Message 4670 - Posted: 11 Jul 2016, 15:51:59 UTC
Last modified: 11 Jul 2016, 15:52:45 UTC

We have released a beta application named "ATLAS_MCORE" for the ATLAS multi-core jobs.

If you are interested in testing it on your machine, you need to allow test task in your project preference to receive jobs from this new application.

This can be enabled by login to your account on the atlasathome webpage, then click on "Your account", then click on "ATLAS@Home preferences", then check the box next to "Run test applications".

The multi-core version will check the BOINC client for both the available CPU cores(the number of CPU cores the client is configured to give to BOINC to use) and available memory size(the number of memory size the client is configured to give to BOINC to use) to decide how many cores will be allocated to one virtual machine which runs the ATLAS job.


For the ATLAS multi-core job, the relation between memory size and number of CPU cores is defined in this formula:

Total_Memory=1300MB+1000MB*Number_of_CPU_Cores

For example, a 1 core job requires 2300 MB memory, and a 2 core job requires 3300 MB memory.

The number of CPU cores which will be allocated to the virtual machine is also calculated according to this formula.
Number_of_CPU_cores=(Total_Memory-1300MB)/1000MB
The minimum number between Number_of_CPU_cores and the available CPU cores from the client is used to allocate to the virtual machine.


Currently, this test app can utilize from 2 to 8 cores of the client depending on the available CPU cores and memory size from the client.

By using multi-core jobs, we expect the runtime of jobs is close to runtime_of_single_core_job/number_of_cores, and it can significantly saves the usage of memory for clients which offers multi-cores to BOINC.
____________

Profile Steve Hawker*
Avatar
Send message
Joined: 27 Jul 14
Posts: 27
Credit: 125,084
RAC: 3
      
Message 4674 - Posted: 11 Jul 2016, 18:55:05 UTC - in response to Message 4670.

Great!

Can you release some WUs as well please?

David Cameron
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 13 May 14
Posts: 251
Credit: 2,028,082
RAC: 30
      
Message 4675 - Posted: 11 Jul 2016, 20:35:30 UTC - in response to Message 4674.

Some more WU are going into the system now. We have a small issue with the assimilator at the moment so we don't want to put too many WU in until it's fixed.

Douglas
Send message
Joined: 24 Dec 14
Posts: 3
Credit: 794,592
RAC: 97
      
Message 4676 - Posted: 12 Jul 2016, 5:07:53 UTC - in response to Message 4670.

How can I verify I am receiving the new WUs? Are they tagged differently?

cyrusNGC_224@P3D
Send message
Joined: 22 Nov 14
Posts: 2
Credit: 279,623
RAC: 0
    
Message 4677 - Posted: 12 Jul 2016, 5:40:08 UTC
Last modified: 12 Jul 2016, 5:40:26 UTC

Look at: http://atlasathome.cern.ch/apps.php

Profile tullio
Send message
Joined: 27 Jun 14
Posts: 256
Credit: 289,886
RAC: 10
      
Message 4683 - Posted: 12 Jul 2016, 11:48:27 UTC

I fnished my first multicore on my Windows 10 PC with 4 core AMD A10-6700 CPU and 24 GB RAM. It's the first time I see a task with CPU time almost equal to 3 runtime.
Tullio

rbpeake
Send message
Joined: 27 Jun 14
Posts: 86
Credit: 8,794,961
RAC: 66
      
Message 4684 - Posted: 12 Jul 2016, 12:01:51 UTC

Maybe back-off -1 core from the maximum allowed. My machine becomes very sluggish when running all 8 of its cores. Or allow the user to specify the number of cores to be used up to the maximum permitted by the calculation.

Thanks.

Profile Yeti
Avatar
Send message
Joined: 20 Jul 14
Posts: 699
Credit: 22,597,832
RAC: 211
      
Message 4685 - Posted: 12 Jul 2016, 12:13:50 UTC - in response to Message 4684.

Maybe back-off -1 core from the maximum allowed. My machine becomes very sluggish when running all 8 of its cores. Or allow the user to specify the number of cores to be used up to the maximum permitted by the calculation.

Thanks.

You can limit the MultiCore-App by using an app_config.xml.

Below an example to limit only MultiCore to 4 Cores:
<app_config> <app_version> <app_name>ATLAS_MCORE</app_name> <avg_ncpus>4.000000</avg_ncpus> <plan_class>vbox_64_mt_mcore</plan_class> <cmdline>--memory_size_mb 6000</cmdline> </app_version> </app_config>


You should change these two lines to your needs:
    <avg_ncpus>4.000000</avg_ncpus>
    <cmdline>--memory_size_mb 6000</cmdline>


Memory is calculated based on the explanation above: 1300 + (1000* NumerOfCores). Correct would be 5300 MB for 4 Tasks but I like to spend a little bit more. 4x Single-Atlas-WU would be 8,4 GB

Sergey Kovalchuk
Send message
Joined: 12 Aug 15
Posts: 2
Credit: 10,325
RAC: 0
    
Message 4686 - Posted: 12 Jul 2016, 12:35:15 UTC - in response to Message 4670.

For example, a 1 core job requires 2300 MB memory, and a 2 core job requires 3300 MB memory.


4 core & 4 Gb memory, but no task :(

"ATLAS Simulation Running on Multiple Core needs 4768.37 MB RAM but only 3929.07 MB is available for use."

So minimal 2-core task requires 2*2,3Gb=4.7 GB of memory

Crystal Pellet
Send message
Joined: 25 Jun 14
Posts: 39
Credit: 59,718
RAC: 0
    
Message 4688 - Posted: 12 Jul 2016, 12:41:22 UTC - in response to Message 4686.

For example, a 1 core job requires 2300 MB memory, and a 2 core job requires 3300 MB memory.


4 core & 4 Gb memory, but no task :(

"ATLAS Simulation Running on Multiple Core needs 4768.37 MB RAM but only 3929.07 MB is available for use."

So minimal 2-core task requires 2*2,3Gb=4.7 GB of memory

Try setting the number of CPU´s to use to 50% (2 cores).
Probably you will get 1 task using 2 cores. After the task has started you can set the CPU use again to 100%.

rbpeake
Send message
Joined: 27 Jun 14
Posts: 86
Credit: 8,794,961
RAC: 66
      
Message 4690 - Posted: 12 Jul 2016, 12:52:01 UTC - in response to Message 4685.

Maybe back-off -1 core from the maximum allowed. My machine becomes very sluggish when running all 8 of its cores. Or allow the user to specify the number of cores to be used up to the maximum permitted by the calculation.

Thanks.

You can limit the MultiCore-App by using an app_config.xml.

Below an example to limit only MultiCore to 4 Cores:
<app_config> <app_version> <app_name>ATLAS_MCORE</app_name> <avg_ncpus>4.000000</avg_ncpus> <plan_class>vbox_64_mt_mcore</plan_class> <cmdline>--memory_size_mb 6000</cmdline> </app_version> </app_config>


You should change these two lines to your needs:
    <avg_ncpus>4.000000</avg_ncpus>
    <cmdline>--memory_size_mb 6000</cmdline>


Memory is calculated based on the explanation above: 1300 + (1000* NumerOfCores). Correct would be 5300 MB for 4 Tasks but I like to spend a little bit more. 4x Single-Atlas-WU would be 8,4 GB


Thank you, that is very useful information! Hopefully others will notice it as well!

Profile Harm Joris ten Napel
Send message
Joined: 27 Nov 14
Posts: 40
Credit: 1,696,115
RAC: 65
      
Message 4691 - Posted: 12 Jul 2016, 13:21:29 UTC - in response to Message 4670.

Gave 4 out of 8 (virtual) cores to boinc and vboxheadless.exe uses about 50 - 54 % of CPU overall which seems reasonable as the overhead may use some cpu from the remaining cores, I would not recommend giving boinc all available cores but keep one free for this overhead and your host os to run smoothly. I also noticed the % of CPU use you can define in boinc is translated as execution cap in vbox, so this is an alternative to throttle down the boinc / atlas cpu usage in case your system becomes a bit sluggish.

David Cameron
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 13 May 14
Posts: 251
Credit: 2,028,082
RAC: 30
      
Message 4694 - Posted: 12 Jul 2016, 13:58:11 UTC

My own experience is similar. I have a 4-core machine (8 cores with hyper threading) and I found that running 8-core tasks took the same or even a little longer walltime than 4-core jobs, so I've fixed the number of CPUs to 4 in BOINC config. I guess virtualbox or the old kernel version we use inside is not well optimised for hyper-threaded machines.

Sergey Kovalchuk
Send message
Joined: 12 Aug 15
Posts: 2
Credit: 10,325
RAC: 0
    
Message 4695 - Posted: 12 Jul 2016, 14:48:43 UTC - in response to Message 4688.

For example, a 1 core job requires 2300 MB memory, and a 2 core job requires 3300 MB memory.


4 core & 4 Gb memory, but no task :(

"ATLAS Simulation Running on Multiple Core needs 4768.37 MB RAM but only 3929.07 MB is available for use."

So minimal 2-core task requires 2*2,3Gb=4.7 GB of memory

Try setting the number of CPU´s to use to 50% (2 cores).
Probably you will get 1 task using 2 cores. After the task has started you can set the CPU use again to 100%.


Not worked:

Number of usable CPUs has changed from 4 to 2.
max CPUs used: 2
ATLAS Simulation Running on Multiple Core needs 4768.37 MB RAM but only 3929.07 MB is available for use.


Perhaps it is a static parameter of the application, rather than specified above formula of memory size and number of cores

Profile Jim1348
Send message
Joined: 15 Nov 14
Posts: 111
Credit: 1,319,885
RAC: 24
      
Message 4697 - Posted: 12 Jul 2016, 16:17:56 UTC - in response to Message 4694.

My own experience is similar. I have a 4-core machine (8 cores with hyper threading) and I found that running 8-core tasks took the same or even a little longer walltime than 4-core jobs, so I've fixed the number of CPUs to 4 in BOINC config. I guess virtualbox or the old kernel version we use inside is not well optimised for hyper-threaded machines.

Cosmology is multi-threaded also. I currently use 7 out of 8 cores on an i7-4770, and its run time is reduced proportionally to the number of cores used. So I don't think it is a VBox problem, but something else. Possibly there is an I/O limitation for your CPU or motherboard?

Profile Harm Joris ten Napel
Send message
Joined: 27 Nov 14
Posts: 40
Credit: 1,696,115
RAC: 65
      
Message 4699 - Posted: 12 Jul 2016, 18:51:07 UTC - in response to Message 4691.

Oops that didn't last long! Oracle released Virtualbox 5.1 and that doesn't work well, please see some debug info here http://atlasathome.cern.ch/result.php?resultid=6087506

Profile Jim1348
Send message
Joined: 15 Nov 14
Posts: 111
Credit: 1,319,885
RAC: 24
      
Message 4700 - Posted: 12 Jul 2016, 20:37:04 UTC - in response to Message 4699.

Oops that didn't last long! Oracle released Virtualbox 5.1 and that doesn't work well, please see some debug info here http://atlasathome.cern.ch/result.php?resultid=6087506

Yes, I just upgraded and lost six jobs.

Profile Yeti
Avatar
Send message
Joined: 20 Jul 14
Posts: 699
Credit: 22,597,832
RAC: 211
      
Message 4701 - Posted: 12 Jul 2016, 21:05:29 UTC

Okay, David,

I ask you to allow a second MultiCore-WU on each PC, so that a PC can continue to crunch MultiCore-WUs without interruption.

At the moment it looks like this:

Downloading MultiCore-WU: a lot of idle cores
Starting up the MultiCore-WU: one core is busy, rest are idle
Running MultiCore-WU: all is fine
Finishing MultiCore-WU: one core is busy, rest are idle
uploading result: a lot of idle cores

and now, the cyclus begins from beginning.

Having a second MultiCore-WU on the system this optimizes the situation quit well; you get more run-time out of the existing hardware

Douglas
Send message
Joined: 24 Dec 14
Posts: 3
Credit: 794,592
RAC: 97
      
Message 4703 - Posted: 13 Jul 2016, 0:43:38 UTC - in response to Message 4677.

Thanks. Looks like I got an 8 CPU WU. Fun!

David Cameron
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 13 May 14
Posts: 251
Credit: 2,028,082
RAC: 30
      
Message 4704 - Posted: 13 Jul 2016, 7:42:51 UTC - in response to Message 4701.

I ask you to allow a second MultiCore-WU on each PC, so that a PC can continue to crunch MultiCore-WUs without interruption.


Ok, I have increased the limit to 2.

1 · 2 · Next

Message boards : News : ATLAS@home releases a beta application for the multi core jobs