Moving multicore out of beta on Mon 29th August


Advanced search

Message boards : News : Moving multicore out of beta on Mon 29th August

Author Message
David Cameron
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 13 May 14
Posts: 252
Credit: 2,028,082
RAC: 0
    
Message 5107 - Posted: 26 Aug 2016, 11:27:51 UTC

We intend to move the multicore app out of beta on Monday the 29th August. This means that by default everyone will get both singlecore and multicore WU.

The main motivations for this are that multicore provides better CPU and memory efficiency, and we only have to manage a single stream of tasks instead of two.

If you do not want to run multicore you can disable it in your ATLAS@Home preferences in the option "Run only the selected applications"

By default the tasks will use as many cores as you have allocated to BOINC. For tuning the number of cores that the tasks will use you can create an app_config.xml file as described in this thread

At some point we plan to discontinue the singlecore app and run only multicore. The multicore app will also run on 1 core so you can still continue with ATLAS even with a single core.

Happy crunching!
The ATLAS@Home team

Profile Yeti
Avatar
Send message
Joined: 20 Jul 14
Posts: 699
Credit: 22,597,832
RAC: 1
    
Message 5109 - Posted: 26 Aug 2016, 18:15:50 UTC - in response to Message 5107.

Great news !

David Cameron wrote:

At some point we plan to discontinue the singlecore app and run only multicore. The multicore app will also run on 1 core so you can still continue with ATLAS even with a single core.

It would be good, if you could solve the problem with "Working set size" before discontinue the SingleCore-APP

gemini8
Send message
Joined: 14 Jul 16
Posts: 9
Credit: 15,832
RAC: 0
    
Message 5113 - Posted: 27 Aug 2016, 5:46:29 UTC

I have an older Mac running ATLAS in Virtual Box 4.3.38 which is the last vbox version supported on OS X 10.6.8.
While the singlecore application is running fine the multicore one doesn't work on it at all.

Having said that I'll switch 'use singlecore-app' on again.
____________
Greetings, Jens

David Cameron
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 13 May 14
Posts: 252
Credit: 2,028,082
RAC: 0
    
Message 5120 - Posted: 29 Aug 2016, 13:04:17 UTC

Multicore is no longer beta!

It would be good, if you could solve the problem with "Working set size" before discontinue the SingleCore-APP


Unfortunately this requires changes in BOINC client/server and so will take some time to be fixed.

I have an older Mac running ATLAS in Virtual Box 4.3.38 which is the last vbox version supported on OS X 10.6.8.
While the singlecore application is running fine the multicore one doesn't work on it at all.


If your mac is so old that it cannot be upgraded from 10.6.8 I'm surprised you can run ATLAS@Home at all :)

From your logs I see that you don't have enough memory configured to run multicore (2 cores = 4100 MB)

VBoxManage: error: Invalid RAM size: 4100 MB (must be in range [4, 3584] MB)

Can you try to configure BOINC to allow more memory usage?

gyllic
Send message
Joined: 9 Dec 14
Posts: 15
Credit: 272,319
RAC: 0
    
Message 5121 - Posted: 29 Aug 2016, 13:26:28 UTC - in response to Message 5120.

Multicore is no longer beta!

very nice!

gemini8
Send message
Joined: 14 Jul 16
Posts: 9
Credit: 15,832
RAC: 0
    
Message 5123 - Posted: 29 Aug 2016, 20:19:37 UTC - in response to Message 5120.

Hi.

gemini8 wrote:
I have an older Mac running ATLAS in Virtual Box 4.3.38 which is the last vbox version supported on OS X 10.6.8.
While the singlecore application is running fine the multicore one doesn't work on it at all.

David Cameron wrote:
If your mac is so old that it cannot be upgraded from 10.6.8 I'm surprised you can run ATLAS@Home at all :)

It would run El Capitan, but for personal reasons I stick to Snow Leopard.
One machine running that funny captain is more than enough.
I have another, older Mac Mini which has an insuffient amount of RAM installed, so I can't test if ATLAS would run on a machine which can't go further than 10.7. ;-)
David Cameron wrote:
Can you try to configure BOINC to allow more memory usage

In fact, there should be six gigs available.
It seems Boincstats is throwing wrong preferences out to two of my machines, and this Mac Mini is one of them.
When I sync with Boincstats manually, everything is fine, but after a while other preferences are used again - without the Boinc client telling me those are from a project, so I have to assume they're from Boincstats.

I will look into that again, manually suppressing other projects while there is enough RAM available.
____________
Greetings, Jens

gemini8
Send message
Joined: 14 Jul 16
Posts: 9
Credit: 15,832
RAC: 0
    
Message 5124 - Posted: 29 Aug 2016, 21:03:16 UTC - in response to Message 5123.

Hi.
I tried again, but again it failed.
A look into the Stderr (http://atlasathome.cern.ch/result.php?resultid=6752496) leaves me suspecting that this problem is related to VirtualBox rather than Boinc.
I think VirtualBox doesn't allow more than 3,5 gb of RAM.
I still have an idea regarding this, so I'll drop by again later.
____________
Greetings, Jens

gemini8
Send message
Joined: 14 Jul 16
Posts: 9
Credit: 15,832
RAC: 0
    
Message 5125 - Posted: 29 Aug 2016, 21:47:14 UTC - in response to Message 5124.

Me again.
I do believe that vbox 4.x does not support 64-bit and thus doesn't want (isn't able) to allocate more memory.
I wasn't able to boot my Mac Mini into 64-bit either, but everyting apart from the system is doing fine in 64-bit.
The Boinc manager itself is one of the few applications running in 32-bit, but boinc_master and the projects running at the moment are using 64-bit.
____________
Greetings, Jens

gyllic
Send message
Joined: 9 Dec 14
Posts: 15
Credit: 272,319
RAC: 0
    
Message 5131 - Posted: 30 Aug 2016, 10:43:18 UTC - in response to Message 5125.
Last modified: 30 Aug 2016, 10:51:18 UTC

isnt atlas single core also 64 bit?

computezrmle
Send message
Joined: 29 Oct 14
Posts: 54
Credit: 1,137,404
RAC: 0
    
Message 5132 - Posted: 30 Aug 2016, 10:45:26 UTC - in response to Message 5129.

Seems to be spam.
Can an admin please check that entry:

http://atlasathome.cern.ch/forum_thread.php?id=559&postid=5129

gemini8
Send message
Joined: 14 Jul 16
Posts: 9
Credit: 15,832
RAC: 0
    
Message 5134 - Posted: 30 Aug 2016, 18:48:44 UTC - in response to Message 5131.

Hi.

gyllic wrote:
isnt atlas single core also 64 bit?

Yes, but:
The problem I encounter is an insufficient amount of RAM on my Virtual Box.
So I assume as Virtual Box 4 is a 32 bit application it might not be able to allocate more RAM.
At least it isn't ready to do so, but it is ready to create 64 bit VMs.
Windows 7 32 bit normally doesn't let you use more than 3.25 gigs of memory.
there are tricks around that, but they don't work on every system.
Nonetheless Windows 7 32 bit can run 64 bit applications.
So maybe it's about that, maybe not.
OS X 10.6 doesn't care about this, and part of my machines runs on a 32 bit system using 8 gigs of memory.

Atm I'm still waiting for a multicore wu running on one core to test if it works or not.
Didn't get any until now.
____________
Greetings, Jens

Erico
Send message
Joined: 30 Aug 16
Posts: 8
Credit: 3,856
RAC: 0
  
Message 5136 - Posted: 31 Aug 2016, 1:50:11 UTC

I was running another project just fine, and today I decided to switch to Atlas@Home. While the last project would use 100% of all cores at all times, with Atlas@Home, it will only use around 20%. I didn't change any settings when switching projects.

Right now I have 6 tasks active and 3 "waiting to start". Previously some tasks had an "insufficient RAM" message (or something along those lines), then I changed my RAM limit from 50% to 90% and those projects started. Windows task manager still only reports 51% RAM usage, though.

Since the last project was working fine and I changed no options, I can only assume some bug with multicore is stopping the program from fully using my processor.

I have a core i7 3760 with multithreading enabled (8 threads), BOINC manager version 7.6.22 (x64) with VirtualBox.

gemini8
Send message
Joined: 14 Jul 16
Posts: 9
Credit: 15,832
RAC: 0
    
Message 5137 - Posted: 31 Aug 2016, 5:21:28 UTC

About performance:
In another thread David pointed out that using three cores is the most effective way to run ATLAS. Additionally, hyperthreading is sort of a performance-killer on ATLAS WU.
____________
Greetings, Jens

Profile Yeti
Avatar
Send message
Joined: 20 Jul 14
Posts: 699
Credit: 22,597,832
RAC: 1
    
Message 5138 - Posted: 31 Aug 2016, 5:49:08 UTC - in response to Message 5136.

I was running another project just fine, and today I decided to switch to Atlas@Home. While the last project would use 100% of all cores at all times, with Atlas@Home, it will only use around 20%. I didn't change any settings when switching projects.

Right now I have 6 tasks active and 3 "waiting to start". Previously some tasks had an "insufficient RAM" message (or something along those lines), then I changed my RAM limit from 50% to 90% and those projects started. Windows task manager still only reports 51% RAM usage, though.

Since the last project was working fine and I changed no options, I can only assume some bug with multicore is stopping the program from fully using my processor.

I have a core i7 3760 with multithreading enabled (8 threads), BOINC manager version 7.6.22 (x64) with VirtualBox.

I have just checked your results and you should work through this checklist very urgent: http://atlasathome.cern.ch/forum_thread.php?id=510

Message boards : News : Moving multicore out of beta on Mon 29th August