Can we beat the ATLAS record?


Advanced search

Message boards : News : Can we beat the ATLAS record?

1 · 2 · Next
Author Message
David Cameron
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 13 May 14
Posts: 248
Credit: 2,026,552
RAC: 390
      
Message 3736 - Posted: 18 Feb 2016, 9:02:37 UTC

Hi all,

Next week (starting 22 Feb) our ATLAS colleagues in the US will get their hands on 100,000 CPU cores from Amazon EC2 for a few days to run ATLAS simulation. In combination with this we are going to push all the other ATLAS resources we have in order to break the record of concurrent simulation tasks running. Can you guys spread the word around to get people to contribute a bit more to ATLAS@Home next week?

You can see the number of tasks running per site for the last month on this page: http://atlasathome.cern.ch/atlas_job.php (ATLAS@Home is "BOINC"). Thanks in advance for your help!

Profile MAGIC Quantum Mechanic
Avatar
Send message
Joined: 4 Jul 14
Posts: 329
Credit: 485,372
RAC: 0
    
Message 3742 - Posted: 19 Feb 2016, 2:48:59 UTC - in response to Message 3736.
Last modified: 19 Feb 2016, 3:28:32 UTC

Well David always good to see you and all I can do is run more Atlas than usual and since I run GPU's at Einstein I can get a few free cores and we have quite a few members here that will help even more.

Good luck

(just my luck right now I can't contact the server for Atlas at all either direction so I can't download or upload which gives me those computer errors)
____________

JSE
Send message
Joined: 14 Feb 15
Posts: 137
Credit: 9,505,329
RAC: 0
    
Message 3748 - Posted: 19 Feb 2016, 10:59:31 UTC

Sure we join with all the power we have David.

Are you guys ready with enough tasks and can the system handle the load we will put on it?

Fuzzy Duck
Send message
Joined: 3 Dec 15
Posts: 33
Credit: 5,068,881
RAC: 2,938
      
Message 3756 - Posted: 20 Feb 2016, 0:33:04 UTC

David,

I am more concerned for issues at your end than the users.

Profile MAGIC Quantum Mechanic
Avatar
Send message
Joined: 4 Jul 14
Posts: 329
Credit: 485,372
RAC: 0
    
Message 3759 - Posted: 20 Feb 2016, 3:10:27 UTC - in response to Message 3758.

Well look at the spam we got......we must have people looking/spying on us now.



(yeah you can erase my post seconds after that spam post)

Adam Myatt
Send message
Joined: 12 Apr 15
Posts: 4
Credit: 242,697
RAC: 0
    
Message 3761 - Posted: 20 Feb 2016, 4:33:20 UTC - in response to Message 3736.
Last modified: 20 Feb 2016, 4:34:22 UTC

From posts and articles I've read it hasn't been possible to run Atlas@Home on EC2 due to VirtualBox not being supported (a VM running on a VM). Has AWS or VirtualBox addressed this issue, or are the 100,000 cores from EC2 a special project set up with Amazon? I would love to occasionally run Atlas@home on EC2 even though it costs money if it were technically possible to do so now.

David Cameron
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 13 May 14
Posts: 248
Credit: 2,026,552
RAC: 390
      
Message 3763 - Posted: 20 Feb 2016, 19:41:29 UTC

The Amazon project is not ATLAS@Home, but the underlying technology is similar. What differs is the method of instantiating the VM. Instead of BOINC starting a VM using VirtualBox and an image downloaded from the BOINC server, the VMs are spawned directly by EC2. So the ATLAS VM in EC2 is the EC2 VM itself rather than a VM inside a VM. But the VM image is basically identical in ATLAS@Home and EC2 - the standard CERNVM image. We have also tried before running ATLAS@Home inside a VM and it didn't work due to hardware acceleration not being available inside the outer VM. It's a pity because almost all the common computing resources CERN provides to experiments are virtualised (via openstack) and we'd love to take advantage of free cycles by putting ATLAS@Home on every node!

Profile Yeti
Avatar
Send message
Joined: 20 Jul 14
Posts: 696
Credit: 22,597,832
RAC: 5,020
      
Message 3764 - Posted: 20 Feb 2016, 19:52:30 UTC - in response to Message 3763.

We have also tried before running ATLAS@Home inside a VM and it didn't work due to hardware acceleration not being available inside the outer VM. It's a pity because almost all the common computing resources CERN provides to experiments are virtualised (via openstack) and we'd love to take advantage of free cycles by putting ATLAS@Home on every node!

HM, several of my boxes are virtual machines on VMWare ESX Hosts 5.5

So, my infrastucture Looks like this:

ESX-Host running several VMs: Atlas1, Atlas4, Atlas5

Atlas1,4,5 are Windows-7-Machines that run BOINC and VirtualBox

It was a bit tricky to get it working. Search for nested virtualisation

At this Moment, Atlas1 is number 4 on the list of the best Hosts of Atlas

Profile MAGIC Quantum Mechanic
Avatar
Send message
Joined: 4 Jul 14
Posts: 329
Credit: 485,372
RAC: 0
    
Message 3765 - Posted: 21 Feb 2016, 1:29:34 UTC

Atlas ran pretty good for me today and got 14 Valids and just 1 Invalid

Hope to have the same or better back to back.
____________

johnnymc
Send message
Joined: 11 Sep 14
Posts: 1
Credit: 5,038
RAC: 0
  
Message 3766 - Posted: 21 Feb 2016, 4:24:39 UTC

I am interested to see what throughput Amazon's 100,000 CPU cores will achieve.
____________
~SETI@home classic workunits: 5,851 ~ CPU time: 108,169 hours~

michael
Send message
Joined: 21 Feb 16
Posts: 2
Credit: 0
RAC: 0
Message 3768 - Posted: 21 Feb 2016, 11:52:07 UTC - in response to Message 3736.
Last modified: 21 Feb 2016, 11:52:25 UTC

I apologize that I only have 4 CPU's to contribute I am working on improving that

michael
Send message
Joined: 21 Feb 16
Posts: 2
Credit: 0
RAC: 0
Message 3769 - Posted: 21 Feb 2016, 11:54:41 UTC - in response to Message 3764.

can somebody tell me how I can tie my desktop into my laptop to increase the amount of CPU's

Profile tullio
Send message
Joined: 27 Jun 14
Posts: 256
Credit: 288,515
RAC: 80
      
Message 3770 - Posted: 21 Feb 2016, 12:45:18 UTC - in response to Message 3736.
Last modified: 21 Feb 2016, 12:45:55 UTC

I am not getting any ATLAS@home tasks on my Windows 10, neither vLHC@home or CMS-dev. It is true is digesting a lot of SETI@Home CPU tasks, one SET@home GPU task and one Einstein@home GPU task. I have put NNT on SETI, but I am still running the Challenge, since Ben says it is important.
Tullio
____________

maeax
Send message
Joined: 25 Jun 14
Posts: 49
Credit: 1,700,662
RAC: 1,370
      
Message 3777 - Posted: 22 Feb 2016, 14:12:09 UTC - in response to Message 3763.

We have also tried before running ATLAS@Home inside a VM and it didn't work due to hardware acceleration not being available inside the outer VM.


Have made a test with OpenSuse 13.2-Guest to start the Atlas.vdi inside a KVM.
But there are problems with the network use and the Guest-Addition.

maeax

JSE
Send message
Joined: 14 Feb 15
Posts: 137
Credit: 9,505,329
RAC: 0
    
Message 3785 - Posted: 22 Feb 2016, 21:39:35 UTC - in response to Message 3756.

David,

I am more concerned for issues at your end than the users.


You are still avoiding to answer/respond to our questions/remarks.

Are you sure the Cern-end can handle the load we will put on as users?

lancone
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 26 May 14
Posts: 219
Credit: 53,963
RAC: 0
    
Message 3786 - Posted: 22 Feb 2016, 21:42:06 UTC - in response to Message 3785.

Hello,

Apologises for the late answer.
We were all busy today, it is the first day of the ATLAS week (every quater)!

In short: Yes, we believe we can sustain the load. But only reality will show if we were right.

Regards

Profile MAGIC Quantum Mechanic
Avatar
Send message
Joined: 4 Jul 14
Posts: 329
Credit: 485,372
RAC: 0
    
Message 3787 - Posted: 22 Feb 2016, 21:57:08 UTC - in response to Message 3786.

Hello,

Apologises for the late answer.
We were all busy today, it is the first day of the ATLAS week (every quater)!

In short: Yes, we believe we can sustain the load. But only reality will show if we were right.

Regards



......and Relativity
____________

JSE
Send message
Joined: 14 Feb 15
Posts: 137
Credit: 9,505,329
RAC: 0
    
Message 3788 - Posted: 22 Feb 2016, 23:12:23 UTC

TO ALL:

Start up all machines you have and let them crunch on Atlas@Home!

lancone
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 26 May 14
Posts: 219
Credit: 53,963
RAC: 0
    
Message 3798 - Posted: 24 Feb 2016, 21:24:16 UTC - in response to Message 3788.

Hello,

we are experiencing difficulties fo feed AWS currently.

more news...

Regards

1 · 2 · Next

Message boards : News : Can we beat the ATLAS record?