ASKSAGE: Sage Q&A Forum - Individual question feedhttp://ask.sagemath.org/questions/Q&A Forum for SageenCopyright Sage, 2010. Some rights reserved under creative commons license.Mon, 28 Oct 2013 13:58:33 -0500Sage Cloud & Parallel processinghttp://ask.sagemath.org/question/10659/sage-cloud-parallel-processing/Hi experts!
I wanna use multiprocessing using 288 cores of SageCloud for my Monte Carlo algorithm.
Is that possible?
My algorithm is like this:
import numpy as np
experiments=1000
sticks= np.array(range(1,1000,1))
def function_1():
funciton_1...
def function_2():
funciton_2...
for n in sticks:
for u range(experiments):
algorithm is executed and a number 'jjjj' is geretaed and saved in array 'numbers jjjj'.
all values in array 'numbers jjjj' are averaged and saved in array 'numbers for each stick'
the array 'numpers for each stick' is saved as .cvs
In the possitive case: I dont know how to incorporate `@parallel` decorator in my script.
Please help!
Thanks a lotSat, 26 Oct 2013 03:55:46 -0500http://ask.sagemath.org/question/10659/sage-cloud-parallel-processing/Answer by William Stein for <p>Hi experts!</p>
<p>I wanna use multiprocessing using 288 cores of SageCloud for my Monte Carlo algorithm.
Is that possible?</p>
<p>My algorithm is like this:</p>
<pre><code>import numpy as np
experiments=1000
sticks= np.array(range(1,1000,1))
def function_1():
funciton_1...
def function_2():
funciton_2...
for n in sticks:
for u range(experiments):
algorithm is executed and a number 'jjjj' is geretaed and saved in array 'numbers jjjj'.
all values in array 'numbers jjjj' are averaged and saved in array 'numbers for each stick'
the array 'numpers for each stick' is saved as .cvs
</code></pre>
<p>In the possitive case: I dont know how to incorporate <code>@parallel</code> decorator in my script.</p>
<p>Please help!</p>
<p>Thanks a lot</p>
http://ask.sagemath.org/question/10659/sage-cloud-parallel-processing/?answer=15612#post-id-15612> I wanna use multiprocessing using 288 cores of SageCloud for my Monte Carlo algorithm. Is that possible?
Unfortunately not at present. The 288 cores refers to the total number of CPU cores across all 19 machines in the cluster(s). When you create a project, it has access to only 12 cores. The main thing that "288 cores" brings is the ability of the cluster to scale up to a large number of simultaneous users. I.e., it's safe to encourage everybody you know to use https://cloud.sagemath.com.
At some point in the future, the answer to this question will be: "pay $10" to get n dedicated cores for the next k hours, or something like that. But that's just not setup yet.
Sat, 26 Oct 2013 06:10:48 -0500http://ask.sagemath.org/question/10659/sage-cloud-parallel-processing/?answer=15612#post-id-15612Comment by mresimulator for <blockquote>
<p>I wanna use multiprocessing using 288 cores of SageCloud for my Monte Carlo algorithm. Is that possible?</p>
</blockquote>
<p>Unfortunately not at present. The 288 cores refers to the total number of CPU cores across all 19 machines in the cluster(s). When you create a project, it has access to only 12 cores. The main thing that "288 cores" brings is the ability of the cluster to scale up to a large number of simultaneous users. I.e., it's safe to encourage everybody you know to use <a href="https://cloud.sagemath.com">https://cloud.sagemath.com</a>. </p>
<p>At some point in the future, the answer to this question will be: "pay $10" to get n dedicated cores for the next k hours, or something like that. But that's just not setup yet. </p>
http://ask.sagemath.org/question/10659/sage-cloud-parallel-processing/?comment=16846#post-id-16846Thanks William. 12 cores is enought. How can I use @parallel decorator to my own script? Waiting for your answer. Thanks a lot!Sun, 27 Oct 2013 03:11:10 -0500http://ask.sagemath.org/question/10659/sage-cloud-parallel-processing/?comment=16846#post-id-16846Comment by mresimulator for <blockquote>
<p>I wanna use multiprocessing using 288 cores of SageCloud for my Monte Carlo algorithm. Is that possible?</p>
</blockquote>
<p>Unfortunately not at present. The 288 cores refers to the total number of CPU cores across all 19 machines in the cluster(s). When you create a project, it has access to only 12 cores. The main thing that "288 cores" brings is the ability of the cluster to scale up to a large number of simultaneous users. I.e., it's safe to encourage everybody you know to use <a href="https://cloud.sagemath.com">https://cloud.sagemath.com</a>. </p>
<p>At some point in the future, the answer to this question will be: "pay $10" to get n dedicated cores for the next k hours, or something like that. But that's just not setup yet. </p>
http://ask.sagemath.org/question/10659/sage-cloud-parallel-processing/?comment=16841#post-id-16841I send you my script by e-mail. Waiting for your answer. Thanks a lot!Mon, 28 Oct 2013 13:58:33 -0500http://ask.sagemath.org/question/10659/sage-cloud-parallel-processing/?comment=16841#post-id-16841Comment by William Stein for <blockquote>
<p>I wanna use multiprocessing using 288 cores of SageCloud for my Monte Carlo algorithm. Is that possible?</p>
</blockquote>
<p>Unfortunately not at present. The 288 cores refers to the total number of CPU cores across all 19 machines in the cluster(s). When you create a project, it has access to only 12 cores. The main thing that "288 cores" brings is the ability of the cluster to scale up to a large number of simultaneous users. I.e., it's safe to encourage everybody you know to use <a href="https://cloud.sagemath.com">https://cloud.sagemath.com</a>. </p>
<p>At some point in the future, the answer to this question will be: "pay $10" to get n dedicated cores for the next k hours, or something like that. But that's just not setup yet. </p>
http://ask.sagemath.org/question/10659/sage-cloud-parallel-processing/?comment=16842#post-id-16842Can you make your exact code more precise? I.e., finish writing it in a single-core way? Then, email me (wstein@uw.edu).Sun, 27 Oct 2013 19:53:20 -0500http://ask.sagemath.org/question/10659/sage-cloud-parallel-processing/?comment=16842#post-id-16842