Let's say I want to define a softmax function over a vector input.
In Python/Numpy that would look something like this
X = np.array([x1, x2, x3])
numerators = np.exp(X)
denominator = np.sum(numerators)
softmax_probs = numerators / denominators # [e^x1 / sum(e^x1, e^x2, e^x3), e^x2 / sum(e^x1, e^x2, e^x3),...
What would be a good way of going about this in sage?
What about
def softmax_probs(L):
R=list(map(exp, L))
S=sum(R)
return map(lambda u:u/S, R)
L=list(var("a, b, c"))
list(softmax_probs(L))
[e^a/(e^a + e^b + e^c), e^b/(e^a + e^b + e^c), e^c/(e^a + e^b + e^c)]
?
The point of the local variables is to avoid recomputing the same quantities more than once :
sage: %timeit list(map(lambda u:exp(u)/sum(map(exp, L)), L))
70.4 µs ± 942 ns per loop (mean ± std. dev. of 7 runs, 10000 loops each)
sage: %timeit list(softmax_probs(L))
31.2 µs ± 699 ns per loop (mean ± std. dev. of 7 runs, 10000 loops each)
Asked: 2021-03-23 21:01:14 +0100
Seen: 213 times
Last updated: Mar 24 '21
Copyright Sage, 2010. Some rights reserved under creative commons license. Content on this site is licensed under a Creative Commons Attribution Share Alike 3.0 license.