2023-01-21

spwnn - scaling

The dictionary size has a big impact on the speed of spwnn (spwnning?).

c7g.16xlarge
dict sizetime (seconds)words / sec
23,1151.4715,768
49,1676.138,024
370,104388.47953



This could be for many reasons.  One is that the number of words traversed per letter pair is much larger.  Another could be exceeding the cache size which slows down memory access.

Every time I think I'm done measuring things I think up something else.

All right, all right.  Here are the increases in times to validate the dictionary vs. the max size of the neurons:

time vs. 23ktime vs len
1.01
4.23.257148909
265.016.02753654

That doesn't directly correlate, so most likely the big dictionary exceeds the cache size.


No comments:

Post a Comment