Large sizedistance matrices (xTour, xDima, xCluster)

Deals with generic topics such as logging, framework and so on. If you are not sure where to place your topic just put it here.
Post Reply
User avatar
Bernd Welter
Site Admin
Posts: 2564
Joined: Mon Apr 14, 2014 10:28 am
Contact:

Large sizedistance matrices (xTour, xDima, xCluster)

Post by Bernd Welter »

Hello together,

while the maximum number of locations within a single distance matrix used to be 18918 (due to 32bit address sizing in memory) we are now working with 64bit address sizing which enable our servers to compute much bigger distances.

But: though the software is now able to handle such sizes we now depend on your system environment, especially the memory!

The size of a single distance matrix simply depends on the number of locations(=#locations). You can compute the size with the following term:
  • #locations * #locations * 6bytes
  • 1'000 : 6 Megabytes
  • 10'000 : 600 Megabytes
  • 20'000 : 2,4 Gigabytes
  • 30'000 : 5.0 Gigabytes
  • 40'000 : 8.95 Gigabytes
  • 50'000 : 15 Gigabytes
  • 75'000 : 32 Gigabytes
  • 100'000 : 60 Gigabytes
This might exceed the usual memory size available in a standard desktop (oct-2014).
Thanks to my colleague Joost Claessen for this important hint!

Here's a rule of thumb:
  • number of locations is doubled: the size will grow by factor 4.
  • number of locations is trippled: the size will grow by factor 9.
  • ..and so on.
Regards from Germany,

Bernd

PS: confirmed sizes:
75.000 locations (F. Radaschewski)
45.941 locations (B. Welter)
Post Reply