SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 2 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # advect particles via VSS collisional flow on a uniform grid # particles reflect off global box boundaries variable x index 10 variable y index 10 variable z index 10 variable lx equal $x*1.0e-5 variable lx equal 128*1.0e-5 variable ly equal $y*1.0e-5 variable ly equal 80*1.0e-5 variable lz equal $z*1.0e-5 variable lz equal 160*1.0e-5 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*160 seed 12345 dimension 3 global gridcut 1.0e-5 boundary rr rr rr create_box 0 ${lx} 0 ${ly} 0 ${lz} create_box 0 0.00128 0 ${ly} 0 ${lz} create_box 0 0.00128 0 0.0008 0 ${lz} create_box 0 0.00128 0 0.0008 0 0.0016 Created orthogonal box = (0 0 0) to (0.00128 0.0008 0.0016) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 160 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 1638400 child grid cells parent cells = 1 CPU time = 0.018205 secs create/ghost percent = 62.0351 37.9649 balance_grid rcb part Balance grid migrated 1593062 cells CPU time = 0.173024 secs reassign/sort/migrate/ghost percent = 19.9897 0.935879 39.8938 39.1807 species ar.species Ar mixture air Ar vstream 0.0 0.0 0.0 temp 273.15 global nrho 7.07043E22 global fnum 7.07043E6 collide vss air ar.vss create_particles air n $n create_particles air n 16384000 Created 16384000 particles CPU time = 0.200969 secs stats 100 compute temp temp stats_style step cpu np nattempt ncoll c_temp # first equilibrate with large timestep to unsort particles # then benchmark with normal timestep timestep 7.00E-8 run 30 Memory usage per proc in Mbytes: particles (ave,min,max) = 68.9175 68.9175 68.9175 grid (ave,min,max) = 10.2899 9.63888 10.5764 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 79.2075 78.5564 79.4939 Step CPU Np Natt Ncoll c_temp 0 0 16384000 0 0 273.16458 30 7.7847513 16384000 16437122 11569520 273.16458 Loop time of 7.78512 on 36 procs for 30 steps with 16384000 particles Particle moves = 491520000 (492M) Cells touched = 2440488132 (2.44B) Particle comms = 38903945 (38.9M) Boundary collides = 17383486 (17.4M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 475937103 (476M) Collide occurs = 345556563 (346M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.75377e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 4.96519 Particle comm iterations/step: 3 Particle fraction communicated: 0.0791503 Particle fraction colliding with boundary: 0.0353668 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.968297 Collisions/particle/step: 0.703037 Reactions/particle/step: 0 Move time (%) = 4.4063 (56.599) Coll time (%) = 1.93775 (24.8904) Sort time (%) = 0.825194 (10.5996) Comm time (%) = 0.602242 (7.73581) Modfy time (%) = 0 (0) Outpt time (%) = 0.0132365 (0.170023) Other time (%) = 0.000400663 (0.00514652) Particles: 455111 ave 456415 max 453296 min Histogram: 2 1 0 4 4 7 7 6 2 3 Cells: 45511.1 ave 45512 max 45511 min Histogram: 32 0 0 0 0 0 0 0 0 4 GhostCell: 12946.3 ave 18549 max 8753 min Histogram: 4 3 4 7 3 4 7 2 0 2 EmptyCell: 3420.08 ave 6114 max 0 min Histogram: 1 0 3 7 4 6 1 11 0 3 timestep 7.00E-9 run $t run 100 Memory usage per proc in Mbytes: particles (ave,min,max) = 68.9175 68.9175 68.9175 grid (ave,min,max) = 10.2899 9.63888 10.5764 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 79.2075 78.5564 79.4939 Step CPU Np Natt Ncoll c_temp 30 0 16384000 16437122 11569520 273.16458 100 6.758424 16384000 1572061 1156686 273.16458 130 9.6782425 16384000 1594234 1158004 273.16458 Loop time of 9.67858 on 36 procs for 100 steps with 16384000 particles Particle moves = 1638400000 (1.64B) Cells touched = 2287344936 (2.29B) Particle comms = 15144082 (15.1M) Boundary collides = 5795889 (5.8M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 153497272 (153M) Collide occurs = 114971869 (115M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 4.70225e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 1.39608 Particle comm iterations/step: 1 Particle fraction communicated: 0.00924321 Particle fraction colliding with boundary: 0.00353753 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0936873 Collisions/particle/step: 0.0701733 Reactions/particle/step: 0 Move time (%) = 5.72778 (59.1799) Coll time (%) = 1.17928 (12.1844) Sort time (%) = 2.54048 (26.2485) Comm time (%) = 0.20441 (2.11198) Modfy time (%) = 0 (0) Outpt time (%) = 0.026215 (0.270855) Other time (%) = 0.000417721 (0.00431594) Particles: 455111 ave 456279 max 453517 min Histogram: 1 0 2 5 7 3 6 6 4 2 Cells: 45511.1 ave 45512 max 45511 min Histogram: 32 0 0 0 0 0 0 0 0 4 GhostCell: 12946.3 ave 18549 max 8753 min Histogram: 4 3 4 7 3 4 7 2 0 2 EmptyCell: 3420.08 ave 6114 max 0 min Histogram: 1 0 3 7 4 6 1 11 0 3