SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 1 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # advect particles via VSS collisional flow on a uniform grid # particles reflect off global box boundaries variable x index 10 variable y index 10 variable z index 10 variable lx equal $x*1.0e-5 variable lx equal 128*1.0e-5 variable ly equal $y*1.0e-5 variable ly equal 80*1.0e-5 variable lz equal $z*1.0e-5 variable lz equal 160*1.0e-5 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*160 seed 12345 dimension 3 global gridcut 1.0e-5 boundary rr rr rr create_box 0 ${lx} 0 ${ly} 0 ${lz} create_box 0 0.00128 0 ${ly} 0 ${lz} create_box 0 0.00128 0 0.0008 0 ${lz} create_box 0 0.00128 0 0.0008 0 0.0016 Created orthogonal box = (0 0 0) to (0.00128 0.0008 0.0016) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 160 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 1638400 child grid cells parent cells = 1 CPU time = 0.0192139 secs create/ghost percent = 60.2427 39.7573 balance_grid rcb part Balance grid migrated 1612800 cells CPU time = 0.155591 secs reassign/sort/migrate/ghost percent = 28.0834 1.05532 32.8431 38.0182 species ar.species Ar mixture air Ar vstream 0.0 0.0 0.0 temp 273.15 global nrho 7.07043E22 global fnum 7.07043E6 collide vss air ar.vss create_particles air n $n create_particles air n 16384000 Created 16384000 particles CPU time = 0.172313 secs stats 100 compute temp temp stats_style step cpu np nattempt ncoll c_temp # first equilibrate with large timestep to unsort particles # then benchmark with normal timestep timestep 7.00E-8 run 30 Memory usage per proc in Mbytes: particles (ave,min,max) = 32.8179 32.8179 32.8179 grid (ave,min,max) = 6.5295 5.82638 6.76388 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 39.3474 38.6443 39.5818 Step CPU Np Natt Ncoll c_temp 0 0 16384000 0 0 273.24335 30 8.3276181 16384000 16439270 11569139 273.24335 Loop time of 8.32765 on 64 procs for 30 steps with 16384000 particles Particle moves = 491520000 (492M) Cells touched = 2442089356 (2.44B) Particle comms = 50857510 (50.9M) Boundary collides = 17388585 (17.4M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 475985362 (476M) Collide occurs = 345559782 (346M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 922229 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 4.96844 Particle comm iterations/step: 3 Particle fraction communicated: 0.10347 Particle fraction colliding with boundary: 0.0353772 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.968395 Collisions/particle/step: 0.703043 Reactions/particle/step: 0 Move time (%) = 4.60947 (55.3514) Coll time (%) = 2.22593 (26.7294) Sort time (%) = 0.749537 (9.00059) Comm time (%) = 0.729145 (8.75571) Modfy time (%) = 0 (0) Outpt time (%) = 0.0134826 (0.161901) Other time (%) = 8.42847e-05 (0.00101211) Particles: 256000 ave 257325 max 254477 min Histogram: 1 1 4 10 8 18 8 9 4 1 Cells: 25600 ave 25600 max 25600 min Histogram: 64 0 0 0 0 0 0 0 0 0 GhostCell: 8590.62 ave 12416 max 4388 min Histogram: 6 4 6 0 4 20 0 22 0 2 EmptyCell: 3193.36 ave 5620 max 882 min Histogram: 6 7 1 11 7 5 10 8 6 3 timestep 7.00E-9 run $t run 100 Memory usage per proc in Mbytes: particles (ave,min,max) = 32.8179 32.8179 32.8179 grid (ave,min,max) = 6.5295 5.82638 6.76388 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 39.3474 38.6443 39.5818 Step CPU Np Natt Ncoll c_temp 30 0 16384000 16439270 11569139 273.24335 100 7.1153228 16384000 1572353 1157042 273.24335 130 10.183519 16384000 1593522 1157442 273.24335 Loop time of 10.1835 on 64 procs for 100 steps with 16384000 particles Particle moves = 1638400000 (1.64B) Cells touched = 2287432840 (2.29B) Particle comms = 17336598 (17.3M) Boundary collides = 5797039 (5.8M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 153516498 (154M) Collide occurs = 114994079 (115M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 2.51386e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 1.39614 Particle comm iterations/step: 1 Particle fraction communicated: 0.0105814 Particle fraction colliding with boundary: 0.00353823 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.093699 Collisions/particle/step: 0.0701868 Reactions/particle/step: 0 Move time (%) = 6.19913 (60.874) Coll time (%) = 1.33729 (13.1318) Sort time (%) = 2.44674 (24.0264) Comm time (%) = 0.173901 (1.70767) Modfy time (%) = 0 (0) Outpt time (%) = 0.0261443 (0.256731) Other time (%) = 0.000343759 (0.00337563) Particles: 256000 ave 257078 max 254825 min Histogram: 2 1 8 8 8 9 13 11 3 1 Cells: 25600 ave 25600 max 25600 min Histogram: 64 0 0 0 0 0 0 0 0 0 GhostCell: 8590.62 ave 12416 max 4388 min Histogram: 6 4 6 0 4 20 0 22 0 2 EmptyCell: 3193.36 ave 5620 max 882 min Histogram: 6 7 1 11 7 5 10 8 6 3