SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 2 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # advect particles via VSS collisional flow on a uniform grid # particles reflect off global box boundaries variable x index 10 variable y index 10 variable z index 10 variable lx equal $x*1.0e-5 variable lx equal 128*1.0e-5 variable ly equal $y*1.0e-5 variable ly equal 80*1.0e-5 variable lz equal $z*1.0e-5 variable lz equal 80*1.0e-5 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*80 seed 12345 dimension 3 global gridcut 1.0e-5 boundary rr rr rr create_box 0 ${lx} 0 ${ly} 0 ${lz} create_box 0 0.00128 0 ${ly} 0 ${lz} create_box 0 0.00128 0 0.0008 0 ${lz} create_box 0 0.00128 0 0.0008 0 0.0008 Created orthogonal box = (0 0 0) to (0.00128 0.0008 0.0008) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 80 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 819200 child grid cells parent cells = 1 CPU time = 0.0143545 secs create/ghost percent = 62.0318 37.9682 balance_grid rcb part Balance grid migrated 793600 cells CPU time = 0.0932462 secs reassign/sort/migrate/ghost percent = 30.5296 0.319535 38.5583 30.5926 species ar.species Ar mixture air Ar vstream 0.0 0.0 0.0 temp 273.15 global nrho 7.07043E22 global fnum 7.07043E6 collide vss air ar.vss create_particles air n $n create_particles air n 8192000 Created 8192000 particles CPU time = 0.0632686 secs stats 100 compute temp temp stats_style step cpu np nattempt ncoll c_temp # first equilibrate with large timestep to unsort particles # then benchmark with normal timestep timestep 7.00E-8 run 30 Memory usage per proc in Mbytes: particles (ave,min,max) = 32.8179 32.8179 32.8179 grid (ave,min,max) = 6.35372 5.82638 6.76388 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 39.1716 38.6443 39.5818 Step CPU Np Natt Ncoll c_temp 0 0 8192000 0 0 273.23582 30 2.1790361 8192000 8216837 5784847 273.23582 Loop time of 2.19133 on 32 procs for 30 steps with 8192000 particles Particle moves = 245760000 (246M) Cells touched = 1219278077 (1.22B) Particle comms = 23481631 (23.5M) Boundary collides = 10743046 (10.7M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 237964638 (238M) Collide occurs = 172770592 (173M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 3.50472e+06 Particle-moves/step: 8.192e+06 Cell-touches/particle/step: 4.96126 Particle comm iterations/step: 3 Particle fraction communicated: 0.095547 Particle fraction colliding with boundary: 0.0437136 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.968281 Collisions/particle/step: 0.703005 Reactions/particle/step: 0 Move time (%) = 0.963493 (43.9684) Coll time (%) = 0.737306 (33.6465) Sort time (%) = 0.238504 (10.884) Comm time (%) = 0.248946 (11.3605) Modfy time (%) = 0 (0) Outpt time (%) = 0.00290385 (0.132515) Other time (%) = 0.000176138 (0.00803795) Particles: 256000 ave 257385 max 255199 min Histogram: 2 4 5 7 9 3 0 0 1 1 Cells: 25600 ave 25600 max 25600 min Histogram: 32 0 0 0 0 0 0 0 0 0 GhostCell: 7658.75 ave 10688 max 4388 min Histogram: 6 0 8 0 0 2 8 0 0 8 EmptyCell: 2786.72 ave 5620 max 882 min Histogram: 6 5 0 7 0 2 6 2 3 1 timestep 7.00E-9 run $t run 100 Memory usage per proc in Mbytes: particles (ave,min,max) = 32.8179 32.8179 32.8179 grid (ave,min,max) = 6.35372 5.82638 6.76388 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 39.1716 38.6443 39.5818 Step CPU Np Natt Ncoll c_temp 30 0 8192000 8216837 5784847 273.23582 100 1.589715 8192000 786381 579066 273.23582 130 2.2711922 8192000 796549 578332 273.23582 Loop time of 2.28391 on 32 procs for 100 steps with 8192000 particles Particle moves = 819200000 (819M) Cells touched = 1143026104 (1.14B) Particle comms = 7992421 (7.99M) Boundary collides = 3582053 (3.58M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 76754057 (76.8M) Collide occurs = 57495923 (57.5M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.12089e+07 Particle-moves/step: 8.192e+06 Cell-touches/particle/step: 1.3953 Particle comm iterations/step: 1 Particle fraction communicated: 0.00975637 Particle fraction colliding with boundary: 0.00437262 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0936939 Collisions/particle/step: 0.0701855 Reactions/particle/step: 0 Move time (%) = 1.01394 (44.3952) Coll time (%) = 0.397398 (17.3999) Sort time (%) = 0.773845 (33.8825) Comm time (%) = 0.0926479 (4.05656) Modfy time (%) = 0 (0) Outpt time (%) = 0.00568117 (0.248748) Other time (%) = 0.000389323 (0.0170464) Particles: 256000 ave 256935 max 255050 min Histogram: 2 0 1 8 6 5 6 1 1 2 Cells: 25600 ave 25600 max 25600 min Histogram: 32 0 0 0 0 0 0 0 0 0 GhostCell: 7658.75 ave 10688 max 4388 min Histogram: 6 0 8 0 0 2 8 0 0 8 EmptyCell: 2786.72 ave 5620 max 882 min Histogram: 6 5 0 7 0 2 6 2 3 1