SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 4 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # advect particles via VSS collisional flow on a uniform grid # particles reflect off global box boundaries variable x index 10 variable y index 10 variable z index 10 variable lx equal $x*1.0e-5 variable lx equal 128*1.0e-5 variable ly equal $y*1.0e-5 variable ly equal 80*1.0e-5 variable lz equal $z*1.0e-5 variable lz equal 160*1.0e-5 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*160 seed 12345 dimension 3 global gridcut 1.0e-5 boundary rr rr rr create_box 0 ${lx} 0 ${ly} 0 ${lz} create_box 0 0.00128 0 ${ly} 0 ${lz} create_box 0 0.00128 0 0.0008 0 ${lz} create_box 0 0.00128 0 0.0008 0 0.0016 Created orthogonal box = (0 0 0) to (0.00128 0.0008 0.0016) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 160 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 1638400 child grid cells parent cells = 1 CPU time = 0.00443728 secs create/ghost percent = 54.5022 45.4978 balance_grid rcb part Balance grid migrated 1632757 cells CPU time = 0.113328 secs reassign/sort/migrate/ghost percent = 56.6662 0.065529 28.4929 14.7754 species ar.species Ar mixture air Ar vstream 0.0 0.0 0.0 temp 273.15 global nrho 7.07043E22 global fnum 7.07043E6 collide vss air ar.vss create_particles air n $n create_particles air n 16384000 Created 16384000 particles CPU time = 0.020598 secs stats 100 compute temp temp stats_style step cpu np nattempt ncoll c_temp # first equilibrate with large timestep to unsort particles # then benchmark with normal timestep timestep 7.00E-8 run 30 Memory usage per proc in Mbytes: particles (ave,min,max) = 7.44173 7.44173 7.44173 grid (ave,min,max) = 2.44487 1.51388 2.45138 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 9.88659 8.9556 9.8931 Step CPU Np Natt Ncoll c_temp 0 0 16384000 0 0 273.18065 30 0.50600621 16384000 16438611 11573733 273.18065 Loop time of 0.506104 on 288 procs for 30 steps with 16384000 particles Particle moves = 491520000 (492M) Cells touched = 2443205015 (2.44B) Particle comms = 91596814 (91.6M) Boundary collides = 17393688 (17.4M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 475940130 (476M) Collide occurs = 345544726 (346M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 3.37216e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 4.97071 Particle comm iterations/step: 3.26667 Particle fraction communicated: 0.186354 Particle fraction colliding with boundary: 0.0353875 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.968303 Collisions/particle/step: 0.703013 Reactions/particle/step: 0 Move time (%) = 0.241309 (47.6797) Coll time (%) = 0.111394 (22.0101) Sort time (%) = 0.0419072 (8.28035) Comm time (%) = 0.10874 (21.4857) Modfy time (%) = 0 (0) Outpt time (%) = 0.00264117 (0.521862) Other time (%) = 0.000112722 (0.0222726) Particles: 56888.9 ave 57576 max 56254 min Histogram: 6 11 20 52 64 75 32 19 6 3 Cells: 5688.89 ave 5690 max 5688 min Histogram: 59 0 0 0 0 202 0 0 0 27 GhostCell: 4279.58 ave 6246 max 2086 min Histogram: 2 9 29 38 51 63 53 13 19 11 EmptyCell: 1542.74 ave 2720 max 360 min Histogram: 4 17 29 49 54 33 63 15 5 19 timestep 7.00E-9 run $t run 100 Memory usage per proc in Mbytes: particles (ave,min,max) = 7.44173 7.44173 7.44173 grid (ave,min,max) = 2.44487 1.51388 2.45138 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 9.88659 8.9556 9.8931 Step CPU Np Natt Ncoll c_temp 30 0 16384000 16438611 11573733 273.18065 100 0.38061006 16384000 1572201 1156012 273.18065 130 0.54476802 16384000 1592759 1157076 273.18065 Loop time of 0.544859 on 288 procs for 100 steps with 16384000 particles Particle moves = 1638400000 (1.64B) Cells touched = 2287362351 (2.29B) Particle comms = 35816783 (35.8M) Boundary collides = 5796473 (5.8M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 153495582 (153M) Collide occurs = 114982476 (115M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.0441e+07 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 1.3961 Particle comm iterations/step: 1 Particle fraction communicated: 0.0218608 Particle fraction colliding with boundary: 0.00353789 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0936863 Collisions/particle/step: 0.0701797 Reactions/particle/step: 0 Move time (%) = 0.277427 (50.9171) Coll time (%) = 0.0621823 (11.4125) Sort time (%) = 0.138329 (25.388) Comm time (%) = 0.0632081 (11.6008) Modfy time (%) = 0 (0) Outpt time (%) = 0.00349069 (0.640659) Other time (%) = 0.000222732 (0.0408789) Particles: 56888.9 ave 57716 max 56047 min Histogram: 2 4 7 59 74 68 45 22 6 1 Cells: 5688.89 ave 5690 max 5688 min Histogram: 59 0 0 0 0 202 0 0 0 27 GhostCell: 4279.58 ave 6246 max 2086 min Histogram: 2 9 29 38 51 63 53 13 19 11 EmptyCell: 1542.74 ave 2720 max 360 min Histogram: 4 17 29 49 54 33 63 15 5 19