SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 1 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # advect particles via VSS collisional flow on a uniform grid # particles reflect off global box boundaries variable x index 10 variable y index 10 variable z index 10 variable lx equal $x*1.0e-5 variable lx equal 128*1.0e-5 variable ly equal $y*1.0e-5 variable ly equal 80*1.0e-5 variable lz equal $z*1.0e-5 variable lz equal 160*1.0e-5 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*160 seed 12345 dimension 3 global gridcut 1.0e-5 boundary rr rr rr create_box 0 ${lx} 0 ${ly} 0 ${lz} create_box 0 0.00128 0 ${ly} 0 ${lz} create_box 0 0.00128 0 0.0008 0 ${lz} create_box 0 0.00128 0 0.0008 0 0.0016 Created orthogonal box = (0 0 0) to (0.00128 0.0008 0.0016) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 160 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 1638400 child grid cells parent cells = 1 CPU time = 0.0754758 secs create/ghost percent = 18.6228 81.3772 balance_grid rcb part Balance grid migrated 1636998 cells CPU time = 0.997274 secs reassign/sort/migrate/ghost percent = 66.4909 0.0451899 14.5937 18.8702 species ar.species Ar mixture air Ar vstream 0.0 0.0 0.0 temp 273.15 global nrho 7.07043E22 global fnum 7.07043E6 collide vss air ar.vss create_particles air n $n create_particles air n 16384000 Created 16384000 particles CPU time = 0.0178296 secs stats 100 compute temp temp stats_style step cpu np nattempt ncoll c_temp # first equilibrate with large timestep to unsort particles # then benchmark with normal timestep timestep 7.00E-8 run 30 Memory usage per proc in Mbytes: particles (ave,min,max) = 1.6875 1.6875 1.6875 grid (ave,min,max) = 1.51388 1.51388 1.51388 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 3.20138 3.20138 3.20138 Step CPU Np Natt Ncoll c_temp 0 0 16384000 0 0 273.15825 30 0.41010608 16384000 16437264 11565317 273.15825 Loop time of 0.41027 on 1152 procs for 30 steps with 16384000 particles Particle moves = 491520000 (492M) Cells touched = 2447693219 (2.45B) Particle comms = 151183328 (151M) Boundary collides = 17384313 (17.4M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 475920310 (476M) Collide occurs = 345542542 (346M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.03997e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 4.97984 Particle comm iterations/step: 3.96667 Particle fraction communicated: 0.307583 Particle fraction colliding with boundary: 0.0353685 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.968262 Collisions/particle/step: 0.703008 Reactions/particle/step: 0 Move time (%) = 0.153013 (37.2958) Coll time (%) = 0.102885 (25.0774) Sort time (%) = 0.0340258 (8.2935) Comm time (%) = 0.119349 (29.0905) Modfy time (%) = 0 (0) Outpt time (%) = 0.000838981 (0.204495) Other time (%) = 0.000157238 (0.0383254) Particles: 14222.2 ave 14644 max 13806 min Histogram: 2 15 93 182 276 309 192 63 18 2 Cells: 1422.22 ave 1423 max 1422 min Histogram: 896 0 0 0 0 0 0 0 0 256 GhostCell: 1992.88 ave 2861 max 888 min Histogram: 12 27 95 98 215 216 66 312 81 30 EmptyCell: 817.5 ave 1364 max 120 min Histogram: 15 36 82 123 157 244 180 171 68 76 timestep 7.00E-9 run $t run 100 Memory usage per proc in Mbytes: particles (ave,min,max) = 1.6875 1.6875 1.6875 grid (ave,min,max) = 1.51388 1.51388 1.51388 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 3.20138 3.20138 3.20138 Step CPU Np Natt Ncoll c_temp 30 0 16384000 16437264 11565317 273.15825 100 0.28036481 16384000 1571714 1157141 273.15825 130 0.40150804 16384000 1592622 1157150 273.15825 Loop time of 0.401689 on 1152 procs for 100 steps with 16384000 particles Particle moves = 1638400000 (1.64B) Cells touched = 2287334124 (2.29B) Particle comms = 61759284 (61.8M) Boundary collides = 5794441 (5.79M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 153499394 (153M) Collide occurs = 114977205 (115M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 3.54061e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 1.39608 Particle comm iterations/step: 1 Particle fraction communicated: 0.0376949 Particle fraction colliding with boundary: 0.00353665 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0936886 Collisions/particle/step: 0.0701765 Reactions/particle/step: 0 Move time (%) = 0.18464 (45.9659) Coll time (%) = 0.0546909 (13.6152) Sort time (%) = 0.115153 (28.6672) Comm time (%) = 0.0448856 (11.1742) Modfy time (%) = 0 (0) Outpt time (%) = 0.00200024 (0.497959) Other time (%) = 0.000319258 (0.079479) Particles: 14222.2 ave 14779 max 13824 min Histogram: 5 41 159 310 355 207 58 14 2 1 Cells: 1422.22 ave 1423 max 1422 min Histogram: 896 0 0 0 0 0 0 0 0 256 GhostCell: 1992.88 ave 2861 max 888 min Histogram: 12 27 95 98 215 216 66 312 81 30 EmptyCell: 817.5 ave 1364 max 120 min Histogram: 15 36 82 123 157 244 180 171 68 76