SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 4 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # advect particles via VSS collisional flow on a uniform grid # particles reflect off global box boundaries variable x index 10 variable y index 10 variable z index 10 variable lx equal $x*1.0e-5 variable lx equal 128*1.0e-5 variable ly equal $y*1.0e-5 variable ly equal 160*1.0e-5 variable lz equal $z*1.0e-5 variable lz equal 160*1.0e-5 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*160*$z variable n equal 10*128*160*160 seed 12345 dimension 3 global gridcut 1.0e-5 boundary rr rr rr create_box 0 ${lx} 0 ${ly} 0 ${lz} create_box 0 0.00128 0 ${ly} 0 ${lz} create_box 0 0.00128 0 0.0016 0 ${lz} create_box 0 0.00128 0 0.0016 0 0.0016 Created orthogonal box = (0 0 0) to (0.00128 0.0016 0.0016) create_grid $x $y $z create_grid 128 $y $z create_grid 128 160 $z create_grid 128 160 160 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 3276800 child grid cells parent cells = 1 CPU time = 0.00490953 secs create/ghost percent = 51.4103 48.5897 balance_grid rcb part Balance grid migrated 3271163 cells CPU time = 0.138287 secs reassign/sort/migrate/ghost percent = 53.249 0.0550171 32.5883 14.1077 species ar.species Ar mixture air Ar vstream 0.0 0.0 0.0 temp 273.15 global nrho 7.07043E22 global fnum 7.07043E6 collide vss air ar.vss create_particles air n $n create_particles air n 32768000 Created 32768000 particles CPU time = 0.0212634 secs stats 100 compute temp temp stats_style step cpu np nattempt ncoll c_temp # first equilibrate with large timestep to unsort particles # then benchmark with normal timestep timestep 7.00E-8 run 30 Memory usage per proc in Mbytes: particles (ave,min,max) = 7.44173 7.44173 7.44173 grid (ave,min,max) = 2.44487 1.51388 2.45138 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 9.88659 8.9556 9.8931 Step CPU Np Natt Ncoll c_temp 0 0 32768000 0 0 273.15328 30 0.57658683 32768000 32873416 23141816 273.15328 Loop time of 0.576919 on 576 procs for 30 steps with 32768000 particles Particle moves = 983040000 (983M) Cells touched = 4894013880 (4.89B) Particle comms = 190598064 (191M) Boundary collides = 26598590 (26.6M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 951826675 (952M) Collide occurs = 691057107 (691M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 2.95824e+06 Particle-moves/step: 3.2768e+07 Cell-touches/particle/step: 4.97845 Particle comm iterations/step: 3.66667 Particle fraction communicated: 0.193886 Particle fraction colliding with boundary: 0.0270575 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.968248 Collisions/particle/step: 0.70298 Reactions/particle/step: 0 Move time (%) = 0.276159 (47.8679) Coll time (%) = 0.111451 (19.3183) Sort time (%) = 0.0420586 (7.29021) Comm time (%) = 0.143573 (24.8861) Modfy time (%) = 0 (0) Outpt time (%) = 0.00345406 (0.598708) Other time (%) = 0.000223669 (0.0387695) Particles: 56888.9 ave 57630 max 56194 min Histogram: 8 19 49 89 139 136 83 42 8 3 Cells: 5688.89 ave 5690 max 5688 min Histogram: 109 0 0 0 0 422 0 0 0 45 GhostCell: 4480.46 ave 6246 max 2086 min Histogram: 4 11 33 70 101 113 96 50 71 27 EmptyCell: 1702.21 ave 2934 max 360 min Histogram: 7 31 38 117 43 133 84 61 55 7 timestep 7.00E-9 run $t run 100 Memory usage per proc in Mbytes: particles (ave,min,max) = 7.44173 7.44173 7.44173 grid (ave,min,max) = 2.44487 1.51388 2.45138 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 9.88659 8.9556 9.8931 Step CPU Np Natt Ncoll c_temp 30 0 32768000 32873416 23141816 273.15328 100 0.40791694 32768000 3146369 2314521 273.15328 130 0.56955449 32768000 3185719 2314152 273.15328 Loop time of 0.569663 on 576 procs for 100 steps with 32768000 particles Particle moves = 3276800000 (3.28B) Cells touched = 4577357305 (4.58B) Particle comms = 74430058 (74.4M) Boundary collides = 8865431 (8.87M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 307006467 (307M) Collide occurs = 229946503 (230M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 9.98641e+06 Particle-moves/step: 3.2768e+07 Cell-touches/particle/step: 1.3969 Particle comm iterations/step: 1 Particle fraction communicated: 0.0227143 Particle fraction colliding with boundary: 0.00270551 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0936909 Collisions/particle/step: 0.0701741 Reactions/particle/step: 0 Move time (%) = 0.293181 (51.4658) Coll time (%) = 0.062682 (11.0034) Sort time (%) = 0.13931 (24.4548) Comm time (%) = 0.0703198 (12.3441) Modfy time (%) = 0 (0) Outpt time (%) = 0.00394247 (0.692071) Other time (%) = 0.000227125 (0.0398701) Particles: 56888.9 ave 57589 max 56205 min Histogram: 8 14 52 94 116 144 83 45 12 8 Cells: 5688.89 ave 5690 max 5688 min Histogram: 109 0 0 0 0 422 0 0 0 45 GhostCell: 4480.46 ave 6246 max 2086 min Histogram: 4 11 33 70 101 113 96 50 71 27 EmptyCell: 1702.21 ave 2934 max 360 min Histogram: 7 31 38 117 43 133 84 61 55 7