SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 4 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # advect particles via VSS collisional flow on a uniform grid # particles reflect off global box boundaries variable x index 10 variable y index 10 variable z index 10 variable lx equal $x*1.0e-5 variable lx equal 256*1.0e-5 variable ly equal $y*1.0e-5 variable ly equal 160*1.0e-5 variable lz equal $z*1.0e-5 variable lz equal 160*1.0e-5 variable n equal 10*$x*$y*$z variable n equal 10*256*$y*$z variable n equal 10*256*160*$z variable n equal 10*256*160*160 seed 12345 dimension 3 global gridcut 1.0e-5 boundary rr rr rr create_box 0 ${lx} 0 ${ly} 0 ${lz} create_box 0 0.00256 0 ${ly} 0 ${lz} create_box 0 0.00256 0 0.0016 0 ${lz} create_box 0 0.00256 0 0.0016 0 0.0016 Created orthogonal box = (0 0 0) to (0.00256 0.0016 0.0016) create_grid $x $y $z create_grid 256 $y $z create_grid 256 160 $z create_grid 256 160 160 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 6553600 child grid cells parent cells = 1 CPU time = 0.055649 secs create/ghost percent = 30.2161 69.7839 balance_grid rcb part Balance grid migrated 6550400 cells CPU time = 0.438052 secs reassign/sort/migrate/ghost percent = 75.5275 0.0557333 10.48 13.9367 species ar.species Ar mixture air Ar vstream 0.0 0.0 0.0 temp 273.15 global nrho 7.07043E22 global fnum 7.07043E6 collide vss air ar.vss create_particles air n $n create_particles air n 65536000 Created 65536000 particles CPU time = 0.0736749 secs stats 100 compute temp temp stats_style step cpu np nattempt ncoll c_temp # first equilibrate with large timestep to unsort particles # then benchmark with normal timestep timestep 7.00E-8 run 30 Memory usage per proc in Mbytes: particles (ave,min,max) = 3.54371 3.54371 3.54371 grid (ave,min,max) = 1.51388 1.51388 1.51388 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 5.05759 5.05759 5.05759 Step CPU Np Natt Ncoll c_temp 0 0 65536000 0 0 273.1798 30 0.9905889 65536000 65748993 46280494 273.1798 Loop time of 0.990984 on 2048 procs for 30 steps with 65536000 particles Particle moves = 1966080000 (1.97B) Cells touched = 9819004519 (9.82B) Particle comms = 481189232 (481M) Boundary collides = 42965618 (43M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 1903730111 (1.9B) Collide occurs = 1382179271 (1.38B) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 968734 Particle-moves/step: 6.5536e+07 Cell-touches/particle/step: 4.9942 Particle comm iterations/step: 3.83333 Particle fraction communicated: 0.244745 Particle fraction colliding with boundary: 0.0218534 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.968287 Collisions/particle/step: 0.703013 Reactions/particle/step: 0 Move time (%) = 0.455973 (46.0121) Coll time (%) = 0.237052 (23.9209) Sort time (%) = 0.0429748 (4.33658) Comm time (%) = 0.253405 (25.5711) Modfy time (%) = 0 (0) Outpt time (%) = 0.0013016 (0.131345) Other time (%) = 0.000277739 (0.0280266) Particles: 32000 ave 32555 max 31359 min Histogram: 5 19 88 259 447 557 408 191 63 11 Cells: 3200 ave 3200 max 3200 min Histogram: 2048 0 0 0 0 0 0 0 0 0 GhostCell: 2958.76 ave 3520 max 1336 min Histogram: 14 10 62 92 140 246 252 490 56 686 EmptyCell: 1210.31 ave 1968 max 252 min Histogram: 36 96 152 278 292 278 376 226 158 156 timestep 7.00E-9 run $t run 100 Memory usage per proc in Mbytes: particles (ave,min,max) = 3.54371 3.54371 3.54371 grid (ave,min,max) = 1.51388 1.51388 1.51388 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 5.05759 5.05759 5.05759 Step CPU Np Natt Ncoll c_temp 30 0 65536000 65748993 46280494 273.1798 100 0.4945159 65536000 6290245 4629358 273.1798 130 0.7118938 65536000 6372729 4630350 273.1798 Loop time of 0.712168 on 2048 procs for 100 steps with 65536000 particles Particle moves = 6553600000 (6.55B) Cells touched = 9158313390 (9.16B) Particle comms = 169795389 (170M) Boundary collides = 14325101 (14.3M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 614003302 (614M) Collide occurs = 459927016 (460M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 4.49332e+06 Particle-moves/step: 6.5536e+07 Cell-touches/particle/step: 1.39745 Particle comm iterations/step: 1 Particle fraction communicated: 0.0259087 Particle fraction colliding with boundary: 0.00218584 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0936895 Collisions/particle/step: 0.0701793 Reactions/particle/step: 0 Move time (%) = 0.36448 (51.1789) Coll time (%) = 0.116561 (16.3671) Sort time (%) = 0.110352 (15.4952) Comm time (%) = 0.116951 (16.4218) Modfy time (%) = 0 (0) Outpt time (%) = 0.00298615 (0.419304) Other time (%) = 0.000837999 (0.117669) Particles: 32000 ave 32554 max 31467 min Histogram: 13 51 179 351 511 447 273 158 56 9 Cells: 3200 ave 3200 max 3200 min Histogram: 2048 0 0 0 0 0 0 0 0 0 GhostCell: 2958.76 ave 3520 max 1336 min Histogram: 14 10 62 92 140 246 252 490 56 686 EmptyCell: 1210.31 ave 1968 max 252 min Histogram: 36 96 152 278 292 278 376 226 158 156