SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 8 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # advect particles via VSS collisional flow on a uniform grid # particles reflect off global box boundaries variable x index 10 variable y index 10 variable z index 10 variable lx equal $x*1.0e-5 variable lx equal 128*1.0e-5 variable ly equal $y*1.0e-5 variable ly equal 80*1.0e-5 variable lz equal $z*1.0e-5 variable lz equal 160*1.0e-5 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*160 seed 12345 dimension 3 global gridcut 1.0e-5 boundary rr rr rr create_box 0 ${lx} 0 ${ly} 0 ${lz} create_box 0 0.00128 0 ${ly} 0 ${lz} create_box 0 0.00128 0 0.0008 0 ${lz} create_box 0 0.00128 0 0.0008 0 0.0016 Created orthogonal box = (0 0 0) to (0.00128 0.0008 0.0016) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 160 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 1638400 child grid cells parent cells = 1 CPU time = 0.0261741 secs create/ghost percent = 36.9751 63.0249 balance_grid rcb part Balance grid migrated 1635200 cells CPU time = 0.178747 secs reassign/sort/migrate/ghost percent = 61.5983 0.0474845 18.3063 20.0479 species ar.species Ar mixture air Ar vstream 0.0 0.0 0.0 temp 273.15 global nrho 7.07043E22 global fnum 7.07043E6 collide vss air ar.vss create_particles air n $n create_particles air n 16384000 Created 16384000 particles CPU time = 0.05305 secs stats 100 compute temp temp stats_style step cpu np nattempt ncoll c_temp # first equilibrate with large timestep to unsort particles # then benchmark with normal timestep timestep 7.00E-8 run 30 Memory usage per proc in Mbytes: particles (ave,min,max) = 3.54371 3.54371 3.54371 grid (ave,min,max) = 1.51388 1.51388 1.51388 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 5.05759 5.05759 5.05759 Step CPU Np Natt Ncoll c_temp 0 0 16384000 0 0 273.06966 30 0.56778097 16384000 16436311 11569886 273.06966 Loop time of 0.56799 on 512 procs for 30 steps with 16384000 particles Particle moves = 491520000 (492M) Cells touched = 2444941358 (2.44B) Particle comms = 114624141 (115M) Boundary collides = 17389888 (17.4M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 475899274 (476M) Collide occurs = 345537409 (346M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.69017e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 4.97425 Particle comm iterations/step: 3.4 Particle fraction communicated: 0.233203 Particle fraction colliding with boundary: 0.0353798 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.96822 Collisions/particle/step: 0.702998 Reactions/particle/step: 0 Move time (%) = 0.240809 (42.3967) Coll time (%) = 0.122861 (21.6309) Sort time (%) = 0.0241433 (4.25065) Comm time (%) = 0.178616 (31.447) Modfy time (%) = 0 (0) Outpt time (%) = 0.00125018 (0.220107) Other time (%) = 0.000310074 (0.0545914) Particles: 32000 ave 32527 max 31538 min Histogram: 10 23 49 92 127 92 72 37 6 4 Cells: 3200 ave 3200 max 3200 min Histogram: 512 0 0 0 0 0 0 0 0 0 GhostCell: 2807.52 ave 3520 max 1336 min Histogram: 10 6 18 44 54 40 100 108 12 120 EmptyCell: 1251.66 ave 1968 max 264 min Histogram: 6 19 32 57 68 85 94 79 37 35 timestep 7.00E-9 run $t run 100 Memory usage per proc in Mbytes: particles (ave,min,max) = 3.54371 3.54371 3.54371 grid (ave,min,max) = 1.51388 1.51388 1.51388 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 5.05759 5.05759 5.05759 Step CPU Np Natt Ncoll c_temp 30 0 16384000 16436311 11569886 273.06966 100 0.28046298 16384000 1571608 1155464 273.06966 130 0.40103197 16384000 1593070 1156878 273.06966 Loop time of 0.40127 on 512 procs for 100 steps with 16384000 particles Particle moves = 1638400000 (1.64B) Cells touched = 2287220202 (2.29B) Particle comms = 40262586 (40.3M) Boundary collides = 5797173 (5.8M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 153492284 (153M) Collide occurs = 114976331 (115M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 7.97468e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 1.39601 Particle comm iterations/step: 1 Particle fraction communicated: 0.0245743 Particle fraction colliding with boundary: 0.00353831 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0936843 Collisions/particle/step: 0.070176 Reactions/particle/step: 0 Move time (%) = 0.178033 (44.3673) Coll time (%) = 0.0654791 (16.318) Sort time (%) = 0.0592533 (14.7664) Comm time (%) = 0.0959286 (23.9062) Modfy time (%) = 0 (0) Outpt time (%) = 0.00164124 (0.409011) Other time (%) = 0.000935048 (0.233022) Particles: 32000 ave 32498 max 31482 min Histogram: 2 13 38 87 109 113 89 40 12 9 Cells: 3200 ave 3200 max 3200 min Histogram: 512 0 0 0 0 0 0 0 0 0 GhostCell: 2807.52 ave 3520 max 1336 min Histogram: 10 6 18 44 54 40 100 108 12 120 EmptyCell: 1251.66 ave 1968 max 264 min Histogram: 6 19 32 57 68 85 94 79 37 35