SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 2 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # advect particles via VSS collisional flow on a uniform grid # particles reflect off global box boundaries variable x index 10 variable y index 10 variable z index 10 variable lx equal $x*1.0e-5 variable lx equal 128*1.0e-5 variable ly equal $y*1.0e-5 variable ly equal 80*1.0e-5 variable lz equal $z*1.0e-5 variable lz equal 160*1.0e-5 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*160 seed 12345 dimension 3 global gridcut 1.0e-5 boundary rr rr rr create_box 0 ${lx} 0 ${ly} 0 ${lz} create_box 0 0.00128 0 ${ly} 0 ${lz} create_box 0 0.00128 0 0.0008 0 ${lz} create_box 0 0.00128 0 0.0008 0 0.0016 Created orthogonal box = (0 0 0) to (0.00128 0.0008 0.0016) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 160 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 1638400 child grid cells parent cells = 1 CPU time = 0.0258081 secs create/ghost percent = 55.4048 44.5952 balance_grid rcb part Balance grid migrated 1625600 cells CPU time = 0.197668 secs reassign/sort/migrate/ghost percent = 37.3915 0.100862 40.3281 22.1796 species ar.species Ar mixture air Ar vstream 0.0 0.0 0.0 temp 273.15 global nrho 7.07043E22 global fnum 7.07043E6 collide vss air ar.vss create_particles air n $n create_particles air n 16384000 Created 16384000 particles CPU time = 0.0652834 secs stats 100 compute temp temp stats_style step cpu np nattempt ncoll c_temp # first equilibrate with large timestep to unsort particles # then benchmark with normal timestep timestep 7.00E-8 run 30 Memory usage per proc in Mbytes: particles (ave,min,max) = 15.6276 15.6276 15.6276 grid (ave,min,max) = 3.83028 2.95138 3.88888 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 19.4579 18.579 19.5165 Step CPU Np Natt Ncoll c_temp 0 0 16384000 0 0 273.09432 30 1.661281 16384000 16435132 11568098 273.09432 Loop time of 1.29257 on 128 procs for 30 steps with 16384000 particles Particle moves = 491520000 (492M) Cells touched = 2443565533 (2.44B) Particle comms = 66118573 (66.1M) Boundary collides = 17381430 (17.4M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 475910010 (476M) Collide occurs = 345537174 (346M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 2.97082e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 4.97145 Particle comm iterations/step: 3.03333 Particle fraction communicated: 0.134519 Particle fraction colliding with boundary: 0.0353626 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.968241 Collisions/particle/step: 0.702997 Reactions/particle/step: 0 Move time (%) = 0.537537 (41.5866) Coll time (%) = 0.407312 (31.5118) Sort time (%) = 0.120967 (9.3586) Comm time (%) = 0.223411 (17.2842) Modfy time (%) = 0 (0) Outpt time (%) = 0.00317526 (0.245654) Other time (%) = 0.000170707 (0.0132067) Particles: 128000 ave 128864 max 127031 min Histogram: 1 4 11 17 22 24 24 16 6 3 Cells: 12800 ave 12800 max 12800 min Histogram: 128 0 0 0 0 0 0 0 0 0 GhostCell: 5712.81 ave 7936 max 2194 min Histogram: 2 6 8 16 4 30 18 20 4 20 EmptyCell: 2179.92 ave 4280 max 441 min Histogram: 6 15 11 19 25 13 23 3 11 2 timestep 7.00E-9 run $t run 100 Memory usage per proc in Mbytes: particles (ave,min,max) = 15.6276 15.6276 15.6276 grid (ave,min,max) = 3.83028 2.95138 3.88888 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 19.4579 18.579 19.5165 Step CPU Np Natt Ncoll c_temp 30 0 16384000 16435132 11568098 273.09432 100 1.0817168 16384000 1573688 1158263 273.09432 130 1.5505178 16384000 1593330 1157254 273.09432 Loop time of 1.20634 on 128 procs for 100 steps with 16384000 particles Particle moves = 1638400000 (1.64B) Cells touched = 2287259536 (2.29B) Particle comms = 22737071 (22.7M) Boundary collides = 5800524 (5.8M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 153503360 (154M) Collide occurs = 114986470 (115M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.06106e+07 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 1.39603 Particle comm iterations/step: 1 Particle fraction communicated: 0.0138776 Particle fraction colliding with boundary: 0.00354036 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.093691 Collisions/particle/step: 0.0701822 Reactions/particle/step: 0 Move time (%) = 0.516838 (42.8436) Coll time (%) = 0.203686 (16.8847) Sort time (%) = 0.393502 (32.6196) Comm time (%) = 0.0877503 (7.27412) Modfy time (%) = 0 (0) Outpt time (%) = 0.00415051 (0.34406) Other time (%) = 0.000409074 (0.0339104) Particles: 128000 ave 129207 max 127031 min Histogram: 2 6 20 27 25 20 18 6 3 1 Cells: 12800 ave 12800 max 12800 min Histogram: 128 0 0 0 0 0 0 0 0 0 GhostCell: 5712.81 ave 7936 max 2194 min Histogram: 2 6 8 16 4 30 18 20 4 20 EmptyCell: 2179.92 ave 4280 max 441 min Histogram: 6 15 11 19 25 13 23 3 11 2