SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 2 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # advect particles via VSS collisional flow on a uniform grid # particles reflect off global box boundaries variable x index 10 variable y index 10 variable z index 10 variable lx equal $x*1.0e-5 variable lx equal 128*1.0e-5 variable ly equal $y*1.0e-5 variable ly equal 80*1.0e-5 variable lz equal $z*1.0e-5 variable lz equal 160*1.0e-5 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*160 seed 12345 dimension 3 global gridcut 1.0e-5 boundary rr rr rr create_box 0 ${lx} 0 ${ly} 0 ${lz} create_box 0 0.00128 0 ${ly} 0 ${lz} create_box 0 0.00128 0 0.0008 0 ${lz} create_box 0 0.00128 0 0.0008 0 0.0016 Created orthogonal box = (0 0 0) to (0.00128 0.0008 0.0016) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 160 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 1638400 child grid cells parent cells = 1 CPU time = 0.0188272 secs create/ghost percent = 63.3454 36.6546 balance_grid rcb part Balance grid migrated 1587200 cells CPU time = 0.155568 secs reassign/sort/migrate/ghost percent = 27.0076 1.07157 35.4989 36.422 species ar.species Ar mixture air Ar vstream 0.0 0.0 0.0 temp 273.15 global nrho 7.07043E22 global fnum 7.07043E6 collide vss air ar.vss create_particles air n $n create_particles air n 16384000 Created 16384000 particles CPU time = 0.19136 secs stats 100 compute temp temp stats_style step cpu np nattempt ncoll c_temp # first equilibrate with large timestep to unsort particles # then benchmark with normal timestep timestep 7.00E-8 run 30 Memory usage per proc in Mbytes: particles (ave,min,max) = 68.9175 68.9175 68.9175 grid (ave,min,max) = 11.3108 11.0764 12.0139 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 80.2283 79.9939 80.9314 Step CPU Np Natt Ncoll c_temp 0 0 16384000 0 0 273.1381 30 8.2643008 16384000 16434085 11566016 273.1381 Loop time of 8.26433 on 32 procs for 30 steps with 16384000 particles Particle moves = 491520000 (492M) Cells touched = 2440005761 (2.44B) Particle comms = 35107809 (35.1M) Boundary collides = 17390644 (17.4M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 475926765 (476M) Collide occurs = 345528666 (346M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.85859e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 4.9642 Particle comm iterations/step: 3.03333 Particle fraction communicated: 0.071427 Particle fraction colliding with boundary: 0.0353814 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.968275 Collisions/particle/step: 0.70298 Reactions/particle/step: 0 Move time (%) = 4.56684 (55.2597) Coll time (%) = 2.19207 (26.5244) Sort time (%) = 0.931865 (11.2758) Comm time (%) = 0.559235 (6.76686) Modfy time (%) = 0 (0) Outpt time (%) = 0.0142366 (0.172266) Other time (%) = 8.09282e-05 (0.000979248) Particles: 512000 ave 513225 max 510476 min Histogram: 1 0 4 6 3 4 4 3 5 2 Cells: 51200 ave 51200 max 51200 min Histogram: 32 0 0 0 0 0 0 0 0 0 GhostCell: 12010 ave 15328 max 8776 min Histogram: 8 0 0 0 8 8 0 0 0 8 EmptyCell: 4033.59 ave 6586 max 1848 min Histogram: 3 0 8 5 0 8 4 1 0 3 timestep 7.00E-9 run $t run 100 Memory usage per proc in Mbytes: particles (ave,min,max) = 68.9175 68.9175 68.9175 grid (ave,min,max) = 11.3108 11.0764 12.0139 surf (ave,min,max) = 0 0 0 total (ave,min,max) = 80.2283 79.9939 80.9314 Step CPU Np Natt Ncoll c_temp 30 0 16384000 16434085 11566016 273.1381 100 7.411113 16384000 1572073 1156892 273.1381 130 10.594933 16384000 1592528 1156037 273.1381 Loop time of 10.595 on 32 procs for 100 steps with 16384000 particles Particle moves = 1638400000 (1.64B) Cells touched = 2287315508 (2.29B) Particle comms = 11905226 (11.9M) Boundary collides = 5800251 (5.8M) Boundary exits = 0 (0K) SurfColl checks = 0 (0K) SurfColl occurs = 0 (0K) Surf reactions = 0 (0K) Collide attempts = 153501592 (154M) Collide occurs = 114973126 (115M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 4.83249e+06 Particle-moves/step: 1.6384e+07 Cell-touches/particle/step: 1.39607 Particle comm iterations/step: 1 Particle fraction communicated: 0.00726637 Particle fraction colliding with boundary: 0.00354019 Particle fraction exiting boundary: 0 Surface-checks/particle/step: 0 Surface-collisions/particle/step: 0 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0936899 Collisions/particle/step: 0.070174 Reactions/particle/step: 0 Move time (%) = 6.20807 (58.5945) Coll time (%) = 1.31266 (12.3895) Sort time (%) = 2.90842 (27.4509) Comm time (%) = 0.138796 (1.31002) Modfy time (%) = 0 (0) Outpt time (%) = 0.0266967 (0.251976) Other time (%) = 0.00031805 (0.0030019) Particles: 512000 ave 512957 max 510637 min Histogram: 1 1 2 3 2 7 5 6 2 3 Cells: 51200 ave 51200 max 51200 min Histogram: 32 0 0 0 0 0 0 0 0 0 GhostCell: 12010 ave 15328 max 8776 min Histogram: 8 0 0 0 8 8 0 0 0 8 EmptyCell: 4033.59 ave 6586 max 1848 min Histogram: 3 0 8 5 0 8 4 1 0 3