SPARTA (23 Dec 2017)
KOKKOS mode is enabled (../kokkos.cpp:39)
  using 0 GPU(s) per MPI task
  using 2 thread(s) per MPI task
package kokkos
package kokkos reduction parallel/reduce comm classic
# advect particles via VSS collisional flow on a uniform grid
# particles reflect off global box boundaries

variable            x index 10
variable            y index 10
variable            z index 10

variable            lx equal $x*1.0e-5
variable            lx equal 32*1.0e-5
variable            ly equal $y*1.0e-5
variable            ly equal 20*1.0e-5
variable            lz equal $z*1.0e-5
variable            lz equal 20*1.0e-5

variable            n equal 10*$x*$y*$z
variable            n equal 10*32*$y*$z
variable            n equal 10*32*20*$z
variable            n equal 10*32*20*20

seed	    	    12345
dimension   	    3
global              gridcut 1.0e-5

boundary	    rr rr rr

create_box  	    0 ${lx} 0 ${ly} 0 ${lz}
create_box  	    0 0.00032 0 ${ly} 0 ${lz}
create_box  	    0 0.00032 0 0.0002 0 ${lz}
create_box  	    0 0.00032 0 0.0002 0 0.0002
Created orthogonal box = (0 0 0) to (0.00032 0.0002 0.0002)
create_grid 	    $x $y $z
create_grid 	    32 $y $z
create_grid 	    32 20 $z
create_grid 	    32 20 20
WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381)
Created 12800 child grid cells
  parent cells = 1
  CPU time = 0.00364477 secs
  create/ghost percent = 68.5384 31.4616

balance_grid        rcb part
Balance grid migrated 12467 cells
  CPU time = 0.00806053 secs
  reassign/sort/migrate/ghost percent = 39.7099 0.192189 32.0086 28.0893

species		    ar.species Ar
mixture		    air Ar vstream 0.0 0.0 0.0 temp 273.15

global              nrho 7.07043E22
global              fnum 7.07043E6

collide		    vss air ar.vss

create_particles    air n $n
create_particles    air n 128000
Created 128000 particles
  CPU time = 0.00483226 secs

stats		    100
compute             temp temp
stats_style	    step cpu np nattempt ncoll c_temp

# first equilibrate with large timestep to unsort particles
# then benchmark with normal timestep

timestep 	    7.00E-8
run                 30
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 1.6875 1.6875 1.6875
  grid      (ave,min,max) = 1.51388 1.51388 1.51388
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 3.20138 3.20138 3.20138
Step CPU Np Natt Ncoll c_temp 
       0            0   128000        0        0    273.45352 
      30  0.070625821   128000   128419    90337    273.45352 
Loop time of 0.0706885 on 36 procs for 30 steps with 128000 particles

Particle moves    = 3840000 (3.84M)
Cells touched     = 18598650 (18.6M)
Particle comms    = 1473255 (1.47M)
Boundary collides = 671919 (0.672M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 3716994 (3.72M)
Collide occurs    = 2699741 (2.7M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 1.50897e+06
Particle-moves/step: 128000
Cell-touches/particle/step: 4.8434
Particle comm iterations/step: 3.03333
Particle fraction communicated: 0.38366
Particle fraction colliding with boundary: 0.174979
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.967967
Collisions/particle/step: 0.703058
Reactions/particle/step: 0

Move  time (%) = 0.0278749 (39.4335)
Coll  time (%) = 0.0121411 (17.1755)
Sort  time (%) = 0.00559676 (7.91749)
Comm  time (%) = 0.0249141 (35.2449)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.000109284 (0.1546)
Other time (%) = 5.23046e-05 (0.0739931)

Particles: 3555.56 ave 3653 max 3433 min
Histogram: 2 1 3 3 5 6 9 0 2 5
Cells:      355.556 ave 356 max 355 min
Histogram: 16 0 0 0 0 0 0 0 0 20
GhostCell: 722.556 ave 1156 max 239 min
Histogram: 2 1 6 3 1 9 4 6 0 4
EmptyCell: 290.694 ave 561 max 54 min
Histogram: 4 3 6 0 6 3 7 3 0 4
timestep 	    7.00E-9
run 		    $t
run 		    100
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 1.6875 1.6875 1.6875
  grid      (ave,min,max) = 1.51388 1.51388 1.51388
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 3.20138 3.20138 3.20138
Step CPU Np Natt Ncoll c_temp 
      30            0   128000   128419    90337    273.45352 
     100  0.032264556   128000    12209     8946    273.45352 
     130  0.046606599   128000    12385     8933    273.45352 
Loop time of 0.0466603 on 36 procs for 100 steps with 128000 particles

Particle moves    = 12800000 (12.8M)
Cells touched     = 17694452 (17.7M)
Particle comms    = 648898 (0.649M)
Boundary collides = 224260 (0.224M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 1199501 (1.2M)
Collide occurs    = 898593 (0.899M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 7.62009e+06
Particle-moves/step: 128000
Cell-touches/particle/step: 1.38238
Particle comm iterations/step: 1
Particle fraction communicated: 0.0506952
Particle fraction colliding with boundary: 0.0175203
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.093711
Collisions/particle/step: 0.0702026
Reactions/particle/step: 0

Move  time (%) = 0.0143603 (30.7762)
Coll  time (%) = 0.00678508 (14.5415)
Sort  time (%) = 0.0154037 (33.0124)
Comm  time (%) = 0.00982173 (21.0494)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.000192263 (0.41205)
Other time (%) = 9.7263e-05 (0.208449)

Particles: 3555.56 ave 3680 max 3417 min
Histogram: 1 2 3 5 6 5 7 3 2 2
Cells:      355.556 ave 356 max 355 min
Histogram: 16 0 0 0 0 0 0 0 0 20
GhostCell: 722.556 ave 1156 max 239 min
Histogram: 2 1 6 3 1 9 4 6 0 4
EmptyCell: 290.694 ave 561 max 54 min
Histogram: 4 3 6 0 6 3 7 3 0 4