SPARTA (23 Dec 2017)
KOKKOS mode is enabled (../kokkos.cpp:39)
  using 0 GPU(s) per MPI task
  using 1 thread(s) per MPI task
package kokkos
package kokkos reduction parallel/reduce comm classic
# advect particles via VSS collisional flow on a uniform grid
# particles reflect off global box boundaries

variable            x index 10
variable            y index 10
variable            z index 10

variable            lx equal $x*1.0e-5
variable            lx equal 64*1.0e-5
variable            ly equal $y*1.0e-5
variable            ly equal 40*1.0e-5
variable            lz equal $z*1.0e-5
variable            lz equal 40*1.0e-5

variable            n equal 10*$x*$y*$z
variable            n equal 10*64*$y*$z
variable            n equal 10*64*40*$z
variable            n equal 10*64*40*40

seed	    	    12345
dimension   	    3
global              gridcut 1.0e-5

boundary	    rr rr rr

create_box  	    0 ${lx} 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 0.0004 0 ${lz}
create_box  	    0 0.00064 0 0.0004 0 0.0004
Created orthogonal box = (0 0 0) to (0.00064 0.0004 0.0004)
create_grid 	    $x $y $z
create_grid 	    64 $y $z
create_grid 	    64 40 $z
create_grid 	    64 40 40
WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381)
Created 102400 child grid cells
  parent cells = 1
  CPU time = 0.00605756 secs
  create/ghost percent = 76.5232 23.4768

balance_grid        rcb part
Balance grid migrated 101011 cells
  CPU time = 0.0210398 secs
  reassign/sort/migrate/ghost percent = 33.1035 0.152405 34.9615 31.7826

species		    ar.species Ar
mixture		    air Ar vstream 0.0 0.0 0.0 temp 273.15

global              nrho 7.07043E22
global              fnum 7.07043E6

collide		    vss air ar.vss

create_particles    air n $n
create_particles    air n 1024000
Created 1024000 particles
  CPU time = 0.0122503 secs

stats		    100
compute             temp temp
stats_style	    step cpu np nattempt ncoll c_temp

# first equilibrate with large timestep to unsort particles
# then benchmark with normal timestep

timestep 	    7.00E-8
run                 30
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 1.6875 1.6875 1.6875
  grid      (ave,min,max) = 1.51388 1.51388 1.51388
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 3.20138 3.20138 3.20138
Step CPU Np Natt Ncoll c_temp 
       0            0  1024000        0        0    273.38015 
      30   0.36210568  1024000  1026967   722770    273.38015 
Loop time of 0.362182 on 72 procs for 30 steps with 1024000 particles

Particle moves    = 30720000 (30.7M)
Cells touched     = 151549387 (152M)
Particle comms    = 8108442 (8.11M)
Boundary collides = 2687558 (2.69M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 29747708 (29.7M)
Collide occurs    = 21597078 (21.6M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 1.17805e+06
Particle-moves/step: 1.024e+06
Cell-touches/particle/step: 4.93325
Particle comm iterations/step: 3.1
Particle fraction communicated: 0.263947
Particle fraction colliding with boundary: 0.0874856
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.96835
Collisions/particle/step: 0.70303
Reactions/particle/step: 0

Move  time (%) = 0.139963 (38.6445)
Coll  time (%) = 0.102598 (28.3278)
Sort  time (%) = 0.034148 (9.42841)
Comm  time (%) = 0.0847099 (23.3888)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.000616179 (0.17013)
Other time (%) = 0.000146135 (0.0403485)

Particles: 14222.2 ave 14433 max 13905 min
Histogram: 2 2 2 9 7 7 13 18 7 5
Cells:      1422.22 ave 1423 max 1422 min
Histogram: 56 0 0 0 0 0 0 0 0 16
GhostCell: 1552.67 ave 2861 max 888 min
Histogram: 9 12 16 9 12 7 1 4 0 2
EmptyCell: 604.847 ave 1276 max 225 min
Histogram: 10 7 19 6 16 4 4 4 0 2
timestep 	    7.00E-9
run 		    $t
run 		    100
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 1.6875 1.6875 1.6875
  grid      (ave,min,max) = 1.51388 1.51388 1.51388
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 3.20138 3.20138 3.20138
Step CPU Np Natt Ncoll c_temp 
      30            0  1024000  1026967   722770    273.38015 
     100   0.25340355  1024000    98272    72165    273.38015 
     130   0.36896281  1024000    99917    72674    273.38015 
Loop time of 0.369072 on 72 procs for 100 steps with 1024000 particles

Particle moves    = 102400000 (102M)
Cells touched     = 142442162 (142M)
Particle comms    = 3317008 (3.32M)
Boundary collides = 895345 (0.895M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 9595287 (9.6M)
Collide occurs    = 7187575 (7.19M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 3.85351e+06
Particle-moves/step: 1.024e+06
Cell-touches/particle/step: 1.39104
Particle comm iterations/step: 1
Particle fraction communicated: 0.0323927
Particle fraction colliding with boundary: 0.0087436
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.093704
Collisions/particle/step: 0.0701912
Reactions/particle/step: 0

Move  time (%) = 0.16369 (44.3518)
Coll  time (%) = 0.0543817 (14.7347)
Sort  time (%) = 0.113293 (30.6966)
Comm  time (%) = 0.035904 (9.72819)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00152826 (0.414082)
Other time (%) = 0.000275268 (0.0745837)

Particles: 14222.2 ave 14503 max 13941 min
Histogram: 1 1 12 11 14 13 5 5 7 3
Cells:      1422.22 ave 1423 max 1422 min
Histogram: 56 0 0 0 0 0 0 0 0 16
GhostCell: 1552.67 ave 2861 max 888 min
Histogram: 9 12 16 9 12 7 1 4 0 2
EmptyCell: 604.847 ave 1276 max 225 min
Histogram: 10 7 19 6 16 4 4 4 0 2