SPARTA (23 Dec 2017)
KOKKOS mode is enabled (../kokkos.cpp:39)
  using 0 GPU(s) per MPI task
  using 2 thread(s) per MPI task
package kokkos
package kokkos reduction parallel/reduce comm classic
# advect particles via VSS collisional flow on a uniform grid
# particles reflect off global box boundaries

variable            x index 10
variable            y index 10
variable            z index 10

variable            lx equal $x*1.0e-5
variable            lx equal 64*1.0e-5
variable            ly equal $y*1.0e-5
variable            ly equal 80*1.0e-5
variable            lz equal $z*1.0e-5
variable            lz equal 80*1.0e-5

variable            n equal 10*$x*$y*$z
variable            n equal 10*64*$y*$z
variable            n equal 10*64*80*$z
variable            n equal 10*64*80*80

seed	    	    12345
dimension   	    3
global              gridcut 1.0e-5

boundary	    rr rr rr

create_box  	    0 ${lx} 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 0.0008 0 ${lz}
create_box  	    0 0.00064 0 0.0008 0 0.0008
Created orthogonal box = (0 0 0) to (0.00064 0.0008 0.0008)
create_grid 	    $x $y $z
create_grid 	    64 $y $z
create_grid 	    64 80 $z
create_grid 	    64 80 80
WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381)
Created 409600 child grid cells
  parent cells = 1
  CPU time = 0.0060035 secs
  create/ghost percent = 73.0559 26.9441

balance_grid        rcb part
Balance grid migrated 398090 cells
  CPU time = 0.0490853 secs
  reassign/sort/migrate/ghost percent = 18.3814 0.856997 32.811 47.9506

species		    ar.species Ar
mixture		    air Ar vstream 0.0 0.0 0.0 temp 273.15

global              nrho 7.07043E22
global              fnum 7.07043E6

collide		    vss air ar.vss

create_particles    air n $n
create_particles    air n 4096000
Created 4096000 particles
  CPU time = 0.0508296 secs

stats		    100
compute             temp temp
stats_style	    step cpu np nattempt ncoll c_temp

# first equilibrate with large timestep to unsort particles
# then benchmark with normal timestep

timestep 	    7.00E-8
run                 30
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 15.6276 15.6276 15.6276
  grid      (ave,min,max) = 3.47221 2.95138 3.88888
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 19.0998 18.579 19.5165
Step CPU Np Natt Ncoll c_temp 
       0            0  4096000        0        0    273.00157 
      30    1.5520358  4096000  4109128  2893053    273.00157 
Loop time of 1.55211 on 36 procs for 30 steps with 4096000 particles

Particle moves    = 122880000 (123M)
Cells touched     = 608069513 (608M)
Particle comms    = 15643980 (15.6M)
Boundary collides = 6647340 (6.65M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 118968244 (119M)
Collide occurs    = 86373087 (86.4M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 2.19916e+06
Particle-moves/step: 4.096e+06
Cell-touches/particle/step: 4.94848
Particle comm iterations/step: 3.03333
Particle fraction communicated: 0.127311
Particle fraction colliding with boundary: 0.0540962
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.968166
Collisions/particle/step: 0.702906
Reactions/particle/step: 0

Move  time (%) = 0.680843 (43.8657)
Coll  time (%) = 0.471237 (30.3611)
Sort  time (%) = 0.153997 (9.92181)
Comm  time (%) = 0.242625 (15.632)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.0032879 (0.211835)
Other time (%) = 0.000116274 (0.00749139)

Particles: 113778 ave 114458 max 113214 min
Histogram: 2 6 3 5 3 6 6 3 1 1
Cells:      11377.8 ave 11378 max 11377 min
Histogram: 8 0 0 0 0 0 0 0 0 28
GhostCell: 5518.19 ave 8587 max 2944 min
Histogram: 2 4 4 7 3 3 8 1 3 1
EmptyCell: 1863.33 ave 3336 max 416 min
Histogram: 2 1 7 3 3 9 1 6 2 2
timestep 	    7.00E-9
run 		    $t
run 		    100
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 15.6276 15.6276 15.6276
  grid      (ave,min,max) = 3.47221 2.95138 3.88888
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 19.0998 18.579 19.5165
Step CPU Np Natt Ncoll c_temp 
      30            0  4096000  4109128  2893053    273.00157 
     100    1.2543981  4096000   393472   289911    273.00157 
     130      1.81171  4096000   398479   289391    273.00157 
Loop time of 1.81179 on 36 procs for 100 steps with 4096000 particles

Particle moves    = 409600000 (410M)
Cells touched     = 571021684 (571M)
Particle comms    = 6234198 (6.23M)
Boundary collides = 2215089 (2.22M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 38374334 (38.4M)
Collide occurs    = 28742472 (28.7M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 6.27985e+06
Particle-moves/step: 4.096e+06
Cell-touches/particle/step: 1.3941
Particle comm iterations/step: 1
Particle fraction communicated: 0.0152202
Particle fraction colliding with boundary: 0.00540793
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.0936873
Collisions/particle/step: 0.0701721
Reactions/particle/step: 0

Move  time (%) = 0.947903 (52.3186)
Coll  time (%) = 0.278194 (15.3546)
Sort  time (%) = 0.493065 (27.2142)
Comm  time (%) = 0.0853576 (4.71123)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00693102 (0.382551)
Other time (%) = 0.000339185 (0.018721)

Particles: 113778 ave 114592 max 113042 min
Histogram: 1 1 5 6 7 8 3 3 0 2
Cells:      11377.8 ave 11378 max 11377 min
Histogram: 8 0 0 0 0 0 0 0 0 28
GhostCell: 5518.19 ave 8587 max 2944 min
Histogram: 2 4 4 7 3 3 8 1 3 1
EmptyCell: 1863.33 ave 3336 max 416 min
Histogram: 2 1 7 3 3 9 1 6 2 2