SPARTA (23 Dec 2017)
KOKKOS mode is enabled (../kokkos.cpp:39)
  using 0 GPU(s) per MPI task
  using 1 thread(s) per MPI task
package kokkos
package kokkos reduction parallel/reduce comm classic
# advect particles via VSS collisional flow on a uniform grid
# particles reflect off global box boundaries

variable            x index 10
variable            y index 10
variable            z index 10

variable            lx equal $x*1.0e-5
variable            lx equal 32*1.0e-5
variable            ly equal $y*1.0e-5
variable            ly equal 40*1.0e-5
variable            lz equal $z*1.0e-5
variable            lz equal 40*1.0e-5

variable            n equal 10*$x*$y*$z
variable            n equal 10*32*$y*$z
variable            n equal 10*32*40*$z
variable            n equal 10*32*40*40

seed	    	    12345
dimension   	    3
global              gridcut 1.0e-5

boundary	    rr rr rr

create_box  	    0 ${lx} 0 ${ly} 0 ${lz}
create_box  	    0 0.00032 0 ${ly} 0 ${lz}
create_box  	    0 0.00032 0 0.0004 0 ${lz}
create_box  	    0 0.00032 0 0.0004 0 0.0004
Created orthogonal box = (0 0 0) to (0.00032 0.0004 0.0004)
create_grid 	    $x $y $z
create_grid 	    32 $y $z
create_grid 	    32 40 $z
create_grid 	    32 40 40
WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381)
Created 51200 child grid cells
  parent cells = 1
  CPU time = 0.0139768 secs
  create/ghost percent = 56.4864 43.5136

balance_grid        rcb part
Balance grid migrated 50400 cells
  CPU time = 0.079922 secs
  reassign/sort/migrate/ghost percent = 56.22 0.0823347 22.7274 20.9703

species		    ar.species Ar
mixture		    air Ar vstream 0.0 0.0 0.0 temp 273.15

global              nrho 7.07043E22
global              fnum 7.07043E6

collide		    vss air ar.vss

create_particles    air n $n
create_particles    air n 512000
Created 512000 particles
  CPU time = 0.0261152 secs

stats		    100
compute             temp temp
stats_style	    step cpu np nattempt ncoll c_temp

# first equilibrate with large timestep to unsort particles
# then benchmark with normal timestep

timestep 	    7.00E-8
run                 30
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 1.6875 1.6875 1.6875
  grid      (ave,min,max) = 1.51388 1.51388 1.51388
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 3.20138 3.20138 3.20138
Step CPU Np Natt Ncoll c_temp 
       0            0   512000        0        0    273.45702 
      30   0.28519797   512000   513178   360862    273.45702 
Loop time of 0.285333 on 128 procs for 30 steps with 512000 particles

Particle moves    = 15360000 (15.4M)
Cells touched     = 75767995 (75.8M)
Particle comms    = 6289244 (6.29M)
Boundary collides = 1663807 (1.66M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 14873139 (14.9M)
Collide occurs    = 10801608 (10.8M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 420561
Particle-moves/step: 512000
Cell-touches/particle/step: 4.93281
Particle comm iterations/step: 3.26667
Particle fraction communicated: 0.409456
Particle fraction colliding with boundary: 0.108321
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.968303
Collisions/particle/step: 0.70323
Reactions/particle/step: 0

Move  time (%) = 0.140191 (49.1323)
Coll  time (%) = 0.0771119 (27.0252)
Sort  time (%) = 0.00728359 (2.55266)
Comm  time (%) = 0.0600983 (21.0625)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.000435535 (0.152641)
Other time (%) = 0.000212831 (0.0745905)

Particles: 4000 ave 4148 max 3844 min
Histogram: 2 2 15 24 15 28 19 12 6 5
Cells:      400 ave 400 max 400 min
Histogram: 128 0 0 0 0 0 0 0 0 0
GhostCell: 719.344 ave 1112 max 248 min
Histogram: 2 10 13 13 17 20 11 20 6 16
EmptyCell: 332.945 ave 672 max 54 min
Histogram: 11 22 14 19 4 17 10 13 11 7
timestep 	    7.00E-9
run 		    $t
run 		    100
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 1.6875 1.6875 1.6875
  grid      (ave,min,max) = 1.51388 1.51388 1.51388
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 3.20138 3.20138 3.20138
Step CPU Np Natt Ncoll c_temp 
      30            0   512000   513178   360862    273.45702 
     100   0.12242699   512000    49240    36253    273.45702 
     130   0.17480302   512000    49907    36274    273.45702 
Loop time of 0.174939 on 128 procs for 100 steps with 512000 particles

Particle moves    = 51200000 (51.2M)
Cells touched     = 71117127 (71.1M)
Particle comms    = 2313423 (2.31M)
Boundary collides = 553459 (0.553M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 4797087 (4.8M)
Collide occurs    = 3593425 (3.59M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 2.28652e+06
Particle-moves/step: 512000
Cell-touches/particle/step: 1.38901
Particle comm iterations/step: 1
Particle fraction communicated: 0.045184
Particle fraction colliding with boundary: 0.0108097
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.0936931
Collisions/particle/step: 0.0701841
Reactions/particle/step: 0

Move  time (%) = 0.0891165 (50.9416)
Coll  time (%) = 0.0368988 (21.0924)
Sort  time (%) = 0.0171285 (9.79117)
Comm  time (%) = 0.0303819 (17.3672)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.000762636 (0.435945)
Other time (%) = 0.000650279 (0.371718)

Particles: 4000 ave 4118 max 3830 min
Histogram: 2 3 6 6 24 21 26 22 13 5
Cells:      400 ave 400 max 400 min
Histogram: 128 0 0 0 0 0 0 0 0 0
GhostCell: 719.344 ave 1112 max 248 min
Histogram: 2 10 13 13 17 20 11 20 6 16
EmptyCell: 332.945 ave 672 max 54 min
Histogram: 11 22 14 19 4 17 10 13 11 7