SPARTA (23 Dec 2017)
KOKKOS mode is enabled (../kokkos.cpp:39)
  using 0 GPU(s) per MPI task
  using 4 thread(s) per MPI task
package kokkos
package kokkos reduction parallel/reduce comm classic
# advect particles via VSS collisional flow on a uniform grid
# particles reflect off global box boundaries

variable            x index 10
variable            y index 10
variable            z index 10

variable            lx equal $x*1.0e-5
variable            lx equal 64*1.0e-5
variable            ly equal $y*1.0e-5
variable            ly equal 40*1.0e-5
variable            lz equal $z*1.0e-5
variable            lz equal 80*1.0e-5

variable            n equal 10*$x*$y*$z
variable            n equal 10*64*$y*$z
variable            n equal 10*64*40*$z
variable            n equal 10*64*40*80

seed	    	    12345
dimension   	    3
global              gridcut 1.0e-5

boundary	    rr rr rr

create_box  	    0 ${lx} 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 0.0004 0 ${lz}
create_box  	    0 0.00064 0 0.0004 0 0.0008
Created orthogonal box = (0 0 0) to (0.00064 0.0004 0.0008)
create_grid 	    $x $y $z
create_grid 	    64 $y $z
create_grid 	    64 40 $z
create_grid 	    64 40 80
WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381)
Created 204800 child grid cells
  parent cells = 1
  CPU time = 0.00350166 secs
  create/ghost percent = 70.9448 29.0552

balance_grid        rcb part
Balance grid migrated 199090 cells
  CPU time = 0.0277024 secs
  reassign/sort/migrate/ghost percent = 39.2172 0.178706 22.4049 38.1992

species		    ar.species Ar
mixture		    air Ar vstream 0.0 0.0 0.0 temp 273.15

global              nrho 7.07043E22
global              fnum 7.07043E6

collide		    vss air ar.vss

create_particles    air n $n
create_particles    air n 2048000
Created 2048000 particles
  CPU time = 0.0188789 secs

stats		    100
compute             temp temp
stats_style	    step cpu np nattempt ncoll c_temp

# first equilibrate with large timestep to unsort particles
# then benchmark with normal timestep

timestep 	    7.00E-8
run                 30
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 7.44173 7.44173 7.44173
  grid      (ave,min,max) = 2.29513 1.51388 2.45138
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 9.73685 8.9556 9.8931
Step CPU Np Natt Ncoll c_temp 
       0            0  2048000        0        0    272.99261 
      30    0.4083039  2048000  2054221  1445834    272.99261 
Loop time of 0.40837 on 36 procs for 30 steps with 2048000 particles

Particle moves    = 61440000 (61.4M)
Cells touched     = 303209238 (303M)
Particle comms    = 9465830 (9.47M)
Boundary collides = 4349097 (4.35M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 59483859 (59.5M)
Collide occurs    = 43182867 (43.2M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 4.17921e+06
Particle-moves/step: 2.048e+06
Cell-touches/particle/step: 4.93505
Particle comm iterations/step: 3.1
Particle fraction communicated: 0.154066
Particle fraction colliding with boundary: 0.0707861
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.968162
Collisions/particle/step: 0.702846
Reactions/particle/step: 0

Move  time (%) = 0.172523 (42.2467)
Coll  time (%) = 0.111441 (27.2891)
Sort  time (%) = 0.041901 (10.2606)
Comm  time (%) = 0.0793926 (19.4413)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00301004 (0.737085)
Other time (%) = 0.000102907 (0.0251995)

Particles: 56888.9 ave 57458 max 56353 min
Histogram: 1 2 2 5 13 5 1 5 1 1
Cells:      5688.89 ave 5690 max 5688 min
Histogram: 6 0 0 0 0 28 0 0 0 2
GhostCell: 3356.75 ave 6246 max 2063 min
Histogram: 6 7 3 11 5 2 1 0 0 1
EmptyCell: 1147.47 ave 1950 max 408 min
Histogram: 1 1 10 5 2 9 0 2 3 3
timestep 	    7.00E-9
run 		    $t
run 		    100
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 7.44173 7.44173 7.44173
  grid      (ave,min,max) = 2.29513 1.51388 2.45138
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 9.73685 8.9556 9.8931
Step CPU Np Natt Ncoll c_temp 
      30            0  2048000  2054221  1445834    272.99261 
     100   0.28951336  2048000   196366   144290    272.99261 
     130   0.41687874  2048000   199177   144967    272.99261 
Loop time of 0.416941 on 36 procs for 100 steps with 2048000 particles

Particle moves    = 204800000 (205M)
Cells touched     = 285164377 (285M)
Particle comms    = 3691039 (3.69M)
Boundary collides = 1449224 (1.45M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 19184684 (19.2M)
Collide occurs    = 14371329 (14.4M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 1.36444e+07
Particle-moves/step: 2.048e+06
Cell-touches/particle/step: 1.3924
Particle comm iterations/step: 1
Particle fraction communicated: 0.0180227
Particle fraction colliding with boundary: 0.00707629
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.0936752
Collisions/particle/step: 0.0701725
Reactions/particle/step: 0

Move  time (%) = 0.179574 (43.0695)
Coll  time (%) = 0.0617274 (14.8048)
Sort  time (%) = 0.134876 (32.349)
Comm  time (%) = 0.0390489 (9.36558)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00151092 (0.362381)
Other time (%) = 0.000203345 (0.0487708)

Particles: 56888.9 ave 57284 max 56352 min
Histogram: 1 1 2 4 8 5 4 3 2 6
Cells:      5688.89 ave 5690 max 5688 min
Histogram: 6 0 0 0 0 28 0 0 0 2
GhostCell: 3356.75 ave 6246 max 2063 min
Histogram: 6 7 3 11 5 2 1 0 0 1
EmptyCell: 1147.47 ave 1950 max 408 min
Histogram: 1 1 10 5 2 9 0 2 3 3