SPARTA (23 Dec 2017)
KOKKOS mode is enabled (../kokkos.cpp:39)
  using 0 GPU(s) per MPI task
  using 1 thread(s) per MPI task
package kokkos
package kokkos reduction parallel/reduce comm classic
# advect particles via VSS collisional flow on a uniform grid
# particles reflect off global box boundaries

variable            x index 10
variable            y index 10
variable            z index 10

variable            lx equal $x*1.0e-5
variable            lx equal 64*1.0e-5
variable            ly equal $y*1.0e-5
variable            ly equal 80*1.0e-5
variable            lz equal $z*1.0e-5
variable            lz equal 80*1.0e-5

variable            n equal 10*$x*$y*$z
variable            n equal 10*64*$y*$z
variable            n equal 10*64*80*$z
variable            n equal 10*64*80*80

seed	    	    12345
dimension   	    3
global              gridcut 1.0e-5

boundary	    rr rr rr

create_box  	    0 ${lx} 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 0.0008 0 ${lz}
create_box  	    0 0.00064 0 0.0008 0 0.0008
Created orthogonal box = (0 0 0) to (0.00064 0.0008 0.0008)
create_grid 	    $x $y $z
create_grid 	    64 $y $z
create_grid 	    64 80 $z
create_grid 	    64 80 80
WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381)
Created 409600 child grid cells
  parent cells = 1
  CPU time = 0.00667239 secs
  create/ghost percent = 74.9244 25.0756

balance_grid        rcb part
Balance grid migrated 403945 cells
  CPU time = 0.0446797 secs
  reassign/sort/migrate/ghost percent = 23.2606 0.787053 34.8146 41.1378

species		    ar.species Ar
mixture		    air Ar vstream 0.0 0.0 0.0 temp 273.15

global              nrho 7.07043E22
global              fnum 7.07043E6

collide		    vss air ar.vss

create_particles    air n $n
create_particles    air n 4096000
Created 4096000 particles
  CPU time = 0.050314 secs

stats		    100
compute             temp temp
stats_style	    step cpu np nattempt ncoll c_temp

# first equilibrate with large timestep to unsort particles
# then benchmark with normal timestep

timestep 	    7.00E-8
run                 30
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 7.44173 7.44173 7.44173
  grid      (ave,min,max) = 2.37325 1.51388 2.45138
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 9.81498 8.9556 9.8931
Step CPU Np Natt Ncoll c_temp 
       0            0  4096000        0        0    273.12058 
      30    1.4765089  4096000  4109851  2893143    273.12058 
Loop time of 1.4766 on 72 procs for 30 steps with 4096000 particles

Particle moves    = 122880000 (123M)
Cells touched     = 608273014 (608M)
Particle comms    = 20796821 (20.8M)
Boundary collides = 6647749 (6.65M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 118971467 (119M)
Collide occurs    = 86379303 (86.4M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 1.15581e+06
Particle-moves/step: 4.096e+06
Cell-touches/particle/step: 4.95014
Particle comm iterations/step: 3.03333
Particle fraction communicated: 0.169245
Particle fraction colliding with boundary: 0.0540995
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.968192
Collisions/particle/step: 0.702957
Reactions/particle/step: 0

Move  time (%) = 0.63506 (43.0083)
Coll  time (%) = 0.462516 (31.3231)
Sort  time (%) = 0.122043 (8.26514)
Comm  time (%) = 0.253443 (17.164)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00338905 (0.229517)
Other time (%) = 0.000148032 (0.0100252)

Particles: 56888.9 ave 57480 max 56434 min
Histogram: 5 2 10 13 13 15 6 5 1 2
Cells:      5688.89 ave 5690 max 5688 min
Histogram: 10 0 0 0 0 60 0 0 0 2
GhostCell: 3871.88 ave 6246 max 2087 min
Histogram: 6 4 8 15 11 12 8 4 3 1
EmptyCell: 1343.31 ave 2574 max 624 min
Histogram: 4 17 2 25 4 8 7 1 3 1
timestep 	    7.00E-9
run 		    $t
run 		    100
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 7.44173 7.44173 7.44173
  grid      (ave,min,max) = 2.37325 1.51388 2.45138
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 9.81498 8.9556 9.8931
Step CPU Np Natt Ncoll c_temp 
      30            0  4096000  4109851  2893143    273.12058 
     100    1.1741352  4096000   392771   288993    273.12058 
     130    1.6810488  4096000   398178   288751    273.12058 
Loop time of 1.68114 on 72 procs for 100 steps with 4096000 particles

Particle moves    = 409600000 (410M)
Cells touched     = 571044457 (571M)
Particle comms    = 8145478 (8.15M)
Boundary collides = 2215833 (2.22M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 38376370 (38.4M)
Collide occurs    = 28744538 (28.7M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 3.38396e+06
Particle-moves/step: 4.096e+06
Cell-touches/particle/step: 1.39415
Particle comm iterations/step: 1
Particle fraction communicated: 0.0198864
Particle fraction colliding with boundary: 0.00540975
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.0936923
Collisions/particle/step: 0.0701771
Reactions/particle/step: 0

Move  time (%) = 0.93484 (55.6077)
Coll  time (%) = 0.281466 (16.7426)
Sort  time (%) = 0.382354 (22.7438)
Comm  time (%) = 0.0753426 (4.48165)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00674725 (0.401351)
Other time (%) = 0.000384654 (0.0228806)

Particles: 56888.9 ave 57597 max 56402 min
Histogram: 4 7 12 10 15 13 7 1 2 1
Cells:      5688.89 ave 5690 max 5688 min
Histogram: 10 0 0 0 0 60 0 0 0 2
GhostCell: 3871.88 ave 6246 max 2087 min
Histogram: 6 4 8 15 11 12 8 4 3 1
EmptyCell: 1343.31 ave 2574 max 624 min
Histogram: 4 17 2 25 4 8 7 1 3 1