SPARTA (23 Dec 2017)
KOKKOS mode is enabled (../kokkos.cpp:39)
  using 0 GPU(s) per MPI task
  using 1 thread(s) per MPI task
package kokkos
package kokkos reduction parallel/reduce comm classic
# advect particles via VSS collisional flow on a uniform grid
# particles reflect off global box boundaries

variable            x index 10
variable            y index 10
variable            z index 10

variable            lx equal $x*1.0e-5
variable            lx equal 64*1.0e-5
variable            ly equal $y*1.0e-5
variable            ly equal 80*1.0e-5
variable            lz equal $z*1.0e-5
variable            lz equal 80*1.0e-5

variable            n equal 10*$x*$y*$z
variable            n equal 10*64*$y*$z
variable            n equal 10*64*80*$z
variable            n equal 10*64*80*80

seed	    	    12345
dimension   	    3
global              gridcut 1.0e-5

boundary	    rr rr rr

create_box  	    0 ${lx} 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 0.0008 0 ${lz}
create_box  	    0 0.00064 0 0.0008 0 0.0008
Created orthogonal box = (0 0 0) to (0.00064 0.0008 0.0008)
create_grid 	    $x $y $z
create_grid 	    64 $y $z
create_grid 	    64 80 $z
create_grid 	    64 80 80
WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381)
Created 409600 child grid cells
  parent cells = 1
  CPU time = 0.00719714 secs
  create/ghost percent = 70.0301 29.9699

balance_grid        rcb part
Balance grid migrated 403200 cells
  CPU time = 0.0506048 secs
  reassign/sort/migrate/ghost percent = 31.5856 0.74534 31.309 36.3601

species		    ar.species Ar
mixture		    air Ar vstream 0.0 0.0 0.0 temp 273.15

global              nrho 7.07043E22
global              fnum 7.07043E6

collide		    vss air ar.vss

create_particles    air n $n
create_particles    air n 4096000
Created 4096000 particles
  CPU time = 0.0486021 secs

stats		    100
compute             temp temp
stats_style	    step cpu np nattempt ncoll c_temp

# first equilibrate with large timestep to unsort particles
# then benchmark with normal timestep

timestep 	    7.00E-8
run                 30
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 7.44173 7.44173 7.44173
  grid      (ave,min,max) = 2.42208 1.51388 2.45138
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 9.86381 8.9556 9.8931
Step CPU Np Natt Ncoll c_temp 
       0            0  4096000        0        0    273.04308 
      30     1.620194  4096000  4110424  2892692    273.04308 
Loop time of 1.62022 on 64 procs for 30 steps with 4096000 particles

Particle moves    = 122880000 (123M)
Cells touched     = 608294839 (608M)
Particle comms    = 19128068 (19.1M)
Boundary collides = 6649695 (6.65M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 118974820 (119M)
Collide occurs    = 86384784 (86.4M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 1.18502e+06
Particle-moves/step: 4.096e+06
Cell-touches/particle/step: 4.95032
Particle comm iterations/step: 3.03333
Particle fraction communicated: 0.155665
Particle fraction colliding with boundary: 0.0541154
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.96822
Collisions/particle/step: 0.703001
Reactions/particle/step: 0

Move  time (%) = 0.693805 (42.8216)
Coll  time (%) = 0.529942 (32.708)
Sort  time (%) = 0.135287 (8.3499)
Comm  time (%) = 0.257212 (15.8751)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00389082 (0.240141)
Other time (%) = 8.45194e-05 (0.00521653)

Particles: 64000 ave 64489 max 63308 min
Histogram: 3 2 3 8 5 8 13 10 8 4
Cells:      6400 ave 6400 max 6400 min
Histogram: 64 0 0 0 0 0 0 0 0 0
GhostCell: 3433.69 ave 5120 max 1538 min
Histogram: 2 4 4 12 10 8 8 8 0 8
EmptyCell: 1555.09 ave 2808 max 441 min
Histogram: 2 10 0 20 0 14 6 6 4 2
timestep 	    7.00E-9
run 		    $t
run 		    100
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 7.44173 7.44173 7.44173
  grid      (ave,min,max) = 2.42208 1.51388 2.45138
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 9.86381 8.9556 9.8931
Step CPU Np Natt Ncoll c_temp 
      30            0  4096000  4110424  2892692    273.04308 
     100    1.3005478  4096000   392998   289331    273.04308 
     130     1.860703  4096000   398563   290202    273.04308 
Loop time of 1.86073 on 64 procs for 100 steps with 4096000 particles

Particle moves    = 409600000 (410M)
Cells touched     = 571021537 (571M)
Particle comms    = 6611667 (6.61M)
Boundary collides = 2216795 (2.22M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 38372095 (38.4M)
Collide occurs    = 28744633 (28.7M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 3.43951e+06
Particle-moves/step: 4.096e+06
Cell-touches/particle/step: 1.3941
Particle comm iterations/step: 1
Particle fraction communicated: 0.0161418
Particle fraction colliding with boundary: 0.0054121
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.0936819
Collisions/particle/step: 0.0701773
Reactions/particle/step: 0

Move  time (%) = 1.05158 (56.5142)
Coll  time (%) = 0.315039 (16.9309)
Sort  time (%) = 0.420719 (22.6104)
Comm  time (%) = 0.0655651 (3.52362)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00751234 (0.403731)
Other time (%) = 0.000318676 (0.0171264)

Particles: 64000 ave 64704 max 63444 min
Histogram: 1 3 8 18 16 7 7 1 1 2
Cells:      6400 ave 6400 max 6400 min
Histogram: 64 0 0 0 0 0 0 0 0 0
GhostCell: 3433.69 ave 5120 max 1538 min
Histogram: 2 4 4 12 10 8 8 8 0 8
EmptyCell: 1555.09 ave 2808 max 441 min
Histogram: 2 10 0 20 0 14 6 6 4 2