SPARTA (23 Dec 2017)
KOKKOS mode is enabled (../kokkos.cpp:39)
  using 0 GPU(s) per MPI task
  using 2 thread(s) per MPI task
package kokkos
package kokkos reduction parallel/reduce comm classic
# advect particles via VSS collisional flow on a uniform grid
# particles reflect off global box boundaries

variable            x index 10
variable            y index 10
variable            z index 10

variable            lx equal $x*1.0e-5
variable            lx equal 32*1.0e-5
variable            ly equal $y*1.0e-5
variable            ly equal 40*1.0e-5
variable            lz equal $z*1.0e-5
variable            lz equal 40*1.0e-5

variable            n equal 10*$x*$y*$z
variable            n equal 10*32*$y*$z
variable            n equal 10*32*40*$z
variable            n equal 10*32*40*40

seed	    	    12345
dimension   	    3
global              gridcut 1.0e-5

boundary	    rr rr rr

create_box  	    0 ${lx} 0 ${ly} 0 ${lz}
create_box  	    0 0.00032 0 ${ly} 0 ${lz}
create_box  	    0 0.00032 0 0.0004 0 ${lz}
create_box  	    0 0.00032 0 0.0004 0 0.0004
Created orthogonal box = (0 0 0) to (0.00032 0.0004 0.0004)
create_grid 	    $x $y $z
create_grid 	    32 $y $z
create_grid 	    32 40 $z
create_grid 	    32 40 40
WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381)
Created 51200 child grid cells
  parent cells = 1
  CPU time = 0.00400186 secs
  create/ghost percent = 75.1623 24.8377

balance_grid        rcb part
Balance grid migrated 49600 cells
  CPU time = 0.0213349 secs
  reassign/sort/migrate/ghost percent = 50.8923 0.0849304 27.9913 21.0315

species		    ar.species Ar
mixture		    air Ar vstream 0.0 0.0 0.0 temp 273.15

global              nrho 7.07043E22
global              fnum 7.07043E6

collide		    vss air ar.vss

create_particles    air n $n
create_particles    air n 512000
Created 512000 particles
  CPU time = 0.014128 secs

stats		    100
compute             temp temp
stats_style	    step cpu np nattempt ncoll c_temp

# first equilibrate with large timestep to unsort particles
# then benchmark with normal timestep

timestep 	    7.00E-8
run                 30
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 1.6875 1.6875 1.6875
  grid      (ave,min,max) = 1.51388 1.51388 1.51388
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 3.20138 3.20138 3.20138
Step CPU Np Natt Ncoll c_temp 
       0            0   512000        0        0      273.689 
      30   0.15740108   512000   513584   361507      273.689 
Loop time of 0.157424 on 32 procs for 30 steps with 512000 particles

Particle moves    = 15360000 (15.4M)
Cells touched     = 75346397 (75.3M)
Particle comms    = 3504039 (3.5M)
Boundary collides = 1663984 (1.66M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 14875589 (14.9M)
Collide occurs    = 10801334 (10.8M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 3.0491e+06
Particle-moves/step: 512000
Cell-touches/particle/step: 4.90536
Particle comm iterations/step: 3
Particle fraction communicated: 0.228128
Particle fraction colliding with boundary: 0.108332
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.968463
Collisions/particle/step: 0.703212
Reactions/particle/step: 0

Move  time (%) = 0.0665074 (42.2474)
Coll  time (%) = 0.0514762 (32.6992)
Sort  time (%) = 0.0120506 (7.65485)
Comm  time (%) = 0.0270858 (17.2057)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.000261694 (0.166236)
Other time (%) = 4.20362e-05 (0.0267026)

Particles: 16000 ave 16297 max 15781 min
Histogram: 1 7 3 4 7 4 2 0 2 2
Cells:      1600 ave 1600 max 1600 min
Histogram: 32 0 0 0 0 0 0 0 0 0
GhostCell: 1326.12 ave 1928 max 992 min
Histogram: 8 0 8 0 10 0 0 4 0 2
EmptyCell: 677.875 ave 1080 max 535 min
Histogram: 16 2 0 0 8 4 0 0 0 2
timestep 	    7.00E-9
run 		    $t
run 		    100
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 1.6875 1.6875 1.6875
  grid      (ave,min,max) = 1.51388 1.51388 1.51388
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 3.20138 3.20138 3.20138
Step CPU Np Natt Ncoll c_temp 
      30            0   512000   513584   361507      273.689 
     100  0.069573164   512000    49160    36266      273.689 
     130  0.099318981   512000    49856    36239      273.689 
Loop time of 0.0993357 on 32 procs for 100 steps with 512000 particles

Particle moves    = 51200000 (51.2M)
Cells touched     = 71120964 (71.1M)
Particle comms    = 1228449 (1.23M)
Boundary collides = 555084 (0.555M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 4798252 (4.8M)
Collide occurs    = 3594187 (3.59M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 1.6107e+07
Particle-moves/step: 512000
Cell-touches/particle/step: 1.38908
Particle comm iterations/step: 1
Particle fraction communicated: 0.0239931
Particle fraction colliding with boundary: 0.0108415
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.0937159
Collisions/particle/step: 0.070199
Reactions/particle/step: 0

Move  time (%) = 0.0441688 (44.4642)
Coll  time (%) = 0.0224602 (22.6104)
Sort  time (%) = 0.0214434 (21.5868)
Comm  time (%) = 0.0109451 (11.0183)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.000230588 (0.23213)
Other time (%) = 8.76337e-05 (0.0882198)

Particles: 16000 ave 16237 max 15654 min
Histogram: 1 2 1 3 5 4 3 6 3 4
Cells:      1600 ave 1600 max 1600 min
Histogram: 32 0 0 0 0 0 0 0 0 0
GhostCell: 1326.12 ave 1928 max 992 min
Histogram: 8 0 8 0 10 0 0 4 0 2
EmptyCell: 677.875 ave 1080 max 535 min
Histogram: 16 2 0 0 8 4 0 0 0 2