SPARTA (23 Dec 2017)
KOKKOS mode is enabled (../kokkos.cpp:39)
  using 0 GPU(s) per MPI task
  using 1 thread(s) per MPI task
package kokkos
package kokkos reduction parallel/reduce comm classic
# advect particles via VSS collisional flow on a uniform grid
# particles reflect off global box boundaries

variable            x index 10
variable            y index 10
variable            z index 10

variable            lx equal $x*1.0e-5
variable            lx equal 64*1.0e-5
variable            ly equal $y*1.0e-5
variable            ly equal 40*1.0e-5
variable            lz equal $z*1.0e-5
variable            lz equal 80*1.0e-5

variable            n equal 10*$x*$y*$z
variable            n equal 10*64*$y*$z
variable            n equal 10*64*40*$z
variable            n equal 10*64*40*80

seed	    	    12345
dimension   	    3
global              gridcut 1.0e-5

boundary	    rr rr rr

create_box  	    0 ${lx} 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 0.0004 0 ${lz}
create_box  	    0 0.00064 0 0.0004 0 0.0008
Created orthogonal box = (0 0 0) to (0.00064 0.0004 0.0008)
create_grid 	    $x $y $z
create_grid 	    64 $y $z
create_grid 	    64 40 $z
create_grid 	    64 40 80
WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381)
Created 204800 child grid cells
  parent cells = 1
  CPU time = 0.00625229 secs
  create/ghost percent = 77.3074 22.6926

balance_grid        rcb part
Balance grid migrated 201940 cells
  CPU time = 0.0276877 secs
  reassign/sort/migrate/ghost percent = 27.6319 0.425321 36.2102 35.7326

species		    ar.species Ar
mixture		    air Ar vstream 0.0 0.0 0.0 temp 273.15

global              nrho 7.07043E22
global              fnum 7.07043E6

collide		    vss air ar.vss

create_particles    air n $n
create_particles    air n 2048000
Created 2048000 particles
  CPU time = 0.0240581 secs

stats		    100
compute             temp temp
stats_style	    step cpu np nattempt ncoll c_temp

# first equilibrate with large timestep to unsort particles
# then benchmark with normal timestep

timestep 	    7.00E-8
run                 30
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 3.54371 3.54371 3.54371
  grid      (ave,min,max) = 1.51388 1.51388 1.51388
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 5.05759 5.05759 5.05759
Step CPU Np Natt Ncoll c_temp 
       0            0  2048000        0        0     272.9588 
      30   0.74472946  2048000  2054713  1445757     272.9588 
Loop time of 0.74465 on 72 procs for 30 steps with 2048000 particles

Particle moves    = 61440000 (61.4M)
Cells touched     = 303216064 (303M)
Particle comms    = 13243869 (13.2M)
Boundary collides = 4346272 (4.35M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 59490906 (59.5M)
Collide occurs    = 43197611 (43.2M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 1.14595e+06
Particle-moves/step: 2.048e+06
Cell-touches/particle/step: 4.93516
Particle comm iterations/step: 3.06667
Particle fraction communicated: 0.215558
Particle fraction colliding with boundary: 0.0707401
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.968276
Collisions/particle/step: 0.703086
Reactions/particle/step: 0

Move  time (%) = 0.293857 (39.4624)
Coll  time (%) = 0.223715 (30.043)
Sort  time (%) = 0.0635982 (8.54069)
Comm  time (%) = 0.161121 (21.6371)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00220944 (0.296709)
Other time (%) = 0.000148887 (0.0199943)

Particles: 28444.4 ave 28918 max 27889 min
Histogram: 1 0 3 12 14 17 14 6 3 2
Cells:      2844.44 ave 2846 max 2844 min
Histogram: 41 0 0 0 0 30 0 0 0 1
GhostCell: 2532.33 ave 4068 max 1476 min
Histogram: 5 8 16 8 15 7 8 3 0 2
EmptyCell: 939.153 ave 1544 max 240 min
Histogram: 2 4 11 2 9 16 8 12 3 5
timestep 	    7.00E-9
run 		    $t
run 		    100
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 3.54371 3.54371 3.54371
  grid      (ave,min,max) = 1.51388 1.51388 1.51388
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 5.05759 5.05759 5.05759
Step CPU Np Natt Ncoll c_temp 
      30            0  2048000  2054713  1445757     272.9588 
     100    0.5509127  2048000   196511   144498     272.9588 
     130   0.78753646  2048000   199008   144742     272.9588 
Loop time of 0.787631 on 72 procs for 100 steps with 2048000 particles

Particle moves    = 204800000 (205M)
Cells touched     = 285159929 (285M)
Particle comms    = 5395966 (5.4M)
Boundary collides = 1449161 (1.45M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 19184922 (19.2M)
Collide occurs    = 14368189 (14.4M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 3.61139e+06
Particle-moves/step: 2.048e+06
Cell-touches/particle/step: 1.39238
Particle comm iterations/step: 1
Particle fraction communicated: 0.0263475
Particle fraction colliding with boundary: 0.00707598
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.0936764
Collisions/particle/step: 0.0701572
Reactions/particle/step: 0

Move  time (%) = 0.398259 (50.5642)
Coll  time (%) = 0.121821 (15.4668)
Sort  time (%) = 0.20163 (25.5996)
Comm  time (%) = 0.0619168 (7.86114)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00367639 (0.466765)
Other time (%) = 0.000327378 (0.0415649)

Particles: 28444.4 ave 28823 max 27779 min
Histogram: 1 1 3 2 11 9 15 13 10 7
Cells:      2844.44 ave 2846 max 2844 min
Histogram: 41 0 0 0 0 30 0 0 0 1
GhostCell: 2532.33 ave 4068 max 1476 min
Histogram: 5 8 16 8 15 7 8 3 0 2
EmptyCell: 939.153 ave 1544 max 240 min
Histogram: 2 4 11 2 9 16 8 12 3 5