SPARTA (23 Dec 2017)
KOKKOS mode is enabled (../kokkos.cpp:39)
  using 0 GPU(s) per MPI task
  using 2 thread(s) per MPI task
package kokkos
package kokkos reduction parallel/reduce comm classic
# advect particles via VSS collisional flow on a uniform grid
# particles reflect off global box boundaries

variable            x index 10
variable            y index 10
variable            z index 10

variable            lx equal $x*1.0e-5
variable            lx equal 64*1.0e-5
variable            ly equal $y*1.0e-5
variable            ly equal 40*1.0e-5
variable            lz equal $z*1.0e-5
variable            lz equal 80*1.0e-5

variable            n equal 10*$x*$y*$z
variable            n equal 10*64*$y*$z
variable            n equal 10*64*40*$z
variable            n equal 10*64*40*80

seed	    	    12345
dimension   	    3
global              gridcut 1.0e-5

boundary	    rr rr rr

create_box  	    0 ${lx} 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 ${ly} 0 ${lz}
create_box  	    0 0.00064 0 0.0004 0 ${lz}
create_box  	    0 0.00064 0 0.0004 0 0.0008
Created orthogonal box = (0 0 0) to (0.00064 0.0004 0.0008)
create_grid 	    $x $y $z
create_grid 	    64 $y $z
create_grid 	    64 40 $z
create_grid 	    64 40 80
WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381)
Created 204800 child grid cells
  parent cells = 1
  CPU time = 0.00740619 secs
  create/ghost percent = 84.427 15.573

balance_grid        rcb part
Balance grid migrated 179200 cells
  CPU time = 0.0539722 secs
  reassign/sort/migrate/ghost percent = 15.3901 0.757855 29.3796 54.4724

species		    ar.species Ar
mixture		    air Ar vstream 0.0 0.0 0.0 temp 273.15

global              nrho 7.07043E22
global              fnum 7.07043E6

collide		    vss air ar.vss

create_particles    air n $n
create_particles    air n 2048000
Created 2048000 particles
  CPU time = 0.0811579 secs

stats		    100
compute             temp temp
stats_style	    step cpu np nattempt ncoll c_temp

# first equilibrate with large timestep to unsort particles
# then benchmark with normal timestep

timestep 	    7.00E-8
run                 30
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 32.8179 32.8179 32.8179
  grid      (ave,min,max) = 5.82638 5.82638 5.82638
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 38.6443 38.6443 38.6443
Step CPU Np Natt Ncoll c_temp 
       0            0  2048000        0        0    273.17562 
      30    2.7503648  2048000  2054399  1447332    273.17562 
Loop time of 2.64198 on 8 procs for 30 steps with 2048000 particles

Particle moves    = 61440000 (61.4M)
Cells touched     = 302911670 (303M)
Particle comms    = 4299817 (4.3M)
Boundary collides = 4346997 (4.35M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 59499177 (59.5M)
Collide occurs    = 43202380 (43.2M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 2.90691e+06
Particle-moves/step: 2.048e+06
Cell-touches/particle/step: 4.9302
Particle comm iterations/step: 3
Particle fraction communicated: 0.069984
Particle fraction colliding with boundary: 0.0707519
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.968411
Collisions/particle/step: 0.703164
Reactions/particle/step: 0

Move  time (%) = 1.16448 (44.0761)
Coll  time (%) = 0.970087 (36.7181)
Sort  time (%) = 0.323412 (12.2413)
Comm  time (%) = 0.180364 (6.82685)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00347236 (0.13143)
Other time (%) = 0.000164592 (0.00622987)

Particles: 256000 ave 256914 max 254811 min
Histogram: 1 1 0 1 0 0 2 1 1 1
Cells:      25600 ave 25600 max 25600 min
Histogram: 8 0 0 0 0 0 0 0 0 0
GhostCell: 5340 ave 7040 max 2960 min
Histogram: 2 0 0 2 0 0 0 0 0 4
EmptyCell: 2230 ave 3600 max 840 min
Histogram: 2 0 0 0 2 2 0 0 0 2
timestep 	    7.00E-9
run 		    $t
run 		    100
Memory usage per proc in Mbytes:
  particles (ave,min,max) = 32.8179 32.8179 32.8179
  grid      (ave,min,max) = 5.82638 5.82638 5.82638
  surf      (ave,min,max) = 0 0 0
  total     (ave,min,max) = 38.6443 38.6443 38.6443
Step CPU Np Natt Ncoll c_temp 
      30            0  2048000  2054399  1447332    273.17562 
     100    2.1071093  2048000   196388   144512    273.17562 
     130    3.0197326  2048000   199476   145134    273.17562 
Loop time of 2.90082 on 8 procs for 100 steps with 2048000 particles

Particle moves    = 204800000 (205M)
Cells touched     = 285201895 (285M)
Particle comms    = 1448133 (1.45M)
Boundary collides = 1447884 (1.45M)
Boundary exits    = 0 (0K)
SurfColl checks   = 0 (0K)
SurfColl occurs   = 0 (0K)
Surf reactions    = 0 (0K)
Collide attempts  = 19185276 (19.2M)
Collide occurs    = 14373191 (14.4M)
Reactions         = 0 (0K)
Particles stuck   = 0

Particle-moves/CPUsec/proc: 8.82509e+06
Particle-moves/step: 2.048e+06
Cell-touches/particle/step: 1.39259
Particle comm iterations/step: 1
Particle fraction communicated: 0.00707096
Particle fraction colliding with boundary: 0.00706975
Particle fraction exiting boundary: 0
Surface-checks/particle/step: 0
Surface-collisions/particle/step: 0
Surf-reactions/particle/step: 0
Collision-attempts/particle/step: 0.0936781
Collisions/particle/step: 0.0701816
Reactions/particle/step: 0

Move  time (%) = 1.27718 (44.0282)
Coll  time (%) = 0.523341 (18.0411)
Sort  time (%) = 1.02904 (35.4742)
Comm  time (%) = 0.0628325 (2.16603)
Modfy time (%) = 0 (0)
Outpt time (%) = 0.00777665 (0.268085)
Other time (%) = 0.000646256 (0.0222784)

Particles: 256000 ave 256530 max 255443 min
Histogram: 1 0 1 2 1 0 1 0 0 2
Cells:      25600 ave 25600 max 25600 min
Histogram: 8 0 0 0 0 0 0 0 0 0
GhostCell: 5340 ave 7040 max 2960 min
Histogram: 2 0 0 2 0 0 0 0 0 4
EmptyCell: 2230 ave 3600 max 840 min
Histogram: 2 0 0 0 2 2 0 0 0 2