SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 2 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # flow around a sphere on a uniform grid # particles are created initially and input at boundaries at stream velocity variable x index 10 variable y index 10 variable z index 10 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*80 variable fnum equal 7.33e+21/v_n seed 12345 dimension 3 global nrho 7.03E18 global fnum ${fnum} global fnum 894775390625000 timestep 1.E-5 global gridcut 0.1 global surfmax 300 boundary o o o create_box -5.0 5.0 -5.0 5.0 -5.0 5.0 Created orthogonal box = (-5 -5 -5) to (5 5 5) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 80 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 819200 child grid cells parent cells = 1 CPU time = 0.00610113 secs create/ghost percent = 71.1684 28.8316 balance_grid rcb cell Balance grid migrated 806400 cells CPU time = 0.050792 secs reassign/sort/migrate/ghost percent = 38.3581 1.63821 38.6773 21.3263 species ar.species Ar mixture air Ar frac 1.0 mixture air group species mixture air Ar vstream 2500.0 0.0 0.0 temp 300.00 fix in emit/face air all collide vss air ar.vss read_surf data.sphere 602 points 1200 triangles -1 1 xlo xhi -1 1 ylo yhi -1 1 zlo zhi 0.100631 min triangle edge length 0.00439601 min triangle area 1664 = cells with surfs 7464 = total surfs in all grid cells 10 = max surfs in one grid cell 0.80505 = min surf-size/cell-size ratio 0 0 = number of pushed cells 1664 0 = cells overlapping surfs, overlap cells with unmarked corner pts 814972 2564 1664 = cells outside/inside/overlapping surfs 1664 = surf cells with 1,2,etc splits 995.862 995.862 = cell-wise and global flow volume CPU time = 0.0358698 secs read/sort/check/surf2grid/ghost/inout/particle percent = 21.929 1.10935 7.52215 48.7341 20.7054 11.5754 0.0166169 surf_collide 1 diffuse 300.0 1.0 surf_modify all collide 1 create_particles air n 0 Created 7824206 particles CPU time = 0.0326879 secs fix 3 balance 100 1.1 rcb part collide_modify vremax 100 yes #compute 1 grid all all nrho mass u v w #fix 1 ave/grid 10 100 1000 c_1 ave running #dump 1 grid all 1000 tmp_flow.* id xc yc zc f_1 #compute 2 surf all all press ke #fix 2 ave/surf all 10 100 1000 c_2 ave running #dump 2 surf all 1000 tmp_surf.* id f_2 compute g grid all all n compute max reduce max c_g[1] stats_style step cpu np nattempt ncoll nscoll c_max stats 100 # equilibrate flow for 1000 steps # then benchmark for 1000 steps run 1000 WARNING: One or more fix inflow faces oppose streaming velocity (../fix_emit_face.cpp:195) Memory usage per proc in Mbytes: particles (ave,min,max) = 7.44173 7.44173 7.44173 grid (ave,min,max) = 2.54537 1.66647 2.60397 surf (ave,min,max) = 0.0779014 0.0778999 0.0779037 total (ave,min,max) = 10.1138 9.23492 10.1724 Step CPU Np Natt Ncoll Nscoll c_max 0 0 7824206 0 0 0 11 100 0.95974207 7821987 3037 2525 971 117 200 1.8973131 7841441 3837 3277 933 126 300 2.7582371 7905464 4152 3514 936 139 400 3.6129439 7988735 4303 3664 1001 143 500 4.5327699 8052961 4291 3677 1054 119 600 5.4267371 8085739 4313 3675 969 132 700 6.2713759 8102081 4383 3715 1032 131 800 7.104363 8107314 4319 3693 949 136 900 7.9420569 8109565 4328 3676 999 139 1000 8.783134 8108476 4378 3742 980 133 Loop time of 8.7833 on 128 procs for 1000 steps with 8108476 particles Particle moves = 8020632682 (8.02B) Cells touched = 10795423030 (10.8B) Particle comms = 132953213 (133M) Boundary collides = 0 (0K) Boundary exits = 22489847 (22.5M) SurfColl checks = 153384955 (153M) SurfColl occurs = 967252 (0.967M) Surf reactions = 0 (0K) Collide attempts = 118084262 (118M) Collide occurs = 89899806 (89.9M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 7.13413e+06 Particle-moves/step: 8.02063e+06 Cell-touches/particle/step: 1.34596 Particle comm iterations/step: 1 Particle fraction communicated: 0.0165764 Particle fraction colliding with boundary: 0 Particle fraction exiting boundary: 0.002804 Surface-checks/particle/step: 0.0191238 Surface-collisions/particle/step: 0.000120595 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0147226 Collisions/particle/step: 0.0112086 Reactions/particle/step: 0 Move time (%) = 4.99336 (56.8506) Coll time (%) = 0.376177 (4.28287) Sort time (%) = 2.48115 (28.2485) Comm time (%) = 0.586712 (6.67985) Modfy time (%) = 0.306671 (3.49152) Outpt time (%) = 0.0360012 (0.409882) Other time (%) = 0.00323274 (0.0368055) Particles: 63347.5 ave 66214 max 62253 min Histogram: 8 47 38 9 12 4 6 0 1 3 Cells: 6400 ave 9807 max 4585 min Histogram: 4 5 24 86 4 1 0 1 0 3 GhostCell: 3236.76 ave 5272 max 1662 min Histogram: 6 12 17 18 30 20 8 11 4 2 EmptyCell: 0 ave 0 max 0 min Histogram: 128 0 0 0 0 0 0 0 0 0 collide_modify vremax 100 no run 1000 WARNING: One or more fix inflow faces oppose streaming velocity (../fix_emit_face.cpp:195) Memory usage per proc in Mbytes: particles (ave,min,max) = 7.44173 7.44173 7.44173 grid (ave,min,max) = 2.63131 2.60397 3.10397 surf (ave,min,max) = 0.0779014 0.0778999 0.0779037 total (ave,min,max) = 10.1998 10.1586 10.6984 Step CPU Np Natt Ncoll Nscoll c_max 1000 0 8108476 4378 3742 0 133 1100 0.83976889 8111260 4339 3674 1016 122 1200 1.6769459 8113263 4298 3660 1016 127 1300 2.5169089 8113177 4296 3682 945 130 1400 3.3535359 8112295 4338 3713 943 133 1500 4.1911159 8112114 4234 3655 946 120 1600 5.029264 8113075 4294 3662 957 130 1700 5.867733 8110524 4291 3694 994 119 1800 6.7085149 8111603 4371 3709 988 122 1900 7.54561 8112084 4297 3685 979 118 2000 8.3823178 8110968 4293 3663 986 133 Loop time of 8.38246 on 128 procs for 1000 steps with 8110968 particles Particle moves = 8134682822 (8.13B) Cells touched = 10943789428 (10.9B) Particle comms = 130645731 (131M) Boundary collides = 0 (0K) Boundary exits = 22773739 (22.8M) SurfColl checks = 160925789 (161M) SurfColl occurs = 993099 (0.993M) Surf reactions = 0 (0K) Collide attempts = 124499528 (124M) Collide occurs = 94808161 (94.8M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 7.58157e+06 Particle-moves/step: 8.13468e+06 Cell-touches/particle/step: 1.34532 Particle comm iterations/step: 1 Particle fraction communicated: 0.0160603 Particle fraction colliding with boundary: 0 Particle fraction exiting boundary: 0.00279959 Surface-checks/particle/step: 0.0197827 Surface-collisions/particle/step: 0.000122082 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0153048 Collisions/particle/step: 0.0116548 Reactions/particle/step: 0 Move time (%) = 4.79874 (57.2473) Coll time (%) = 0.38633 (4.60879) Sort time (%) = 2.49731 (29.792) Comm time (%) = 0.545565 (6.50841) Modfy time (%) = 0.114026 (1.3603) Outpt time (%) = 0.0377864 (0.450779) Other time (%) = 0.00271329 (0.0323686) Particles: 63366.9 ave 66214 max 62358 min Histogram: 10 61 23 7 12 8 3 1 0 3 Cells: 6400 ave 9807 max 4585 min Histogram: 4 5 24 86 4 1 0 1 0 3 GhostCell: 3236.76 ave 5272 max 1662 min Histogram: 6 12 17 18 30 20 8 11 4 2 EmptyCell: 0 ave 0 max 0 min Histogram: 128 0 0 0 0 0 0 0 0 0