SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 8 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # flow around a sphere on a uniform grid # particles are created initially and input at boundaries at stream velocity variable x index 10 variable y index 10 variable z index 10 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*80 variable fnum equal 7.33e+21/v_n seed 12345 dimension 3 global nrho 7.03E18 global fnum ${fnum} global fnum 894775390625000 timestep 1.E-5 global gridcut 0.1 global surfmax 300 boundary o o o create_box -5.0 5.0 -5.0 5.0 -5.0 5.0 Created orthogonal box = (-5 -5 -5) to (5 5 5) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 80 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 819200 child grid cells parent cells = 1 CPU time = 0.0244012 secs create/ghost percent = 37.4778 62.5222 balance_grid rcb cell Balance grid migrated 816000 cells CPU time = 0.170279 secs reassign/sort/migrate/ghost percent = 56.2624 4.39512 15.7642 23.5783 species ar.species Ar mixture air Ar frac 1.0 mixture air group species mixture air Ar vstream 2500.0 0.0 0.0 temp 300.00 fix in emit/face air all collide vss air ar.vss read_surf data.sphere 602 points 1200 triangles -1 1 xlo xhi -1 1 ylo yhi -1 1 zlo zhi 0.100631 min triangle edge length 0.00439601 min triangle area 1664 = cells with surfs 7464 = total surfs in all grid cells 10 = max surfs in one grid cell 0.80505 = min surf-size/cell-size ratio 0 0 = number of pushed cells 1664 0 = cells overlapping surfs, overlap cells with unmarked corner pts 814972 2564 1664 = cells outside/inside/overlapping surfs 1664 = surf cells with 1,2,etc splits 995.862 995.862 = cell-wise and global flow volume CPU time = 0.0913489 secs read/sort/check/surf2grid/ghost/inout/particle percent = 26.1556 0.270394 10.4282 52.7296 10.4162 26.2368 0.0349737 surf_collide 1 diffuse 300.0 1.0 surf_modify all collide 1 create_particles air n 0 Created 7824206 particles CPU time = 0.039938 secs fix 3 balance 100 1.1 rcb part collide_modify vremax 100 yes #compute 1 grid all all nrho mass u v w #fix 1 ave/grid 10 100 1000 c_1 ave running #dump 1 grid all 1000 tmp_flow.* id xc yc zc f_1 #compute 2 surf all all press ke #fix 2 ave/surf all 10 100 1000 c_2 ave running #dump 2 surf all 1000 tmp_surf.* id f_2 compute g grid all all n compute max reduce max c_g[1] stats_style step cpu np nattempt ncoll nscoll c_max stats 100 # equilibrate flow for 1000 steps # then benchmark for 1000 steps run 1000 WARNING: One or more fix inflow faces oppose streaming velocity (../fix_emit_face.cpp:195) Memory usage per proc in Mbytes: particles (ave,min,max) = 1.6875 1.6875 1.6875 grid (ave,min,max) = 1.66647 1.66647 1.66647 surf (ave,min,max) = 0.0778745 0.0778732 0.077877 total (ave,min,max) = 3.44405 3.44405 3.44405 Step CPU Np Natt Ncoll Nscoll c_max 0 0 7824206 0 0 0 11 100 0.50462508 7821594 3055 2564 972 125 200 1.0059719 7839260 3951 3398 967 125 300 1.465029 7903142 4172 3572 967 123 400 1.8566351 7986550 4269 3644 1023 132 500 2.3169529 8052291 4260 3656 963 128 600 2.7042489 8087051 4298 3685 971 130 700 3.082154 8102649 4279 3635 953 123 800 3.4540601 8108645 4326 3695 996 117 900 3.866302 8107541 4382 3751 946 129 1000 4.255471 8108835 4339 3664 1023 121 Loop time of 4.25569 on 512 procs for 1000 steps with 8108835 particles Particle moves = 8020122266 (8.02B) Cells touched = 10794902995 (10.8B) Particle comms = 199270609 (199M) Boundary collides = 0 (0K) Boundary exits = 22487428 (22.5M) SurfColl checks = 153386593 (153M) SurfColl occurs = 967603 (0.968M) Surf reactions = 0 (0K) Collide attempts = 118060246 (118M) Collide occurs = 89897975 (89.9M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 3.68079e+06 Particle-moves/step: 8.02012e+06 Cell-touches/particle/step: 1.34598 Particle comm iterations/step: 1 Particle fraction communicated: 0.0248463 Particle fraction colliding with boundary: 0 Particle fraction exiting boundary: 0.00280388 Surface-checks/particle/step: 0.0191252 Surface-collisions/particle/step: 0.000120647 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0147205 Collisions/particle/step: 0.0112091 Reactions/particle/step: 0 Move time (%) = 2.12947 (50.0383) Coll time (%) = 0.192077 (4.51341) Sort time (%) = 0.355214 (8.34681) Comm time (%) = 0.92583 (21.7551) Modfy time (%) = 0.616287 (14.4815) Outpt time (%) = 0.0260912 (0.613091) Other time (%) = 0.0107191 (0.251877) Particles: 15837.6 ave 16420 max 15310 min Histogram: 3 12 43 98 140 110 63 34 7 2 Cells: 1600 ave 3258 max 844 min Histogram: 4 38 105 347 6 0 0 2 6 4 GhostCell: 1426.12 ave 2610 max 608 min Histogram: 7 31 76 151 111 75 41 14 5 1 EmptyCell: 0 ave 0 max 0 min Histogram: 512 0 0 0 0 0 0 0 0 0 collide_modify vremax 100 no run 1000 WARNING: One or more fix inflow faces oppose streaming velocity (../fix_emit_face.cpp:195) Memory usage per proc in Mbytes: particles (ave,min,max) = 2.18056 1.6875 3.54371 grid (ave,min,max) = 1.66647 1.66647 1.66647 surf (ave,min,max) = 0.0778745 0.0778732 0.077877 total (ave,min,max) = 3.9371 3.44031 5.31254 Step CPU Np Natt Ncoll Nscoll c_max 1000 0 8108835 4339 3664 0 121 1100 0.38326788 8110033 4405 3754 1010 143 1200 0.75581288 8112718 4338 3713 938 124 1300 1.1316159 8113460 4387 3752 1016 132 1400 1.5023799 8113498 4373 3714 992 119 1500 1.8721731 8111855 4296 3656 987 128 1600 2.2345641 8110435 4300 3674 1014 124 1700 2.601831 8112524 4393 3721 969 143 1800 2.9735501 8111823 4366 3699 1023 130 1900 3.3343029 8112978 4399 3764 990 130 2000 3.697073 8112461 4386 3717 1013 131 Loop time of 3.69734 on 512 procs for 1000 steps with 8112461 particles Particle moves = 8134744676 (8.13B) Cells touched = 10943987467 (10.9B) Particle comms = 207646223 (208M) Boundary collides = 0 (0K) Boundary exits = 22771452 (22.8M) SurfColl checks = 161621554 (162M) SurfColl occurs = 997510 (0.998M) Surf reactions = 0 (0K) Collide attempts = 124613522 (125M) Collide occurs = 94884156 (94.9M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 4.29719e+06 Particle-moves/step: 8.13474e+06 Cell-touches/particle/step: 1.34534 Particle comm iterations/step: 1 Particle fraction communicated: 0.0255258 Particle fraction colliding with boundary: 0 Particle fraction exiting boundary: 0.00279928 Surface-checks/particle/step: 0.0198681 Surface-collisions/particle/step: 0.000122623 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0153187 Collisions/particle/step: 0.0116641 Reactions/particle/step: 0 Move time (%) = 1.99014 (53.8263) Coll time (%) = 0.192202 (5.19839) Sort time (%) = 0.355832 (9.62399) Comm time (%) = 0.759512 (20.5421) Modfy time (%) = 0.372638 (10.0785) Outpt time (%) = 0.0191627 (0.518285) Other time (%) = 0.00785115 (0.212346) Particles: 15844.7 ave 16359 max 15234 min Histogram: 3 3 15 56 113 158 96 41 23 4 Cells: 1600 ave 3258 max 844 min Histogram: 4 38 105 347 6 0 0 2 6 4 GhostCell: 1426.12 ave 2610 max 608 min Histogram: 7 31 76 151 111 75 41 14 5 1 EmptyCell: 0 ave 0 max 0 min Histogram: 512 0 0 0 0 0 0 0 0 0