SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 1 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # flow around a sphere on a uniform grid # particles are created initially and input at boundaries at stream velocity variable x index 10 variable y index 10 variable z index 10 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*160 variable fnum equal 7.33e+21/v_n seed 12345 dimension 3 global nrho 7.03E18 global fnum ${fnum} global fnum 447387695312500 timestep 1.E-5 global gridcut 0.1 global surfmax 300 boundary o o o create_box -5.0 5.0 -5.0 5.0 -5.0 5.0 Created orthogonal box = (-5 -5 -5) to (5 5 5) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 160 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 1638400 child grid cells parent cells = 1 CPU time = 0.0426672 secs create/ghost percent = 42.3231 57.6769 balance_grid rcb cell Balance grid migrated 1625600 cells CPU time = 0.315848 secs reassign/sort/migrate/ghost percent = 43.7176 3.44945 18.5959 34.237 species ar.species Ar mixture air Ar frac 1.0 mixture air group species mixture air Ar vstream 2500.0 0.0 0.0 temp 300.00 fix in emit/face air all collide vss air ar.vss read_surf data.sphere 602 points 1200 triangles -1 1 xlo xhi -1 1 ylo yhi -1 1 zlo zhi 0.100631 min triangle edge length 0.00439601 min triangle area 2704 = cells with surfs 9720 = total surfs in all grid cells 8 = max surfs in one grid cell 0.80505 = min surf-size/cell-size ratio 0 0 = number of pushed cells 2704 0 = cells overlapping surfs, overlap cells with unmarked corner pts 1630252 5444 2704 = cells outside/inside/overlapping surfs 2704 = surf cells with 1,2,etc splits 995.862 995.862 = cell-wise and global flow volume CPU time = 0.243437 secs read/sort/check/surf2grid/ghost/inout/particle percent = 17.5121 1.33304 7.32345 51.5591 22.2723 28.3317 0.0550414 surf_collide 1 diffuse 300.0 1.0 surf_modify all collide 1 create_particles air n 0 Created 15648413 particles CPU time = 0.140136 secs fix 3 balance 100 1.1 rcb part collide_modify vremax 100 yes #compute 1 grid all all nrho mass u v w #fix 1 ave/grid 10 100 1000 c_1 ave running #dump 1 grid all 1000 tmp_flow.* id xc yc zc f_1 #compute 2 surf all all press ke #fix 2 ave/surf all 10 100 1000 c_2 ave running #dump 2 surf all 1000 tmp_surf.* id f_2 compute g grid all all n compute max reduce max c_g[1] stats_style step cpu np nattempt ncoll nscoll c_max stats 100 # equilibrate flow for 1000 steps # then benchmark for 1000 steps run 1000 WARNING: One or more fix inflow faces oppose streaming velocity (../fix_emit_face.cpp:195) Memory usage per proc in Mbytes: particles (ave,min,max) = 7.44173 7.44173 7.44173 grid (ave,min,max) = 2.60397 2.60397 2.60397 surf (ave,min,max) = 0.0778835 0.0778809 0.0778847 total (ave,min,max) = 10.1724 10.1724 10.1724 Step CPU Np Natt Ncoll Nscoll c_max 0 0 15648413 0 0 0 11 100 6.3149369 15645010 6185 5178 1756 122 200 13.250894 15682336 7854 6674 1935 136 300 19.278709 15811479 8453 7159 1981 131 400 25.97177 15975845 8633 7288 1984 134 500 32.353462 16102467 8699 7350 2007 143 600 38.784832 16165782 8673 7334 2031 135 700 45.5004 16196250 8743 7424 1961 138 800 51.635161 16210964 8612 7356 1975 136 900 58.107757 16214116 8877 7443 2070 132 1000 64.599603 16216718 8669 7378 1866 134 Loop time of 64.6007 on 256 procs for 1000 steps with 16216718 particles Particle moves = 16038663343 (16B) Cells touched = 21885588908 (21.9B) Particle comms = 296995922 (297M) Boundary collides = 0 (0K) Boundary exits = 44986384 (45M) SurfColl checks = 218152604 (218M) SurfColl occurs = 1929015 (1.93M) Surf reactions = 0 (0K) Collide attempts = 236174356 (236M) Collide occurs = 179752153 (180M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 969819 Particle-moves/step: 1.60387e+07 Cell-touches/particle/step: 1.36455 Particle comm iterations/step: 1 Particle fraction communicated: 0.0185175 Particle fraction colliding with boundary: 0 Particle fraction exiting boundary: 0.00280487 Surface-checks/particle/step: 0.0136017 Surface-collisions/particle/step: 0.000120273 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0147253 Collisions/particle/step: 0.0112074 Reactions/particle/step: 0 Move time (%) = 49.5474 (76.698) Coll time (%) = 2.27445 (3.52078) Sort time (%) = 7.89511 (12.2214) Comm time (%) = 2.90777 (4.50114) Modfy time (%) = 1.6891 (2.61468) Outpt time (%) = 0.271556 (0.420361) Other time (%) = 0.015289 (0.023667) Particles: 63346.6 ave 64623 max 62489 min Histogram: 4 11 47 70 71 27 19 5 1 1 Cells: 6400 ave 10345 max 3989 min Histogram: 4 9 38 75 118 0 0 7 1 4 GhostCell: 4240.37 ave 6839 max 2142 min Histogram: 7 18 24 57 51 53 27 13 3 3 EmptyCell: 0 ave 0 max 0 min Histogram: 256 0 0 0 0 0 0 0 0 0 collide_modify vremax 100 no run 1000 WARNING: One or more fix inflow faces oppose streaming velocity (../fix_emit_face.cpp:195) Memory usage per proc in Mbytes: particles (ave,min,max) = 7.56963 7.44173 15.6276 grid (ave,min,max) = 2.65572 2.60397 4.04147 surf (ave,min,max) = 0.0778835 0.0778809 0.0778847 total (ave,min,max) = 10.3521 10.154 18.3598 Step CPU Np Natt Ncoll Nscoll c_max 1000 0 16216718 8669 7378 0 134 1100 6.5024781 16218348 8763 7436 1981 142 1200 13.008401 16216823 8795 7492 1993 141 1300 19.500772 16216939 8721 7440 1976 142 1400 25.979033 16215783 8694 7344 1977 130 1500 32.46647 16215426 8796 7487 2010 131 1600 38.984622 16215625 8774 7422 2010 134 1700 45.47324 16214275 8737 7466 1891 130 1800 51.976921 16214458 8594 7334 1945 130 1900 58.456965 16216111 8735 7393 1913 129 2000 64.943577 16216893 8780 7480 2122 135 Loop time of 64.9446 on 256 procs for 1000 steps with 16216893 particles Particle moves = 16261347927 (16.3B) Cells touched = 22196254783 (22.2B) Particle comms = 303816716 (304M) Boundary collides = 0 (0K) Boundary exits = 45549581 (45.5M) SurfColl checks = 228907839 (229M) SurfColl occurs = 1984395 (1.98M) Surf reactions = 0 (0K) Collide attempts = 248932287 (249M) Collide occurs = 189496940 (189M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 978078 Particle-moves/step: 1.62613e+07 Cell-touches/particle/step: 1.36497 Particle comm iterations/step: 1 Particle fraction communicated: 0.0186834 Particle fraction colliding with boundary: 0 Particle fraction exiting boundary: 0.0028011 Surface-checks/particle/step: 0.0140768 Surface-collisions/particle/step: 0.000122031 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0153082 Collisions/particle/step: 0.0116532 Reactions/particle/step: 0 Move time (%) = 50.4231 (77.6402) Coll time (%) = 2.3363 (3.59738) Sort time (%) = 8.39589 (12.9278) Comm time (%) = 2.95143 (4.54454) Modfy time (%) = 0.549126 (0.845529) Outpt time (%) = 0.281531 (0.433494) Other time (%) = 0.00720284 (0.0110907) Particles: 63347.2 ave 64766 max 62229 min Histogram: 1 6 29 67 77 50 15 8 1 2 Cells: 6400 ave 10345 max 3989 min Histogram: 4 9 38 75 118 0 0 7 1 4 GhostCell: 4240.37 ave 6839 max 2142 min Histogram: 7 18 24 57 51 53 27 13 3 3 EmptyCell: 0 ave 0 max 0 min Histogram: 256 0 0 0 0 0 0 0 0 0