SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 2 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # flow around a sphere on a uniform grid # particles are created initially and input at boundaries at stream velocity variable x index 10 variable y index 10 variable z index 10 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*80 variable fnum equal 7.33e+21/v_n seed 12345 dimension 3 global nrho 7.03E18 global fnum ${fnum} global fnum 894775390625000 timestep 1.E-5 global gridcut 0.1 global surfmax 300 boundary o o o create_box -5.0 5.0 -5.0 5.0 -5.0 5.0 Created orthogonal box = (-5 -5 -5) to (5 5 5) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 80 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 819200 child grid cells parent cells = 1 CPU time = 0.0182587 secs create/ghost percent = 55.5541 44.4459 balance_grid rcb cell Balance grid migrated 806400 cells CPU time = 0.0934016 secs reassign/sort/migrate/ghost percent = 35.6577 6.57632 35.9549 21.8111 species ar.species Ar mixture air Ar frac 1.0 mixture air group species mixture air Ar vstream 2500.0 0.0 0.0 temp 300.00 fix in emit/face air all collide vss air ar.vss read_surf data.sphere 602 points 1200 triangles -1 1 xlo xhi -1 1 ylo yhi -1 1 zlo zhi 0.100631 min triangle edge length 0.00439601 min triangle area 1664 = cells with surfs 7464 = total surfs in all grid cells 10 = max surfs in one grid cell 0.80505 = min surf-size/cell-size ratio 0 0 = number of pushed cells 1664 0 = cells overlapping surfs, overlap cells with unmarked corner pts 814972 2564 1664 = cells outside/inside/overlapping surfs 1664 = surf cells with 1,2,etc splits 995.862 995.862 = cell-wise and global flow volume CPU time = 0.0571397 secs read/sort/check/surf2grid/ghost/inout/particle percent = 26.1401 6.95605 9.94307 47.0023 9.95849 4.42429 0.0250908 surf_collide 1 diffuse 300.0 1.0 surf_modify all collide 1 create_particles air n 0 Created 7824206 particles CPU time = 0.0212505 secs fix 3 balance 100 1.1 rcb part collide_modify vremax 100 yes #compute 1 grid all all nrho mass u v w #fix 1 ave/grid 10 100 1000 c_1 ave running #dump 1 grid all 1000 tmp_flow.* id xc yc zc f_1 #compute 2 surf all all press ke #fix 2 ave/surf all 10 100 1000 c_2 ave running #dump 2 surf all 1000 tmp_surf.* id f_2 compute g grid all all n compute max reduce max c_g[1] stats_style step cpu np nattempt ncoll nscoll c_max stats 100 # equilibrate flow for 1000 steps # then benchmark for 1000 steps run 1000 WARNING: One or more fix inflow faces oppose streaming velocity (../fix_emit_face.cpp:195) Memory usage per proc in Mbytes: particles (ave,min,max) = 7.44173 7.44173 7.44173 grid (ave,min,max) = 2.54537 1.66647 2.60397 surf (ave,min,max) = 0.0779014 0.0778999 0.0779037 total (ave,min,max) = 10.1138 9.23492 10.1724 Step CPU Np Natt Ncoll Nscoll c_max 0 0 7824206 0 0 0 11 100 0.56037265 7820979 3040 2567 900 117 200 1.1166195 7839875 3843 3255 939 119 300 1.6061237 7904850 4151 3563 961 131 400 2.0938298 7987591 4289 3667 1010 129 500 2.6327175 8052898 4329 3690 979 132 600 3.1322479 8087931 4401 3725 937 132 700 3.6291339 8099910 4312 3652 1024 130 800 4.1189539 8106435 4299 3672 974 133 900 4.6016904 8110748 4219 3669 952 133 1000 5.0793062 8109484 4291 3639 983 136 Loop time of 4.98531 on 128 procs for 1000 steps with 8109484 particles Particle moves = 8020364311 (8.02B) Cells touched = 10795045560 (10.8B) Particle comms = 135232126 (135M) Boundary collides = 0 (0K) Boundary exits = 22489679 (22.5M) SurfColl checks = 153223381 (153M) SurfColl occurs = 966313 (0.966M) Surf reactions = 0 (0K) Collide attempts = 118068847 (118M) Collide occurs = 89885237 (89.9M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.25687e+07 Particle-moves/step: 8.02036e+06 Cell-touches/particle/step: 1.34595 Particle comm iterations/step: 1 Particle fraction communicated: 0.0168611 Particle fraction colliding with boundary: 0 Particle fraction exiting boundary: 0.00280407 Surface-checks/particle/step: 0.0191043 Surface-collisions/particle/step: 0.000120482 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0147211 Collisions/particle/step: 0.0112071 Reactions/particle/step: 0 Move time (%) = 2.48716 (49.8897) Coll time (%) = 0.236364 (4.7412) Sort time (%) = 1.46181 (29.3223) Comm time (%) = 0.476448 (9.55703) Modfy time (%) = 0.292989 (5.87705) Outpt time (%) = 0.0258429 (0.51838) Other time (%) = 0.00469956 (0.0942681) Particles: 63355.3 ave 66286 max 62366 min Histogram: 20 52 24 7 9 7 3 2 0 4 Cells: 6400 ave 9802 max 4550 min Histogram: 4 5 22 88 4 1 0 1 0 3 GhostCell: 3203.55 ave 5304 max 1801 min Histogram: 8 12 19 33 18 16 10 11 0 1 EmptyCell: 0 ave 0 max 0 min Histogram: 128 0 0 0 0 0 0 0 0 0 collide_modify vremax 100 no run 1000 WARNING: One or more fix inflow faces oppose streaming velocity (../fix_emit_face.cpp:195) Memory usage per proc in Mbytes: particles (ave,min,max) = 7.44173 7.44173 7.44173 grid (ave,min,max) = 2.63131 2.60397 3.10397 surf (ave,min,max) = 0.0779014 0.0778999 0.0779037 total (ave,min,max) = 10.1998 10.1583 10.6984 Step CPU Np Natt Ncoll Nscoll c_max 1000 0 8109484 4291 3639 0 136 1100 0.5055404 8109838 4314 3655 957 129 1200 0.98443282 8110133 4309 3703 959 127 1300 1.454897 8109797 4278 3667 978 140 1400 1.931908 8111111 4410 3782 1064 131 1500 2.4091194 8113210 4314 3659 968 128 1600 2.8870119 8111850 4331 3696 994 125 1700 3.3600893 8110521 4325 3718 988 130 1800 3.8298815 8111488 4317 3709 953 132 1900 4.2939619 8111040 4304 3689 994 122 2000 4.770505 8111191 4326 3634 1016 125 Loop time of 4.68228 on 128 procs for 1000 steps with 8111191 particles Particle moves = 8133640834 (8.13B) Cells touched = 10942355553 (10.9B) Particle comms = 134919956 (135M) Boundary collides = 0 (0K) Boundary exits = 22772815 (22.8M) SurfColl checks = 161165578 (161M) SurfColl occurs = 996240 (0.996M) Surf reactions = 0 (0K) Collide attempts = 124534803 (125M) Collide occurs = 94817067 (94.8M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.35712e+07 Particle-moves/step: 8.13364e+06 Cell-touches/particle/step: 1.34532 Particle comm iterations/step: 1 Particle fraction communicated: 0.0165879 Particle fraction colliding with boundary: 0 Particle fraction exiting boundary: 0.00279983 Surface-checks/particle/step: 0.0198147 Surface-collisions/particle/step: 0.000122484 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0153111 Collisions/particle/step: 0.0116574 Reactions/particle/step: 0 Move time (%) = 2.27666 (48.6228) Coll time (%) = 0.240106 (5.12796) Sort time (%) = 1.58432 (33.8365) Comm time (%) = 0.427676 (9.13391) Modfy time (%) = 0.124227 (2.65313) Outpt time (%) = 0.0266478 (0.56912) Other time (%) = 0.0026503 (0.0566026) Particles: 63368.7 ave 66800 max 62369 min Histogram: 26 52 23 9 6 6 3 1 1 1 Cells: 6400 ave 9802 max 4550 min Histogram: 4 5 22 88 4 1 0 1 0 3 GhostCell: 3203.55 ave 5304 max 1801 min Histogram: 8 12 19 33 18 16 10 11 0 1 EmptyCell: 0 ave 0 max 0 min Histogram: 128 0 0 0 0 0 0 0 0 0