SPARTA (23 Dec 2017) KOKKOS mode is enabled (../kokkos.cpp:39) using 0 GPU(s) per MPI task using 2 thread(s) per MPI task package kokkos package kokkos reduction parallel/reduce comm classic # flow around a sphere on a uniform grid # particles are created initially and input at boundaries at stream velocity variable x index 10 variable y index 10 variable z index 10 variable n equal 10*$x*$y*$z variable n equal 10*128*$y*$z variable n equal 10*128*80*$z variable n equal 10*128*80*80 variable fnum equal 7.33e+21/v_n seed 12345 dimension 3 global nrho 7.03E18 global fnum ${fnum} global fnum 894775390625000 timestep 1.E-5 global gridcut 0.1 global surfmax 300 boundary o o o create_box -5.0 5.0 -5.0 5.0 -5.0 5.0 Created orthogonal box = (-5 -5 -5) to (5 5 5) create_grid $x $y $z create_grid 128 $y $z create_grid 128 80 $z create_grid 128 80 80 WARNING: Could not acquire nearby ghost cells b/c grid partition is not clumped (../grid.cpp:381) Created 819200 child grid cells parent cells = 1 CPU time = 0.0168587 secs create/ghost percent = 57.5178 42.4822 balance_grid rcb cell Balance grid migrated 793600 cells CPU time = 0.0930233 secs reassign/sort/migrate/ghost percent = 29.0628 3.19359 41.4936 26.25 species ar.species Ar mixture air Ar frac 1.0 mixture air group species mixture air Ar vstream 2500.0 0.0 0.0 temp 300.00 fix in emit/face air all collide vss air ar.vss read_surf data.sphere 602 points 1200 triangles -1 1 xlo xhi -1 1 ylo yhi -1 1 zlo zhi 0.100631 min triangle edge length 0.00439601 min triangle area 1664 = cells with surfs 7464 = total surfs in all grid cells 10 = max surfs in one grid cell 0.80505 = min surf-size/cell-size ratio 0 0 = number of pushed cells 1664 0 = cells overlapping surfs, overlap cells with unmarked corner pts 814972 2564 1664 = cells outside/inside/overlapping surfs 1664 = surf cells with 1,2,etc splits 995.862 995.862 = cell-wise and global flow volume CPU time = 0.118963 secs read/sort/check/surf2grid/ghost/inout/particle percent = 30.2248 2.73438 3.6094 52.8384 10.593 7.0873 0.00742002 surf_collide 1 diffuse 300.0 1.0 surf_modify all collide 1 create_particles air n 0 Created 7824206 particles CPU time = 0.0717244 secs fix 3 balance 100 1.1 rcb part collide_modify vremax 100 yes #compute 1 grid all all nrho mass u v w #fix 1 ave/grid 10 100 1000 c_1 ave running #dump 1 grid all 1000 tmp_flow.* id xc yc zc f_1 #compute 2 surf all all press ke #fix 2 ave/surf all 10 100 1000 c_2 ave running #dump 2 surf all 1000 tmp_surf.* id f_2 compute g grid all all n compute max reduce max c_g[1] stats_style step cpu np nattempt ncoll nscoll c_max stats 100 # equilibrate flow for 1000 steps # then benchmark for 1000 steps run 1000 WARNING: One or more fix inflow faces oppose streaming velocity (../fix_emit_face.cpp:195) Memory usage per proc in Mbytes: particles (ave,min,max) = 32.8179 32.8179 32.8179 grid (ave,min,max) = 5.97897 5.97897 5.97897 surf (ave,min,max) = 0.0780087 0.0780067 0.0780106 total (ave,min,max) = 39.0702 39.0702 39.0702 Step CPU Np Natt Ncoll Nscoll c_max 0 0 7824206 0 0 0 11 100 1.8020652 7821341 3049 2586 936 123 200 3.6934971 7840459 3834 3248 982 118 300 5.5134387 7902832 4177 3547 1020 133 400 7.3715728 7987695 4251 3654 1039 133 500 9.1874256 8053589 4236 3628 924 138 600 10.989219 8084673 4287 3673 948 143 700 12.766277 8100323 4284 3677 1006 128 800 14.560993 8105738 4304 3712 970 124 900 16.354777 8108262 4339 3712 974 133 1000 18.137903 8111629 4355 3706 981 127 Loop time of 18.3895 on 32 procs for 1000 steps with 8111629 particles Particle moves = 8019927574 (8.02B) Cells touched = 10794517952 (10.8B) Particle comms = 66210083 (66.2M) Boundary collides = 0 (0K) Boundary exits = 22486440 (22.5M) SurfColl checks = 153122376 (153M) SurfColl occurs = 965716 (0.966M) Surf reactions = 0 (0K) Collide attempts = 118047263 (118M) Collide occurs = 89862419 (89.9M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.36286e+07 Particle-moves/step: 8.01993e+06 Cell-touches/particle/step: 1.34596 Particle comm iterations/step: 1 Particle fraction communicated: 0.0082557 Particle fraction colliding with boundary: 0 Particle fraction exiting boundary: 0.00280382 Surface-checks/particle/step: 0.0190927 Surface-collisions/particle/step: 0.000120415 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0147192 Collisions/particle/step: 0.0112049 Reactions/particle/step: 0 Move time (%) = 9.64107 (52.427) Coll time (%) = 0.998491 (5.42968) Sort time (%) = 6.49915 (35.3416) Comm time (%) = 0.79786 (4.33868) Modfy time (%) = 0.36151 (1.96585) Outpt time (%) = 0.0747743 (0.406614) Other time (%) = 0.016642 (0.0904975) Particles: 253488 ave 269626 max 239612 min Histogram: 4 0 12 0 4 0 4 0 0 8 Cells: 25600 ave 25600 max 25600 min Histogram: 32 0 0 0 0 0 0 0 0 0 GhostCell: 5252.5 ave 6872 max 3674 min Histogram: 8 0 0 0 8 8 0 0 0 8 EmptyCell: 0 ave 0 max 0 min Histogram: 32 0 0 0 0 0 0 0 0 0 collide_modify vremax 100 no run 1000 WARNING: One or more fix inflow faces oppose streaming velocity (../fix_emit_face.cpp:195) Memory usage per proc in Mbytes: particles (ave,min,max) = 32.8179 32.8179 32.8179 grid (ave,min,max) = 5.97897 5.97897 5.97897 surf (ave,min,max) = 0.0780087 0.0780067 0.0780106 total (ave,min,max) = 39.0702 39.0702 39.0702 Step CPU Np Natt Ncoll Nscoll c_max 1000 0 8111629 4355 3706 0 127 1100 1.7841229 8111740 4403 3716 1041 126 1200 3.5602036 8111002 4417 3734 1057 128 1300 5.3441584 8113792 4377 3737 946 134 1400 7.1496328 8111706 4311 3676 1024 124 1500 8.9375583 8109379 4284 3676 996 134 1600 10.718303 8109746 4350 3709 1023 133 1700 12.494028 8110238 4295 3648 981 126 1800 14.275748 8111736 4398 3758 1004 130 1900 16.057079 8110218 4301 3686 978 131 2000 17.834393 8110330 4363 3711 998 124 Loop time of 18.0817 on 32 procs for 1000 steps with 8110330 particles Particle moves = 8134013646 (8.13B) Cells touched = 10943000377 (10.9B) Particle comms = 67202002 (67.2M) Boundary collides = 0 (0K) Boundary exits = 22774951 (22.8M) SurfColl checks = 161400984 (161M) SurfColl occurs = 995760 (0.996M) Surf reactions = 0 (0K) Collide attempts = 124560529 (125M) Collide occurs = 94853711 (94.9M) Reactions = 0 (0K) Particles stuck = 0 Particle-moves/CPUsec/proc: 1.40577e+07 Particle-moves/step: 8.13401e+06 Cell-touches/particle/step: 1.34534 Particle comm iterations/step: 1 Particle fraction communicated: 0.00826185 Particle fraction colliding with boundary: 0 Particle fraction exiting boundary: 0.00279996 Surface-checks/particle/step: 0.0198427 Surface-collisions/particle/step: 0.000122419 Surf-reactions/particle/step: 0 Collision-attempts/particle/step: 0.0153135 Collisions/particle/step: 0.0116614 Reactions/particle/step: 0 Move time (%) = 9.19401 (50.847) Coll time (%) = 1.02854 (5.68829) Sort time (%) = 6.70994 (37.109) Comm time (%) = 0.758191 (4.19314) Modfy time (%) = 0.316329 (1.74944) Outpt time (%) = 0.0715436 (0.395669) Other time (%) = 0.00315137 (0.0174285) Particles: 253448 ave 269357 max 238975 min Histogram: 4 0 12 0 4 0 3 1 0 8 Cells: 25600 ave 25600 max 25600 min Histogram: 32 0 0 0 0 0 0 0 0 0 GhostCell: 5252.5 ave 6872 max 3674 min Histogram: 8 0 0 0 8 8 0 0 0 8 EmptyCell: 0 ave 0 max 0 min Histogram: 32 0 0 0 0 0 0 0 0 0