MFC
Exascale flow solver
Loading...
Searching...
No Matches
m_start_up.fpp.f90
Go to the documentation of this file.
1# 1 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
2!>
3!! @file
4!! @brief Contains module m_start_up
5
6# 1 "/home/runner/work/MFC/MFC/src/common/include/case.fpp" 1
7! This file exists so that Fypp can be run without generating case.fpp files for
8! each target. This is useful when generating documentation, for example. This
9! should also let MFC be built with CMake directly, without invoking mfc.sh.
10
11! For pre-process.
12# 9 "/home/runner/work/MFC/MFC/src/common/include/case.fpp"
13
14! For moving immersed boundaries in simulation
15# 14 "/home/runner/work/MFC/MFC/src/common/include/case.fpp"
16# 6 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp" 2
17# 1 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp" 1
18# 1 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp" 1
19# 1 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp" 1
20# 2 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
21# 3 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
22# 4 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
23# 5 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
24# 6 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
25
26# 8 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
27# 9 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
28# 10 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
29
30# 17 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
31
32# 46 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
33
34# 58 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
35
36# 68 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
37
38# 98 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
39
40# 110 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
41
42# 120 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
43! New line at end of file is required for FYPP
44# 2 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp" 2
45# 1 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp" 1
46# 1 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp" 1
47# 2 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
48# 3 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
49# 4 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
50# 5 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
51# 6 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
52
53# 8 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
54# 9 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
55# 10 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
56
57# 17 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
58
59# 46 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
60
61# 58 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
62
63# 68 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
64
65# 98 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
66
67# 110 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
68
69# 120 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
70! New line at end of file is required for FYPP
71# 2 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp" 2
72
73# 4 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
74# 5 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
75# 6 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
76# 7 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
77# 8 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
78
79# 20 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
80
81# 43 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
82
83# 48 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
84
85# 53 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
86
87# 58 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
88
89# 63 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
90
91# 68 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
92
93# 76 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
94
95# 81 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
96
97# 86 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
98
99# 91 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
100
101# 96 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
102
103# 101 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
104
105# 106 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
106
107# 111 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
108
109# 116 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
110
111# 121 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
112
113# 151 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
114
115# 192 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
116
117# 206 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
118
119# 231 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
120
121# 242 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
122
123# 244 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
124# 255 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
125
126# 284 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
127
128# 294 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
129
130# 304 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
131
132# 313 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
133
134# 330 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
135
136# 340 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
137
138# 347 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
139
140# 353 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
141
142# 359 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
143
144# 365 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
145
146# 371 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
147
148# 377 "/home/runner/work/MFC/MFC/src/common/include/omp_macros.fpp"
149! New line at end of file is required for FYPP
150# 3 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp" 2
151# 1 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp" 1
152# 1 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp" 1
153# 2 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
154# 3 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
155# 4 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
156# 5 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
157# 6 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
158
159# 8 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
160# 9 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
161# 10 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
162
163# 17 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
164
165# 46 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
166
167# 58 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
168
169# 68 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
170
171# 98 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
172
173# 110 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
174
175# 120 "/home/runner/work/MFC/MFC/src/common/include/shared_parallel_macros.fpp"
176! New line at end of file is required for FYPP
177# 2 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp" 2
178
179# 7 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
180
181# 17 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
182
183# 22 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
184
185# 27 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
186
187# 32 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
188
189# 37 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
190
191# 42 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
192
193# 47 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
194
195# 52 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
196
197# 57 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
198
199# 62 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
200
201# 73 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
202
203# 78 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
204
205# 83 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
206
207# 88 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
208
209# 103 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
210
211# 131 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
212
213# 160 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
214
215# 175 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
216
217# 193 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
218
219# 215 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
220
221# 244 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
222
223# 259 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
224
225# 269 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
226
227# 278 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
228
229# 294 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
230
231# 304 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
232
233# 311 "/home/runner/work/MFC/MFC/src/common/include/acc_macros.fpp"
234! New line at end of file is required for FYPP
235# 4 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp" 2
236
237! GPU parallel region (scalar reductions, maxval/minval)
238# 23 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
239
240! GPU parallel loop over threads (most common GPU macro)
241# 43 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
242
243! Required closing for GPU_PARALLEL_LOOP
244# 55 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
245
246! Mark routine for device compilation
247# 112 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
248
249! Declare device-resident data
250# 130 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
251
252! Inner loop within a GPU parallel region
253# 145 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
254
255! Scoped GPU data region
256# 164 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
257
258! Host code with device pointers (for MPI with GPU buffers)
259# 193 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
260
261! Allocate device memory (unscoped)
262# 207 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
263
264! Free device memory
265# 219 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
266
267! Atomic operation on device
268# 231 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
269
270! End atomic capture block
271# 242 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
272
273! Copy data between host and device
274# 254 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
275
276! Synchronization barrier
277# 266 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
278
279! Import GPU library module (openacc or omp_lib)
280# 275 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
281
282! Emit code only for AMD compiler
283# 282 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
284
285! Emit code for non-Cray compilers
286# 289 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
287
288! Emit code only for Cray compiler
289# 296 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
290
291! Emit code for non-NVIDIA compilers
292# 303 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
293
294# 305 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
295# 306 "/home/runner/work/MFC/MFC/src/common/include/parallel_macros.fpp"
296! New line at end of file is required for FYPP
297# 2 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp" 2
298
299# 14 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp"
300
301! Caution: This macro requires the use of a binding script to set CUDA_VISIBLE_DEVICES, such that we have one GPU device per MPI
302! rank. That's because for both cudaMemAdvise (preferred location) and cudaMemPrefetchAsync we use location = device_id = 0. For an
303! example see misc/nvidia_uvm/bind.sh. NVIDIA unified memory page placement hint
304# 57 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp"
305
306! Allocate and create GPU device memory
307# 77 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp"
308
309! Free GPU device memory and deallocate
310# 85 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp"
311
312! Cray-specific GPU pointer setup for vector fields
313# 109 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp"
314
315! Cray-specific GPU pointer setup for scalar fields
316# 125 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp"
317
318! Cray-specific GPU pointer setup for acoustic source spatials
319# 150 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp"
320
321# 156 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp"
322
323# 163 "/home/runner/work/MFC/MFC/src/common/include/macros.fpp"
324! New line at end of file is required for FYPP
325# 7 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp" 2
326
327!> @brief Reads input files, loads initial conditions and grid data, and orchestrates solver initialization and finalization
328module m_start_up
329
330 use m_derived_types
331 use m_global_parameters
332 use m_mpi_proxy
333 use m_mpi_common
334 use m_variables_conversion
335 use m_weno
336 use m_muscl
337 use m_thinc
338 use m_riemann_solvers
339 use m_cbc
340 use m_boundary_common
341 use m_acoustic_src
342 use m_rhs
343 use m_chemistry
344 use m_data_output
345 use m_time_steppers
346 use m_qbmm
347 use m_derived_variables
348 use m_hypoelastic
349 use m_hyperelastic
350 use m_phase_change
351 use m_viscous
352 use m_bubbles_ee
353 use m_bubbles_el
354 use ieee_arithmetic
355 use m_helper_basic
356 use m_helper
357
358#if defined(MFC_OpenACC)
359# 39 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
360 use openacc
361# 39 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
362#elif defined(MFC_OpenMP)
363# 39 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
364 use omp_lib
365# 39 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
366#endif
367
368 use m_nvtx
369 use m_ibm
370 use m_compile_specific
371 use m_checker_common
372 use m_checker
373 use m_surface_tension
374 use m_body_forces
375 use m_sim_helpers
376 use m_igr
377
378 implicit none
379
380 private; public :: s_read_input_file, s_check_input_file, s_read_data_files, s_read_serial_data_files, &
381 & s_read_parallel_data_files, s_initialize_internal_energy_equations, s_initialize_modules, s_initialize_gpu_vars, &
382 & s_initialize_mpi_domain, s_finalize_modules, s_perform_time_step, s_save_data, s_save_performance_metrics
383
384 type(scalar_field), allocatable, dimension(:) :: q_cons_temp
385 real(wp) :: dt_init
386
387contains
388
389 !> Read data files. Dispatch subroutine that replaces procedure pointer.
390 impure subroutine s_read_data_files(q_cons_vf)
391
392 type(scalar_field), dimension(sys_size), intent(inout) :: q_cons_vf
393
394 if (.not. parallel_io) then
395 call s_read_serial_data_files(q_cons_vf)
396 else
397 call s_read_parallel_data_files(q_cons_vf)
398 end if
399
400 end subroutine s_read_data_files
401
402 !> Verify the input file exists and read it
403 impure subroutine s_read_input_file
404
405 character(LEN=name_len), parameter :: file_path = './simulation.inp'
406 logical :: file_exist !< Logical used to check the existence of the input file
407 integer :: iostatus
408 ! Integer to check iostat of file read
409
410 character(len=1000) :: line
411
412 namelist /user_inputs/ case_dir, run_time_info, m, n, p, dt, &
413 t_step_start, t_step_stop, t_step_save, t_step_print, &
414 model_eqns, mpp_lim, time_stepper, weno_eps, muscl_eps, &
415 rdma_mpi, teno_ct, mp_weno, weno_avg, &
416 riemann_solver, low_mach, wave_speeds, avg_state, &
417 bc_x, bc_y, bc_z, &
418 x_a, y_a, z_a, x_b, y_b, z_b, &
419 x_domain, y_domain, z_domain, &
420 hypoelasticity, &
421 ib, num_ibs, patch_ib, &
422 collision_model, coefficient_of_restitution, collision_time, &
423 ib_coefficient_of_friction, ib_state_wrt, &
424 fluid_pp, bub_pp, probe_wrt, prim_vars_wrt, &
425 fd_order, probe, num_probes, t_step_old, &
426 alt_soundspeed, mixture_err, weno_re_flux, &
427 null_weights, precision, parallel_io, cyl_coord, &
428 rhoref, pref, bubbles_euler, bubble_model, &
429 r0ref, chem_params, &
430# 104 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
431 nb, mapped_weno, wenoz, teno, wenoz_q, weno_order, &
432 num_fluids, mhd, relativity, igr_order, viscous, &
433 igr_iter_solver, igr, igr_pres_lim, &
434 recon_type, muscl_order, muscl_lim, &
435# 109 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
436 ca, web, re_inv, acoustic_source, acoustic, num_source, polytropic, thermal, integral, integral_wrt, num_integrals, &
437 & polydisperse, poly_sigma, qbmm, relax, relax_model, palpha_eps, ptgalpha_eps, file_per_process, sigma, pi_fac, &
438 & adv_n, adap_dt, adap_dt_tol, adap_dt_max_iters, bf_x, bf_y, bf_z, k_x, k_y, k_z, w_x, w_y, w_z, p_x, p_y, p_z, g_x, &
439 & g_y, g_z, n_start, t_save, t_stop, cfl_adap_dt, cfl_const_dt, cfl_target, surface_tension, bubbles_lagrange, &
440 & lag_params, hyperelasticity, r0ref, num_bc_patches, bx0, cont_damage, tau_star, cont_damage_s, alpha_bar, &
441 & hyper_cleaning, hyper_cleaning_speed, hyper_cleaning_tau, alf_factor, num_igr_iters, num_igr_warm_start_iters, &
442 & int_comp, ic_eps, ic_beta, nv_uvm_out_of_core, nv_uvm_igr_temps_on_gpu, nv_uvm_pref_gpu, down_sample, fft_wrt
443
444 inquire (file=trim(file_path), exist=file_exist)
445
446 if (file_exist) then
447 open (1, file=trim(file_path), form='formatted', action='read', status='old')
448 read (1, nml=user_inputs, iostat=iostatus)
449
450 if (iostatus /= 0) then
451 backspace(1)
452 read (1, fmt='(A)') line
453 print *, 'Invalid line in namelist: ' // trim(line)
454 call s_mpi_abort('Invalid line in simulation.inp. It is ' // 'likely due to a datatype mismatch. Exiting.')
455 end if
456
457 close (1)
458
459 if ((bf_x) .or. (bf_y) .or. (bf_z)) then
460 bodyforces = .true.
461 end if
462
463 m_glb = m
464 n_glb = n
465 p_glb = p
466
467 call s_update_cell_bounds(cells_bounds, m, n, p)
468
469 if (cfl_adap_dt .or. cfl_const_dt) cfl_dt = .true.
470
471 if (any((/bc_x%beg, bc_x%end, bc_y%beg, bc_y%end, bc_z%beg, bc_z%end/) == -17) .or. num_bc_patches > 0) then
472 bc_io = .true.
473 end if
474 else
475 call s_mpi_abort(trim(file_path) // ' is missing. Exiting.')
476 end if
477
478 end subroutine s_read_input_file
479
480 !> Validate that all user-provided inputs form a consistent simulation configuration
481 impure subroutine s_check_input_file
482
483 character(LEN=path_len) :: file_path
484 logical :: file_exist
485
486 file_path = trim(case_dir) // '/.'
487
488 call my_inquire(file_path, file_exist)
489
490 if (file_exist .neqv. .true.) then
491 call s_mpi_abort(trim(file_path) // ' is missing. Exiting.')
492 end if
493
494 call s_check_inputs_common()
495 call s_check_inputs()
496
497 end subroutine s_check_input_file
498
499 !> Read serial initial condition and grid data files and compute cell-width distributions
500 impure subroutine s_read_serial_data_files(q_cons_vf)
501
502 type(scalar_field), dimension(sys_size), intent(inout) :: q_cons_vf
503 character(LEN=path_len + 2*name_len) :: t_step_dir !< Relative path to the starting time-step directory
504 character(LEN=path_len + 3*name_len) :: file_path !< Relative path to the grid and conservative variables data files
505 logical :: file_exist !< Logical used to check the existence of the input file
506 integer :: i, r
507
508 if (cfl_dt) then
509 write (t_step_dir, '(A,I0,A,I0)') trim(case_dir) // '/p_all/p', proc_rank, '/', n_start
510 else
511 write (t_step_dir, '(A,I0,A,I0)') trim(case_dir) // '/p_all/p', proc_rank, '/', t_step_start
512 end if
513
514 file_path = trim(t_step_dir) // '/.'
515 call my_inquire(file_path, file_exist)
516
517 if (file_exist .neqv. .true.) then
518 call s_mpi_abort(trim(file_path) // ' is missing. Exiting.')
519 end if
520
521 if (bc_io) then
522 call s_read_serial_boundary_condition_files(t_step_dir, bc_type)
523 else
524 call s_assign_default_bc_type(bc_type)
525 end if
526
527 file_path = trim(t_step_dir) // '/x_cb.dat'
528
529 inquire (file=trim(file_path), exist=file_exist)
530
531 if (file_exist) then
532 open (2, file=trim(file_path), form='unformatted', action='read', status='old')
533 read (2) x_cb(-1:m); close (2)
534 else
535 call s_mpi_abort(trim(file_path) // ' is missing. Exiting.')
536 end if
537
538 dx(0:m) = x_cb(0:m) - x_cb(-1:m - 1)
539 x_cc(0:m) = x_cb(-1:m - 1) + dx(0:m)/2._wp
540
541 if (ib) then
542 do i = 1, num_ibs
543 if (patch_ib(i)%c > 0) then
544 np = int((patch_ib(i)%p*patch_ib(i)%c/dx(0))*20) + int(((patch_ib(i)%c - patch_ib(i)%p*patch_ib(i)%c)/dx(0)) &
545 & *20) + 1
546 end if
547 end do
548 end if
549
550 if (n > 0) then
551 file_path = trim(t_step_dir) // '/y_cb.dat'
552
553 inquire (file=trim(file_path), exist=file_exist)
554
555 if (file_exist) then
556 open (2, file=trim(file_path), form='unformatted', action='read', status='old')
557 read (2) y_cb(-1:n); close (2)
558 else
559 call s_mpi_abort(trim(file_path) // ' is missing. Exiting.')
560 end if
561
562 dy(0:n) = y_cb(0:n) - y_cb(-1:n - 1)
563 y_cc(0:n) = y_cb(-1:n - 1) + dy(0:n)/2._wp
564 end if
565
566 if (p > 0) then
567 file_path = trim(t_step_dir) // '/z_cb.dat'
568
569 inquire (file=trim(file_path), exist=file_exist)
570
571 if (file_exist) then
572 open (2, file=trim(file_path), form='unformatted', action='read', status='old')
573 read (2) z_cb(-1:p); close (2)
574 else
575 call s_mpi_abort(trim(file_path) // ' is missing. Exiting.')
576 end if
577
578 dz(0:p) = z_cb(0:p) - z_cb(-1:p - 1)
579 z_cc(0:p) = z_cb(-1:p - 1) + dz(0:p)/2._wp
580 end if
581
582 do i = 1, sys_size
583 write (file_path, '(A,I0,A)') trim(t_step_dir) // '/q_cons_vf', i, '.dat'
584 inquire (file=trim(file_path), exist=file_exist)
585 if (file_exist) then
586 open (2, file=trim(file_path), form='unformatted', action='read', status='old')
587 read (2) q_cons_vf(i)%sf(0:m,0:n,0:p); close (2)
588 else
589 call s_mpi_abort(trim(file_path) // ' is missing. Exiting.')
590 end if
591 end do
592
593 if (bubbles_euler .or. elasticity) then
594 ! Read pb and mv for non-polytropic qbmm
595 if (qbmm .and. .not. polytropic) then
596 do i = 1, nb
597 do r = 1, nnode
598 write (file_path, '(A,I0,A)') trim(t_step_dir) // '/pb', sys_size + (i - 1)*nnode + r, '.dat'
599 inquire (file=trim(file_path), exist=file_exist)
600 if (file_exist) then
601 open (2, file=trim(file_path), form='unformatted', action='read', status='old')
602 read (2) pb_ts(1)%sf(0:m,0:n,0:p,r, i); close (2)
603 else
604 call s_mpi_abort(trim(file_path) // ' is missing. Exiting.')
605 end if
606 end do
607 end do
608 do i = 1, nb
609 do r = 1, nnode
610 write (file_path, '(A,I0,A)') trim(t_step_dir) // '/mv', sys_size + (i - 1)*nnode + r, '.dat'
611 inquire (file=trim(file_path), exist=file_exist)
612 if (file_exist) then
613 open (2, file=trim(file_path), form='unformatted', action='read', status='old')
614 read (2) mv_ts(1)%sf(0:m,0:n,0:p,r, i); close (2)
615 else
616 call s_mpi_abort(trim(file_path) // ' is missing. Exiting.')
617 end if
618 end do
619 end do
620 end if
621 end if
622
623 end subroutine s_read_serial_data_files
624
625 !> Read parallel initial condition and grid data files via MPI I/O
626 impure subroutine s_read_parallel_data_files(q_cons_vf)
627
628 type(scalar_field), dimension(sys_size), intent(inout) :: q_cons_vf
629
630#ifdef MFC_MPI
631 real(wp), allocatable, dimension(:) :: x_cb_glb, y_cb_glb, z_cb_glb
632 integer :: ifile, ierr, data_size
633 integer, dimension(MPI_STATUS_SIZE) :: status
634 integer(KIND=MPI_OFFSET_KIND) :: disp
635 integer(KIND=MPI_OFFSET_KIND) :: m_mok, n_mok, p_mok
636 integer(KIND=MPI_OFFSET_KIND) :: wp_mok, var_mok
637 integer(KIND=MPI_OFFSET_KIND) :: mok
638 character(LEN=path_len + 2*name_len) :: file_loc
639 logical :: file_exist
640 character(len=10) :: t_step_start_string
641 integer :: i, j
642
643 ! Downsampled data variables
644 integer :: m_ds, n_ds, p_ds
645 integer :: m_glb_ds, n_glb_ds, p_glb_ds
646 integer :: m_glb_read, n_glb_read, p_glb_read !< data size of read
647
648 allocate (x_cb_glb(-1:m_glb))
649 allocate (y_cb_glb(-1:n_glb))
650 allocate (z_cb_glb(-1:p_glb))
651
652 file_loc = trim(case_dir) // '/restart_data' // trim(mpiiofs) // 'x_cb.dat'
653 inquire (file=trim(file_loc), exist=file_exist)
654
655 if (down_sample) then
656 m_ds = int((m + 1)/3) - 1
657 n_ds = int((n + 1)/3) - 1
658 p_ds = int((p + 1)/3) - 1
659
660 m_glb_ds = int((m_glb + 1)/3) - 1
661 n_glb_ds = int((n_glb + 1)/3) - 1
662 p_glb_ds = int((p_glb + 1)/3) - 1
663 end if
664
665 if (file_exist) then
666 data_size = m_glb + 2
667 call mpi_file_open(mpi_comm_world, file_loc, mpi_mode_rdonly, mpi_info_int, ifile, ierr)
668 call mpi_file_read(ifile, x_cb_glb, data_size, mpi_p, status, ierr)
669 call mpi_file_close(ifile, ierr)
670 else
671 call s_mpi_abort('File ' // trim(file_loc) // ' is missing. Exiting.')
672 end if
673
674 x_cb(-1:m) = x_cb_glb((start_idx(1) - 1):(start_idx(1) + m))
675 dx(0:m) = x_cb(0:m) - x_cb(-1:m - 1)
676 x_cc(0:m) = x_cb(-1:m - 1) + dx(0:m)/2._wp
677
678 if (ib) then
679 do i = 1, num_ibs
680 if (patch_ib(i)%c > 0) then
681 np = int((patch_ib(i)%p*patch_ib(i)%c/dx(0))*20) + int(((patch_ib(i)%c - patch_ib(i)%p*patch_ib(i)%c)/dx(0)) &
682 & *20) + 1
683 allocate (mpi_io_airfoil_ib_data%var(1:2*np))
684 end if
685 end do
686 end if
687
688 if (n > 0) then
689 file_loc = trim(case_dir) // '/restart_data' // trim(mpiiofs) // 'y_cb.dat'
690 inquire (file=trim(file_loc), exist=file_exist)
691
692 if (file_exist) then
693 data_size = n_glb + 2
694 call mpi_file_open(mpi_comm_world, file_loc, mpi_mode_rdonly, mpi_info_int, ifile, ierr)
695 call mpi_file_read(ifile, y_cb_glb, data_size, mpi_p, status, ierr)
696 call mpi_file_close(ifile, ierr)
697 else
698 call s_mpi_abort('File ' // trim(file_loc) // ' is missing. Exiting.')
699 end if
700
701 y_cb(-1:n) = y_cb_glb((start_idx(2) - 1):(start_idx(2) + n))
702 dy(0:n) = y_cb(0:n) - y_cb(-1:n - 1)
703 y_cc(0:n) = y_cb(-1:n - 1) + dy(0:n)/2._wp
704
705 if (p > 0) then
706 file_loc = trim(case_dir) // '/restart_data' // trim(mpiiofs) // 'z_cb.dat'
707 inquire (file=trim(file_loc), exist=file_exist)
708
709 if (file_exist) then
710 data_size = p_glb + 2
711 call mpi_file_open(mpi_comm_world, file_loc, mpi_mode_rdonly, mpi_info_int, ifile, ierr)
712 call mpi_file_read(ifile, z_cb_glb, data_size, mpi_p, status, ierr)
713 call mpi_file_close(ifile, ierr)
714 else
715 call s_mpi_abort('File ' // trim(file_loc) // 'is missing. Exiting.')
716 end if
717
718 z_cb(-1:p) = z_cb_glb((start_idx(3) - 1):(start_idx(3) + p))
719 dz(0:p) = z_cb(0:p) - z_cb(-1:p - 1)
720 z_cc(0:p) = z_cb(-1:p - 1) + dz(0:p)/2._wp
721 end if
722 end if
723
724 if (file_per_process) then
725 if (cfl_dt) then
726 call s_int_to_str(n_start, t_step_start_string)
727 write (file_loc, '(I0,A1,I7.7,A)') n_start, '_', proc_rank, '.dat'
728 else
729 call s_int_to_str(t_step_start, t_step_start_string)
730 write (file_loc, '(I0,A1,I7.7,A)') t_step_start, '_', proc_rank, '.dat'
731 end if
732 file_loc = trim(case_dir) // '/restart_data/lustre_' // trim(t_step_start_string) // trim(mpiiofs) // trim(file_loc)
733 inquire (file=trim(file_loc), exist=file_exist)
734
735 if (file_exist) then
736 call mpi_file_open(mpi_comm_self, file_loc, mpi_mode_rdonly, mpi_info_int, ifile, ierr)
737
738 if (down_sample) then
739 call s_initialize_mpi_data_ds(q_cons_vf)
740 else
741 if (ib) then
742 call s_initialize_mpi_data(q_cons_vf, ib_markers)
743 else
744 call s_initialize_mpi_data(q_cons_vf)
745 end if
746 end if
747
748 if (down_sample) then
749 data_size = (m_ds + 3)*(n_ds + 3)*(p_ds + 3)
750 m_glb_read = m_glb_ds + 1
751 n_glb_read = n_glb_ds + 1
752 p_glb_read = p_glb_ds + 1
753 else
754 data_size = (m + 1)*(n + 1)*(p + 1)
755 m_glb_read = m_glb + 1
756 n_glb_read = n_glb + 1
757 p_glb_read = p_glb + 1
758 end if
759
760 m_mok = int(m_glb_read + 1, mpi_offset_kind)
761 n_mok = int(m_glb_read + 1, mpi_offset_kind)
762 p_mok = int(m_glb_read + 1, mpi_offset_kind)
763 wp_mok = int(storage_size(0._stp)/8, mpi_offset_kind)
764 mok = int(1._wp, mpi_offset_kind)
765
766 if (bubbles_euler .or. elasticity) then
767 do i = 1, sys_size
768 var_mok = int(i, mpi_offset_kind)
769
770 call mpi_file_read(ifile, mpi_io_data%var(i)%sf, data_size*mpi_io_type, mpi_io_p, status, ierr)
771 end do
772 ! Read pb and mv for non-polytropic qbmm
773 if (qbmm .and. .not. polytropic) then
774 do i = sys_size + 1, sys_size + 2*nb*nnode
775 var_mok = int(i, mpi_offset_kind)
776
777 call mpi_file_read(ifile, mpi_io_data%var(i)%sf, data_size*mpi_io_type, mpi_io_p, status, ierr)
778 end do
779 end if
780 else
781 if (down_sample) then
782 do i = 1, sys_size
783 var_mok = int(i, mpi_offset_kind)
784
785 call mpi_file_read(ifile, q_cons_temp(i)%sf, data_size*mpi_io_type, mpi_io_p, status, ierr)
786 end do
787 else
788 do i = 1, sys_size
789 var_mok = int(i, mpi_offset_kind)
790
791 call mpi_file_read(ifile, mpi_io_data%var(i)%sf, data_size*mpi_io_type, mpi_io_p, status, ierr)
792 end do
793 end if
794 end if
795
796 call s_mpi_barrier()
797
798 call mpi_file_close(ifile, ierr)
799 else
800 call s_mpi_abort('File ' // trim(file_loc) // ' is missing. Exiting.')
801 end if
802 else
803 if (cfl_dt) then
804 write (file_loc, '(I0,A)') n_start, '.dat'
805 else
806 write (file_loc, '(I0,A)') t_step_start, '.dat'
807 end if
808 file_loc = trim(case_dir) // '/restart_data' // trim(mpiiofs) // trim(file_loc)
809 inquire (file=trim(file_loc), exist=file_exist)
810
811 if (file_exist) then
812 call mpi_file_open(mpi_comm_world, file_loc, mpi_mode_rdonly, mpi_info_int, ifile, ierr)
813
814 if (ib) then
815 call s_initialize_mpi_data(q_cons_vf, ib_markers)
816 else
817 call s_initialize_mpi_data(q_cons_vf)
818 end if
819
820 data_size = (m + 1)*(n + 1)*(p + 1)
821
822 m_mok = int(m_glb + 1, mpi_offset_kind)
823 n_mok = int(n_glb + 1, mpi_offset_kind)
824 p_mok = int(p_glb + 1, mpi_offset_kind)
825 wp_mok = int(storage_size(0._stp)/8, mpi_offset_kind)
826 mok = int(1._wp, mpi_offset_kind)
827
828 if (bubbles_euler .or. elasticity) then
829 do i = 1, sys_size
830 var_mok = int(i, mpi_offset_kind)
831 disp = m_mok*max(mok, n_mok)*max(mok, p_mok)*wp_mok*(var_mok - 1)
832
833 call mpi_file_set_view(ifile, disp, mpi_io_p, mpi_io_data%view(i), 'native', mpi_info_int, ierr)
834 call mpi_file_read(ifile, mpi_io_data%var(i)%sf, data_size*mpi_io_type, mpi_io_p, status, ierr)
835 end do
836 ! Read pb and mv for non-polytropic qbmm
837 if (qbmm .and. .not. polytropic) then
838 do i = sys_size + 1, sys_size + 2*nb*nnode
839 var_mok = int(i, mpi_offset_kind)
840 disp = m_mok*max(mok, n_mok)*max(mok, p_mok)*wp_mok*(var_mok - 1)
841
842 call mpi_file_set_view(ifile, disp, mpi_io_p, mpi_io_data%view(i), 'native', mpi_info_int, ierr)
843 call mpi_file_read(ifile, mpi_io_data%var(i)%sf, data_size*mpi_io_type, mpi_io_p, status, ierr)
844 end do
845 end if
846 else
847 do i = 1, sys_size
848 var_mok = int(i, mpi_offset_kind)
849
850 disp = m_mok*max(mok, n_mok)*max(mok, p_mok)*wp_mok*(var_mok - 1)
851
852 call mpi_file_set_view(ifile, disp, mpi_io_p, mpi_io_data%view(i), 'native', mpi_info_int, ierr)
853 call mpi_file_read_all(ifile, mpi_io_data%var(i)%sf, data_size*mpi_io_type, mpi_io_p, status, ierr)
854 end do
855 end if
856
857 call s_mpi_barrier()
858
859 call mpi_file_close(ifile, ierr)
860 else
861 call s_mpi_abort('File ' // trim(file_loc) // ' is missing. Exiting.')
862 end if
863 end if
864
865 deallocate (x_cb_glb, y_cb_glb, z_cb_glb)
866
867 if (bc_io) then
868 call s_read_parallel_boundary_condition_files(bc_type)
869 else
870 call s_assign_default_bc_type(bc_type)
871 end if
872#endif
873
874 end subroutine s_read_parallel_data_files
875
876 !> Initialize internal-energy equations from phase mass, mixture momentum, and total energy
877 subroutine s_initialize_internal_energy_equations(v_vf)
878
879 type(scalar_field), dimension(sys_size), intent(inout) :: v_vf
880 real(wp) :: rho
881 real(wp) :: dyn_pres
882 real(wp) :: gamma
883 real(wp) :: pi_inf
884 real(wp) :: qv
885 real(wp), dimension(2) :: re
886 real(wp) :: pres, t
887 integer :: i, j, k, l, c
888 real(wp), dimension(num_species) :: rhoyks
889 real(wp) :: pres_mag
890
891 pres_mag = 0._wp
892
893 t = dflt_t_guess
894
895 do j = 0, m
896 do k = 0, n
897 do l = 0, p
898 call s_convert_to_mixture_variables(v_vf, j, k, l, rho, gamma, pi_inf, qv, re)
899
900 dyn_pres = 0._wp
901 do i = eqn_idx%mom%beg, eqn_idx%mom%end
902 dyn_pres = dyn_pres + 5.e-1_wp*v_vf(i)%sf(j, k, l)*v_vf(i)%sf(j, k, l)/max(rho, sgm_eps)
903 end do
904
905 if (chemistry) then
906 do c = 1, num_species
907 rhoyks(c) = v_vf(eqn_idx%species%beg + c - 1)%sf(j, k, l)
908 end do
909 end if
910
911 if (mhd) then
912 if (n == 0) then
913 pres_mag = 0.5_wp*(bx0**2 + v_vf(eqn_idx%B%beg)%sf(j, k, l)**2 + v_vf(eqn_idx%B%beg + 1)%sf(j, k, l)**2)
914 else
915 pres_mag = 0.5_wp*(v_vf(eqn_idx%B%beg)%sf(j, k, l)**2 + v_vf(eqn_idx%B%beg + 1)%sf(j, k, &
916 & l)**2 + v_vf(eqn_idx%B%beg + 2)%sf(j, k, l)**2)
917 end if
918 end if
919
920 call s_compute_pressure(v_vf(eqn_idx%E)%sf(j, k, l), 0._stp, dyn_pres, pi_inf, gamma, rho, qv, rhoyks, pres, &
921 & t, pres_mag=pres_mag)
922
923 do i = 1, num_fluids
924 v_vf(i + eqn_idx%int_en%beg - 1)%sf(j, k, l) = v_vf(i + eqn_idx%adv%beg - 1)%sf(j, k, &
925 & l)*(gammas(i)*pres + pi_infs(i)) + v_vf(i + eqn_idx%cont%beg - 1)%sf(j, k, l)*qvs(i)
926 end do
927 end do
928 end do
929 end do
930
931 end subroutine s_initialize_internal_energy_equations
932
933 !> Advance the simulation by one time step, handling CFL-based dt and time-stepper dispatch
934 impure subroutine s_perform_time_step(t_step, time_avg)
935
936 integer, intent(inout) :: t_step
937 real(wp), intent(inout) :: time_avg
938 integer :: i, eta_hh, eta_mm, eta_ss
939 real(wp) :: eta_sec
940
941 if (cfl_dt) then
942 if (cfl_const_dt .and. t_step == 0) call s_compute_dt()
943
944 if (cfl_adap_dt) call s_compute_dt()
945
946 if (t_step == 0) dt_init = dt
947
948 if (dt < 1.e-3_wp*dt_init .and. cfl_adap_dt .and. proc_rank == 0) then
949 print *, "Delta t = ", dt
950 call s_mpi_abort("Delta t has become too small")
951 end if
952 end if
953
954 if (cfl_dt) then
955 if ((mytime + dt) >= t_stop) then
956 dt = t_stop - mytime
957
958# 630 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
959#if defined(MFC_OpenACC)
960# 630 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
961!$acc update device(dt)
962# 630 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
963#elif defined(MFC_OpenMP)
964# 630 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
965!$omp target update to(dt)
966# 630 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
967#endif
968 end if
969 else
970 if ((mytime + dt) >= finaltime) then
971 dt = finaltime - mytime
972
973# 635 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
974#if defined(MFC_OpenACC)
975# 635 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
976!$acc update device(dt)
977# 635 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
978#elif defined(MFC_OpenMP)
979# 635 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
980!$omp target update to(dt)
981# 635 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
982#endif
983 end if
984 end if
985
986 if (cfl_dt) then
987 if (proc_rank == 0 .and. mod(t_step - t_step_start, t_step_print) == 0) then
988 eta_sec = wall_time_avg*(t_stop - mytime)/max(dt, tiny(dt))
989 eta_hh = int(eta_sec)/3600
990 eta_mm = mod(int(eta_sec), 3600)/60
991 eta_ss = mod(int(eta_sec), 60)
992 print '(" [", I3, "%] Time ", ES16.6, " dt = ", ES16.6, " @ Time Step = ", I8, " Time Avg = ", ES16.6, " Time/step = ", ES12.6, " ETA (HH:MM:SS) = ", I0, ":", I2.2, ":", I2.2)', &
993 & int(ceiling(100._wp*(mytime/t_stop))), mytime, dt, t_step, wall_time_avg, wall_time, eta_hh, eta_mm, eta_ss
994 end if
995 else
996 if (proc_rank == 0 .and. mod(t_step - t_step_start, t_step_print) == 0) then
997 eta_sec = wall_time_avg*real(t_step_stop - t_step, wp)
998 eta_hh = int(eta_sec)/3600
999 eta_mm = mod(int(eta_sec), 3600)/60
1000 eta_ss = mod(int(eta_sec), 60)
1001 print '(" [", I3, "%] Time step ", I8, " of ", I0, " @ t_step = ", I8, " Time Avg = ", ES12.6, " Time/step= ", ES12.6, " ETA (HH:MM:SS) = ", I0, ":", I2.2, ":", I2.2)', &
1002 & int(ceiling(100._wp*(real(t_step - t_step_start)/(t_step_stop - t_step_start + 1)))), &
1003 & t_step - t_step_start + 1, t_step_stop - t_step_start + 1, t_step, wall_time_avg, wall_time, eta_hh, &
1004 & eta_mm, eta_ss
1005 end if
1006 end if
1007
1008 if (probe_wrt) then
1009 do i = 1, sys_size
1010
1011# 663 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1012#if defined(MFC_OpenACC)
1013# 663 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1014!$acc update host(q_cons_ts(1)%vf(i)%sf)
1015# 663 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1016#elif defined(MFC_OpenMP)
1017# 663 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1018!$omp target update from(q_cons_ts(1)%vf(i)%sf)
1019# 663 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1020#endif
1021 end do
1022 end if
1023
1024 ! Total-variation-diminishing (TVD) Runge-Kutta (RK) time-steppers
1025 if (any(time_stepper == (/1, 2, 3/))) then
1026 call s_tvd_rk(t_step, time_avg, time_stepper)
1027 end if
1028
1029 ! Advance time after RK so source terms see current-step time
1030 mytime = mytime + dt
1031
1032 if (relax) call s_infinite_relaxation_k(q_cons_ts(1)%vf)
1033
1034 ! Time-stepping loop controls
1035 t_step = t_step + 1
1036
1037 end subroutine s_perform_time_step
1038
1039 !> Collect per-process wall-clock times and write aggregate performance metrics to file
1040 impure subroutine s_save_performance_metrics(time_avg, time_final, io_time_avg, io_time_final, proc_time, io_proc_time, &
1041 & file_exists)
1042
1043 real(wp), intent(inout) :: time_avg, time_final
1044 real(wp), intent(inout) :: io_time_avg, io_time_final
1045 real(wp), dimension(:), intent(inout) :: proc_time
1046 real(wp), dimension(:), intent(inout) :: io_proc_time
1047 logical, intent(inout) :: file_exists
1048 real(wp) :: grind_time
1049
1050 call s_mpi_barrier()
1051
1052 if (num_procs > 1) then
1053 call mpi_bcast_time_step_values(proc_time, time_avg)
1054
1055 call mpi_bcast_time_step_values(io_proc_time, io_time_avg)
1056 end if
1057
1058 if (proc_rank == 0) then
1059 time_final = 0._wp
1060 io_time_final = 0._wp
1061 if (num_procs == 1) then
1062 time_final = time_avg
1063 io_time_final = io_time_avg
1064 else
1065 time_final = maxval(proc_time)
1066 io_time_final = maxval(io_proc_time)
1067 end if
1068
1069 grind_time = time_final*1.0e9_wp/(real(sys_size, wp)*real(maxval((/1, m_glb/)), wp)*real(maxval((/1, n_glb/)), &
1070 & wp)*real(maxval((/1, p_glb/)), wp))
1071
1072 print *, "Performance:", grind_time, "ns/gp/eq/rhs"
1073 inquire (file='time_data.dat', exist=file_exists)
1074 if (file_exists) then
1075 open (1, file='time_data.dat', position='append', status='old')
1076 else
1077 open (1, file='time_data.dat', status='new')
1078 write (1, '(A10, A15, A15)') "Ranks", "s/step", "ns/gp/eq/rhs"
1079 end if
1080
1081 write (1, '(I10, 2(F15.8))') num_procs, time_final, grind_time
1082
1083 close (1)
1084
1085 inquire (file='io_time_data.dat', exist=file_exists)
1086 if (file_exists) then
1087 open (1, file='io_time_data.dat', position='append', status='old')
1088 else
1089 open (1, file='io_time_data.dat', status='new')
1090 write (1, '(A10, A15)') "Ranks", "s/step"
1091 end if
1092
1093 write (1, '(I10, F15.8)') num_procs, io_time_final
1094 close (1)
1095 end if
1096
1097 end subroutine s_save_performance_metrics
1098
1099 !> Save conservative variable data to disk at the current time step
1100 impure subroutine s_save_data(t_step, start, finish, io_time_avg, nt)
1101
1102 integer, intent(inout) :: t_step
1103 real(wp), intent(inout) :: start, finish, io_time_avg
1104 integer, intent(inout) :: nt
1105 integer(kind=8) :: i, j, k, l
1106 integer :: stor
1107 integer :: save_count
1108
1109 if (down_sample) then
1110 call s_populate_variables_buffers(bc_type, q_cons_ts(1)%vf)
1111 end if
1112
1113 stor = 1
1114
1115 if (time_stepper /= 1) then
1116
1117# 759 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1118
1119# 759 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1120#if defined(MFC_OpenACC)
1121# 759 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1122!$acc parallel loop collapse(4) gang vector default(present) copyin(idwbuff)
1123# 759 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1124#elif defined(MFC_OpenMP)
1125# 759 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1126
1127# 759 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1128
1129# 759 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1130
1131# 759 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1132!$omp target teams loop defaultmap(firstprivate:scalar) bind(teams,parallel) collapse(4) defaultmap(tofrom:aggregate) defaultmap(tofrom:allocatable) defaultmap(tofrom:pointer) map(to:idwbuff)
1133# 759 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1134#endif
1135 do i = 1, sys_size
1136 do l = idwbuff(3)%beg, idwbuff(3)%end
1137 do k = idwbuff(2)%beg, idwbuff(2)%end
1138 do j = idwbuff(1)%beg, idwbuff(1)%end
1139 q_cons_ts(2)%vf(i)%sf(j, k, l) = q_cons_ts(1)%vf(i)%sf(j, k, l)
1140 end do
1141 end do
1142 end do
1143 end do
1144
1145# 769 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1146#if defined(MFC_OpenACC)
1147# 769 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1148!$acc end parallel loop
1149# 769 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1150#elif defined(MFC_OpenMP)
1151# 769 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1152
1153# 769 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1154!$omp end target teams loop
1155# 769 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1156#endif
1157 stor = 2
1158 end if
1159
1160 call cpu_time(start)
1161 call nvtxstartrange("SAVE-DATA")
1162 do i = 1, sys_size
1163#ifndef FRONTIER_UNIFIED
1164
1165# 777 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1166#if defined(MFC_OpenACC)
1167# 777 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1168!$acc update host(q_cons_ts(stor)%vf(i)%sf)
1169# 777 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1170#elif defined(MFC_OpenMP)
1171# 777 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1172!$omp target update from(q_cons_ts(stor)%vf(i)%sf)
1173# 777 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1174#endif
1175#endif
1176 do l = 0, p
1177 do k = 0, n
1178 do j = 0, m
1179 if (ieee_is_nan(real(q_cons_ts(stor)%vf(i)%sf(j, k, l), kind=wp))) then
1180 print *, "NaN(s) in timestep output.", j, k, l, i, proc_rank, t_step, m, n, p
1181 call s_mpi_abort("NaN(s) in timestep output.")
1182 end if
1183 end do
1184 end do
1185 end do
1186 end do
1187
1188 if (qbmm .and. .not. polytropic) then
1189
1190# 792 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1191#if defined(MFC_OpenACC)
1192# 792 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1193!$acc update host(pb_ts(1)%sf)
1194# 792 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1195#elif defined(MFC_OpenMP)
1196# 792 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1197!$omp target update from(pb_ts(1)%sf)
1198# 792 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1199#endif
1200
1201# 793 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1202#if defined(MFC_OpenACC)
1203# 793 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1204!$acc update host(mv_ts(1)%sf)
1205# 793 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1206#elif defined(MFC_OpenMP)
1207# 793 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1208!$omp target update from(mv_ts(1)%sf)
1209# 793 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1210#endif
1211 end if
1212
1213 if (cfl_dt) then
1214 save_count = int(mytime/t_save)
1215 else
1216 save_count = t_step
1217 end if
1218
1219 if (bubbles_lagrange) then
1220
1221# 803 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1222#if defined(MFC_OpenACC)
1223# 803 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1224!$acc update host(lag_id, mtn_pos, mtn_posPrev, mtn_vel, intfc_rad, intfc_vel, bub_R0, Rmax_stats, Rmin_stats, bub_dphidt, gas_p, gas_mv, gas_mg, gas_betaT, gas_betaC)
1225# 803 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1226#elif defined(MFC_OpenMP)
1227# 803 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1228!$omp target update from(lag_id, mtn_pos, mtn_posPrev, mtn_vel, intfc_rad, intfc_vel, bub_R0, Rmax_stats, Rmin_stats, bub_dphidt, gas_p, gas_mv, gas_mg, gas_betaT, gas_betaC)
1229# 803 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1230#endif
1231# 805 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1232 do i = 1, nbubs
1233 if (ieee_is_nan(intfc_rad(i, 1)) .or. intfc_rad(i, 1) <= 0._wp) then
1234 call s_mpi_abort("Bubble radius is negative or NaN, please reduce dt.")
1235 end if
1236 end do
1237
1238
1239# 811 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1240#if defined(MFC_OpenACC)
1241# 811 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1242!$acc update host(q_beta(1)%sf)
1243# 811 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1244#elif defined(MFC_OpenMP)
1245# 811 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1246!$omp target update from(q_beta(1)%sf)
1247# 811 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1248#endif
1249 call s_write_data_files(q_cons_ts(stor)%vf, q_t_sf, q_prim_vf, save_count, bc_type, q_beta(1))
1250
1251# 813 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1252#if defined(MFC_OpenACC)
1253# 813 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1254!$acc update host(Rmax_stats, Rmin_stats, gas_p, gas_mv, intfc_vel)
1255# 813 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1256#elif defined(MFC_OpenMP)
1257# 813 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1258!$omp target update from(Rmax_stats, Rmin_stats, gas_p, gas_mv, intfc_vel)
1259# 813 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1260#endif
1261 call s_write_restart_lag_bubbles(save_count) ! parallel
1262 if (lag_params%write_bubbles_stats) call s_write_lag_bubble_stats()
1263 else
1264 call s_write_data_files(q_cons_ts(stor)%vf, q_t_sf, q_prim_vf, save_count, bc_type)
1265 end if
1266
1267 ! Write IB kinematic state for restart
1268 if (ib) call s_write_ib_state_file(save_count)
1269
1270 call nvtxendrange
1271 call cpu_time(finish)
1272 if (cfl_dt) then
1273 nt = mytime/t_save
1274 else
1275 nt = int((t_step - t_step_start)/(t_step_save))
1276 end if
1277
1278 if (nt == 1) then
1279 io_time_avg = abs(finish - start)
1280 else
1281 io_time_avg = (abs(finish - start) + io_time_avg*(nt - 1))/nt
1282 end if
1283
1284 end subroutine s_save_data
1285
1286 !> Initialize all simulation sub-modules in the required dependency order
1287 impure subroutine s_initialize_modules
1288
1289 integer :: m_ds, n_ds, p_ds
1290 integer :: i
1291
1292 call s_initialize_global_parameters_module()
1293# 856 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1294 if (bubbles_euler .or. bubbles_lagrange) then
1295 call s_initialize_bubbles_model()
1296 end if
1297 call s_initialize_mpi_common_module()
1298 call s_initialize_mpi_proxy_module()
1299 call s_initialize_variables_conversion_module()
1300 if (grid_geometry == 3) call s_initialize_fftw_module()
1301
1302 if (bubbles_euler) call s_initialize_bubbles_ee_module()
1303 if (ib) call s_initialize_ibm_module()
1304 if (qbmm) call s_initialize_qbmm_module()
1305
1306 if (acoustic_source) then
1307 call s_initialize_acoustic_src()
1308 end if
1309
1310 if (viscous .and. (.not. igr)) then
1311 call s_initialize_viscous_module()
1312 end if
1313
1314 call s_initialize_rhs_module()
1315
1316 if (surface_tension) call s_initialize_surface_tension_module()
1317
1318 if (relax) call s_initialize_phasechange_module()
1319
1320 call s_initialize_data_output_module()
1321 call s_initialize_derived_variables_module()
1322 call s_initialize_time_steppers_module()
1323
1324 call s_initialize_boundary_common_module()
1325
1326 if (down_sample) then
1327 m_ds = int((m + 1)/3) - 1
1328 n_ds = int((n + 1)/3) - 1
1329 p_ds = int((p + 1)/3) - 1
1330
1331 allocate (q_cons_temp(1:sys_size))
1332 do i = 1, sys_size
1333 allocate (q_cons_temp(i)%sf(-1:m_ds + 1,-1:n_ds + 1,-1:p_ds + 1))
1334 end do
1335 end if
1336
1337 if (down_sample) then
1338 call s_read_data_files(q_cons_temp)
1339 call s_upsample_data(q_cons_ts(1)%vf, q_cons_temp)
1340 do i = 1, sys_size
1341
1342# 903 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1343#if defined(MFC_OpenACC)
1344# 903 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1345!$acc update device(q_cons_ts(1)%vf(i)%sf)
1346# 903 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1347#elif defined(MFC_OpenMP)
1348# 903 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1349!$omp target update to(q_cons_ts(1)%vf(i)%sf)
1350# 903 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1351#endif
1352 end do
1353 do i = 1, sys_size
1354 deallocate (q_cons_temp(i)%sf)
1355 end do
1356 deallocate (q_cons_temp)
1357 else
1358 call s_read_data_files(q_cons_ts(1)%vf)
1359 end if
1360
1361 call s_populate_grid_variables_buffers()
1362
1363 if (model_eqns == 3) call s_initialize_internal_energy_equations(q_cons_ts(1)%vf)
1364 if (ib) then
1365 if (cfl_dt .and. n_start > 0) then
1366 call s_read_ib_restart_data(n_start)
1367 else if (t_step_start > 0) then
1368 call s_read_ib_restart_data(t_step_start)
1369 end if
1370 call s_ibm_setup()
1371 if (t_step_start == 0 .or. (cfl_dt .and. n_start == 0)) then
1372 call s_write_ib_data_file(0)
1373 call s_write_ib_state_file(0)
1374 end if
1375 end if
1376 if (bodyforces) call s_initialize_body_forces_module()
1377 if (acoustic_source) call s_precalculate_acoustic_spatial_sources()
1378
1379 ! Initialize the Temperature cache.
1380 if (chemistry) call s_compute_q_t_sf(q_t_sf, q_cons_ts(1)%vf, idwint)
1381
1382 ! Computation of parameters, allocation of memory, association of pointers, and/or execution of any other tasks that are
1383 ! needed to properly configure the modules. The preparations below DO DEPEND on the grid being complete.
1384 if (igr) then
1385 call s_initialize_igr_module()
1386 end if
1387 if (.not. igr) then
1388 if (recon_type == weno_type) then
1389 call s_initialize_weno_module()
1390 else if (recon_type == muscl_type) then
1391 call s_initialize_muscl_module()
1392 end if
1393 call s_initialize_cbc_module()
1394 call s_initialize_riemann_solvers_module()
1395 end if
1396 if (int_comp > 0) call s_initialize_thinc_module()
1397 call s_initialize_derived_variables()
1398 if (bubbles_lagrange) call s_initialize_bubbles_el_module(q_cons_ts(1)%vf)
1399
1400 if (hypoelasticity) call s_initialize_hypoelastic_module()
1401 if (hyperelasticity) call s_initialize_hyperelastic_module()
1402
1403 end subroutine s_initialize_modules
1404
1405 !> Set up the MPI execution environment, bind GPUs, and decompose the computational domain
1406 impure subroutine s_initialize_mpi_domain
1407
1408 integer :: ierr
1409
1410#ifdef MFC_GPU
1411 real(wp) :: starttime, endtime
1412 integer :: num_devices, local_size, num_nodes, ppn, my_device_num
1413 integer :: dev, devnum, local_rank
1414#ifdef MFC_MPI
1415 integer :: local_comm
1416#endif
1417#if defined(MFC_OpenACC)
1418 integer(acc_device_kind) :: devtype
1419#endif
1420#endif
1421
1422 call s_mpi_initialize()
1423
1424#ifdef MFC_GPU
1425#ifndef MFC_MPI
1426 local_size = 1
1427 local_rank = 0
1428#else
1429 call mpi_comm_split_type(mpi_comm_world, mpi_comm_type_shared, 0, mpi_info_null, local_comm, ierr)
1430 call mpi_comm_size(local_comm, local_size, ierr)
1431 call mpi_comm_rank(local_comm, local_rank, ierr)
1432#endif
1433#if defined(MFC_OpenACC)
1434 devtype = acc_get_device_type()
1435 devnum = acc_get_num_devices(devtype)
1436 dev = mod(local_rank, devnum)
1437
1438 call acc_set_device_num(dev, devtype)
1439#elif defined(MFC_OpenMP)
1440 devnum = omp_get_num_devices()
1441 dev = mod(local_rank, devnum)
1442 call omp_set_default_device(dev)
1443#endif
1444#endif
1445
1446 if (proc_rank == 0) then
1447 call s_assign_default_values_to_user_inputs()
1448 call s_read_input_file()
1449 call s_check_input_file()
1450
1451 print '(" Simulating a ", A, " ", I0, "x", I0, "x", I0, " case on ", I0, " rank(s) ", A, ".")', &
1452# 1005 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1453 "regular", &
1454# 1009 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1455 m, n, p, num_procs, &
1456#if defined(MFC_OpenACC)
1457 "with OpenACC offloading"
1458#elif defined(MFC_OpenMP)
1459 "with OpenMP offloading"
1460#else
1461 "on CPUs"
1462#endif
1463 end if
1464
1465 call s_mpi_bcast_user_inputs()
1466
1467 ! Save original BCs before decomposition overwrites them with MPI neighbor ranks
1468 ib_bc_x = bc_x
1469 ib_bc_y = bc_y
1470 ib_bc_z = bc_z
1471
1472 call s_initialize_parallel_io()
1473
1474 call s_mpi_decompose_computational_domain()
1475
1476 end subroutine s_initialize_mpi_domain
1477
1478 !> Transfer initial conservative variable and model parameter data to the GPU device
1479 subroutine s_initialize_gpu_vars
1480
1481 integer :: i
1482
1483 if (.not. down_sample) then
1484 do i = 1, sys_size
1485
1486# 1039 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1487#if defined(MFC_OpenACC)
1488# 1039 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1489!$acc update device(q_cons_ts(1)%vf(i)%sf)
1490# 1039 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1491#elif defined(MFC_OpenMP)
1492# 1039 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1493!$omp target update to(q_cons_ts(1)%vf(i)%sf)
1494# 1039 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1495#endif
1496 end do
1497 end if
1498
1499 if (qbmm .and. .not. polytropic) then
1500
1501# 1044 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1502#if defined(MFC_OpenACC)
1503# 1044 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1504!$acc update device(pb_ts(1)%sf, mv_ts(1)%sf)
1505# 1044 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1506#elif defined(MFC_OpenMP)
1507# 1044 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1508!$omp target update to(pb_ts(1)%sf, mv_ts(1)%sf)
1509# 1044 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1510#endif
1511 end if
1512 if (chemistry) then
1513
1514# 1047 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1515#if defined(MFC_OpenACC)
1516# 1047 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1517!$acc update device(q_T_sf%sf)
1518# 1047 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1519#elif defined(MFC_OpenMP)
1520# 1047 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1521!$omp target update to(q_T_sf%sf)
1522# 1047 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1523#endif
1524 end if
1525
1526
1527# 1050 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1528#if defined(MFC_OpenACC)
1529# 1050 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1530!$acc update device(chem_params)
1531# 1050 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1532#elif defined(MFC_OpenMP)
1533# 1050 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1534!$omp target update to(chem_params)
1535# 1050 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1536#endif
1537
1538
1539# 1052 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1540#if defined(MFC_OpenACC)
1541# 1052 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1542!$acc update device(R0ref, p0ref, rho0ref, ss, pv, vd, mu_l, mu_v, mu_g, gam_v, gam_g, M_v, M_g, R_v, R_g, Tw, cp_v, cp_g, k_vl, k_gl, gam, gam_m, Eu, Ca, Web, Re_inv, Pe_c, phi_vg, phi_gv, omegaN, bubbles_euler, polytropic, polydisperse, qbmm, ptil, bubble_model, thermal, poly_sigma, adv_n, adap_dt, adap_dt_tol, adap_dt_max_iters, eqn_idx%n, pi_fac, low_Mach)
1543# 1052 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1544#elif defined(MFC_OpenMP)
1545# 1052 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1546!$omp target update to(R0ref, p0ref, rho0ref, ss, pv, vd, mu_l, mu_v, mu_g, gam_v, gam_g, M_v, M_g, R_v, R_g, Tw, cp_v, cp_g, k_vl, k_gl, gam, gam_m, Eu, Ca, Web, Re_inv, Pe_c, phi_vg, phi_gv, omegaN, bubbles_euler, polytropic, polydisperse, qbmm, ptil, bubble_model, thermal, poly_sigma, adv_n, adap_dt, adap_dt_tol, adap_dt_max_iters, eqn_idx%n, pi_fac, low_Mach)
1547# 1052 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1548#endif
1549# 1056 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1550
1551 if (bubbles_euler) then
1552
1553# 1058 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1554#if defined(MFC_OpenACC)
1555# 1058 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1556!$acc update device(weight, R0)
1557# 1058 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1558#elif defined(MFC_OpenMP)
1559# 1058 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1560!$omp target update to(weight, R0)
1561# 1058 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1562#endif
1563 if (.not. polytropic) then
1564
1565# 1060 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1566#if defined(MFC_OpenACC)
1567# 1060 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1568!$acc update device(pb0, Pe_T, k_g, k_v, mass_g0, mass_v0, Re_trans_T, Re_trans_c, Im_trans_T, Im_trans_c)
1569# 1060 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1570#elif defined(MFC_OpenMP)
1571# 1060 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1572!$omp target update to(pb0, Pe_T, k_g, k_v, mass_g0, mass_v0, Re_trans_T, Re_trans_c, Im_trans_T, Im_trans_c)
1573# 1060 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1574#endif
1575 else if (qbmm) then
1576
1577# 1062 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1578#if defined(MFC_OpenACC)
1579# 1062 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1580!$acc update device(pb0)
1581# 1062 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1582#elif defined(MFC_OpenMP)
1583# 1062 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1584!$omp target update to(pb0)
1585# 1062 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1586#endif
1587 end if
1588 end if
1589
1590
1591# 1066 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1592#if defined(MFC_OpenACC)
1593# 1066 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1594!$acc update device(adv_n, adap_dt, adap_dt_tol, adap_dt_max_iters, pi_fac, low_Mach)
1595# 1066 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1596#elif defined(MFC_OpenMP)
1597# 1066 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1598!$omp target update to(adv_n, adap_dt, adap_dt_tol, adap_dt_max_iters, pi_fac, low_Mach)
1599# 1066 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1600#endif
1601
1602
1603# 1068 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1604#if defined(MFC_OpenACC)
1605# 1068 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1606!$acc update device(acoustic_source, num_source)
1607# 1068 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1608#elif defined(MFC_OpenMP)
1609# 1068 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1610!$omp target update to(acoustic_source, num_source)
1611# 1068 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1612#endif
1613
1614# 1069 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1615#if defined(MFC_OpenACC)
1616# 1069 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1617!$acc update device(sigma, surface_tension)
1618# 1069 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1619#elif defined(MFC_OpenMP)
1620# 1069 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1621!$omp target update to(sigma, surface_tension)
1622# 1069 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1623#endif
1624
1625
1626# 1071 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1627#if defined(MFC_OpenACC)
1628# 1071 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1629!$acc update device(dx, dy, dz, x_cb, x_cc, y_cb, y_cc, z_cb, z_cc)
1630# 1071 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1631#elif defined(MFC_OpenMP)
1632# 1071 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1633!$omp target update to(dx, dy, dz, x_cb, x_cc, y_cb, y_cc, z_cb, z_cc)
1634# 1071 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1635#endif
1636
1637# 1072 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1638#if defined(MFC_OpenACC)
1639# 1072 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1640!$acc update device(bc_x%beg, bc_x%end, bc_y%beg, bc_y%end, bc_z%beg, bc_z%end)
1641# 1072 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1642#elif defined(MFC_OpenMP)
1643# 1072 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1644!$omp target update to(bc_x%beg, bc_x%end, bc_y%beg, bc_y%end, bc_z%beg, bc_z%end)
1645# 1072 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1646#endif
1647
1648# 1073 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1649#if defined(MFC_OpenACC)
1650# 1073 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1651!$acc update device(bc_x%vb1, bc_x%vb2, bc_x%vb3, bc_x%ve1, bc_x%ve2, bc_x%ve3)
1652# 1073 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1653#elif defined(MFC_OpenMP)
1654# 1073 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1655!$omp target update to(bc_x%vb1, bc_x%vb2, bc_x%vb3, bc_x%ve1, bc_x%ve2, bc_x%ve3)
1656# 1073 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1657#endif
1658
1659# 1074 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1660#if defined(MFC_OpenACC)
1661# 1074 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1662!$acc update device(bc_y%vb1, bc_y%vb2, bc_y%vb3, bc_y%ve1, bc_y%ve2, bc_y%ve3)
1663# 1074 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1664#elif defined(MFC_OpenMP)
1665# 1074 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1666!$omp target update to(bc_y%vb1, bc_y%vb2, bc_y%vb3, bc_y%ve1, bc_y%ve2, bc_y%ve3)
1667# 1074 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1668#endif
1669
1670# 1075 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1671#if defined(MFC_OpenACC)
1672# 1075 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1673!$acc update device(bc_z%vb1, bc_z%vb2, bc_z%vb3, bc_z%ve1, bc_z%ve2, bc_z%ve3)
1674# 1075 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1675#elif defined(MFC_OpenMP)
1676# 1075 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1677!$omp target update to(bc_z%vb1, bc_z%vb2, bc_z%vb3, bc_z%ve1, bc_z%ve2, bc_z%ve3)
1678# 1075 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1679#endif
1680
1681
1682# 1077 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1683#if defined(MFC_OpenACC)
1684# 1077 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1685!$acc update device(bc_x%grcbc_in, bc_x%grcbc_out, bc_x%grcbc_vel_out)
1686# 1077 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1687#elif defined(MFC_OpenMP)
1688# 1077 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1689!$omp target update to(bc_x%grcbc_in, bc_x%grcbc_out, bc_x%grcbc_vel_out)
1690# 1077 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1691#endif
1692
1693# 1078 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1694#if defined(MFC_OpenACC)
1695# 1078 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1696!$acc update device(bc_y%grcbc_in, bc_y%grcbc_out, bc_y%grcbc_vel_out)
1697# 1078 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1698#elif defined(MFC_OpenMP)
1699# 1078 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1700!$omp target update to(bc_y%grcbc_in, bc_y%grcbc_out, bc_y%grcbc_vel_out)
1701# 1078 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1702#endif
1703
1704# 1079 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1705#if defined(MFC_OpenACC)
1706# 1079 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1707!$acc update device(bc_z%grcbc_in, bc_z%grcbc_out, bc_z%grcbc_vel_out)
1708# 1079 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1709#elif defined(MFC_OpenMP)
1710# 1079 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1711!$omp target update to(bc_z%grcbc_in, bc_z%grcbc_out, bc_z%grcbc_vel_out)
1712# 1079 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1713#endif
1714
1715
1716# 1081 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1717#if defined(MFC_OpenACC)
1718# 1081 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1719!$acc update device(bc_x%isothermal_in, bc_x%isothermal_out)
1720# 1081 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1721#elif defined(MFC_OpenMP)
1722# 1081 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1723!$omp target update to(bc_x%isothermal_in, bc_x%isothermal_out)
1724# 1081 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1725#endif
1726
1727# 1082 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1728#if defined(MFC_OpenACC)
1729# 1082 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1730!$acc update device(bc_y%isothermal_in, bc_y%isothermal_out)
1731# 1082 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1732#elif defined(MFC_OpenMP)
1733# 1082 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1734!$omp target update to(bc_y%isothermal_in, bc_y%isothermal_out)
1735# 1082 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1736#endif
1737
1738# 1083 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1739#if defined(MFC_OpenACC)
1740# 1083 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1741!$acc update device(bc_z%isothermal_in, bc_z%isothermal_out)
1742# 1083 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1743#elif defined(MFC_OpenMP)
1744# 1083 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1745!$omp target update to(bc_z%isothermal_in, bc_z%isothermal_out)
1746# 1083 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1747#endif
1748
1749# 1084 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1750#if defined(MFC_OpenACC)
1751# 1084 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1752!$acc update device(bc_x%Twall_in, bc_x%Twall_out, bc_y%Twall_in, bc_y%Twall_out, bc_z%Twall_in, bc_z%Twall_out)
1753# 1084 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1754#elif defined(MFC_OpenMP)
1755# 1084 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1756!$omp target update to(bc_x%Twall_in, bc_x%Twall_out, bc_y%Twall_in, bc_y%Twall_out, bc_z%Twall_in, bc_z%Twall_out)
1757# 1084 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1758#endif
1759
1760
1761# 1086 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1762#if defined(MFC_OpenACC)
1763# 1086 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1764!$acc update device(relax, relax_model)
1765# 1086 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1766#elif defined(MFC_OpenMP)
1767# 1086 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1768!$omp target update to(relax, relax_model)
1769# 1086 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1770#endif
1771 if (relax) then
1772
1773# 1088 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1774#if defined(MFC_OpenACC)
1775# 1088 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1776!$acc update device(palpha_eps, ptgalpha_eps)
1777# 1088 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1778#elif defined(MFC_OpenMP)
1779# 1088 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1780!$omp target update to(palpha_eps, ptgalpha_eps)
1781# 1088 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1782#endif
1783 end if
1784
1785 if (ib) then
1786
1787# 1092 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1788#if defined(MFC_OpenACC)
1789# 1092 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1790!$acc update device(ib_markers%sf)
1791# 1092 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1792#elif defined(MFC_OpenMP)
1793# 1092 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1794!$omp target update to(ib_markers%sf)
1795# 1092 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1796#endif
1797 end if
1798# 1095 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1799
1800# 1095 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1801#if defined(MFC_OpenACC)
1802# 1095 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1803!$acc update device(igr, nb, igr_order)
1804# 1095 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1805#elif defined(MFC_OpenMP)
1806# 1095 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1807!$omp target update to(igr, nb, igr_order)
1808# 1095 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1809#endif
1810# 1097 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1811# 1105 "/home/runner/work/MFC/MFC/src/simulation/m_start_up.fpp"
1812
1813 end subroutine s_initialize_gpu_vars
1814
1815 !> Finalize and deallocate all simulation sub-modules in reverse initialization order
1816 impure subroutine s_finalize_modules
1817
1818 call s_finalize_time_steppers_module()
1819 if (hypoelasticity) call s_finalize_hypoelastic_module()
1820 if (hyperelasticity) call s_finalize_hyperelastic_module()
1821 call s_finalize_derived_variables_module()
1822 call s_finalize_data_output_module()
1823 call s_finalize_rhs_module()
1824 if (igr) then
1825 call s_finalize_igr_module()
1826 else
1827 call s_finalize_cbc_module()
1828 call s_finalize_riemann_solvers_module()
1829 if (recon_type == weno_type) then
1830 call s_finalize_weno_module()
1831 else if (recon_type == muscl_type) then
1832 call s_finalize_muscl_module()
1833 end if
1834 end if
1835 if (int_comp > 0) call s_finalize_thinc_module()
1836 call s_finalize_variables_conversion_module()
1837 if (grid_geometry == 3) call s_finalize_fftw_module
1838 call s_finalize_mpi_common_module()
1839 call s_finalize_global_parameters_module()
1840 call s_finalize_boundary_common_module()
1841 if (relax) call s_finalize_relaxation_solver_module()
1842 if (bubbles_lagrange) call s_finalize_lagrangian_solver()
1843 if (viscous .and. (.not. igr)) then
1844 call s_finalize_viscous_module()
1845 end if
1846 call s_finalize_mpi_proxy_module()
1847
1848 if (surface_tension) call s_finalize_surface_tension_module()
1849 if (bodyforces) call s_finalize_body_forces_module()
1850 if (ib) call s_finalize_ibm_module()
1851
1852 call s_mpi_finalize()
1853
1854 end subroutine s_finalize_modules
1855
1856 !> @brief Reads IB kinematic state from restart_data/ib_state.dat on restart. Rank 0 reads the last num_ibs records and
1857 !! broadcasts to all ranks. Overwrites patch_ib vel, angular_vel, angles, and centroid.
1858 impure subroutine s_read_ib_restart_data(t_step)
1859
1860 integer, intent(in) :: t_step
1861 character(len=path_len + 2*name_len) :: file_loc
1862 integer :: i, ios, file_unit, ierr
1863 integer, parameter :: nfields_per_ib = 20
1864 real(wp) :: ib_buf(nfields_per_ib)
1865 logical :: file_exist
1866
1867 write (file_loc, '(A,I0,A)') '/restart_data/ib_state_', t_step, '.dat'
1868 file_loc = trim(case_dir) // trim(file_loc)
1869
1870 if (proc_rank == 0) then
1871 inquire (file=trim(file_loc), exist=file_exist)
1872 if (.not. file_exist) then
1873 call s_mpi_abort('Cannot open IB state file for restart: ' // trim(file_loc))
1874 end if
1875
1876 open (newunit=file_unit, file=trim(file_loc), form='unformatted', access='stream', status='old', iostat=ios)
1877 if (ios /= 0) call s_mpi_abort('Error opening IB state restart file: ' // trim(file_loc))
1878
1879 do i = 1, num_ibs
1880 read (file_unit, iostat=ios) ib_buf
1881 if (ios /= 0) call s_mpi_abort('Error reading IB state restart file')
1882
1883 patch_ib(i)%vel = ib_buf(8:10)
1884 patch_ib(i)%angular_vel = ib_buf(11:13)
1885 patch_ib(i)%angles = ib_buf(14:16)
1886 patch_ib(i)%x_centroid = ib_buf(17)
1887 patch_ib(i)%y_centroid = ib_buf(18)
1888 patch_ib(i)%z_centroid = ib_buf(19)
1889 end do
1890
1891 close (file_unit)
1892 end if
1893
1894#ifdef MFC_MPI
1895 do i = 1, num_ibs
1896 call mpi_bcast(patch_ib(i)%vel, 3, mpi_p, 0, mpi_comm_world, ierr)
1897 call mpi_bcast(patch_ib(i)%angular_vel, 3, mpi_p, 0, mpi_comm_world, ierr)
1898 call mpi_bcast(patch_ib(i)%angles, 3, mpi_p, 0, mpi_comm_world, ierr)
1899 call mpi_bcast(patch_ib(i)%x_centroid, 1, mpi_p, 0, mpi_comm_world, ierr)
1900 call mpi_bcast(patch_ib(i)%y_centroid, 1, mpi_p, 0, mpi_comm_world, ierr)
1901 call mpi_bcast(patch_ib(i)%z_centroid, 1, mpi_p, 0, mpi_comm_world, ierr)
1902 end do
1903#endif
1904
1905 end subroutine s_read_ib_restart_data
1906
1907end module m_start_up
q_cons_vf
type(scalar_field), dimension(sys_size), intent(inout) q_cons_vf
Definition m_phase_change.fpp.f90:1065
m_acoustic_src
One-way acoustic source injection, Maeda and Colonius JCP (2017).
Definition m_acoustic_src.fpp.f90:317
m_acoustic_src::s_precalculate_acoustic_spatial_sources
impure subroutine, public s_precalculate_acoustic_spatial_sources
Pre-compute non-zero spatial source weights before time-stepping.
Definition m_acoustic_src.fpp.f90:1151
m_acoustic_src::s_initialize_acoustic_src
impure subroutine, public s_initialize_acoustic_src
Initialize the acoustic source module.
Definition m_acoustic_src.fpp.f90:493
m_body_forces
Computes gravitational and user-defined body force source terms for the momentum equations.
Definition m_body_forces.fpp.f90:317
m_body_forces::s_initialize_body_forces_module
impure subroutine, public s_initialize_body_forces_module
Initialize the body forces module.
Definition m_body_forces.fpp.f90:348
m_body_forces::s_finalize_body_forces_module
impure subroutine, public s_finalize_body_forces_module
Finalize the body forces module.
Definition m_body_forces.fpp.f90:734
m_boundary_common
Noncharacteristic and processor boundary condition application for ghost cells and buffer regions.
Definition m_boundary_common.fpp.f90:328
m_boundary_common::s_initialize_boundary_common_module
impure subroutine, public s_initialize_boundary_common_module()
Allocate and set up boundary condition buffer arrays for all coordinate directions.
Definition m_boundary_common.fpp.f90:373
m_boundary_common::s_finalize_boundary_common_module
subroutine, public s_finalize_boundary_common_module()
Deallocate boundary condition buffer arrays allocated during module initialization.
Definition m_boundary_common.fpp.f90:3844
m_boundary_common::s_read_parallel_boundary_condition_files
subroutine, public s_read_parallel_boundary_condition_files(bc_type)
Read boundary condition type and buffer data from per-rank parallel files using MPI I/O.
Definition m_boundary_common.fpp.f90:3460
m_boundary_common::s_populate_grid_variables_buffers
subroutine, public s_populate_grid_variables_buffers
Populate the buffers of the grid variables, which are constituted of the cell-boundary locations and ...
Definition m_boundary_common.fpp.f90:3660
m_boundary_common::s_populate_variables_buffers
impure subroutine, public s_populate_variables_buffers(bc_type, q_prim_vf, pb_in, mv_in, q_t_sf)
Populate the buffers of the primitive variables based on the selected boundary conditions.
Definition m_boundary_common.fpp.f90:685
m_boundary_common::s_read_serial_boundary_condition_files
subroutine, public s_read_serial_boundary_condition_files(step_dirpath, bc_type)
Read boundary condition type and buffer data from serial (unformatted) restart files.
Definition m_boundary_common.fpp.f90:3396
m_boundary_common::s_assign_default_bc_type
subroutine, public s_assign_default_bc_type(bc_type)
Initialize the per-cell boundary condition type arrays with the global default BC values.
Definition m_boundary_common.fpp.f90:3603
m_bubbles_ee
Computes ensemble-averaged (Euler–Euler) bubble source terms for radius, velocity,...
Definition m_bubbles_EE.fpp.f90:317
m_bubbles_ee::s_initialize_bubbles_ee_module
impure subroutine s_initialize_bubbles_ee_module
Initialize the Euler-Euler bubble module.
Definition m_bubbles_EE.fpp.f90:371
m_bubbles_el
Tracks Lagrangian bubbles and couples their dynamics to the Eulerian flow via volume averaging.
Definition m_bubbles_EL.fpp.f90:317
m_bubbles_el::s_write_lag_bubble_stats
impure subroutine s_write_lag_bubble_stats()
Write the maximum and minimum radius statistics for each bubble.
Definition m_bubbles_EL.fpp.f90:3586
m_bubbles_el::s_write_restart_lag_bubbles
impure subroutine s_write_restart_lag_bubbles(t_step)
Write restart files for the Lagrangian bubble solver.
Definition m_bubbles_EL.fpp.f90:3399
m_bubbles_el::nbubs
integer nbubs
Number of bubbles in the local domain.
Definition m_bubbles_EL.fpp.f90:429
m_bubbles_el::s_initialize_bubbles_el_module
impure subroutine s_initialize_bubbles_el_module(q_cons_vf)
Initializes the lagrangian subgrid bubble solver.
Definition m_bubbles_EL.fpp.f90:450
m_bubbles_el::q_beta
type(scalar_field), dimension(:), allocatable q_beta
Projection of the lagrangian particles in the Eulerian framework.
Definition m_bubbles_EL.fpp.f90:432
m_bubbles_el::intfc_rad
real(wp), dimension(:,:), allocatable intfc_rad
Bubble radius.
Definition m_bubbles_EL.fpp.f90:368
m_bubbles_el::s_finalize_lagrangian_solver
impure subroutine s_finalize_lagrangian_solver()
Finalize the Lagrangian bubble solver.
Definition m_bubbles_EL.fpp.f90:3687
m_cbc
Characteristic boundary conditions (CBC) for slip walls, non-reflecting subsonic inflow/outflow,...
Definition m_cbc.fpp.f90:328
m_cbc::s_initialize_cbc_module
impure subroutine, public s_initialize_cbc_module
Initialize the CBC module.
Definition m_cbc.fpp.f90:508
m_cbc::s_finalize_cbc_module
impure subroutine, public s_finalize_cbc_module
Module deallocation and/or disassociation procedures.
Definition m_cbc.fpp.f90:6339
m_checker_common
Shared input validation checks for grid dimensions and AMD GPU compiler limits.
Definition m_checker_common.fpp.f90:328
m_checker_common::s_check_inputs_common
impure subroutine, public s_check_inputs_common
Checks compatibility of parameters in the input file. Used by all three stages.
Definition m_checker_common.fpp.f90:343
m_checker
Validates simulation input parameters for consistency and supported configurations.
Definition m_checker.fpp.f90:328
m_checker::s_check_inputs
impure subroutine, public s_check_inputs
Checks compatibility of parameters in the input file. Used by the simulation stage.
Definition m_checker.fpp.f90:343
m_chemistry
Multi-species chemistry interface for thermodynamic properties, reaction rates, and transport coeffic...
Definition m_chemistry.fpp.f90:329
m_chemistry::s_compute_q_t_sf
subroutine s_compute_q_t_sf(q_t_sf, q_cons_vf, bounds)
Initialize the temperature field from conservative variables by inverting the energy equation.
Definition m_chemistry.fpp.f90:421
m_compile_specific
Platform-specific file and directory operations: create, delete, inquire, getcwd, and basename.
Definition m_compile_specific.f90:6
m_compile_specific::my_inquire
impure subroutine my_inquire(fileloc, dircheck)
Inquires on the existence of a directory.
Definition m_compile_specific.f90:57
m_data_output
Writes solution data, run-time stability diagnostics (ICFL, VCFL, CCFL, Rc), and probe/center-of-mass...
Definition m_data_output.fpp.f90:328
m_data_output::s_initialize_data_output_module
impure subroutine, public s_initialize_data_output_module
Initialize the data output module.
Definition m_data_output.fpp.f90:2181
m_data_output::s_finalize_data_output_module
impure subroutine, public s_finalize_data_output_module
Module deallocation and/or disassociation procedures.
Definition m_data_output.fpp.f90:2344
m_data_output::s_write_data_files
impure subroutine, public s_write_data_files(q_cons_vf, q_t_sf, q_prim_vf, t_step, bc_type, beta)
Write data files. Dispatch subroutine that replaces procedure pointer.
Definition m_data_output.fpp.f90:405
m_data_output::s_write_ib_state_file
impure subroutine, public s_write_ib_state_file(time_step)
Writes IB state records to restart_data/ib_state.dat. Must be called only on rank 0.
Definition m_data_output.fpp.f90:1496
m_data_output::s_write_ib_data_file
subroutine, public s_write_ib_data_file(time_step)
Dispatch immersed boundary data output to the serial or parallel writer.
Definition m_data_output.fpp.f90:1374
m_derived_types
Shared derived types for field data, patch geometry, bubble dynamics, and MPI I/O structures.
Definition m_derived_types.fpp.f90:317
m_derived_variables
Derives diagnostic flow quantities (vorticity, speed of sound, numerical Schlieren,...
Definition m_derived_variables.fpp.f90:318
m_derived_variables::s_initialize_derived_variables
impure subroutine, public s_initialize_derived_variables
Allocate and open derived variables. Computing FD coefficients.
Definition m_derived_variables.fpp.f90:629
m_derived_variables::s_initialize_derived_variables_module
impure subroutine, public s_initialize_derived_variables_module
Computation of parameters, allocation procedures, and/or any other tasks needed to properly setup the...
Definition m_derived_variables.fpp.f90:375
m_derived_variables::s_finalize_derived_variables_module
impure subroutine, public s_finalize_derived_variables_module
Deallocation procedures for the module.
Definition m_derived_variables.fpp.f90:1754
m_global_parameters
Global parameters for the computational domain, fluid properties, and simulation algorithm configurat...
Definition m_global_parameters.fpp.f90:328
m_global_parameters::ib_bc_z
type(int_bounds_info) ib_bc_z
Definition m_global_parameters.fpp.f90:703
m_global_parameters::mytime
real(wp) mytime
Current simulation time.
Definition m_global_parameters.fpp.f90:1306
m_global_parameters::w_x
real(wp) w_x
Definition m_global_parameters.fpp.f90:529
m_global_parameters::web
real(wp) web
Weber number.
Definition m_global_parameters.fpp.f90:1045
m_global_parameters::null_weights
logical null_weights
Null undesired WENO weights.
Definition m_global_parameters.fpp.f90:486
m_global_parameters::bubbles_euler
logical bubbles_euler
Bubbles euler on/off.
Definition m_global_parameters.fpp.f90:1073
m_global_parameters::cont_damage_s
real(wp) cont_damage_s
Exponent s for continuum damage modeling.
Definition m_global_parameters.fpp.f90:1358
m_global_parameters::grid_geometry
integer grid_geometry
Definition m_global_parameters.fpp.f90:366
m_global_parameters::wave_speeds
integer wave_speeds
Wave speeds estimation method.
Definition m_global_parameters.fpp.f90:483
m_global_parameters::cont_damage
logical cont_damage
Continuum damage modeling.
Definition m_global_parameters.fpp.f90:509
m_global_parameters::p_glb
integer p_glb
Definition m_global_parameters.fpp.f90:360
m_global_parameters::igr
logical igr
Use information geometric regularization.
Definition m_global_parameters.fpp.f90:461
m_global_parameters::hypoelasticity
logical hypoelasticity
hypoelasticity modeling
Definition m_global_parameters.fpp.f90:488
m_global_parameters::s_assign_default_values_to_user_inputs
impure subroutine s_assign_default_values_to_user_inputs
Assigns default values to the user inputs before reading them in. This enables for an easier consiste...
Definition m_global_parameters.fpp.f90:1395
m_global_parameters::k_x
real(wp) k_x
Definition m_global_parameters.fpp.f90:535
m_global_parameters::s_finalize_global_parameters_module
impure subroutine s_finalize_global_parameters_module
Module deallocation and/or disassociation procedures.
Definition m_global_parameters.fpp.f90:3705
m_global_parameters::thermal
integer thermal
Thermal behavior. 1 = adiabatic, 2 = isotherm, 3 = transfer.
Definition m_global_parameters.fpp.f90:1105
m_global_parameters::avg_state
integer avg_state
Average state evaluation method.
Definition m_global_parameters.fpp.f90:484
m_global_parameters::g_x
real(wp) g_x
Definition m_global_parameters.fpp.f90:533
m_global_parameters::weno_avg
logical weno_avg
Average left/right cell-boundary states.
Definition m_global_parameters.fpp.f90:479
m_global_parameters::p_x
real(wp) p_x
Definition m_global_parameters.fpp.f90:531
m_global_parameters::idwint
type(int_bounds_info), dimension(1:3) idwint
Definition m_global_parameters.fpp.f90:841
m_global_parameters::z_cb
real(wp), dimension(:), allocatable, target z_cb
Definition m_global_parameters.fpp.f90:382
m_global_parameters::recon_type
integer recon_type
Reconstruction Type.
Definition m_global_parameters.fpp.f90:444
m_global_parameters::igr_pres_lim
logical igr_pres_lim
Limit to positive pressures for IGR.
Definition m_global_parameters.fpp.f90:462
m_global_parameters::p_z
real(wp) p_z
Definition m_global_parameters.fpp.f90:541
m_global_parameters::chemistry
logical, parameter chemistry
Chemistry modeling.
Definition m_global_parameters.fpp.f90:506
m_global_parameters::wenoz
logical wenoz
WENO-Z.
Definition m_global_parameters.fpp.f90:454
m_global_parameters::ib_bc_y
type(int_bounds_info) ib_bc_y
Definition m_global_parameters.fpp.f90:703
m_global_parameters::cfl_adap_dt
logical cfl_adap_dt
Definition m_global_parameters.fpp.f90:431
m_global_parameters::acoustic_source
logical acoustic_source
Acoustic source switch.
Definition m_global_parameters.fpp.f90:1260
m_global_parameters::mpi_info_int
integer mpi_info_int
Definition m_global_parameters.fpp.f90:816
m_global_parameters::ib_coefficient_of_friction
real(wp) ib_coefficient_of_friction
Definition m_global_parameters.fpp.f90:1007
m_global_parameters::k_z
real(wp) k_z
Definition m_global_parameters.fpp.f90:545
m_global_parameters::ib_bc_x
type(int_bounds_info) ib_bc_x
Definition m_global_parameters.fpp.f90:703
m_global_parameters::rhoref
real(wp) rhoref
Definition m_global_parameters.fpp.f90:986
m_global_parameters::bc_z
type(int_bounds_info) bc_z
Definition m_global_parameters.fpp.f90:698
m_global_parameters::probe_wrt
logical probe_wrt
Definition m_global_parameters.fpp.f90:977
m_global_parameters::num_fluids
integer num_fluids
number of fluids in the simulation
Definition m_global_parameters.fpp.f90:451
m_global_parameters::polydisperse
logical polydisperse
Polydisperse bubbles.
Definition m_global_parameters.fpp.f90:1075
m_global_parameters::lag_params
type(bubbles_lagrange_parameters) lag_params
Lagrange bubbles' parameters.
Definition m_global_parameters.fpp.f90:1327
m_global_parameters::proc_rank
integer proc_rank
Rank of the local processor.
Definition m_global_parameters.fpp.f90:349
m_global_parameters::collision_time
real(wp) collision_time
Definition m_global_parameters.fpp.f90:1006
m_global_parameters::hyper_cleaning_tau
real(wp) hyper_cleaning_tau
Hyperbolic cleaning tau.
Definition m_global_parameters.fpp.f90:1376
m_global_parameters::mixture_err
logical mixture_err
Mixture properties correction.
Definition m_global_parameters.fpp.f90:487
m_global_parameters::adap_dt
logical adap_dt
Adaptive step size control.
Definition m_global_parameters.fpp.f90:1089
m_global_parameters::weno_re_flux
logical weno_re_flux
WENO reconstruct velocity gradients for viscous stress tensor.
Definition m_global_parameters.fpp.f90:480
m_global_parameters::hyper_cleaning_speed
real(wp) hyper_cleaning_speed
Hyperbolic cleaning wave speed (c_h).
Definition m_global_parameters.fpp.f90:1375
m_global_parameters::n_start
integer n_start
Definition m_global_parameters.fpp.f90:417
m_global_parameters::t_step_print
integer t_step_print
Number of time-steps between printouts.
Definition m_global_parameters.fpp.f90:432
m_global_parameters::g_z
real(wp) g_z
Definition m_global_parameters.fpp.f90:543
m_global_parameters::poly_sigma
real(wp) poly_sigma
log normal sigma for polydisperse PDF
Definition m_global_parameters.fpp.f90:1119
m_global_parameters::bc_io
logical bc_io
Definition m_global_parameters.fpp.f90:695
m_global_parameters::z_domain
type(bounds_info) z_domain
Definition m_global_parameters.fpp.f90:774
m_global_parameters::mpiiofs
character(len=name_len) mpiiofs
Definition m_global_parameters.fpp.f90:815
m_global_parameters::start_idx
integer, dimension(:), allocatable start_idx
Starting cell-center index of local processor in global grid.
Definition m_global_parameters.fpp.f90:805
m_global_parameters::probe
type(vec3_dt), dimension(num_probes_max) probe
Definition m_global_parameters.fpp.f90:981
m_global_parameters::sys_size
integer sys_size
Number of unknowns in system of eqns.
Definition m_global_parameters.fpp.f90:822
m_global_parameters::collision_model
integer collision_model
Definition m_global_parameters.fpp.f90:1004
m_global_parameters::x_b
real(wp) x_b
Definition m_global_parameters.fpp.f90:787
m_global_parameters::integral_wrt
logical integral_wrt
Definition m_global_parameters.fpp.f90:978
m_global_parameters::cyl_coord
logical cyl_coord
Definition m_global_parameters.fpp.f90:365
m_global_parameters::muscl_order
integer muscl_order
Order of the MUSCL reconstruction.
Definition m_global_parameters.fpp.f90:448
m_global_parameters::z_b
real(wp) z_b
Definition m_global_parameters.fpp.f90:787
m_global_parameters::x_domain
type(bounds_info) x_domain
Definition m_global_parameters.fpp.f90:774
m_global_parameters::alt_soundspeed
logical alt_soundspeed
Alternate mixture sound speed.
Definition m_global_parameters.fpp.f90:485
m_global_parameters::int_comp
integer int_comp
Interface compression: 0=off, 1=THINC, 2=MTHINC.
Definition m_global_parameters.fpp.f90:490
m_global_parameters::ptgalpha_eps
real(wp) ptgalpha_eps
trigger parameter for the pTg relaxation procedure, phase change model
Definition m_global_parameters.fpp.f90:681
m_global_parameters::fft_wrt
logical fft_wrt
Definition m_global_parameters.fpp.f90:1354
m_global_parameters::relax_model
integer relax_model
Relaxation model.
Definition m_global_parameters.fpp.f90:679
m_global_parameters::t_step_old
integer t_step_old
Existing IC/grid folder.
Definition m_global_parameters.fpp.f90:347
m_global_parameters::cfl_const_dt
logical cfl_const_dt
Definition m_global_parameters.fpp.f90:431
m_global_parameters::viscous
logical viscous
Viscous effects.
Definition m_global_parameters.fpp.f90:463
m_global_parameters::bodyforces
logical bodyforces
Definition m_global_parameters.fpp.f90:514
m_global_parameters::ib
logical ib
Definition m_global_parameters.fpp.f90:1002
m_global_parameters::run_time_info
logical run_time_info
Run-time output flag.
Definition m_global_parameters.fpp.f90:346
m_global_parameters::sigma
real(wp) sigma
Definition m_global_parameters.fpp.f90:1278
m_global_parameters::num_bc_patches
integer num_bc_patches
Definition m_global_parameters.fpp.f90:694
m_global_parameters::r0ref
real(wp) r0ref
Definition m_global_parameters.fpp.f90:1244
m_global_parameters::wenoz_q
real(wp) wenoz_q
Power constant for WENO-Z.
Definition m_global_parameters.fpp.f90:456
m_global_parameters::riemann_solver
integer riemann_solver
Riemann solver algorithm.
Definition m_global_parameters.fpp.f90:481
m_global_parameters::idwbuff
type(int_bounds_info), dimension(1:3) idwbuff
Definition m_global_parameters.fpp.f90:856
m_global_parameters::re_inv
real(wp) re_inv
Inverse Reynolds number.
Definition m_global_parameters.fpp.f90:1046
m_global_parameters::ic_eps
real(wp) ic_eps
THINC Epsilon to compress on surface cells.
Definition m_global_parameters.fpp.f90:491
m_global_parameters::model_eqns
integer model_eqns
Multicomponent flow model.
Definition m_global_parameters.fpp.f90:434
m_global_parameters::precision
integer precision
Precision of output files.
Definition m_global_parameters.fpp.f90:790
m_global_parameters::ib_state_wrt
logical ib_state_wrt
Definition m_global_parameters.fpp.f90:1008
m_global_parameters::hyperelasticity
logical hyperelasticity
hyperelasticity modeling
Definition m_global_parameters.fpp.f90:489
m_global_parameters::k_y
real(wp) k_y
Definition m_global_parameters.fpp.f90:525
m_global_parameters::fluid_pp
type(physical_parameters), dimension(num_fluids_max) fluid_pp
Stiffened gas EOS parameters and Reynolds numbers per fluid.
Definition m_global_parameters.fpp.f90:960
m_global_parameters::prim_vars_wrt
logical prim_vars_wrt
Definition m_global_parameters.fpp.f90:441
m_global_parameters::bc_y
type(int_bounds_info) bc_y
Definition m_global_parameters.fpp.f90:698
m_global_parameters::num_integrals
integer num_integrals
Definition m_global_parameters.fpp.f90:980
m_global_parameters::alf_factor
real(wp) alf_factor
alpha factor for IGR
Definition m_global_parameters.fpp.f90:513
m_global_parameters::s_initialize_global_parameters_module
impure subroutine s_initialize_global_parameters_module
Initialize the global parameters module.
Definition m_global_parameters.fpp.f90:1817
m_global_parameters::y_cc
real(wp), dimension(:), allocatable, target y_cc
Definition m_global_parameters.fpp.f90:387
m_global_parameters::pb_ts
type(pres_field), dimension(:), allocatable pb_ts
Definition m_global_parameters.fpp.f90:1309
m_global_parameters::g_y
real(wp) g_y
Definition m_global_parameters.fpp.f90:523
m_global_parameters::mv_ts
type(pres_field), dimension(:), allocatable mv_ts
Definition m_global_parameters.fpp.f90:1310
m_global_parameters::rdma_mpi
logical rdma_mpi
Definition m_global_parameters.fpp.f90:1308
m_global_parameters::chem_params
type(chemistry_parameters) chem_params
Definition m_global_parameters.fpp.f90:1178
m_global_parameters::p_y
real(wp) p_y
Definition m_global_parameters.fpp.f90:521
m_global_parameters::fd_order
integer fd_order
Finite-difference order for CoM and flow probe derivatives.
Definition m_global_parameters.fpp.f90:963
m_global_parameters::bubbles_lagrange
logical bubbles_lagrange
Lagrangian subgrid bubble model switch.
Definition m_global_parameters.fpp.f90:1326
m_global_parameters::ca
real(wp) ca
Cavitation number.
Definition m_global_parameters.fpp.f90:1044
m_global_parameters::alpha_bar
real(wp) alpha_bar
Damage rate factor for continuum damage modeling.
Definition m_global_parameters.fpp.f90:1359
m_global_parameters::polytropic
logical polytropic
Polytropic switch.
Definition m_global_parameters.fpp.f90:1074
m_global_parameters::bf_z
logical bf_z
body force toggle in three directions
Definition m_global_parameters.fpp.f90:515
m_global_parameters::mp_weno
logical mp_weno
Monotonicity preserving (MP) WENO.
Definition m_global_parameters.fpp.f90:478
m_global_parameters::bc_x
type(int_bounds_info) bc_x
Definition m_global_parameters.fpp.f90:698
m_global_parameters::t_save
real(wp) t_save
Definition m_global_parameters.fpp.f90:416
m_global_parameters::y_domain
type(bounds_info) y_domain
Definition m_global_parameters.fpp.f90:774
m_global_parameters::z_cc
real(wp), dimension(:), allocatable, target z_cc
Definition m_global_parameters.fpp.f90:387
m_global_parameters::relax
logical relax
activate phase change
Definition m_global_parameters.fpp.f90:678
m_global_parameters::qbmm
logical qbmm
Quadrature moment method.
Definition m_global_parameters.fpp.f90:1132
m_global_parameters::t_step_save
integer t_step_save
Definition m_global_parameters.fpp.f90:411
m_global_parameters::pi_fac
real(wp) pi_fac
Factor for artificial pi_inf.
Definition m_global_parameters.fpp.f90:1136
m_global_parameters::hyper_cleaning
logical hyper_cleaning
Hyperbolic cleaning for MHD for divB=0.
Definition m_global_parameters.fpp.f90:510
m_global_parameters::bf_x
logical bf_x
Definition m_global_parameters.fpp.f90:515
m_global_parameters::adap_dt_max_iters
integer adap_dt_max_iters
Maximum number of iterations.
Definition m_global_parameters.fpp.f90:1091
m_global_parameters::w_z
real(wp) w_z
Definition m_global_parameters.fpp.f90:539
m_global_parameters::pref
real(wp) pref
Definition m_global_parameters.fpp.f90:986
m_global_parameters::ic_beta
real(wp) ic_beta
THINC Sharpness Parameter.
Definition m_global_parameters.fpp.f90:492
m_global_parameters::num_probes
integer num_probes
Definition m_global_parameters.fpp.f90:979
m_global_parameters::bx0
real(wp) bx0
Constant magnetic field in the x-direction (1D).
Definition m_global_parameters.fpp.f90:1341
m_global_parameters::wall_time
real(wp) wall_time
Definition m_global_parameters.fpp.f90:340
m_global_parameters::num_source
integer num_source
Number of acoustic sources.
Definition m_global_parameters.fpp.f90:1262
m_global_parameters::qvs
real(wp), dimension(:), allocatable qvs
Definition m_global_parameters.fpp.f90:1293
m_global_parameters::bf_y
logical bf_y
Definition m_global_parameters.fpp.f90:515
m_global_parameters::pi_infs
real(wp), dimension(:), allocatable pi_infs
Definition m_global_parameters.fpp.f90:1293
m_global_parameters::adv_n
logical adv_n
Solve the number density equation and compute alpha from number density.
Definition m_global_parameters.fpp.f90:1088
m_global_parameters::num_procs
integer num_procs
Number of processors.
Definition m_global_parameters.fpp.f90:344
m_global_parameters::case_dir
character(len=path_len) case_dir
Case folder location.
Definition m_global_parameters.fpp.f90:345
m_global_parameters::weno_eps
real(wp) weno_eps
Binding for the WENO nonlinear weights.
Definition m_global_parameters.fpp.f90:476
m_global_parameters::weno_order
integer weno_order
Order of the WENO reconstruction.
Definition m_global_parameters.fpp.f90:447
m_global_parameters::y_b
real(wp) y_b
Definition m_global_parameters.fpp.f90:787
m_global_parameters::mhd
logical mhd
Magnetohydrodynamics.
Definition m_global_parameters.fpp.f90:457
m_global_parameters::x_cc
real(wp), dimension(:), allocatable, target x_cc
Definition m_global_parameters.fpp.f90:387
m_global_parameters::acoustic
type(acoustic_parameters), dimension(num_probes_max) acoustic
Acoustic source parameters.
Definition m_global_parameters.fpp.f90:1261
m_global_parameters::tau_star
real(wp) tau_star
Stress threshold for continuum damage modeling.
Definition m_global_parameters.fpp.f90:1357
m_global_parameters::p
integer p
Definition m_global_parameters.fpp.f90:352
m_global_parameters::parallel_io
logical parallel_io
Format of the data files.
Definition m_global_parameters.fpp.f90:788
m_global_parameters::integral
type(integral_parameters), dimension(num_probes_max) integral
Definition m_global_parameters.fpp.f90:982
m_global_parameters::cfl_target
real(wp) cfl_target
Definition m_global_parameters.fpp.f90:416
m_global_parameters::y_cb
real(wp), dimension(:), allocatable, target y_cb
Definition m_global_parameters.fpp.f90:382
m_global_parameters::w_y
real(wp) w_y
amplitude, frequency, and phase shift sinusoid in each direction
Definition m_global_parameters.fpp.f90:519
m_global_parameters::adap_dt_tol
real(wp) adap_dt_tol
Tolerance to control adaptive step size.
Definition m_global_parameters.fpp.f90:1090
m_global_parameters::n
integer n
Definition m_global_parameters.fpp.f90:352
m_global_parameters::cells_bounds
type(cell_num_bounds) cells_bounds
Definition m_global_parameters.fpp.f90:356
m_global_parameters::down_sample
logical down_sample
down sample the output files
Definition m_global_parameters.fpp.f90:791
m_global_parameters::z_a
real(wp) z_a
Definition m_global_parameters.fpp.f90:786
m_global_parameters::mpi_io_airfoil_ib_data
type(mpi_io_airfoil_ib_var), public mpi_io_airfoil_ib_data
Definition m_global_parameters.fpp.f90:808
m_global_parameters::nv_uvm_out_of_core
logical nv_uvm_out_of_core
Enable out-of-core storage of q_cons_ts(2) in timestepping (default FALSE).
Definition m_global_parameters.fpp.f90:468
m_global_parameters::file_per_process
logical file_per_process
shared file or not when using parallel io
Definition m_global_parameters.fpp.f90:789
m_global_parameters::palpha_eps
real(wp) palpha_eps
trigger parameter for the p relaxation procedure, phase change model
Definition m_global_parameters.fpp.f90:680
m_global_parameters::surface_tension
logical surface_tension
Definition m_global_parameters.fpp.f90:1279
m_global_parameters::t_step_start
integer t_step_start
Definition m_global_parameters.fpp.f90:411
m_global_parameters::num_igr_warm_start_iters
integer num_igr_warm_start_iters
number of warm start iterations for elliptic solve
Definition m_global_parameters.fpp.f90:512
m_global_parameters::nv_uvm_igr_temps_on_gpu
integer nv_uvm_igr_temps_on_gpu
0 => jac, jac_rhs, and jac_old on CPU
Definition m_global_parameters.fpp.f90:469
m_global_parameters::wall_time_avg
real(wp) wall_time_avg
Definition m_global_parameters.fpp.f90:341
m_global_parameters::elasticity
logical elasticity
elasticity modeling, true for hyper or hypo
Definition m_global_parameters.fpp.f90:505
m_global_parameters::m_glb
integer m_glb
Definition m_global_parameters.fpp.f90:360
m_global_parameters::np
integer np
Definition m_global_parameters.fpp.f90:1011
m_global_parameters::nb
integer nb
Number of eq. bubble sizes.
Definition m_global_parameters.fpp.f90:1040
m_global_parameters::mpi_io_data
type(mpi_io_var), public mpi_io_data
Definition m_global_parameters.fpp.f90:806
m_global_parameters::muscl_eps
real(wp) muscl_eps
MUSCL limiter slope-product threshold.
Definition m_global_parameters.fpp.f90:475
m_global_parameters::n_glb
integer n_glb
Definition m_global_parameters.fpp.f90:360
m_global_parameters::x_a
real(wp) x_a
Definition m_global_parameters.fpp.f90:786
m_global_parameters::s_initialize_parallel_io
impure subroutine s_initialize_parallel_io
Initializes parallel infrastructure.
Definition m_global_parameters.fpp.f90:3668
m_global_parameters::mpp_lim
logical mpp_lim
Mixture physical parameters (MPP) limits.
Definition m_global_parameters.fpp.f90:439
m_global_parameters::num_igr_iters
integer num_igr_iters
number of iterations for elliptic solve
Definition m_global_parameters.fpp.f90:511
m_global_parameters::teno_ct
real(wp) teno_ct
Smoothness threshold for TENO.
Definition m_global_parameters.fpp.f90:477
m_global_parameters::low_mach
integer low_mach
Low Mach number fix to HLLC Riemann solver.
Definition m_global_parameters.fpp.f90:482
m_global_parameters::igr_order
integer igr_order
Reconstruction order for IGR.
Definition m_global_parameters.fpp.f90:460
m_global_parameters::coefficient_of_restitution
real(wp) coefficient_of_restitution
Definition m_global_parameters.fpp.f90:1005
m_global_parameters::teno
logical teno
TENO (Targeted ENO).
Definition m_global_parameters.fpp.f90:455
m_global_parameters::dy
real(wp), dimension(:), allocatable, target dy
Definition m_global_parameters.fpp.f90:392
m_global_parameters::dt
real(wp) dt
Size of the time-step.
Definition m_global_parameters.fpp.f90:395
m_global_parameters::bub_pp
type(subgrid_bubble_physical_parameters) bub_pp
Definition m_global_parameters.fpp.f90:962
m_global_parameters::t_stop
real(wp) t_stop
Definition m_global_parameters.fpp.f90:416
m_global_parameters::time_stepper
integer time_stepper
Time-stepper algorithm.
Definition m_global_parameters.fpp.f90:440
m_global_parameters::m
integer m
Definition m_global_parameters.fpp.f90:352
m_global_parameters::relativity
logical relativity
Relativity (only for MHD).
Definition m_global_parameters.fpp.f90:458
m_global_parameters::nv_uvm_pref_gpu
logical nv_uvm_pref_gpu
Enable explicit gpu memory hints (default FALSE).
Definition m_global_parameters.fpp.f90:472
m_global_parameters::gammas
real(wp), dimension(:), allocatable gammas
Definition m_global_parameters.fpp.f90:1293
m_global_parameters::bubble_model
integer bubble_model
Gilmore or Keller–Miksis bubble model.
Definition m_global_parameters.fpp.f90:1104
m_global_parameters::finaltime
real(wp) finaltime
Final simulation time.
Definition m_global_parameters.fpp.f90:1307
m_global_parameters::dz
real(wp), dimension(:), allocatable, target dz
Definition m_global_parameters.fpp.f90:392
m_global_parameters::dx
real(wp), dimension(:), allocatable, target dx
Definition m_global_parameters.fpp.f90:392
m_global_parameters::mapped_weno
logical mapped_weno
WENO-M (WENO with mapping of nonlinear weights).
Definition m_global_parameters.fpp.f90:453
m_global_parameters::eqn_idx
type(eqn_idx_info) eqn_idx
All conserved-variable equation index ranges and scalars.
Definition m_global_parameters.fpp.f90:823
m_global_parameters::igr_iter_solver
integer igr_iter_solver
IGR elliptic solver.
Definition m_global_parameters.fpp.f90:459
m_global_parameters::num_ibs
integer num_ibs
Definition m_global_parameters.fpp.f90:1003
m_global_parameters::muscl_lim
integer muscl_lim
MUSCL Limiter.
Definition m_global_parameters.fpp.f90:450
m_global_parameters::patch_ib
type(ib_patch_parameters), dimension(num_ib_patches_max) patch_ib
Immersed boundary patch parameters.
Definition m_global_parameters.fpp.f90:1009
m_global_parameters::y_a
real(wp) y_a
Definition m_global_parameters.fpp.f90:786
m_global_parameters::x_cb
real(wp), dimension(:), allocatable, target x_cb
Definition m_global_parameters.fpp.f90:382
m_global_parameters::cfl_dt
logical cfl_dt
Definition m_global_parameters.fpp.f90:431
m_global_parameters::t_step_stop
integer t_step_stop
Definition m_global_parameters.fpp.f90:411
m_helper_basic
Basic floating-point utilities: approximate equality, default detection, and coordinate bounds.
Definition m_helper_basic.fpp.f90:317
m_helper_basic::s_update_cell_bounds
elemental subroutine, public s_update_cell_bounds(bounds, m, n, p)
Updates the min and max number of cells in each set of axes.
Definition m_helper_basic.fpp.f90:529
m_helper
Utility routines for bubble model setup, coordinate transforms, array sampling, and special functions...
Definition m_helper.fpp.f90:328
m_helper::s_upsample_data
subroutine, public s_upsample_data(q_cons_vf, q_cons_temp)
Upsample conservative variable fields from a coarsened grid back to the original resolution using int...
Definition m_helper.fpp.f90:1145
m_helper::s_initialize_bubbles_model
impure subroutine, public s_initialize_bubbles_model()
Initialize bubble model arrays for Euler or Lagrangian bubbles with polytropic or non-polytropic gas.
Definition m_helper.fpp.f90:434
m_helper::s_int_to_str
elemental subroutine, public s_int_to_str(i, res)
Convert an integer to its trimmed string representation.
Definition m_helper.fpp.f90:730
m_hyperelastic
Computes the left Cauchy–Green deformation tensor and hyperelastic stress source terms.
Definition m_hyperelastic.fpp.f90:318
m_hyperelastic::s_finalize_hyperelastic_module
impure subroutine, public s_finalize_hyperelastic_module()
Finalize the hyperelastic module.
Definition m_hyperelastic.fpp.f90:1051
m_hyperelastic::s_initialize_hyperelastic_module
impure subroutine, public s_initialize_hyperelastic_module
Initialize the hyperelastic module.
Definition m_hyperelastic.fpp.f90:375
m_hypoelastic
Computes hypoelastic stress-rate source terms and damage-state evolution.
Definition m_hypoelastic.fpp.f90:317
m_hypoelastic::s_initialize_hypoelastic_module
impure subroutine, public s_initialize_hypoelastic_module
Initialize the hypoelastic module.
Definition m_hypoelastic.fpp.f90:389
m_hypoelastic::s_finalize_hypoelastic_module
impure subroutine, public s_finalize_hypoelastic_module()
Finalize the hypoelastic module.
Definition m_hypoelastic.fpp.f90:1382
m_ibm
Ghost-node immersed boundary method: locates ghost/image points, computes interpolation coefficients,...
Definition m_ibm.fpp.f90:318
m_ibm::s_ibm_setup
impure subroutine, public s_ibm_setup()
Initializes the values of various IBM variables, such as ghost points and image points.
Definition m_ibm.fpp.f90:576
m_ibm::s_finalize_ibm_module
impure subroutine, public s_finalize_ibm_module()
Finalize the IBM module.
Definition m_ibm.fpp.f90:2120
m_ibm::ib_markers
type(integer_field), public ib_markers
Definition m_ibm.fpp.f90:339
m_ibm::s_initialize_ibm_module
impure subroutine, public s_initialize_ibm_module()
Allocates memory for the variables in the IBM module.
Definition m_ibm.fpp.f90:397
m_igr
Iterative ghost rasterization (IGR) for sharp immersed boundary treatment.
Definition m_igr.fpp.f90:328
m_igr::s_initialize_igr_module
subroutine, public s_initialize_igr_module()
Initialize the IGR module.
Definition m_igr.fpp.f90:455
m_igr::j
integer(kind=8) j
Definition m_igr.fpp.f90:434
m_igr::i
integer(kind=8) i
Definition m_igr.fpp.f90:434
m_igr::l
integer(kind=8) l
Definition m_igr.fpp.f90:434
m_igr::r
integer(kind=8) r
Definition m_igr.fpp.f90:434
m_igr::k
integer(kind=8) k
Definition m_igr.fpp.f90:434
m_igr::s_finalize_igr_module
subroutine, public s_finalize_igr_module()
Finalize the IGR module.
Definition m_igr.fpp.f90:8075
m_mpi_common
MPI communication layer: domain decomposition, halo exchange, reductions, and parallel I/O setup.
Definition m_mpi_common.fpp.f90:328
m_mpi_common::s_mpi_abort
impure subroutine s_mpi_abort(prnt, code)
The subroutine terminates the MPI execution environment.
Definition m_mpi_common.fpp.f90:859
m_mpi_common::s_initialize_mpi_common_module
impure subroutine s_initialize_mpi_common_module
Initialize the module.
Definition m_mpi_common.fpp.f90:388
m_mpi_common::s_mpi_barrier
impure subroutine s_mpi_barrier
Halts all processes until all have reached barrier.
Definition m_mpi_common.fpp.f90:890
m_mpi_common::s_mpi_initialize
impure subroutine s_mpi_initialize
Initialize the MPI execution environment and query the number of processors and local rank.
Definition m_mpi_common.fpp.f90:491
m_mpi_common::s_initialize_mpi_data
impure subroutine s_initialize_mpi_data(q_cons_vf, ib_markers, beta)
Set up MPI I/O data views and variable pointers for parallel file output.
Definition m_mpi_common.fpp.f90:514
m_mpi_common::s_mpi_finalize
impure subroutine s_mpi_finalize
The subroutine finalizes the MPI execution environment.
Definition m_mpi_common.fpp.f90:901
m_mpi_common::s_initialize_mpi_data_ds
subroutine s_initialize_mpi_data_ds(q_cons_vf)
Set up MPI I/O data views for downsampled (coarsened) parallel file output.
Definition m_mpi_common.fpp.f90:595
m_mpi_common::mpi_bcast_time_step_values
impure subroutine mpi_bcast_time_step_values(proc_time, time_avg)
Gather per-rank time step wall-clock times onto rank 0 for performance reporting.
Definition m_mpi_common.fpp.f90:671
m_mpi_common::s_finalize_mpi_common_module
impure subroutine s_finalize_mpi_common_module
Module deallocation and/or disassociation procedures.
Definition m_mpi_common.fpp.f90:2746
m_mpi_common::s_mpi_decompose_computational_domain
subroutine s_mpi_decompose_computational_domain
Decompose the computational domain among processors by balancing cells per rank in each coordinate di...
Definition m_mpi_common.fpp.f90:2259
m_mpi_proxy
MPI halo exchange, domain decomposition, and buffer packing/unpacking for the simulation solver.
Definition m_mpi_proxy.fpp.f90:328
m_mpi_proxy::s_initialize_mpi_proxy_module
subroutine s_initialize_mpi_proxy_module()
Initialize the MPI proxy module.
Definition m_mpi_proxy.fpp.f90:363
m_mpi_proxy::s_finalize_mpi_proxy_module
subroutine s_finalize_mpi_proxy_module()
Finalize the MPI proxy module.
Definition m_mpi_proxy.fpp.f90:1118
m_mpi_proxy::s_mpi_bcast_user_inputs
impure subroutine s_mpi_bcast_user_inputs()
Since only the processor with rank 0 reads and verifies the consistency of user inputs,...
Definition m_mpi_proxy.fpp.f90:432
m_muscl
MUSCL reconstruction with interface sharpening for contact-preserving advection.
Definition m_muscl.fpp.f90:317
m_muscl::s_initialize_muscl_module
subroutine, public s_initialize_muscl_module()
Allocate and initialize MUSCL reconstruction working arrays.
Definition m_muscl.fpp.f90:379
m_muscl::s_finalize_muscl_module
subroutine, public s_finalize_muscl_module()
Finalize the MUSCL module.
Definition m_muscl.fpp.f90:946
m_nvtx
NVIDIA NVTX profiling API bindings for GPU performance instrumentation.
Definition m_nvtx.f90:6
m_nvtx::nvtxstartrange
subroutine nvtxstartrange(name, id)
Push a named NVTX range for GPU profiling, optionally with a color based on the given identifier.
Definition m_nvtx.f90:62
m_nvtx::nvtxendrange
subroutine nvtxendrange
Pop the current NVTX range to end the GPU profiling region.
Definition m_nvtx.f90:83
m_phase_change
Phase transition relaxation solvers for liquid-vapor flows with cavitation and boiling.
Definition m_phase_change.fpp.f90:328
m_phase_change::s_finalize_relaxation_solver_module
impure subroutine, public s_finalize_relaxation_solver_module
Finalize the phase change module.
Definition m_phase_change.fpp.f90:1183
m_phase_change::s_infinite_relaxation_k
subroutine, public s_infinite_relaxation_k(q_cons_vf)
Apply pT- or pTg-equilibrium relaxation with mass depletion based on the incoming state conditions.
Definition m_phase_change.fpp.f90:404
m_phase_change::c
real(wp) c
Definition m_phase_change.fpp.f90:355
m_phase_change::s_initialize_phasechange_module
impure subroutine, public s_initialize_phasechange_module
Initialize the phase change module by setting saturation curve coefficients for pT- or pTg-equilibriu...
Definition m_phase_change.fpp.f90:390
m_qbmm
Quadrature-based moment methods (QBMM) for polydisperse bubble moment inversion and transport.
Definition m_qbmm.fpp.f90:328
m_qbmm::s_initialize_qbmm_module
impure subroutine, public s_initialize_qbmm_module
Initialize the QBMM module.
Definition m_qbmm.fpp.f90:399
m_rhs
Assembles the right-hand side of the governing equations using finite-volume flux differencing,...
Definition m_rhs.fpp.f90:329
m_rhs::s_initialize_rhs_module
impure subroutine, public s_initialize_rhs_module
Initialize the RHS module.
Definition m_rhs.fpp.f90:599
m_rhs::s_finalize_rhs_module
impure subroutine, public s_finalize_rhs_module
Module deallocation and/or disassociation procedures.
Definition m_rhs.fpp.f90:8733
m_riemann_solvers
Approximate and exact Riemann solvers (HLL, HLLC, HLLD, exact) for the multicomponent Navier–Stokes e...
Definition m_riemann_solvers.fpp.f90:338
m_riemann_solvers::s_finalize_riemann_solvers_module
impure subroutine, public s_finalize_riemann_solvers_module
Module deallocation and/or disassociation procedures.
Definition m_riemann_solvers.fpp.f90:18815
m_riemann_solvers::s_initialize_riemann_solvers_module
impure subroutine, public s_initialize_riemann_solvers_module
Initialize the Riemann solvers module.
Definition m_riemann_solvers.fpp.f90:16062
m_sim_helpers
Simulation helper routines for enthalpy computation, CFL calculation, and stability checks.
Definition m_sim_helpers.fpp.f90:328
m_start_up
Reads input files, loads initial conditions and grid data, and orchestrates solver initialization and...
Definition m_start_up.fpp.f90:328
m_start_up::s_read_ib_restart_data
impure subroutine s_read_ib_restart_data(t_step)
Reads IB kinematic state from restart_data/ib_state.dat on restart. Rank 0 reads the last num_ibs rec...
Definition m_start_up.fpp.f90:1859
m_start_up::s_read_serial_data_files
impure subroutine, public s_read_serial_data_files(q_cons_vf)
Read serial initial condition and grid data files and compute cell-width distributions.
Definition m_start_up.fpp.f90:501
m_start_up::s_initialize_modules
impure subroutine, public s_initialize_modules
Initialize all simulation sub-modules in the required dependency order.
Definition m_start_up.fpp.f90:1288
m_start_up::s_read_data_files
impure subroutine, public s_read_data_files(q_cons_vf)
Read data files. Dispatch subroutine that replaces procedure pointer.
Definition m_start_up.fpp.f90:391
m_start_up::s_read_parallel_data_files
impure subroutine, public s_read_parallel_data_files(q_cons_vf)
Read parallel initial condition and grid data files via MPI I/O.
Definition m_start_up.fpp.f90:627
m_start_up::s_initialize_internal_energy_equations
subroutine, public s_initialize_internal_energy_equations(v_vf)
Initialize internal-energy equations from phase mass, mixture momentum, and total energy.
Definition m_start_up.fpp.f90:878
m_start_up::s_save_performance_metrics
impure subroutine, public s_save_performance_metrics(time_avg, time_final, io_time_avg, io_time_final, proc_time, io_proc_time, file_exists)
Collect per-process wall-clock times and write aggregate performance metrics to file.
Definition m_start_up.fpp.f90:1042
m_start_up::s_save_data
impure subroutine, public s_save_data(t_step, start, finish, io_time_avg, nt)
Save conservative variable data to disk at the current time step.
Definition m_start_up.fpp.f90:1101
m_start_up::q_cons_temp
type(scalar_field), dimension(:), allocatable q_cons_temp
Definition m_start_up.fpp.f90:384
m_start_up::dt_init
real(wp) dt_init
Definition m_start_up.fpp.f90:385
m_start_up::s_initialize_gpu_vars
subroutine, public s_initialize_gpu_vars
Transfer initial conservative variable and model parameter data to the GPU device.
Definition m_start_up.fpp.f90:1480
m_start_up::s_initialize_mpi_domain
impure subroutine, public s_initialize_mpi_domain
Set up the MPI execution environment, bind GPUs, and decompose the computational domain.
Definition m_start_up.fpp.f90:1407
m_start_up::s_finalize_modules
impure subroutine, public s_finalize_modules
Finalize and deallocate all simulation sub-modules in reverse initialization order.
Definition m_start_up.fpp.f90:1817
m_start_up::s_read_input_file
impure subroutine, public s_read_input_file
Verify the input file exists and read it.
Definition m_start_up.fpp.f90:404
m_start_up::s_check_input_file
impure subroutine, public s_check_input_file
Validate that all user-provided inputs form a consistent simulation configuration.
Definition m_start_up.fpp.f90:482
m_start_up::s_perform_time_step
impure subroutine, public s_perform_time_step(t_step, time_avg)
Advance the simulation by one time step, handling CFL-based dt and time-stepper dispatch.
Definition m_start_up.fpp.f90:935
m_surface_tension
Computes capillary source fluxes and color-function gradients for the diffuse-interface surface tensi...
Definition m_surface_tension.fpp.f90:331
m_surface_tension::s_initialize_surface_tension_module
impure subroutine, public s_initialize_surface_tension_module
Allocate and initialize surface tension module arrays.
Definition m_surface_tension.fpp.f90:396
m_surface_tension::s_finalize_surface_tension_module
impure subroutine, public s_finalize_surface_tension_module
Finalize the surface tension module.
Definition m_surface_tension.fpp.f90:1187
m_thinc
THINC and MTHINC interface compression for volume fraction sharpening. THINC (int_comp=1): 1D directi...
Definition m_thinc.fpp.f90:323
m_thinc::s_finalize_thinc_module
subroutine, public s_finalize_thinc_module()
Definition m_thinc.fpp.f90:1220
m_thinc::s_initialize_thinc_module
subroutine, public s_initialize_thinc_module()
Definition m_thinc.fpp.f90:609
m_thinc::position
real(wp), dimension(:,:,:), allocatable position
Definition m_thinc.fpp.f90:355
m_time_steppers
Total-variation-diminishing (TVD) Runge–Kutta time integrators (1st-, 2nd-, and 3rd-order SSP).
Definition m_time_steppers.fpp.f90:328
m_time_steppers::q_t_sf
type(scalar_field) q_t_sf
Cell-average temperature variables at the current time-stage.
Definition m_time_steppers.fpp.f90:358
m_time_steppers::bc_type
type(integer_field), dimension(:,:), allocatable bc_type
Boundary condition identifiers.
Definition m_time_steppers.fpp.f90:354
m_time_steppers::s_initialize_time_steppers_module
impure subroutine s_initialize_time_steppers_module
Initialize the time steppers module.
Definition m_time_steppers.fpp.f90:393
m_time_steppers::q_cons_ts
type(vector_field), dimension(:), allocatable q_cons_ts
Cell-average conservative variables at each time-stage (TS).
Definition m_time_steppers.fpp.f90:351
m_time_steppers::q_prim_vf
type(scalar_field), dimension(:), allocatable q_prim_vf
Cell-average primitive variables at the current time-stage.
Definition m_time_steppers.fpp.f90:352
m_time_steppers::s_finalize_time_steppers_module
impure subroutine s_finalize_time_steppers_module
Module deallocation and/or disassociation procedures.
Definition m_time_steppers.fpp.f90:5632
m_time_steppers::s_compute_dt
impure subroutine s_compute_dt()
Compute the global time step size from CFL stability constraints across all cells.
Definition m_time_steppers.fpp.f90:5147
m_time_steppers::s_tvd_rk
impure subroutine s_tvd_rk(t_step, time_avg, nstage)
Advance the solution one full step using a TVD Runge-Kutta time integrator.
Definition m_time_steppers.fpp.f90:4909
m_time_steppers::stor
integer stor
storage index
Definition m_time_steppers.fpp.f90:362
m_variables_conversion
Conservative-to-primitive variable conversion, mixture property evaluation, and pressure computation.
Definition m_variables_conversion.fpp.f90:328
m_variables_conversion::s_compute_pressure
subroutine, public s_compute_pressure(energy, alf, dyn_p, pi_inf, gamma, rho, qv, rhoyks, pres, t, stress, mom, g, pres_mag)
Compute the pressure from the appropriate equation of state.
Definition m_variables_conversion.fpp.f90:431
m_variables_conversion::s_initialize_variables_conversion_module
impure subroutine, public s_initialize_variables_conversion_module
Initialize the variables conversion module.
Definition m_variables_conversion.fpp.f90:729
m_variables_conversion::s_finalize_variables_conversion_module
impure subroutine s_finalize_variables_conversion_module()
Deallocate fluid property arrays and post-processing fields allocated during module initialization.
Definition m_variables_conversion.fpp.f90:2413
m_variables_conversion::s_convert_to_mixture_variables
subroutine, public s_convert_to_mixture_variables(q_vf, i, j, k, rho, gamma, pi_inf, qv, re_k, g_k, g)
Dispatch to the s_convert_mixture_to_mixture_variables and s_convert_species_to_mixture_variables sub...
Definition m_variables_conversion.fpp.f90:413
m_viscous
Computes viscous stress tensors and diffusive flux contributions for the Navier–Stokes equations.
Definition m_viscous.fpp.f90:327
m_viscous::s_initialize_viscous_module
impure subroutine, public s_initialize_viscous_module
Initialize the viscous module.
Definition m_viscous.fpp.f90:370
m_viscous::s_finalize_viscous_module
impure subroutine, public s_finalize_viscous_module()
Finalize the viscous module.
Definition m_viscous.fpp.f90:3718
m_weno
WENO/WENO-Z/TENO reconstruction with optional monotonicity-preserving bounds and mapped weights.
Definition m_weno.fpp.f90:327
m_weno::s_initialize_weno_module
impure subroutine, public s_initialize_weno_module
Initialize the WENO module.
Definition m_weno.fpp.f90:487
m_weno::s_finalize_weno_module
impure subroutine, public s_finalize_weno_module()
Module deallocation and/or disassociation procedures.
Definition m_weno.fpp.f90:5714
m_derived_types::scalar_field
Derived type annexing a scalar field (SF).
Definition m_derived_types.fpp.f90:331