WRF4L - Historial de revisiones

Lluis.fita en 12:26 30 oct 2025

2025-10-30T12:26:53Z

← Revisión anterior		Revisión del 12:26 30 oct 2025
Línea 1:		Línea 1:
	There is a far more powerful tool to manage work-flow of [http://www.meteo.unican.es/software/wrf4g/ WRF4G].		There is a far more powerful tool to manage work-flow of [http://www.meteo.unican.es/software/wrf4g/ WRF4G].

			Lluís expanded this work to other HPCs and models. See more details in this GIT repository [https://git.cima.fcen.uba.ar/lluis.fita/workflows/-/wikis/home WRFL]

	Lluís developed a less powerful one which is here described		Lluís developed a less powerful one which is here described

Lluis.fita: /* EXPERIMENTSparameters.txt */

2025-07-31T11:10:54Z

EXPERIMENTSparameters.txt

← Revisión anterior		Revisión del 11:10 31 jul 2025
Línea 200:		Línea 200:
	# Simulation name		# Simulation name
	SimName = control		SimName = control
	~~</pre>~~

	~~Which binary of <code>python</code> 2.x to be used~~
	~~<pre>~~
	~~# python binary~~
	~~pyBIN=/home/lluis.fita/bin/anaconda2/bin/python2.7~~
	</pre>		</pre>

Lluis.fita: /* Checking the experiment */

2025-07-31T11:09:25Z

Checking the experiment

← Revisión anterior		Revisión del 11:09 31 jul 2025
Línea 118:		Línea 118:
	== Checking the experiment ==		== Checking the experiment ==
	Once the experiment runs, one needs to look on (following name of the variables from <code>EXPERIMENTparameters.txt</code>		Once the experiment runs, one needs to look on (following name of the variables from <code>EXPERIMENTparameters.txt</code>
	* <code>[runHOME]/[SimName]</code>: Will content the copies of the templates <code>namelist.wps</code>, <code>namelist.input</code> and files:		* <code>[runHOME]/[ExpName]/[SimName]</code>: Will content the copies of the templates <code>namelist.wps</code>, <code>namelist.input</code> and files:
	** <code>chunk_attemps.inf</code> which counts how many times a '''chunk''' has been attempted to be run (if it reached 4 times, the <code>WRF4L</code> is stopped)		** <code>chunk_attemps.inf</code> which counts how many times a '''chunk''' has been attempted to be run (if it reached 4 times, the <code>WRF4L</code> is stopped)
	** <code>chunk_nums.inf</code> which keeps track of the jobs and periods used for each step for a given '''chunk'''		** <code>chunk_nums.inf</code> which keeps track of the jobs and periods used for each step for a given '''chunk'''
	* <code>[runHOME]/[SimName]/ungrib</code>: actual folder where the computing nodes run ungrib (either ungrib.exe or netcdf2wps)		* <code>[runHOME]/[ExpName]/[SimName]/ungrib</code>: actual folder where the computing nodes run ungrib (either ungrib.exe or netcdf2wps)
	* <code>[runHOME]/[SimName]/metgrid</code>: actual folder where the computing nodes run metgrd (metgrid.exe)		* <code>[runHOME]/[ExpName]/[SimName]/metgrid</code>: actual folder where the computing nodes run metgrd (metgrid.exe)
	* <code>[runHOME]/[SimName]/run</code>: actual folder where the computing nodes run the model (real.exe and wrf.exe)		* <code>[runHOME]/[ExpName]/[SimName]/run</code>: actual folder where the computing nodes run the model (real.exe and wrf.exe)
	* <code>[runHOME]/[SimName]/run/outreal/</code>: folder with the output of real.exe		* <code>[runHOME]/[ExpName]/[SimName]/run/outreal/</code>: folder with the output of real.exe
	* <code>[storageHOME]/[SimName]/outwrf/</code>: folder with the output of wrf.exe		* <code>[storageHOME]/[ExpName]/[SimName]/outwrf/</code>: folder with the output of wrf.exe
	'''NOTE:''' ungrib, metgrid and real outputs are not kept in the storage folder		'''NOTE:''' ungrib, metgrid and real outputs are not kept in the storage folder

Lluis.fita: /* How to simulate */

2025-07-31T11:08:26Z

How to simulate

← Revisión anterior		Revisión del 11:08 31 jul 2025
Línea 61:		Línea 61:
	</PRE>		</PRE>

	# Creation of a new folder from where launch the experiment [ExperimentName] (g.e. somewhere at <CODE>salidas/<CODE> folder)		# Creation of a new folder from where launch the experiment [ExperimentName] (g.e. somewhere at <CODE>salidas/</CODE> folder)
	<pre>		<pre>
	$ mkdir salidas/[ExperimentName]		$ mkdir salidas/[ExperimentName]
	cd salidas/[ExperimentName]		cd salidas/[ExperimentName]
	</pre>		</pre>
	# copy ~~basic~~ WRF4L files to this folder		# copy essential WRF4L files to this folder
	<pre>		<pre>
	cp /share/tools/workflows/WRF4L/hydra/EXPERIMENTparameters.txt ./		cp /share/tools/workflows/WRF4L/hydra/EXPERIMENTparameters.txt ./

Lluis.fita en 11:07 31 jul 2025

2025-07-31T11:07:14Z

← Revisión anterior		Revisión del 11:07 31 jul 2025
Línea 89:		Línea 89:
	</pre>		</pre>

	When it is running one would have multiple jobs, see for example for an experiment called 'MPIsimplest' and it simulation labelled 'urban' (runnig ~~WRF job <code>wrf_[SimName]</code>~~ `R', and ~~<code>exp_[SimName]</code> in~~ hold `H'):		When it is running one would have multiple jobs, see for example for an experiment called 'MPIsimplest' and it simulation labelled 'urban' (finished `C', runnig `R', and hold `H'):
	<pre>		<pre>
	$ qstat -u $USER		$ qstat -u $USER
Línea 111:		Línea 111:
	</pre>		</pre>

	In case of crash of the simulation, after fixing the issue, go to <code>[expHOME]//[SimName]</code> and re-launch the experiment (after the first run the <code>scratch</code> is switched automatically to `false')		In case of crash of the simulation, after fixing the issue, go to <code>[expHOME]/[ExpName]/[SimName]</code> and re-launch the experiment (after the first run the <code>scratch</code> is switched automatically to `false')
	<pre>		<pre>
	$ qsub launch_experiment.pbs		$ qsub launch_experiment.pbs
Línea 129:		Línea 129:

	=== When something went wrong ===		=== When something went wrong ===
	If there has been any problem check the last chunk ~~(in outwrf/[PERIODchunk])~~ to try to understand what happens and where the problem comes from:		If there has been any problem check the last chunk to try to understand what happens and where the problem comes from:
	* <code>rsl.[error/out].[nnnn]</code>: These are the files which content the standard output while running the model. One file for each process. If the problem was something related to model execution and it has been prepared for the error, a correct message must appear. (look first for the largest files...		* <code>rsl.[error/out].[nnnn]</code>: These are the files which content the standard output while running the model. One file for each process. If the problem was something related to model execution and it has been prepared for the error, a correct message must appear. (look first for the largest files...
	<pre>		<pre>
Línea 165:		Línea 165:
	** <code>run/wrf_[ExpName]-[SimName].o[nnnn]</code>: output of the <code>wrf4l_launch_wrf.pbs</code>		** <code>run/wrf_[ExpName]-[SimName].o[nnnn]</code>: output of the <code>wrf4l_launch_wrf.pbs</code>

	All the logs and job outputs are kept in <CODE>${storageHOME}/[SimName]/joblogs</CODE> with a compressed file for ecah chunk and attemp as <CODE>${chunk_period}-${Nattempts}_joblogs.tar</CODE>		All the logs and job outputs are kept in <CODE>${storageHOME}/[ExpName]/[SimName]/joblogs</CODE> with a compressed file for ecah chunk and attemp as <CODE>${chunk_period}-${Nattempts}_joblogs.tar</CODE>

	== EXPERIMENTSparameters.txt ==		== EXPERIMENTSparameters.txt ==
Línea 255:		Línea 255:
	Folder where the workflow will be launched (on top of that there will be one more [SimName])		Folder where the workflow will be launched (on top of that there will be one more [SimName])
	<pre>		<pre>
	# ~~Running~~ folder		# Experiment folder
	expHOME=/home/lluis.fita/salidas/estudios/MPIsimplest/exp		expHOME=/home/lluis.fita/salidas/estudios/MPIsimplest/exp
	</PRE>		</PRE>

	Folder where the WRF model will run in the computing nodes (on top of that there will be ~~one additional~~ folders [SimName]). WRF will run at the folder [SimName]/run		Folder where the WRF model will run in the computing nodes (on top of that there will be two folders [ExpName]/[SimName]). WRF will run at the folder [SimName]/run
	<pre>		<pre>
	# Running folder		# Running folder
	runHOME = /home/lluis.fita/salidas/RUNNING~~/WRFsensSFC/sims~~		runHOME = /home/lluis.fita/salidas/RUNNING
	</pre>		</pre>

Línea 277:		Línea 277:
	</pre>		</pre>

	Folder to storage all the output of the model (history files, restarts and compressed file with content of the configuration and the standard output of the given run). The content of the folder will be organized by chunks (located at <code>[storageHOST]</code>) with ~~an additional folder~~ called [SimName].		Folder to storage all the output of the model (history files, restarts and compressed file with content of the configuration and the standard output of the given run). The content of the folder will be organized by chunks (located at <code>[storageHOST]</code>) with two folders called [ExpName]/[SimName].
	<pre>		<pre>
	# Storage folder of the output		# Storage folder of the output
	storageHOME = /home/lluis.fita/salidas/EXPS~~/WRFsensSFC~~		storageHOME = /home/lluis.fita/salidas/EXPS
	</pre>		</pre>

Lluis.fita: /* EXPERIMENTSparameters.txt */

2025-07-31T09:31:30Z

EXPERIMENTSparameters.txt

← Revisión anterior		Revisión del 09:31 31 jul 2025
Línea 250:		Línea 250:
	<pre>		<pre>
	# Folder with the `namelist.wps', `namelist.input' and `geo_em.d[nn].nc' of the experiment		# Folder with the `namelist.wps', `namelist.input' and `geo_em.d[nn].nc' of the experiment
	domainHOME = /home/lluis.fita/salidas/EXPS//estudios/dominmios/SA50k		domainHOME = /home/lluis.fita/salidas/EXPS/estudios/dominmios/SA50k
	</pre>		</pre>

	Folder where the ~~WRF model~~ will ~~run in the computing nodes~~ (on top of that there will be ~~two~~ more ~~folders [ExpName]/~~[SimName])~~. WRF will run at the folder [ExpName]/[SimName]/run~~		Folder where the workflow will be launched (on top of that there will be one more [SimName])
	<pre>		<pre>
	# Running folder		# Running folder
	runHOME = /home/lluis.fita/salidas/~~estudios~~/WRFsensSFC/sims		expHOME=/home/lluis.fita/salidas/estudios/MPIsimplest/exp
			</PRE>

			Folder where the WRF model will run in the computing nodes (on top of that there will be one additional folders [SimName]). WRF will run at the folder [SimName]/run
			<pre>
			# Running folder
			runHOME = /home/lluis.fita/salidas/RUNNING/WRFsensSFC/sims
	</pre>		</pre>

Línea 271:		Línea 277:
	</pre>		</pre>

	Folder to storage all the output of the model (history files, restarts and compressed file with content of the configuration and the standard output of the given run). The content of the folder will be organized by chunks (located at <code>[storageHOST]</code>)		Folder to storage all the output of the model (history files, restarts and compressed file with content of the configuration and the standard output of the given run). The content of the folder will be organized by chunks (located at <code>[storageHOST]</code>) with an additional folder called [SimName].
	<pre>		<pre>
	# Storage folder of the output		# Storage folder of the output
	storageHOME = /home/lluis.fita/salidas/EXPS/WRFsensSFC~~/sims/output~~		storageHOME = /home/lluis.fita/salidas/EXPS/WRFsensSFC
	</pre>		</pre>

Lluis.fita en 09:27 31 jul 2025

2025-07-31T09:27:53Z

Mostrar los cambios

Lluis.fita: /* How to simulate */

2025-07-31T08:49:45Z

How to simulate

← Revisión anterior		Revisión del 08:49 31 jul 2025
Línea 25:		Línea 25:

	== How to simulate ==		== How to simulate ==
	# Creation of a new folder from where launch the experiment [ExperimentName] (g.e. somewhere at ~~$HOME~~)		# Assuming that we have already defined the domains of simulation and that we have a suited <CODE>namelist.wps</CODE> and <CODE>namelist.input</CODE> WRF namelist files in a folder called <CODE>$GEOGRID</CODE>. We will gather all this information in the storage folder for the experiment (let's assume called $STORAGEdir) and we create there a folder for the information of the domains.
			<PRE style"shell">
			mkdir ${STORAGEdir}/domains
			cp ${GEOGRID}/geo_em.d* ${STORAGEdir}/domains
			cp ${GEOGRID}/namelist.wps ${STORAGEdir}/domains
			cp ${GEOGRID}/namelist.input ${STORAGEdir}/domains
			</PRE>

			# We then move to the <CODE>${STORAGEdir}/domains</CODE> and create a template file for the <CODE>namelist.wps</CODE>
			<PRE style="shell">
			cd ${STORAGEdir}/domains
			cp namelist.wps namelist.wps_template
			diff namelist.wps namelist.wps_template
			4,6c4,6
			< start_date = '2010-06-01_00:00:00', '2010-06-01_00:00:00'
			< end_date = '2010-06-16_00:00:00', '2010-06-16_00:00:00'
			< interval_seconds = 10800,
			---
			> start_date = 'iyr-imo-ida_iho:imi:ise', 'iyr-imo-ida_iho:imi:ise',
			> end_date = 'eyr-emo-eda_eho:emi:ese', 'eyr-emo-eda_eho:emi:ese',
			> interval_seconds = infreq
			</PRE>
			# In case we are going to use <CODE>nc2wps</CODE> to generate the intermediate files (<CODE>ungrib.exe</CODE> output directly generated from netCDF files), we need to generate a template for the <CODE>namelist.nc2wps</CODE>. There are different options available in <CODE>/share/tools/workflows/WRF4L/hydra</CODE>. In this example we use the one prepared for ERA5 data as it is kept in Papa-Deimos:
			<PRE style="shell">
			cp /share/tools/workflows/WRF4L/hydra/namelist.nc2wps_template_ERA5 ${STORAGEdir}/domains/namelist.nc2wps_template
			</PRE>

			# Creation of a new folder from where launch the experiment [ExperimentName] (g.e. somewhere at <CODE>salidas/<CODE> folder)
	<pre>		<pre>
	$ mkdir [ExperimentName]		$ mkdir salidas/[ExperimentName]
	cd [ExperimentName]		cd salidas/[ExperimentName]
	</pre>		</pre>
	# copy ~~the~~ WRF4L files to this folder		# copy basic WRF4L files to this folder
	<pre>		<pre>
	cp /share/tools/workflows/WRF4L/hydra/EXPERIMENTparameters.txt ./		cp /share/tools/workflows/WRF4L/hydra/EXPERIMENTparameters.txt ./
	cp /share/tools/workflows/WRF4L/hydra/~~wrf4l_experiment.pbs ./~~		cp /share/tools/workflows/WRF4L/hydra/launch_experiment.pbs ./
	~~cp /share/tools/workflows/WRF4L/hydra/wrf4l_WPS.pbs ./~~
	~~cp /share/tools/workflows/WRF4L/hydra/wrf4l_WRF~~.pbs ./
	</pre>		</pre>
	# Edit the configuration/set-up of the simulation of the experiment		# Edit the configuration/set-up of the simulation of the experiment (e.g. period of simulation, version of WPS and WRF to use, additional <CODE>namelist.input</CODE> parameters, multiple folders: <CODE>storageHOME</CODE>, <CODE>runHOME</CODE>, MPI configuration, ...)
	<pre>		<pre>
	$ vim EXPERIMENTparameters.txt		$ vim EXPERIMENTparameters.txt
	</pre>		</pre>
	# ~~Launch~~ the ~~simulation~~ of the experiment		# Change the name of the user in the <CODE>launch_experiment.pbs</CODE>
			<PRE style="shell">
			diff launch_experiment.pbs /share/tools/workflows/WRF4L/hydra/launch_experiment.pbs
			11c11
			< #PBS -M lluis.fita@cima.fcen.uba.ar
			---
			> #PBS -M [user]@cima.fcen.uba.ar
			</PRE>

			# Launch the experiment
	<pre>		<pre>
	$ qsub ~~wrf4l_experiment~~.pbs		$ qsub launch_experiment.pbs
	</pre>		</pre>

	When it is running one would have (runnig WRF job <code>wrf_[SimName]</code> `R', and <code>exp_[SimName]</code> in hold `H'):		When it is running one would have (runnig WRF job <code>wrf_[SimName]</code> `R', and <code>exp_[SimName]</code> in hold `H'):
	<pre>		<pre>

Lluis.fita: /* How to simulate */

2023-09-27T15:53:21Z

How to simulate

← Revisión anterior		Revisión del 15:53 27 sep 2023
Línea 32:		Línea 32:
	# copy the WRF4L files to this folder		# copy the WRF4L files to this folder
	<pre>		<pre>
	$ cp /share/tools/workflows/WRF4L/hydra/EXPERIMENTparameters.txt ./		cp /share/tools/workflows/WRF4L/hydra/EXPERIMENTparameters.txt ./
	$ cp /share/tools/workflows/WRF4L/hydra/wrf4l_experiment.pbs ./		cp /share/tools/workflows/WRF4L/hydra/wrf4l_experiment.pbs ./
	$ cp /share/tools/workflows/WRF4L/hydra/wrf4l_WPS.pbs ./		cp /share/tools/workflows/WRF4L/hydra/wrf4l_WPS.pbs ./
	$ cp /share/tools/workflows/WRF4L/hydra/wrf4l_WRF.pbs ./		cp /share/tools/workflows/WRF4L/hydra/wrf4l_WRF.pbs ./
	</pre>		</pre>
	# Edit the configuration/set-up of the simulation of the experiment		# Edit the configuration/set-up of the simulation of the experiment

Lluis.fita en 15:33 27 sep 2023

2023-09-27T15:33:49Z

← Revisión anterior		Revisión del 15:33 27 sep 2023
Línea 17:		Línea 17:
	# Launches the next <code>wrf4l_experiments.pbs</code> (which waits until the end of <code>wrf4l_WRF.pbs</code>)		# Launches the next <code>wrf4l_experiments.pbs</code> (which waits until the end of <code>wrf4l_WRF.pbs</code>)

	[[File:~~WRF4L~~.png]]		[[File:WRF4L_resize.png]]

	All the scripts are located in <code>hydra</code> at:		All the scripts are located in <code>hydra</code> at: