parameter qualifiers (r, v, and a) and editing the file.cio

P.D. Leslie

unread,

Jan 21, 2015, 9:44:10 AM1/21/15

to swat...@googlegroups.com

To whom if may concern,

I'm working on getting a model calibrated for a South Carolina Piedmont drainage basin. I've formatted the Observed_reach.txt on a monthly time-step (will be included at the end of the post) and I have already ran the program using the SUFI-2 method with the objective function set to the NSE. I have simulated 300 times, on two different iterations, just to get a "rough idea" of where I am at and the scores are all below 0.

Where I'm at now I understand in the Par_inf.txt is that for spatial parameters (.mgt, .sol) NOT to use the v qualifer. For spatial parameters I have (included below) I am using the relative qualifier to adjust values within a range. for non-spatial parameters (.gw) I believe, from what I understand, that I can use the replacing qualifier v to set entirely new ranges. Any corrections to my methods, or corrections to my reasoning would be greatly appreciated. Copy and Pasted portions of files are in green.

7 : Number of Parameters (the program only reads the first 7 parameters or any number indicated here)

300 : number of simulations

r__CN2.mgt -0.2 0.2

v__ALPHA_BF.gw 0.25 0.95

v__GW_DELAY.gw 25 250

v__GWQMN.gw 990 1110

r__GW_REVAP.gw 0.02 0.2

r__SOL_K(1).sol____SCL-C-SCL 1 2.88

r__SOL_AWC(1).sol 0.1 0.16

The next thing that I'm probably messing up is getting the time periods to line up. In the SWAT 2012 model I am using I have weather data extending back to 1950 (the purpose for this is that I want to model water yields from periods of extreme record when there wasn't a gauge in the basin) so I am simulating from 1950-2014. Yet, I have to calibrate the model to the period when there were observations (1992-2014). So here is what I have done on the file.cio and SUFI_extract_rch.def files:

Master Watershed File: file.cio

Project Description:

General Input/Output section (file.cio):

1/15/2015 12:00:00 AM ARCGIS-SWAT interface AV

General Information/Watershed Configuration:

fig.fig

64 | NBYR : Number of years simulated

1950 | IYR : Beginning year of simulation

1 | IDAF : Beginning julian day of simulation

365 | IDAL : Ending julian day of simulation

Climate:

0 | IGEN : Random number seed cycle code

1 | PCPSIM : precipitation simulation code: 1=measured, 2=simulated

0 | IDT : Rainfall data time step

0 | IDIST : rainfall distribution code: 0 skewed, 1 exponential

1.300 | REXP : Exponent for IDIST=1

1 | NRGAGE: number of pcp files used in simulation

2 | NRTOT: number of precip gage records used in simulation

2 | NRGFIL: number of gage records in each pcp file

1 | TMPSIM: temperature simulation code: 1=measured, 2=simulated

1 | NTGAGE: number of tmp files used in simulation

2 | NTTOT: number of temp gage records used in simulation

2 | NTGFIL: number of gage records in each tmp file

2 | SLRSIM : Solar radiation simulation Code: 1=measured, 2=simulated

0 | NSTOT: number of solar radiation records in slr file

2 | RHSIM : relative humidity simulation code: 1=measured, 2=simulated

0 | NHTOT: number of relative humidity records in hmd file

2 | WINDSIM : Windspeed simulation code: 1=measured, 2=simulated

0 | NWTOT: number of wind speed records in wnd file

0 | FCSTYR: beginning year of forecast period

0 | FCSTDAY: beginning julian date of forecast period

0 | FCSTCYCLES: number of time to simulate forecast period

Precipitation Files:

pcp1.pcp

Temperature Files:

tmp1.tmp

| SLRFILE: name of solar radiation file

| RHFILE: name of relative humidity file

| WNDFILE: name of wind speed file

cst.cst | FCSTFILE: name of forecast data file

Watershed Modeling Options:

basins.bsn | BSNFILE: name of basin input file

Database Files:

plant.dat | PLANTDB: name of plant growth database file

till.dat | TILLDB: name of tillage database file

pest.dat | PESTDB: name of pesticide database file

fert.dat | FERTDB: name of fertilizer database file

urban.dat | URBANDB: name of urban database file

Special Projects:

0 | ISPROJ: special project: 1=repeat simulation

0 | ICLB: auto-calibration option: 0=no, 1=yes

| CALFILE: auto-calibration parameter file

Output Information:

0 | IPRINT: print code (month, day, year)

2 | NYSKIP: number of years to skip output printing/summarization SWAT 2012 simulates from 1952-2013 but my calibration should start in 1992, should I change this to 42 to skip all the way to 1992?

0 | ILOG: streamflow print code: 1=print log of streamflow

0 | IPRP: print code for output.pst file: 1= print pesticide output

And here is the SUFI2_extract_rch.def file:

output.rch : swat output file name

1 : number of variables to get

6 : variable column number(s) in the swat output file (as many as the above number)

11 : total number of reaches (subbasins) in the project

1 : number of reaches (subbasins) to get for the first variable

11 : reach (subbasin) numbers for the first variable (ordered)

1952 : beginning year of simulation not including the warm up period

2013 : end year of simulation

2 : time step (1=daily, 2=monthly, 3=yearly)

// Remarks

So what I think is wrong so far is that a) I don't completely get the the r,v,a qualifiers or if my ranges are accurate or I need to include more parameters and b) I have a long simulation from SWAT 2012 (1952-2013) yet I need to calibrate it to the first part of my gauge record (1992-2001). I will eventually validate it to the later portion (2002-2013). If you took the time to read this post, thank you. If anyone can help, that would be much obliged. If I need to give more information to help diagnose the issue I can do that as soon as possible. Finally, here is the Observed_rch.txt file:

1 : number of observed variables

FLOW_OUT_11 : this is the name of the variable and the subbasin number to be included in the objective function

132 : number of data points for this variable as it follows below. First column is a sequential number from beginning

: of the simulation, second column is variable name and date (format arbitrary), third column is variable value.

1 FLOW_OUT_1_1991 7.445544097

2 FLOW_OUT_2_1991 5.250780857

3 FLOW_OUT_3_1991 9.741961452

4 FLOW_OUT_4_1991 4.1163479

5 FLOW_OUT_5_1991 3.699479032

6 FLOW_OUT_6_1991 2.1190555

7 FLOW_OUT_7_1991 1.994978323

8 FLOW_OUT_8_1991 3.993610452

9 FLOW_OUT_9_1991 0.8938733

10 FLOW_OUT_10_1991 0.699703935

11 FLOW_OUT_11_1991 0.858949

12 FLOW_OUT_12_1991 1.260563226

13 FLOW_OUT_1_1992 1.439599742

14 FLOW_OUT_2_1992 3.422451207

15 FLOW_OUT_3_1992 4.80840929

16 FLOW_OUT_4_1992 2.8751194

17 FLOW_OUT_5_1992 1.571136774

18 FLOW_OUT_6_1992 1.1845945

19 FLOW_OUT_7_1992 0.783741484

20 FLOW_OUT_8_1992 1.119891677

21 FLOW_OUT_9_1992 0.7249152

22 FLOW_OUT_10_1992 5.424989129

23 FLOW_OUT_11_1992 9.5635948

24 FLOW_OUT_12_1992 3.971687613

25 FLOW_OUT_1_1993 10.91574677

26 FLOW_OUT_2_1993 9.432594964

27 FLOW_OUT_3_1993 13.58850619

28 FLOW_OUT_4_1993 3.4244692

29 FLOW_OUT_5_1993 1.425897968

30 FLOW_OUT_6_1993 0.8051467

31 FLOW_OUT_7_1993 0.884221161

32 FLOW_OUT_8_1993 0.692396323

33 FLOW_OUT_9_1993 0.6626178

34 FLOW_OUT_10_1993 0.96825871

35 FLOW_OUT_11_1993 1.1222971

36 FLOW_OUT_12_1993 1.620463161

37 FLOW_OUT_1_1994 3.113043097

38 FLOW_OUT_2_1994 3.837964821

39 FLOW_OUT_3_1994 6.144789

40 FLOW_OUT_4_1994 1.6763664

41 FLOW_OUT_5_1994 1.001142968

42 FLOW_OUT_6_1994 8.032589

43 FLOW_OUT_7_1994 1.667049194

44 FLOW_OUT_8_1994 5.379316548

45 FLOW_OUT_9_1994 1.9095097

46 FLOW_OUT_10_1994 1.837864645

47 FLOW_OUT_11_1994 2.2134455

48 FLOW_OUT_12_1994 8.481398226

49 FLOW_OUT_1_1995 11.51679794

50 FLOW_OUT_2_1995 10.38930504

51 FLOW_OUT_3_1995 4.359904548

52 FLOW_OUT_4_1995 1.595191

53 FLOW_OUT_5_1995 1.161910452

54 FLOW_OUT_6_1995 3.8010853

55 FLOW_OUT_7_1995 1.060517323

56 FLOW_OUT_8_1995 1.841518452

57 FLOW_OUT_9_1995 0.9844877

58 FLOW_OUT_10_1995 2.224254677

59 FLOW_OUT_11_1995 3.9568288

60 FLOW_OUT_12_1995 2.526607161

61 FLOW_OUT_1_1996 5.736476129

62 FLOW_OUT_2_1996 7.553803862

63 FLOW_OUT_3_1996 7.342324065

64 FLOW_OUT_4_1996 4.0748163

65 FLOW_OUT_5_1996 2.679153581

66 FLOW_OUT_6_1996 1.5697057

67 FLOW_OUT_7_1996 0.763645548

68 FLOW_OUT_8_1996 1.038594484

69 FLOW_OUT_9_1996 2.5853421

70 FLOW_OUT_10_1996 4.596488516

71 FLOW_OUT_11_1996 1.9604803

72 FLOW_OUT_12_1996 2.976025355

73 FLOW_OUT_1_1997 5.445085065

74 FLOW_OUT_2_1997 8.882436107

75 FLOW_OUT_3_1997 6.311037194

76 FLOW_OUT_4_1997 3.6283516

77 FLOW_OUT_5_1997 1.949305742

78 FLOW_OUT_6_1997 2.0473191

79 FLOW_OUT_7_1997 2.167620677

80 FLOW_OUT_8_1997 0.904317097

81 FLOW_OUT_9_1997 0.8136418

82 FLOW_OUT_10_1997 1.657001226

83 FLOW_OUT_11_1997 2.7807294

84 FLOW_OUT_12_1997 4.784659548

85 FLOW_OUT_1_1998 8.162603613

86 FLOW_OUT_2_1998 11.48153218

87 FLOW_OUT_3_1998 8.061210484

88 FLOW_OUT_4_1998 8.0335329

89 FLOW_OUT_5_1998 3.687604161

90 FLOW_OUT_6_1998 1.4337841

91 FLOW_OUT_7_1998 0.948162774

92 FLOW_OUT_8_1998 1.002969871

93 FLOW_OUT_9_1998 3.2404087

94 FLOW_OUT_10_1998 1.141814516

95 FLOW_OUT_11_1998 1.330899

96 FLOW_OUT_12_1998 1.333639355

97 FLOW_OUT_1_1999 3.747891968

98 FLOW_OUT_2_1999 4.182825429

99 FLOW_OUT_3_1999 2.140217129

100 FLOW_OUT_4_1999 1.7490467

101 FLOW_OUT_5_1999 1.851566419

102 FLOW_OUT_6_1999 0.9391805

103 FLOW_OUT_7_1999 0.915278516

104 FLOW_OUT_8_1999 0.647089123

105 FLOW_OUT_9_1999 0.62335156

106 FLOW_OUT_10_1999 0.591003194

107 FLOW_OUT_11_1999 0.66073

108 FLOW_OUT_12_1999 0.756337935

109 FLOW_OUT_1_2000 4.439374839

110 FLOW_OUT_2_2000 3.442956621

111 FLOW_OUT_3_2000 2.386849065

112 FLOW_OUT_4_2000 1.3733745

113 FLOW_OUT_5_2000 0.553551677

114 FLOW_OUT_6_2000 0.46449319

115 FLOW_OUT_7_2000 0.441653855

116 FLOW_OUT_8_2000 0.442475961

117 FLOW_OUT_9_2000 3.06229477

118 FLOW_OUT_10_2000 0.437543323

119 FLOW_OUT_11_2000 0.9882633

120 FLOW_OUT_12_2000 0.794702903

121 FLOW_OUT_1_2001 1.034940677

122 FLOW_OUT_2_2001 1.245948

123 FLOW_OUT_3_2001 6.388680581

124 FLOW_OUT_4_2001 1.5933032

125 FLOW_OUT_5_2001 0.561772742

126 FLOW_OUT_6_2001 1.0883167

127 FLOW_OUT_7_2001 0.708381726

128 FLOW_OUT_8_2001 0.2208726

129 FLOW_OUT_9_2001 0.31375236

130 FLOW_OUT_10_2001 0.237406074

131 FLOW_OUT_11_2001 0.40616017

132 FLOW_OUT_12_2001 0.525234677

Tadesse Alemayehu

unread,

Jan 21, 2015, 10:04:32 AM1/21/15

to swat...@googlegroups.com

Dear Leslie,

Just to give you a quick note:

You're calibrating for a relatively shorter period (1992-2001) so there is no point running your model from the very beginning...it rather take longer time to finish the simulation. Therefore, I suggest you modify the file cio as follow (red color test):

13 | NBYR : Number of years simulated

1989 | IYR : Beginning year of simulation

1 | IDAF : Beginning julian day of simulation

365 | IDAL : Ending julian day of simulation

Output Information:

0 | IPRINT: print code (month, day, year)

3 | NYSKIP: number of years to skip output printing/summarization

0 | ILOG: streamflow print code: 1=print log of streamflow

0 | IPRP: print code for output.pst file: 1= print pesticide output

For the warm up 3-5 is mostly recommended.....so I set it with 3

SUFI2_extract_rch.def file:

output.rch : swat output file name

1 : number of variables to get

7 : variable column number(s) in the swat output file (as many as the above number)

11 : total number of reaches (subbasins) in the project

1 : number of reaches (subbasins) to get for the first variable

11 : reach (subbasin) numbers for the first variable (ordered)

1992 : beginning year of simulation not including the warm up period

2001 : end year of simulation

2 : time step (1=daily, 2=monthly, 3=yearly)

Observed_rch.txt file:

this file should start from 1992 January and end December 2001.

Hope it helps!

Tade

--
You received this message because you are subscribed to the Google Groups "SWAT-CUP" group.
To unsubscribe from this group and stop receiving emails from it, send an email to swat-cup+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

--------------------------------------------------------------------------------------------------------------------------------------

"Life is 10% what happens to me and 90% of how I react to it" ―Charles R.Swindoll

P.D. Leslie

unread,

Jan 21, 2015, 4:42:19 PM1/21/15

to swat...@googlegroups.com

To Tade or whoever else can contribute,

Thank you for the advise on the correct simulation years. However I have another hang-up now. I ran 500 simulations after the email to get an alert (at the bottom). Was I supposed to change the variable column numbers in the original from 6 to 7. I thought this went into SWAT 2012 output and extracted the simulated streamflow. If thats the case then it should have been 6. I'm going to fix it and run a quick simulation just to keep anyone interested informed and will reply after supper with results. Also, should I re-run Arc SWAT to my specific dates instead of my entire weather record.I eventually want to simulate water yields from past extreme weather periods on record. If I just need to get it calibrated and validated I can re-run the model and re-do SWAT-CUP.

Thanks for reading and any potential help,

P.D. Leslie

SUFI2_extract_rch.def file:

output.rch : swat output file name
1 : number of variables to get

7 : variable column number(s) in the swat output file (as many as the above number) I'm changing this from 7 back to 6 and will respond

SWAT-CUP error.png

Tadesse Alemayehu

unread,

Jan 21, 2015, 6:26:14 PM1/21/15

to swat...@googlegroups.com

hello,

it shouldn't be 6 ..check in swat output documentation and output.rch file and count the number of columns up to FLOW_OUT, which is 7 in fact and that is SWAT simulated streamflow leaving your watershed.

Besides recheck your observed data format.

Good luck.

--
You received this message because you are subscribed to the Google Groups "SWAT-CUP" group.
To unsubscribe from this group and stop receiving emails from it, send an email to swat-cup+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

P.D. Leslie

unread,

Jan 21, 2015, 8:48:14 PM1/21/15

to swat...@googlegroups.com

Tade,

I went to the SWATOutput.mdb and went to the rch section. Would the 'cms' at the end of it be affecting it? I've been typing FLOW_OUT_11 when I need to give information to define the variable I'm trying to calibrate and the sub-basin it is located in. I'm including the reach output .png to justify why I use 6 instead of 7.

I feel that I formatted the observed data right. There were no missing dates (months in my case), so I know the record should be continuous. I know this is probably getting old but thank you for this much help already. I really am trying to nail this down soon.

Regards,

P.D. Leslie

output.rch.png

Tadesse Alemayehu

unread,

Jan 22, 2015, 4:05:16 AM1/22/15

to swat...@googlegroups.com

Leslie,

.From the screen shot you sent that is right we are referring to that column. However, SUFI2 is extracting simulated flow from output.rch not from output.mdb and hence the output.rch format is a bit different. To be specific output.rch is located in your SUFI2 project files that you created using SWAT TxtInOut, I suggest you go there see the column number, which is 7...no need to worry on this at all. Rather look for other problems if your simulation is not going well.

Success!

Tade

--

You received this message because you are subscribed to the Google Groups "SWAT-CUP" group.
To unsubscribe from this group and stop receiving emails from it, send an email to swat-cup+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Abbaspour, Karim

unread,

Jan 22, 2015, 4:57:45 AM1/22/15

to swat...@googlegroups.com

I may be missing something here, but this is not a standard swat output file and swat-cup will not read it properly.

Best, Karim

--

Abbaspour, Karim

unread,

Jan 22, 2015, 4:59:28 AM1/22/15

to swat...@googlegroups.com

Yes! Thank you Tade.

From: swat...@googlegroups.com [mailto:swat...@googlegroups.com] On Behalf Of Tadesse Alemayehu
Sent: Thursday, January 22, 2015 10:05 AM
To: swat...@googlegroups.com
Subject: Re: parameter qualifiers (r, v, and a) and editing the file.cio

Leslie,

P.D. Leslie

unread,

Jan 22, 2015, 8:31:08 AM1/22/15

to swat...@googlegroups.com

Tade and Dr. Abbaspour,

Understood and thanks for the clarification. Running the model using the recommended values and I have ran into the issue of the SUFI2_run.bat stalling out after the first simulation (only does the first year). I went searching through the groups recently posted questions similar to this and decided to check the the echo files (within my SWAT-CUP project folder). I only had three files which were echo_extract_rch, echo_LH_sample, and Echo_make_par. I compared my echo_LH_sample to the example echo files and the format is correct. My issue is with the echo_extract_rch file:

----- Echo of extract_rch_SUFI2.cpp

----------------------------

---- Reading SUFI2_extract_rch.def --------------

swat file name= output.rch

number of variables= 1

column number of variables= 7

total reaches in the project= 11

number of reaches for variable 1= 1

reach numbers for variable 1 = 11

total number of rchs to get= 1

beg_sim_year= 1992

end_sim_year= 2001

time_step= 2

--------------------------------------

---- Names of files of simulated variables:

file name 1= SUFI2.OUT/FLOW_OUT_11.txt

------- Reading observation file observed_rch.txt -----

---- total number of variables= 1

**** Time_Array ***********

variable no. = 1

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21

22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42

43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63

64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84

85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105

106 107 108 109 110 111 112 113 114 115 116 117 118 119 120

-------------------------------------

variable no: 1 ----------------------

variable= 1 pfile_no=0

time_step= 2 year= 1992 end= 12

---------------------------------------------------------

variable= 1 year= 1992 d= 1 file_no=1

variable= 1 year= 1992 d= 2 file_no=1

variable= 1 year= 1992 d= 3 file_no=1

variable= 1 year= 1992 d= 4 file_no=1

variable= 1 year= 1992 d= 5 file_no=1

variable= 1 year= 1992 d= 6 file_no=1

variable= 1 year= 1992 d= 7 file_no=1

variable= 1 year= 1992 d= 8 file_no=1

variable= 1 year= 1992 d= 9 file_no=1

variable= 1 year= 1992 d= 10 file_no=1

variable= 1 year= 1992 d= 11 file_no=1

variable= 1 year= 1992 d= 12 file_no=1

time_step= 2 year= 1993 end= 12

---------------------------------------------------------

variable= 1 year= 1993 d= 1 file_no=1

variable= 1 year= 1993 d= 2 file_no=1

variable= 1 year= 1993 d= 3 file_no=1

variable= 1 year= 1993 d= 4 file_no=1

variable= 1 year= 1993 d= 5 file_no=1

variable= 1 year= 1993 d= 6 file_no=1

variable= 1 year= 1993 d= 7 file_no=1

variable= 1 year= 1993 d= 8 file_no=1

variable= 1 year= 1993 d= 9 file_no=1

variable= 1 year= 1993 d= 10 file_no=1

variable= 1 year= 1993 d= 11 file_no=1

variable= 1 year= 1993 d= 12 file_no=1

time_step= 2 year= 1994 end= 12

---------------------------------------------------------

variable= 1 year= 1994 d= 1 file_no=1

variable= 1 year= 1994 d= 2 file_no=1

variable= 1 year= 1994 d= 3 file_no=1

variable= 1 year= 1994 d= 4 file_no=1

variable= 1 year= 1994 d= 5 file_no=1

variable= 1 year= 1994 d= 6 file_no=1

variable= 1 year= 1994 d= 7 file_no=1

variable= 1 year= 1994 d= 8 file_no=1

variable= 1 year= 1994 d= 9 file_no=1

variable= 1 year= 1994 d= 10 file_no=1

variable= 1 year= 1994 d= 11 file_no=1

variable= 1 year= 1994 d= 12 file_no=1

time_step= 2 year= 1995 end= 12

---------------------------------------------------------

variable= 1 year= 1995 d= 1 file_no=1

variable= 1 year= 1995 d= 2 file_no=1

variable= 1 year= 1995 d= 3 file_no=1

variable= 1 year= 1995 d= 4 file_no=1

variable= 1 year= 1995 d= 5 file_no=1

variable= 1 year= 1995 d= 6 file_no=1

variable= 1 year= 1995 d= 7 file_no=1

variable= 1 year= 1995 d= 8 file_no=1

variable= 1 year= 1995 d= 9 file_no=1

variable= 1 year= 1995 d= 10 file_no=1

variable= 1 year= 1995 d= 11 file_no=1

variable= 1 year= 1995 d= 12 file_no=1

time_step= 2 year= 1996 end= 12

---------------------------------------------------------

variable= 1 year= 1996 d= 1 file_no=1

variable= 1 year= 1996 d= 2 file_no=1

variable= 1 year= 1996 d= 3 file_no=1

variable= 1 year= 1996 d=

Why did it just end in April of 1996? I looked back at my observed record for this month and there wasn't a formatting issue. Any guidance is appreciated. If there is anybody willing I can send some files in a zipped folder to them to look at the issue first-hand.

Regards,

P.D. Leslie

Abbaspour, Karim

unread,

Jan 22, 2015, 9:38:18 AM1/22/15

to swat...@googlegroups.com

Probably the timing is not correct between swat-cup and file.cio. Please send me observed_rch.txt, file.cio, and SUFI2_extract_rch.def files to see.

Best, Karim

From: swat...@googlegroups.com [mailto:swat...@googlegroups.com] On Behalf Of P.D. Leslie
Sent: Thursday, January 22, 2015 2:31 PM
To: swat...@googlegroups.com
Subject: Re: parameter qualifiers (r, v, and a) and editing the file.cio