difficulties on the RIOS Pre-processing toolbox for ArcGIS

adrianvogladrianvogl Member, NatCap Staff
edited November 2013 in RIOS
I'm Gabriel, the student working with RIOS alongside prof. Wilson.
I've encountered some difficulties on the RIOS Pre-processing toolbox for ArcGIS.

When it asks you to enter the "Land use general class/activities table", it returns an error saying that the table does not exist or is not supported.
I've tried changing the path of the file, tried remaking the table using one of the tables included on some of the sample data, and I even tried running this toolbox exclusively with the sample data we got (the Blancos and the Chiapas case study), but with no success.

If it's no trouble for you, I'd like for you to see if, maybe, we're missing something or we're entering the wrong data.

I thank you in advance for your time and disposition on the matter.

Best regards,

Gabriel.

Comments

  • adrianvogladrianvogl Member, NatCap Staff
    Hello Gabriel, Wilson,
    I believe I had a similar problem with the pre-processing toolbox, and it may be related to the field names in the file. Can you try loading the table directly into ArcGIS? If you do, you may get an error saying that one or more of the field names is invalid. What I did was to create a copy of the Land use classification table, and change the names so that there are no capital letters and that all the field names follow the ArcGIS naming conventions. If you can load the table into ArcMap, then it should work in the pre-processing tool.

    Let me know if that helps.

    Cheers,
    Adrian
  • swolnyswolny Member, NatCap Staff
    Hi Gabriel -

    As Adrian said, the field names are important, and I have also seen Arc complain if there are characters in any of the fields that it does not support, which are usually in the LULC_desc field (control characters, for example, that are often invisible, sometimes symbols from non-English languages.) It also tends to complain if the table is open in another program (like Excel.) More often though, I have seen Arc give this error message for no obvious reason, but if I simply copy and paste the table to a new file with a new name, it works.

    If none of these things help, please post your table and I'll take a look at it.

    ~ Stacie
  • Hi 

    My I am running pre-procesing toolbox in arcgis and just obtain the following outputs:
    intermediate: lucl coef
    lucl copy
    output:  Hydrolayer
    flow accumulation
    flow direction
    slope
    but it do not creates erosion_downslope_retention_index and erosion_upslope_source; erosion_riparian_index

    I am very gratefull if somebody can suggest me how resolve it

    Annie Escobedo
  • swolnyswolny Member, NatCap Staff
    Hi Annie -

    It looks like something went wrong, so it should have given you some sort of error message. Would you please post any messages that came up while the tool was running? Also, which version of ArcGIS are you using? Thanks...

    ~ Stacie


  • Executing: RIOS-Pre-Processing true # # # # C:\2CSF-RARE\0IRIOSmodelos\ErosionUTM\1 C:\2CSF-RARE\0IRIOSmodelos\ErosionUTM\lulc_cu C:\2CSF-RARE\0IRIOSmodelos\ErosionUTM\rios_default_lulc_coefficients.csv C:\2CSF-RARE\0IRIOSmodelos\ErosionUTM\dem_cu C:\2CSF-RARE\0IRIOSmodelos\ErosionUTM\eros_cu C:\2CSF-RARE\0IRIOSmodelos\ErosionUTM\erod_cu C:\2CSF-RARE\0IRIOSmodelos\ErosionUTM\depth_cu # # # # 80 30 # #
    Start Time: Mon Jan 18 18:28:08 2016
    Running script RIOS-Pre-Processing...

    Validating arguments...

    Erosion Control selected, checking required inputs:
    DEM
    Erosivity
    Erodibility
    Soil depth
    Land use/land cover
    RIOS general coefficient table
    Threshold flow accumulation
    Riparian buffer distance

    Checking input raster projections...


    Processing Erosion Control objective...

    Mapping coefficients to landcover...

    Error processing Erosion Control objective:  Failed to execute. Parameters are not valid.
    ERROR 001000: Lookup field: Field Sed_Exp does not exist
    Failed to execute (Lookup).


    Error running script
    Failed script RIOS-Pre-Processing...

    Traceback (most recent call last):
      File "C:\Rios\RIOS_Pre_Processing.py", line 1276, in <module>
        raise Exception
    Exception

    Failed to execute (RIOS-Pre-Processing).
    Failed at Mon Jan 18 18:28:12 2016 (Elapsed Time: 3.66 seconds)

    ................................
    when I open the csv table in arcgis de Sed_Exp column appear as <<null>>, but in excel the data is there. Please help me, because I have to run Rios for ARA project in Colombia.

    Thank you

    Stacie

  • I forgot, I am running in Arcgis 10.3; but I tried in the v.10; and the error is the same.
  • I share you the image of the error message. Thanks!!
  • swolnyswolny Member, NatCap Staff
    Hi Annie -

    I've seen this error with ArcGIS 10.3, but am surprised that it's happening in 10.0 as well. Is it possible for you to send me your input data so I can take a look at it?

    ~ Stacie

  • Thank you Stacie

    I am sending you my data. 
    I am appreciating your help

    Anita
  • swolnyswolny Member, NatCap Staff
    Hi Anita -

    I don't get an error running your data on my machine with ArcGIS 10.2, so it's hard to figure out what's happening. It must be time for me to update and test this on Arc 10.3. In the meantime, here are the results of running the pre-processor with your inputs, including a threshold flow accumulation of 80 and riparian buffer of 30, which I got from looking at the tool output text above.

    ~ Stacie

  • Dear Stacie

    Thank you for the data!, I prepared these data use the step by step manual, and I got flow accumulation = 80, and for riparian index I did for 30 and 60 meters. So I have two question:

    1. The outputs that you send me, is ready to use for Rios, because I saw that erosion upslope source is not normalized (0-1).

    2. When I run Rios portfolio traslator, after to run the investment portfolio, I saw that Restoration item is empty, and agriculture not, there are some errors?, because I mark for restoration too?

    I will happy to eard your thoughts

    Anita
  • swolnyswolny Member, NatCap Staff
    Yes, the outputs are ready for RIOS - the upslope source does not get normalized in the pre-processor, it's a little different than the others.

    There are a few reasons why Restoration may be empty. First, how are you assigning budgets? If you are only using a "floating" budget, without assigning any budget to the individual activities, then RIOS is likely to choose a lot of the cheapest activity, which in your case may be Agriculture. If it does not run out of space to choose Agriculture before it spends all of the budget, then no Restoration may be selected at all. To force RIOS to select Restoration areas, make sure you set a budget specifically for Restoration in the Yearly Activity Allocation Table.

    If you are assigning an activity budget specifically to Restoration and RIOS is not selecting any pixels, then look at how you are defining both the LULC classes that Restoration is allowed on, and any prefer/prevent layers that you've defined for Restoration. It is possible that these are so restricted that there are actually not any pixels that can be chosen.

    Let me know if either of these help.

    ~ Stacie


  • Dear Stacie

    Thank you for your advices. Now I am sharing you my lulc classification, transsition and budget aloccation, and my first run with Rios, I will happy if you can explain me why I dont have the option of restoration or agriculture... as I told you before.

    Thank you for all,

    Anita
  • Hi,
    I have an error during the ArcGIS toolbox preprocessing......Thank any helps…

    Executing: RIOS-Pre-Processing true # #
    true true C:\GSI-LAC\Rios\POMCAS\Lebrija\Preprocessing_ARCGIS
    C:\GSI-LAC\Rios\POMCAS\Lebrija\input\LULC_2010_2012.TIF C:\GSI-LAC\Rios\POMCAS\Lebrija\input\2_Biophysical_table_Bu.csv
    C:\GSI-LAC\Rios\POMCAS\Lebrija\input\DEM_Lebrija.tif
    C:\GSI-LAC\Rios\POMCAS\Lebrija\input\Eros_R17_Bu.tif
    C:\GSI-LAC\Rios\POMCAS\Lebrija\input\K_Eroda_Bu.tif
    C:\GSI-LAC\Rios\POMCAS\Lebrija\input\01.RRLD_Bu.tif
    C:\GSI-LAC\Rios\POMCAS\Lebrija\input\Precipitacion\PP_Wettest_Month_MAGNA.tif
    C:\GSI-LAC\Rios\POMCAS\Lebrija\input\TExtura_Suelo_Bu_MAGNA.tif
    C:\GSI-LAC\Rios\POMCAS\Lebrija\input\Precipitacion\AnualPP_Bu.tif
    C:\GSI-LAC\Rios\POMCAS\Lebrija\input\ETO_Anual_MAGNA.tif 1500 30
    C:\GSI-LAC\Rios\POMCAS\Lebrija\input\SW_BU.shp Bu

    Start Time: Fri Oct 14 12:04:43 2016

    Running script RIOS-Pre-Processing...

     

    Validating arguments...

     

    Erosion Control selected, checking
    required inputs:

         DEM

         Erosivity

         Erodibility

         Soil
    depth

         Land
    use/land cover

         RIOS
    general coefficient table

         Threshold
    flow accumulation

         Riparian
    buffer distance

     

    Flood Mitigation selected, checking
    required inputs:

         DEM

         Precipitation
    depth for wettest month

         Soil
    texture

         Land
    use/land cover

         RIOS
    general coefficient table

         Threshold
    flow accumulation

         Riparian
    buffer distance

     

    Groundwater Recharge/Baseflow selected,
    checking required inputs:

         DEM

         Annual
    average precipitation

         Actual
    Evapotranspiration

         Land
    use/land cover

         RIOS
    general coefficient table

         Soil
    texture

         Soil
    depth

         Threshold
    flow accumulation

     

    Checking input raster projections...

     

     

    Processing Erosion Control objective...

     

         Mapping
    coefficients to landcover...

     

    Error processing Erosion Control
    objective:  Failed to execute. Parameters
    are not valid.

    ERROR 001000: Lookup field: Field
    Sed_Exp does not exist

    Failed to execute (Lookup).

     

     

    Error running script

    Failed script RIOS-Pre-Processing...

     

    Traceback (most recent call last):

     
    File "C:\GSI-LAC\Rios\Sample data
    RIOS\RIOS_Pre_Processing.py", line 1276, in <module>

       
    raise Exception

    Exception

     

    Failed to execute (RIOS-Pre-Processing).

    Failed at Fri Oct 14
    12:04:47 2016 (Elapsed Time: 3.39 seconds)


  • swolnyswolny Member, NatCap Staff
    Hi @EdgarEstrada -

    Which version of ArcGIS are you using?

    ~ Stacie
  • Hi- I am encountering essentially the same error as @EdgarEstrada above. I am running ArcGIS 10.4...perhaps that is the problem. I can negate the sedimentation objective and it will produce similar errors related to remaining objectives. 

    Thanks in advance!

    David

  • swolnyswolny Member, NatCap Staff
    Hi David -

    Apologies, I have not kept up with Arc updates, as we keep hoping to make this independent from Arc, as our other tools are, but that hasnt happened yet. I'm traveling for work now, but can look into this when I return (which will be beginning of May.)

    ~ Stacie
  • Hi Stacie,

    Thanks so much for the update. I'll stay tuned...safe travels!

    David
  • Hi--So I sent a colleague the input data and they were able to run the preprocessing model with ArcGIS 10.3.1 but it did not produce any visible output in the defined workspace. Strange. My colleague is not experienced with Rios so could have missed something but perhaps you have encountered this before? The preprocessing output suggested a full and successful run.

    Thank you.

    David.
  • swolnyswolny Member, NatCap Staff
    That is indeed strange, and no, I haven't encountered it before. So no error messages were generated along the way? Can you watch the folder while it's running and see if files are being written and deleted, vs not being written at all?

    ~ Stacie
  • Hi Stacie I am D Williams colleague and I have encountered the error message below after running the RIOS .tbx:

    Executing: RIOS-Pre-Processing true true true true true
    C:\Charlie_Storm C:\Charlie_Storm\pre_process_input_data\kid_lulc_res90.img
    C:\Charlie_Storm\pre_process_input_data\RIOS_kidepo_lulc_coefficients.csv
    C:\Charlie_Storm\pre_process_input_data\kid_alb_90m_ss.img
    C:\Charlie_Storm\pre_process_input_data\erosivity_ss.img
    C:\Charlie_Storm\pre_process_input_data\kidepo_soil_erodibility_ss.img
    C:\Charlie_Storm\pre_process_input_data\soil_depth_ss.img
    C:\Charlie_Storm\pre_process_input_data\bio13_ss2.img
    C:\Charlie_Storm\pre_process_input_data\kid_soil_texture_ranked_ss.img
    C:\Charlie_Storm\pre_process_input_data\bio12_ss.img
    C:\Charlie_Storm\pre_process_input_data\aet_yr_ss.img 200 150
    C:\Charlie_Storm\pre_process_input_data\kidepo_analysis_watersheds\kidepo_analysis_watersheds.shp
    #

    Start Time: Tue Apr 18 08:58:33 2017

    Running script RIOS-Pre-Processing...

     

    Validating arguments...

     

    Erosion Control selected, checking required inputs:

         DEM

         Erosivity

         Erodibility

         Soil depth

         Land use/land cover

         RIOS general coefficient
    table

         Threshold flow
    accumulation

         Riparian buffer distance

     

    Phosphorus Retention selected, checking required inputs:

         DEM

         Erosivity

         Erodibility

         Soil depth

         Land use/land cover

         RIOS general coefficient
    table

         Threshold flow
    accumulation

         Riparian buffer distance

     

    Nitrogen Retention selected, checking required inputs:

         DEM

         Soil depth

         Land use/land cover

         RIOS general coefficient
    table

         Threshold flow
    accumulation

         Riparian buffer distance

     

    Flood Mitigation selected, checking required inputs:

         DEM

         Precipitation depth for
    wettest month

         Soil texture

         Land use/land cover

         RIOS general coefficient
    table

         Threshold flow
    accumulation

         Riparian buffer distance

     

    Groundwater Recharge/Baseflow selected, checking required inputs:

         DEM

         Annual average
    precipitation

         Actual
    Evapotranspiration

         Land use/land cover

         RIOS general coefficient
    table

         Soil texture

         Soil depth

         Threshold flow
    accumulation

     

    Checking input raster projections...

     

    Creating hydrology layers...

     

     

    Processing Erosion Control objective...

     

         Mapping coefficients to
    landcover...

     

    Error mapping coefficients to landcover:  ERROR 000358: Invalid expression

    Failed to execute (MakeTableView).

     

     

    Error processing Erosion Control objective:  ERROR 000358: Invalid expression

    Failed to execute (MakeTableView).

     

     

    Error running script

    Failed script RIOS-Pre-Processing...

     

    Traceback (most recent call last):

      File
    "C:\Charlie_Storm\rios_1.1.16_arcgis_preprocessor\RIOS_Pre_Processing.py",
    line 1276, in <module>

        raise Exception

    Exception

     

    Failed to execute (RIOS-Pre-Processing).

    Failed at Tue Apr 18 08:58:38 2017 (Elapsed Time: 4.84 seconds)

     I am trying to understand what has gone on. Can you provide some direction?  There was no initial output but I was able to garner these details and there is an output folder but it is too large to include on this site.

    Thankyou most kindly


    ~Natasha


  • RichRich Administrator, NatCap Staff
    Hi All, I hope this is helfpul, but if you have some experience using Python, there was another RIOS user that implemented a python based preprocessor that's available: https://forums.naturalcapitalproject.org/index.php?p=/discussion/847/announce-an-alternative-rios-preprocessing-tool

    I haven't used it myself, but it's possible that user is willing to support it if you find it helpful.
  • Thanks Rich! We'll have a look at that.

    Cheers,
    David
Sign In or Register to comment.