Issues running SDR - stops after _build_flat_set

bsullenderbsullender Member
edited March 2015 in Terrestrial Models
I'm running into some difficulties with the SDR model. After about 30 minutes of processing, when everything seems to be going smoothly, the SDR model suddenly stops running and automatically closes itself. The last line in the log file is, "routing cython core / INFO / _build_flat_set 99.7% complete..." (Most recent log file attached).
I've tried running this multiple times, and it stalls out at the same point every time. I un-installed the version I was using and re-installed using the version Rich posted on March 4th (forums.naturalcapitalproject.org/index.php?p=/discussion/comment/1632/#Comment_1632), to no avail (that version of SDR doesn't even open on my machine).


Anybody else running into this issue? Any insights or ideas?


My only guess would be the size of my data - my input files total a little over 1.6 GB. Not sure if this is part of the problem.

(Since SDR didn't seem to be working, I then tried to use the RouteDEM to generate the d-infinity flow/accumulation data and take it from there. This crashes with a Windows-caused error, but also in the "_build_flat_set" portion of the run.)

Thank you!
-Ben
Post edited by bsullender on

Comments

  • RichRich Administrator, NatCap Staff
    There may be a few issues there that might have something to do with your DEM especially if it is a very large size, or some pits.  We have a development version that addresses many of these issues you can try right now:


    And in the meantime I'm working on a release that will address all of them.  (In fact a giant test case is running in another window right now).

    Could you try out the link I sent you and hopefully that solves your problem, and if not let us know?
  • Hi Rich,

    Sorry for the delay in getting back to you - still not working with the updated build you sent. Now, SDR is crashing at a different point. 
    The final line of the log and error message are copied and pasted here:

    03/19/2015 15:07:00  routing cython core INFO     calculate_flow_weights 96.9% complete
    03/19/2015 15:07:01  root               ERROR    ---------------------------------------------------
    03/19/2015 15:07:01  root               ERROR    ---------------------- ERROR ----------------------
    03/19/2015 15:07:01  root               ERROR    ---------------------------------------------------
    03/19/2015 15:07:01  root               ERROR    Error: exception found while running sdr
    03/19/2015 15:07:01  root               DEBUG    
    03/19/2015 15:07:01  root               DEBUG    Build details
    03/19/2015 15:07:01  root               DEBUG    Interpreter
    03/19/2015 15:07:01  root               DEBUG    Current temp dir: C:\Users\Sullender\Documents\Borneo\Output_3_19\tmp
    03/19/2015 15:07:01  root               DEBUG    tempfile.tempdir: C:\Users\Sullender\Documents\Borneo\Output_3_19\tmp
    03/19/2015 15:07:01  root               DEBUG    
    03/19/2015 15:07:01  root               DEBUG    System
    03/19/2015 15:07:01  root               DEBUG    OS              : Windows-7-6.1.7601-SP1
    03/19/2015 15:07:01  root               DEBUG    Processor architecture: AMD64
    03/19/2015 15:07:01  root               DEBUG    FS encoding     : mbcs
    03/19/2015 15:07:01  root               DEBUG    
    03/19/2015 15:07:01  root               DEBUG    Python
    03/19/2015 15:07:01  root               DEBUG    Version         : 2.7.9
    03/19/2015 15:07:01  root               DEBUG    Build           : ('default', 'Dec 10 2014 12:24:55')
    03/19/2015 15:07:01  root               DEBUG    Compiler        : MSC v.1500 32 bit (Intel)
    03/19/2015 15:07:01  root               DEBUG    Implementation  : CPython
    03/19/2015 15:07:01  root               DEBUG    Architecture    : 32bit
    03/19/2015 15:07:01  root               DEBUG    Linkage format  : WindowsPE
    03/19/2015 15:07:01  root               DEBUG    
    03/19/2015 15:07:01  root               DEBUG    Packages
    03/19/2015 15:07:01  root               DEBUG    Cython          : ?
    03/19/2015 15:07:01  root               DEBUG    Numpy           : 1.8.1
    03/19/2015 15:07:01  root               DEBUG    Scipy           : 0.15.1
    03/19/2015 15:07:01  root               DEBUG    OSGEO           : 1.11.1
    03/19/2015 15:07:01  root               DEBUG    Shapely         : 1.5.5
    03/19/2015 15:07:01  root               DEBUG    InVEST          : dev298:3.1.0b1 [cc86bb85076e]
    03/19/2015 15:07:01  root               DEBUG    
    03/19/2015 15:07:01  root               DEBUG    
    03/19/2015 15:07:01  root               DEBUG    Exception not environment-related
    03/19/2015 15:07:01  root               DEBUG    Printing traceback
    Traceback (most recent call last):
      File "invest_natcap\iui\executor.pyc", line 553, in runModel
      File "invest_natcap\sdr\sdr.pyc", line 102, in execute
      File "invest_natcap\sdr\sdr.pyc", line 766, in _prepare
      File "pygeoprocessing\routing\routing.pyc", line 139, in flow_accumulation
      File "pygeoprocessing\routing\routing.pyc", line 100, in route_flux
      File "pygeoprocessing\routing\routing_core.pyx", line 256, in pygeoprocessing.routing.routing_core.calculate_transport (pygeoprocessing/routing\routing_core.cpp:6283)
    MemoryError
    None

    03/19/2015 15:07:01  root               ERROR    Exiting due to failures
    03/19/2015 15:07:01  root               INFO     Elapsed time: 44m 17.1s
Sign In or Register to comment.