2.6.0 Habitat quality error

brendanhbrendanh Member
edited February 2014 in Terrestrial Models

Issue. Is there really not enough space (126GB)? Or is this another issue "Execption not disk-space related". Only a 25MB landcover raster.


Initializing...
02/06/2014 16:40:27 root DEBUG PATH: ['C:\\InVEST_2_6_0_x86\\invest-3-x86\\.']
02/06/2014 16:40:27 root DEBUG Loading habitat_quality from PATH
Arguments:
half_saturation_constant 0.5
landuse_cur_uri D:/13614991 Mayoko/lc_final/w001001.adf
sensitivity_uri G:/GISS/Gis Projects/13614916_MayokoIronOre/Data/Invest/Biodiversity inputs/Inputs/Sensitivity_rd_b.csv
threats_uri G:/GISS/Gis Projects/13614916_MayokoIronOre/Data/Invest/Biodiversity inputs/Inputs/Threats_Baseline_rd.csv
workspace_dir D:\13614991 Mayoko\InVEST


02/06/2014 16:40:27 root INFO Logging will be saved to habitat_quality-log-2014-02-06--16_40_27.txt
02/06/2014 16:40:27 root DEBUG Loaded the model from invest_natcap.habitat_quality.habitat_quality
02/06/2014 16:40:27 root INFO Executing the loaded model
02/06/2014 16:40:27 root INFO Running InVEST version "2.6.0"
02/06/2014 16:40:27 root INFO Python architecture: ('32bit', 'WindowsPE')
02/06/2014 16:40:27 root INFO Disk space remaining for workspace: 126.87 GB
02/06/2014 16:40:30 root INFO Pointing temporary directory at the workspace at D:\13614991 Mayoko\InVEST
02/06/2014 16:40:30 root INFO Upddating os.environ["TMP"]=C:\Users\BHart\AppData\Local\Temp to D:\13614991 Mayoko\InVEST
02/06/2014 16:40:30 root INFO Upddating os.environ["TEMP"]=C:\Users\BHart\AppData\Local\Temp to D:\13614991 Mayoko\InVEST
02/06/2014 16:40:30 root INFO Setting os.environ["TMPDIR"]=D:\13614991 Mayoko\InVEST
02/06/2014 16:40:30 root INFO Starting habitat_quality
02/06/2014 16:40:30 habitat_quality DEBUG Starting habitat_quality biophysical calculations
02/06/2014 16:40:30 habitat_quality DEBUG Starting map_raster_to_dict_values
02/06/2014 16:40:30 raster_utils INFO Reclassifying
02/06/2014 16:40:32 raster_utils INFO Creating lookup numpy array
02/06/2014 16:40:32 raster_utils INFO Looping through rows in the input data
02/06/2014 16:40:39 raster_utils INFO Flushing the cache and exiting reclassification
02/06/2014 16:40:39 habitat_quality DEBUG Handling Access Shape
02/06/2014 16:40:39 habitat_quality DEBUG No Access Shape Provided, access raster filled with 1s.
02/06/2014 16:40:39 habitat_quality DEBUG landuse_uri_dict : {'_c': u'D:/13614991 Mayoko/lc_final/w001001.adf'}
02/06/2014 16:40:39 habitat_quality DEBUG Calculating results for landuse : _c
02/06/2014 16:40:39 habitat_quality DEBUG Calculating threat : Settled
02/06/2014 16:40:39 habitat_quality DEBUG Threat Data : {'MAX_DIST': '15', 'WEIGHT': '1', 'THREAT': 'Settled', 'DECAY': ''}
02/06/2014 16:40:39 habitat_quality DEBUG threat_dataset_uri D:\13614991 Mayoko\InVEST\input\Settled_c
02/06/2014 16:40:39 habitat_quality DEBUG Sigma for gaussian : 22.3766101331
02/06/2014 16:40:39 raster_utils INFO setting up files in gaussian_filter_dataset
02/06/2014 16:40:40 raster_utils INFO shape (11199, 8446)
02/06/2014 16:40:40 raster_utils INFO make the source memmap at d:\13614991 mayoko\invest\tmp\tmp6dbcq6\source.dat
02/06/2014 16:40:40 root ERROR ---------------------------------------------------
02/06/2014 16:40:40 root ERROR ---------------------- ERROR ----------------------
02/06/2014 16:40:40 root ERROR ---------------------------------------------------
02/06/2014 16:40:40 root ERROR Error: exception found while running habitat_quality
02/06/2014 16:40:40 root DEBUG
02/06/2014 16:40:40 root DEBUG Build details
02/06/2014 16:40:40 root DEBUG System
02/06/2014 16:40:40 root DEBUG OS : Windows-7-6.1.7601-SP1
02/06/2014 16:40:40 root DEBUG Processor architecture: AMD64
02/06/2014 16:40:40 root DEBUG FS encoding : mbcs
02/06/2014 16:40:40 root DEBUG
02/06/2014 16:40:40 root DEBUG Python
02/06/2014 16:40:40 root DEBUG Version : 2.7.3
02/06/2014 16:40:40 root DEBUG Build : ('default', 'Apr 10 2012 23:31:26')
02/06/2014 16:40:40 root DEBUG Compiler : MSC v.1500 32 bit (Intel)
02/06/2014 16:40:40 root DEBUG Implementation : CPython
02/06/2014 16:40:40 root DEBUG Architecture : 32bit
02/06/2014 16:40:40 root DEBUG Linkage format : WindowsPE
02/06/2014 16:40:40 root DEBUG
02/06/2014 16:40:40 root DEBUG Packages
02/06/2014 16:40:40 root DEBUG Cython : ?
02/06/2014 16:40:40 root DEBUG Numpy : 1.7.0
02/06/2014 16:40:40 root DEBUG Scipy : 0.11.0
02/06/2014 16:40:40 root DEBUG OSGEO : 1.10.1
02/06/2014 16:40:40 root DEBUG Shapely : 1.2.18
02/06/2014 16:40:40 root DEBUG InVEST : 2.6.0
02/06/2014 16:40:40 root DEBUG
02/06/2014 16:40:40 root DEBUG
02/06/2014 16:40:40 root DEBUG error number 12
02/06/2014 16:40:40 root DEBUG Error message: [Error 8] Not enough storage is available to process this command
02/06/2014 16:40:40 root DEBUG Exception not disk-space related
02/06/2014 16:40:40 root DEBUG Printing traceback
Traceback (most recent call last):
File "invest_natcap\iui\executor.pyc", line 523, in runModel
File "invest_natcap\habitat_quality\habitat_quality.pyc", line 263, in execute
File "invest_natcap\raster_utils.pyc", line 1497, in gaussian_filter_dataset_uri
File "invest_natcap\raster_utils.pyc", line 1541, in gaussian_filter_dataset
File "numpy\core\memmap.pyc", line 253, in __new__
WindowsError: [Error 8] Not enough storage is available to process this command
None

02/06/2014 16:40:40 root ERROR Exiting due to failures

Comments

  • jdouglassjdouglass Administrator, NatCap Staff
    This error is happening because your raster, though it may be only 25MB, has such large dimensions (11199 x 8446) and you're running the 32-bit build of InVEST. This means that your raster, when converted to a matrix for the gaussian filter operation, will not fit into the 32-bit memory space.

    The best solution for you at the moment would be to run the 64-bit version of InVEST, available on our download page (or you can click this link). The 64-bit version should allow you to run InVEST on your data.

    Fixing this and other memory issues is a very high priority for us and will be fixed in a future version of InVEST.

    Let me know how the 64-bit version works for you!
Sign In or Register to comment.